5 Filters

NVIDIA changes the game

Technology
#1

Seems Nvidia is releasing a data centre machine for home use. And it’s going to cost about £3k (which is cheap considering the power and comparing against the highest 40XX video card).

People are going to be left behind and I’m willingly one of them (I have to deal with about a dozen computers).

…A single Project DIGITS unit can reportedly run AI models with up to 200 billion parameters, while two linked units can handle models with 405 billion parameters. In AI models, parameter count roughly corresponds to an AI model’s neural network size and complexity, with more parameters requiring more memory and computational power to run. Also, parameter size approximates AI model capability, though different-sized AI models perform differently depending on how they were trained and architected…

The world is changing at a terrifying pace.

2 Likes
#2

Impressive, and researchers who don’t have access to AWS or similar compute server could certainly benefit. But most institutionally-based statisticians and the like will be logging on to a data farm controlled by the institution. Or rented as a service. Bumping elbows with the economists of a quantitative bent (most of them), psych quants, etc.

I don’t think the client end really matters all that much anymore.

But I would not say no to a MacBook Pro by any means.

1 Like