2026-11-03 17:19 UTC
More people using it, more training data fed into it
yes but that’s not actually the hard and costly part. the hard and costly part is the actual training action, which runs in the hundred of millions if not more
which, y’know, when lower prices……
Replies (1)
-
@scruiser@awful.systems 2026-11-05 01:42
Well, they’ve also reached model sizes where scrapes of the entire internet aren’t sufficiently large enough to train the model, so they also need more data. But yeah, they compute cost of actually training the models are prohibitively large.