2026-11-05 01:42 UTC
Well, they’ve also reached model sizes where scrapes of the entire internet aren’t sufficiently large enough to train the model, so they also need more data. But yeah, they compute cost of actually training the models are prohibitively large.
Replies (1)
-
@froztbyte@awful.systems 2026-11-05 11:14
yeah they’re far past public-only sources, there’s more than a few non-public sources going into this shit too. and still it’s not enough to work and sort out the issues! almost as tho the whole thing is a bit of a silly idea I’m glad there’s finally some financial reckoning coming, I just hope I’m wrong about how utterly fucking bad it will be