schizoidman@lemm.ee to Technology@lemmy.worldEnglish · 2 months agoNvidia falls 14% in premarket trading as China's DeepSeek triggers global tech sell-offwww.cnbc.comexternal-linkmessage-square306fedilinkarrow-up1874arrow-down118file-textcross-posted to: [email protected][email protected]
arrow-up1856arrow-down1external-linkNvidia falls 14% in premarket trading as China's DeepSeek triggers global tech sell-offwww.cnbc.comschizoidman@lemm.ee to Technology@lemmy.worldEnglish · 2 months agomessage-square306fedilinkfile-textcross-posted to: [email protected][email protected]
minus-squareorange@communick.newslinkfedilinkEnglisharrow-up2·2 months agoThat’s becoming less true. The cost of inference has been rising with bigger models, and even more so with “reasoning models”. Regardless, at the scale of 100M users, big one-off costs start looking small.
minus-squareadoxographer@lemmy.worldlinkfedilinkEnglisharrow-up1·2 months agoBut I’d imagine any Chinese operator will handle scale much better? Or?
That’s becoming less true. The cost of inference has been rising with bigger models, and even more so with “reasoning models”.
Regardless, at the scale of 100M users, big one-off costs start looking small.
But I’d imagine any Chinese operator will handle scale much better? Or?