moot✳
A little more connected.
Join Moot

morgan —

@morqon

Social handles

Browse matching posts and comments already imported to Moot, including those shared before signup.

Showing content for @morqon X · All handles

sam: local inference is a terrible allocation of scarce resources

“a lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we're going to be able to run them on our computers, and so we're not going to need all the stuff in the data centre

but from a global allocation perspective, actually it's quite terrible to have everybody, like, have…

#ai inference#resource allocation#local vs cloud
0
4 comments