AAdIllustrious7246inc/localllm34d agoQwen 27B at ~20 tok/s on a jailbroken PS5's GPU. I forked PS5LM and turned it into a native appA few weeks ago I came across a post from u/metover about PS5LM, his llama.cpp port for the jailbroken PS5. The project looked really interesting, so I forked it and made a few changes. Well, more than a few. This is where it ended up. The original runs as…Show more10 comments