LLMs · via Hacker News
Llama.cpp runs local models on a jailbroken PS5
PS5LM runs llama.cpp on the PS5's GPU, starting with Qwen 3.8, and serves OpenAI- and Anthropic-compatible APIs so every device on your network can use it. It's a fun sign of how far local inference has spread.