LLMs · via X
thdxr says a self-built DeepSeek inference rack beats every vendor on price/performance
Dax (@thdxr) says a first test run on a new GPU rack with their own DeepSeek inference setup gave better price/performance than any vendor they've tried, with more optimisation still to come. More teams are weighing self-hosting open models over paying API providers.