- Published on
What breaks when you run local LLMs for coding agents
I moved my coding agents off hosted APIs and onto two machines I own, a MacBook Pro M5 Pro as the client and a gaming PC with an RX 7800 XT as the model server. Model capability was rarely the blocker. The blockers were unified memory limits, inference engines that mangle tool call formats, a model stuck in a loop, and a laptop that kept freezing for reasons I still have not pinned down.