Quoting Georgi Gerganov

Simon Willison’s Weblog Subscribe Sponsored by: WorkOS — Ready to sell to Enterprise clients? Build and ship securely with WorkOS. Note that the main issues that people currently unknowingly face with local models mostly revolve around the harness and some intricacies around model chat templates and prompt construction. Sometimes there are even pure inference bugs. From typing the task in the client to the actual result, there is a long chain of components that atm are not only fragile - are also developed by different parties. So it's difficult to consolidate the entire stack and you have to keep in mind that what you are currently observing is with very high probability still broken in some subtle way along that chain. — Georgi Gerganov, explaining why it's hard to find local models that work well with coding agents Posted 30th March 2026 at 9:31 pm Recent articles Mr. Chatterbox is a (weak) Victorian-era ethically trained model you can run on your own computer - 30th March 2026 Vibe coding SwiftUI apps is a lot of fun - 27th March 2026 Experimenting with Starlette 1.0 with Claude skills - 22nd March 2026 This is a quotation collected by Simon Willison, posted on 30th March 2026. ai 1939 generative-ai 1720 local-llms 151 llms 1686 coding-agents 187 georgi-gerganov 8 Disclosures Colophon © 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026