Can a Local LLM REALLY be your daily coder? Framework Desktop with GLM 4.5 Air and Qwen 3 Coder
With the arrival of my new Framework Desktop I decided to move to coding just with Local LLM's without touching any Claude, GPT5, etc models. I learned a lot while running GLM 4.5 Air, Qwen 3 Coder, GPT OSS 120b, and ultimately I think I landed in a good spot. Links: 🧑💻My Recommended AI Engineer course is Scrimba: https://scrimba.com/the-ai-engineer-path-c02v?via=GosuCoder My Links 🔗 👉🏻 Subscribe: https://www.youtube.com/@GosuCoder 👉🏻 Twitter/X: https://x.com/GosuCoder 👉🏻 LinkedIn: https://www.linkedin.com/in/adamwilliamlarson/ 👉🏻 Discord: https://discord.gg/YGS4AJ2MxA My computer specs GPU: RTX 5090 (sometimes a AMD 7900xtx) CPU: 7800x3d RAM: DDR5 6000Mhz Media/Sponsorship Inquiries ✅ gosucoderyt@gmail.com
Video Chapters
- 0:00 Kickstarting the Local LLM Revolution: Say Goodbye to Cloud Costs!
- 0:30 Unveiling the Powerhouse: The Framework Desktop's AI Muscle
- 1:45 Putting Models to the Test: Real-World Benchmarks Revealed
- 3:20 Optimizing for Peak Performance: Essential Settings for Speed & Memory
- 6:30 The Early Struggles: Battling Repetitive Code Generation
- 7:55 Facing the Frustration: Long Prompts & Persistent Timeouts
- 9:45 A Game-Changer Arrives: Solving Timeouts with Crush
- 11:25 Exploring New Horizons: Jan AI's Creative UI Insights
- 15:15 The Ultimate Strategy: Smart Models & Swift Agents Working Together
- 16:00 Finding the Perfect Balance: Matching Model Speed to Task Size
Original Output
0:00 Kickstarting the Local LLM Revolution: Say Goodbye to Cloud Costs! 0:30 Unveiling the Powerhouse: The Framework Desktop's AI Muscle 1:45 Putting Models to the Test: Real-World Benchmarks Revealed 3:20 Optimizing for Peak Performance: Essential Settings for Speed & Memory 6:30 The Early Struggles: Battling Repetitive Code Generation 7:55 Facing the Frustration: Long Prompts & Persistent Timeouts 9:45 A Game-Changer Arrives: Solving Timeouts with Crush 11:25 Exploring New Horizons: Jan AI's Creative UI Insights 15:15 The Ultimate Strategy: Smart Models & Swift Agents Working Together 16:00 Finding the Perfect Balance: Matching Model Speed to Task Size Timestamps by StampBot 🤖