G Talks Tech podcast

Local AI For Network Engineers - Stop Redacting Configs for ChatGPT

22/8/2026
0:00
21:08
Manda indietro di 15 secondi
Manda avanti di 15 secondi
This episode is the audio from a YouTube video. Some segments reference on-screen demos. Watch the full video at https://youtu.be/dDE8gajTKkQ Local AI for network engineers: your configs never leave your desk. This episode sets up Ollama properly on a MacBook, benchmarks 6 local models against real Cisco configs, generates handoff documentation from a full 14,000-token show run all capture, and finishes with a 9B model driving real network tools through LM Studio’s permission gate. Free, private, and measured on camera, including the parts where local AI needs a fix. What you’ll learn How to install Ollama and the 5 environment settings that make it config-ready instead of chat-ready Why a bigger mixture-of-experts model runs 4x faster than a smaller dense one, and the ollama show check that tells you before you download How to turn a real show run all capture into handoff documentation with a free local model Why the default 4,096-token context window silently breaks config work, and the one-line fix How to get valid JSON out of a thinking model for automation pipelines How to verify nothing leaves your machine with a live socket check, plus the cloud-tag exception to watch for How to wire a read-only MCP server into LM Studio and drive live network tools from a 9 billion parameter model Chapters 00:00 Local AI Can Do Real Work 01:03 Why Local AI for Network Engineers 01:44 Install Ollama and the 5 Settings 03:41 What This Mac Runs: MoE vs Dense 05:58 The Real Test: Docs From a Config 09:31 Four Edge Cases That Fail Silently 12:59 Local AI vs Claude 15:16 Is It Actually Private? Watch the Sockets 16:38 What It Costs 17:27 A 9B Model Driving Real Tools 18:55 Recap and Resources 20:12 A Prayer for Engineers Resources Everything from this episode (runbook, prompt pack, configs, topology, scripts): https://github.com/GTalksTech/netops-toolkit/tree/main/local-ai/local-ai-network-engineers Companion blog post: https://gtalkstech.com/blog/local-ai-network-engineers/ Ollama: https://ollama.com LM Studio: https://lmstudio.ai Heads up on this one: it’s a screen-share build, so there is real terminal work you can’t see here. The reasoning and the findings all stand on their own in audio. If you want to replicate the lab, the video version is worth the watch. Support the show: https://ko-fi.com/gtalkstech

Altri episodi di "G Talks Tech"