Local AI with Ollama & Open WebUI: Run Your Own Private AI

About this course

*This course contains the use of artificial intelligence.

Welcome to "Local AI with Ollama & Open WebUI: Run Your Own Private AI"!Are you a sysadmin, DevOps engineer, or IT professional who wants to use AI in your daily work without your logs, configs or customer data ending up in the cloud – with no subscription, no cost per request and full control over models and versions? Then this course is exactly right for you!

We don't stop at theory. You set up your own AI machine, as a VM on Proxmox VE or on your own computer, install Ollama on Linux and Windows and run an open language model entirely without a GPU. You measure its speed, find the right number of threads and build your own model variants with a Modelfile, such as a Linux admin assistant.

Then you talk to your model from the command line, through the REST API and the OpenAI-compatible API – existing ChatGPT code runs locally with one changed line. With Open WebUI, your team gets its own chat interface with users and roles, a knowledge base (RAG) from your own documents, web search with SearXNG, tools via MCP and HTTPS behind nginx.

In the main part, you put the local AI to work in everyday admin tasks: writing and checking Bash and PowerShell scripts, analyzing logs and the Windows event log, fixing systemd services and hardening SSH. On top of that come AI agents: Cline and Kilo Code in the editor, Claude Code and OpenCode in the terminal, a local agent that writes Terraform and Ansible – and an honest comparison of local versus cloud.

Read the full description on Udemy on Udemy (opens in a new tab)

Prices, discounts and availability are set by Udemy. We may earn a commission when you purchase through links on this site.