Most "Windows AI" rigs are running Linux in a trench coat. Anyone using ComfyUI, training a LoRA, or serving a local LLM on Windows is almost certainly going through WSL2, which is Linux with a Windows logo on the taskbar. So the real question isn't Windows vs Linux. It's whether the abstraction layer is costing you something.
For VRAM, it is. And for most other parts of an AI workflow, the gap is bigger than people realize.
The VRAM tax nobody talks about
Boot Windows. Open Task Manager. The Desktop Window Manager (dwm.exe) is sitting on somewhere between 500 MB and 1.2 GB of VRAM, even with nothing else running. That's the cost of having a desktop that composites windows on the GPU. Add Chrome, Discord, or anything with hardware acceleration, and you can lose another gig before you've opened a single notebook.
On Linux running headless (or with a lightweight tiling WM), you can get within ~150 MB of total VRAM used by the OS. That's the difference between fitting Flux dev at fp16 on a 12 GB card and dropping to a quantized build. It's the difference between SDXL running with the refiner loaded and having to swap. For people on 12 or 16 GB cards, it's the single biggest free upgrade available.
I've seen this play out in practice. Same 4070 Ti, same prompts, same model. Windows topped out at batch size 2. Linux ran comfortable at batch size 4. The hardware didn't change. The OS got out of the way.
The driver story is one-sided
NVIDIA ships new features on Linux first. CUDA toolkit releases, TensorRT updates, the new transformer optimizations all land on Linux as the reference platform. Windows drivers catch up, but they're always playing catch-up.
ROCm, AMD's CUDA alternative, is effectively Linux-only for serious workloads. If you're considering a 7900 XTX for AI on cost grounds, Linux isn't a preference. It's the entire reason that hardware works.
The ecosystem assumes Linux
Open the README for any open-source AI project. llama.cpp, vLLM, Axolotl, ComfyUI, Open WebUI: the install instructions start with apt install or curl ... | bash. Windows-native installs work, but you're always the second-class citizen. The Discord channels for these projects have a #windows tag, and it's usually the channel with the most "doesn't work" posts.
That's not a knock on Windows users. It's the predictable outcome of a community where 90% of contributors are running Linux on their dev boxes.
The stability part most people forget
A Windows machine can decide to reboot for updates while you're 14 hours into a fine-tune. Group Policy can mitigate this, and most enthusiasts know the workaround. But the default behavior of a Windows install is hostile to long-running compute.
Linux doesn't do this. A box you build for inference can sit at 99% uptime for months. For anyone running training jobs overnight, batch inference, or a home server that family members hit for chat, the OS choice quietly determines whether your work survives a Tuesday morning.
Where Windows still wins
I'm not telling anyone to nuke their Windows install. Three real cases keep it competitive.
If your workflow includes Topaz Photo AI, certain Adobe video tools, or any of the AI plugins for commercial creative suites, those are Windows or Mac only. Dual-boot or stay.
If you game on the same machine, Windows is still the better choice for that half of the system's life. Linux gaming has gotten dramatically better, but specific anti-cheat systems still block it.
If you're using Windows + WSL2 + an NVIDIA driver that supports CUDA passthrough, you've already gotten most of the Linux benefits for development. The VRAM tax still applies, because the host is Windows, but for code-writing and training a model, WSL2 is fine.
So what should you actually do
Building a dedicated AI box, especially one running headless or doing image work? Install Ubuntu Server, install the NVIDIA driver, install Docker, and never look back. The pain is one weekend of setup. The payoff is years of reclaimed VRAM, faster drivers, and not fighting your OS.
Using a single laptop for everything? WSL2 is the right answer. You give up the VRAM win but keep your tools.
The point isn't that Linux is better in some abstract way. It's that for the specific workload of running AI models, every decision the Linux ecosystem has made (driver priorities, ecosystem defaults, headless-first design) happens to be the right one. Windows can do AI. Linux was built for it.