Ollama runs gpt-oss on the CPU (GPU idle) while other models use the GPU

发生场景

Source(s): https://github.com/ollama/ollama/issues/11676 Signal: 31 reactions, 91 comments. Status: reported working by source, not reproduced by us.

问题

gpt-oss:20b/120b load entirely or mostly on the CPU (ollama ps shows 100% CPU, or a split such as 12%/88% CPU/GPU after lowering OLLAMA_NUM_PARALLEL) and are slow.

报错原文（已脱敏/规范化）

(symptom, no error text) ollama ps shows gpt-oss on 100% CPU or a mostly-CPU split while other models use the GPU

不是这个问题时 / 边界

The model is simply bigger than your VRAM; then partial CPU offload is expected (maintainer).

根因

Raising OLLAMA_NUM_PARALLEL or the context length increases the memory needed, so the model no longer fits in VRAM and is offloaded to the CPU (maintainer).

修复步骤

1. Remove OLLAMA_NUM_PARALLEL or set it back to 1, and restart the server. Users confirmed this.
2. Lower the context length (num_ctx). The reporter's GPUs worked at 4k; one user on an RTX 5090 could use 32k but not 64k.
3. To force layers onto the GPU, make a Modelfile with PARAMETER num_gpu 256 and your num_ctx, then ollama create (a maintainer posted this; a user thanked them).

如何验证

ollama ps shows 100% GPU (or mostly GPU).