Cookbook
Can I run this AI model?
A plain answer to a confusing question. Tell it the graphics card you own, or the model you want to run, and it shows what fits, how fast it will be, and what it costs. If your card is too small, it names the cheapest one to rent. 57 models, no account, no jargon you have to already know.
- 1
Pick your card, or a model
Choose the GPU in your machine, or the model you want to run. That is the only input.
- 2
See what fits, and how fast
The table shows what runs, the memory it needs, and roughly its speed. Green means it fits.
- 3
Run it, or rent a card
Runs on your card? Done. Too big? It names the cheapest card to rent that holds it, per hour.
Pick the graphics card in your machine. The table lists every model, the easiest to run at the top. A green Runs badge means it fits your card; anything too big shows the cheapest card to rent instead. Precision and context change how much memory a model needs.
| Fit | Score | Model | Size | Precision | Memory | Context | Speed | Do it |
|---|---|---|---|---|---|---|---|---|
| Runs | 77/100 | Qwen3 32BChat | 32B | int4 | 21 GB | 8k | ~44 t/s | on your card |
| Runs | 77/100 | QwQ 32BChat | 32B | int4 | 21 GB | 8k | ~44 t/s | on your card |
| Runs | 77/100 | Qwen2.5 Coder 32BCode | 32B | int4 | 21 GB | 8k | ~44 t/s | on your card |
| Runs | 77/100 | Qwen2.5 32BChat | 32B | int4 | 21 GB | 8k | ~44 t/s | on your card |
| Runs | 80/100 | Qwen3 30B-A3BChatMoE | 30.5B /3.3B | int4 | 20 GB | 8k | ~428 t/s | on your card |
| Runs | 85/100 | Gemma 3 27BChat | 27B | int4 | 18 GB | 8k | ~52 t/s | on your card |
| Runs | 85/100 | Gemma 2 27BChat | 27B | int4 | 18 GB | 8k | ~52 t/s | on your card |
| Runs | 90/100 | Mistral Small 3.1 24BChat | 24B | int4 | 16 GB | 8k | ~59 t/s | on your card |
| Runs | 94/100 | Codestral 22BCode | 22B | int4 | 15 GB | 8k | ~64 t/s | on your card |
| Runs | 100/100 | StarCoder2 15BCode | 15B | int4 | 10.0 GB | 8k | ~94 t/s | on your card |
| Runs | 100/100 | Phi-4 14BChat | 14B | int4 | 9.3 GB | 8k | ~101 t/s | on your card |
| Runs | 100/100 | Qwen2.5 14BChat | 14B | int4 | 9.3 GB | 8k | ~101 t/s | on your card |
57 models · 41 run on a GeForce RTX 4090 at int4, 8k context
estimates, err upward · not benchmarks
Already own a card? Check it in one line
A web page cannot look inside your machine, and this one does not pretend to. The command below is meant to run on the box you are asking about, print what it finds, and send nothing anywhere.
curl -fsSL https://kracht.ai/diagnose.sh | shIt reads the GPU model, its VRAM and the driver: the same three facts the node agent already reports on every heartbeat once a machine is registered. This is a one-off look for someone deciding whether to bother.
Nothing leaves the machine. There is no curl, wget or nc anywhere in it, no telemetry and no identifier, and the build refuses to publish it if that stops being true. Read it first if you would rather: kracht.ai/diagnose.sh is the same file the command fetches.
Everything here is arithmetic from a spec sheet, before a rental exists. When one does, Autopilot reads what it actually cost and how long it actually took, and says whether a different card would have been cheaper.