Last Update 2026/01/30
低スペック寄りのPCでローカルLLMを動作させた際の記録です。
LLM以外の仮想マシンなどが起動され、多少負荷がかかった状態で実行しています。
ベンチマークなどでLLMの性能を評価する内容ではありません。
LLM以外の仮想マシンなどが起動され、多少負荷がかかった状態で実行しています。
ベンチマークなどでLLMの性能を評価する内容ではありません。
検証用PC
|
OS |
Debian GNU/Linux 12 (bookworm) |
|
CPU |
Intel(R) Core(TM) i5-14400F |
|
GPU |
GeForce RTX 3060 12GB |
|
メモリ |
DDR4 PC4-25600 32GB × 4 |
|
SSD |
crucial P310 CT1000P310SSD8-JP |
構築環境 : Docker + Ollama (特別な設定などは無い状態)
検証用プロンプト
おすすめの日本の絶景を教えてください。東西南北、10箇所程度。
Gemma 3
GPU無し 事前のモデルのロード無し GPU使用 事前のモデルのロード無し GPU使用 事前にモデルをロード済みTPS(tokens/s) は eval_count / eval_duration により算出
gemma3:270m(GPU無し 事前のモデルのロード無し)
2026-01-27
total_duration(合計時間) : 9695522447 (9.696s)
load_duration(モデルのロード時間) : 514601362 (0.515s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 21901508 (0.022s)
eval_count(生成トークン数) : 1017
eval_duration(生成時間) : 8697233344 (8.697s)
real 0m9.714s
user 0m0.047s
sys 0m0.005s
メモリ使用量(RSS) : 608356 KB
gemma3:1b(GPU無し 事前のモデルのロード無し)
2026-01-27
total_duration(合計時間) : 25437160737 (25.437s)
load_duration(モデルのロード時間) : 920508801 ( 0.921s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 133970519 ( 0.013s)
eval_count(生成トークン数) : 1035
eval_duration(生成時間) : 23670048422 (23.670s)
real 0m25.456s
user 0m0.044s
sys 0m0.010s
メモリ使用量(RSS) : 1301176 KB
gemma3:4b(GPU無し 事前のモデルのロード無し)
2026-01-27
total_duration(合計時間) : 61520936552 (61.521s)
load_duration(モデルのロード時間) : 1762188858 ( 1.761s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 438743018 ( 0.440s)
eval_count(生成トークン数) : 858
eval_duration(生成時間) : 58700082362 (58.700s)
real 1m1.533s
user 0m0.024s
sys 0m0.013s
メモリ使用量(RSS) : 4255008 KB
gemma3:12b(GPU無し 事前のモデルのロード無し)
2026-01-27
total_duration(合計時間) : 163055509701 (163.056s)
load_duration(モデルのロード時間) : 2817491251 ( 2.817s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 1374931489 ( 1.375s)
eval_count(生成トークン数) : 831
eval_duration(生成時間) : 158337913414 (158.338s)
real 2m43.067s
user 0m0.030s
sys 0m0.021s
メモリ使用量(RSS) : 9807936 KB
gemma3:27b(GPU無し 事前のモデルのロード無し)
2026-01-27
total_duration(合計時間) : 289249089327 (289.249s)
load_duration(モデルのロード時間) : 4565653640 ( 4.566s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 3212111298 ( 3.212s)
eval_count(生成トークン数) : 662
eval_duration(生成時間) : 281016373949 (281.016s)
real 4m49.261s
user 0m0.043s
sys 0m0.027s
メモリ使用量(RSS) : 23333504 KB
gemma3:270m(GPU使用 事前のモデルのロード無し)
2026-01-27
total_duration(合計時間) : 3049374553 (3.049s)
load_duration(モデルのロード時間) : 709243966 (0.709s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 6071112 (0.006s)
eval_count(生成トークン数) : 737
eval_duration(生成時間) : 1971427107 (1.971s)
real 0m3.067s
user 0m0.036s
sys 0m0.013s
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.261.03 Driver Version: 535.261.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 3060 On | 00000000:01:00.0 On | N/A |
| 0% 38C P2 105W / 170W | 761MiB / 12288MiB | 80% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 1226 G /usr/lib/xorg/Xorg 107MiB |
| 0 N/A N/A 1794 G xfwm4 2MiB |
| 0 N/A N/A 2322 G /usr/bin/x-www-browser 128MiB |
| 0 N/A N/A 39905 C /usr/bin/ollama 510MiB |
+---------------------------------------------------------------------------------------+
メモリ使用量(RSS) : 622492 KB
gemma3:1b(GPU使用 事前のモデルのロード無し)
2026-01-27
total_duration(合計時間) : 5753693341 (5.754s)
load_duration(モデルのロード時間) : 886173796 (0.886s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 11861262 (0.012s)
eval_count(生成トークン数) : 885
eval_duration(生成時間) : 4457316393 (4.457s)
real 0m5.764s
user 0m0.021s
sys 0m0.014s
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.261.03 Driver Version: 535.261.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 3060 On | 00000000:01:00.0 On | N/A |
| 0% 43C P2 136W / 170W | 1427MiB / 12288MiB | 88% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 1226 G /usr/lib/xorg/Xorg 108MiB |
| 0 N/A N/A 1794 G xfwm4 2MiB |
| 0 N/A N/A 2322 G /usr/bin/x-www-browser 233MiB |
| 0 N/A N/A 40228 C /usr/bin/ollama 1070MiB |
+---------------------------------------------------------------------------------------+
メモリ使用量(RSS) : 838536 KB
gemma3:4b(GPU使用 事前のモデルのロード無し)
2026-01-27
total_duration(合計時間) : 9315677595 (9.316s)
load_duration(モデルのロード時間) : 1409785195 (1.409s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 21871747 ( 0.022s)
eval_count(生成トークン数) : 680
eval_duration(生成時間) : 7567312183 ( 7.567s)
real 0m9.323s
user 0m0.018s
sys 0m0.007s
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.261.03 Driver Version: 535.261.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 3060 On | 00000000:01:00.0 On | N/A |
| 0% 48C P2 169W / 170W | 4219MiB / 12288MiB | 96% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 1226 G /usr/lib/xorg/Xorg 108MiB |
| 0 N/A N/A 1794 G xfwm4 2MiB |
| 0 N/A N/A 2322 G /usr/bin/x-www-browser 233MiB |
| 0 N/A N/A 40358 C /usr/bin/ollama 3862MiB |
+---------------------------------------------------------------------------------------+
メモリ使用量(RSS) : 1196172 KB
gemma3:12b(GPU使用 事前のモデルのロード無し)
2026-01-28
total_duration(合計時間) : 20055041932 (20.055s)
load_duration(モデルのロード時間) : 3458920674 ( 3.459s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 57497235 ( 0.057s)
eval_count(生成トークン数) : 599
eval_duration(生成時間) : 16257443620 (16.257s)
real 0m20.073s
user 0m0.040s
sys 0m0.011s
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.261.03 Driver Version: 535.261.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 3060 On | 00000000:01:00.0 On | N/A |
| 0% 46C P2 169W / 170W | 9239MiB / 12288MiB | 97% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 1234 G /usr/lib/xorg/Xorg 104MiB |
| 0 N/A N/A 1805 G xfwm4 2MiB |
| 0 N/A N/A 2301 G /usr/bin/x-www-browser 211MiB |
| 0 N/A N/A 6175 C /usr/bin/ollama 8908MiB |
+---------------------------------------------------------------------------------------+
メモリ使用量(RSS) : 1526188 KB
gemma3:27b(GPU使用 事前のモデルのロード無し)
2026-01-28
total_duration(合計時間) : 161079593974 (161.080s)
load_duration(モデルのロード時間) : 4903481463 ( 4.903s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 1126430372 ( 1.126s)
eval_count(生成トークン数) : 807
eval_duration(生成時間) : 154521965367 (154.522s)
real 2m41.099s
user 0m0.069s
sys 0m0.003s
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.261.03 Driver Version: 535.261.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 3060 On | 00000000:01:00.0 On | N/A |
| 0% 52C P2 71W / 170W | 11503MiB / 12288MiB | 18% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 1234 G /usr/lib/xorg/Xorg 107MiB |
| 0 N/A N/A 1805 G xfwm4 2MiB |
| 0 N/A N/A 2301 G /usr/bin/x-www-browser 114MiB |
| 0 N/A N/A 6409 C /usr/bin/ollama 11266MiB |
+---------------------------------------------------------------------------------------+
メモリ使用量(RSS) : 8767976 KB
gemma3:270m(GPU使用 事前にモデルをロード済み)
2026-01-28
total_duration(合計時間) : 3013057548 (3.013s)
load_duration(モデルのロード時間) : 68434979 (0.068s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 16883901 (0.017s)
eval_count(生成トークン数) : 957
eval_duration(生成時間) : 2481066198 (2.481s)
real 0m3.020s
user 0m0.019s
sys 0m0.004s
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.261.03 Driver Version: 535.261.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 3060 On | 00000000:01:00.0 On | N/A |
| 0% 41C P2 107W / 170W | 644MiB / 12288MiB | 73% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 1234 G /usr/lib/xorg/Xorg 107MiB |
| 0 N/A N/A 1805 G xfwm4 2MiB |
| 0 N/A N/A 2301 G /usr/bin/x-www-browser 9MiB |
| 0 N/A N/A 14839 C /usr/bin/ollama 512MiB |
+---------------------------------------------------------------------------------------+
メモリ使用量(RSS) : 623272 KB
gemma3:1b(GPU使用 事前にモデルをロード済み)
2026-01-28
total_duration(合計時間) : 3613165933 (3.613s)
load_duration(モデルのロード時間) : 140200802 (0.140s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 22484731 (0.022s)
eval_count(生成トークン数) : 649
eval_duration(生成時間) : 3173141892 (3.173s)
real 0m3.624s
user 0m0.015s
sys 0m0.015s
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.261.03 Driver Version: 535.261.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 3060 On | 00000000:01:00.0 On | N/A |
| 0% 42C P2 136W / 170W | 1324MiB / 12288MiB | 82% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 1234 G /usr/lib/xorg/Xorg 107MiB |
| 0 N/A N/A 1805 G xfwm4 2MiB |
| 0 N/A N/A 2301 G /usr/bin/x-www-browser 131MiB |
| 0 N/A N/A 15704 C /usr/bin/ollama 1070MiB |
+---------------------------------------------------------------------------------------+
メモリ使用量(RSS) : 841244 KB
gemma3:4b(GPU使用 事前にモデルをロード済み)
2026-01-28
total_duration(合計時間) : 10862841543 (10.863s)
load_duration(モデルのロード時間) : 156877637 ( 0.160s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 35755839 ( 0.036s)
eval_count(生成トークン数) : 931
eval_duration(生成時間) : 10268641137 (10.269s)
real 0m10.874s
user 0m0.021s
sys 0m0.011s
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.261.03 Driver Version: 535.261.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 3060 On | 00000000:01:00.0 On | N/A |
| 0% 48C P2 169W / 170W | 4205MiB / 12288MiB | 94% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 1234 G /usr/lib/xorg/Xorg 108MiB |
| 0 N/A N/A 1805 G xfwm4 2MiB |
| 0 N/A N/A 2301 G /usr/bin/x-www-browser 219MiB |
| 0 N/A N/A 16909 C /usr/bin/ollama 3862MiB |
+---------------------------------------------------------------------------------------+
メモリ使用量(RSS) : 1205296 KB
gemma3:12b(GPU使用 事前にモデルをロード済み)
2026-01-28
total_duration(合計時間) : 16533192674 (16.533s)
load_duration(モデルのロード時間) : 162883571 ( 0.160s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 64256500 ( 0.064s)
eval_count(生成トークン数) : 588
eval_duration(生成時間) : 16043770105 (16.044s)
real 0m16.551s
user 0m0.041s
sys 0m0.008s
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.261.03 Driver Version: 535.261.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 3060 On | 00000000:01:00.0 On | N/A |
| 0% 53C P2 169W / 170W | 9269MiB / 12288MiB | 97% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 1234 G /usr/lib/xorg/Xorg 108MiB |
| 0 N/A N/A 1805 G xfwm4 2MiB |
| 0 N/A N/A 2301 G /usr/bin/x-www-browser 236MiB |
| 0 N/A N/A 17026 C /usr/bin/ollama 8908MiB |
+---------------------------------------------------------------------------------------+
メモリ使用量(RSS) : 1527704 KB
gemma3:27b(GPU使用 事前にモデルをロード済み)
2026-01-28
total_duration(合計時間) : 167723181826 (167.723s)
load_duration(モデルのロード時間) : 165128810 ( 0.165s)
prompt_eval_count(評価されたプロンプトのトークン数) : 26
prompt_eval_duration(プロンプトの評価時間) : 1133656815 ( 1.134s)
eval_count(生成トークン数) : 859
eval_duration(生成時間) : 165847503559 (165.848s)
real 2m47.729s
user 0m0.030s
sys 0m0.013s
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.261.03 Driver Version: 535.261.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 3060 On | 00000000:01:00.0 On | N/A |
| 0% 58C P2 72W / 170W | 11533MiB / 12288MiB | 21% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 1234 G /usr/lib/xorg/Xorg 108MiB |
| 0 N/A N/A 1805 G xfwm4 2MiB |
| 0 N/A N/A 2301 G /usr/bin/x-www-browser 143MiB |
| 0 N/A N/A 17435 C /usr/bin/ollama 11266MiB |
+---------------------------------------------------------------------------------------+
メモリ使用量(RSS) : 8763096 KB