Local AI Club logoLOCAL AICLUB
OPEN BENCHMARKS

Beyond leaderboards — reproducible

Open models, quantizations, engines, devices, parameters, scripts and raw data. Every conclusion states its limits.

01
Apple M4 Pro · 48GB

7B–32B Chinese models benchmarked

Comparing time-to-first-token, generation speed, memory and long-context behavior.

12 models · 4 engines
02
RTX 4090 · 24GB

Local coding models and agent task evaluation

From code completion to tool calling, multi-file edits and task recovery.

86 tasks · Raw data open
03
CPU ONLY

No GPU — what can local AI do?

Covering 8 common desktop CPUs with model limits and acceptable experience ranges.

Community benchmark · Reproduced
04
ANDROID

Speed, power and thermals of small on-phone models

Comparing on-device engines and quantization schemes under unified tasks and conditions.

6 devices · 3 engines