GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
CA
Captain Eris Twighlight V0.420 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LF
LFM2.5 2.6B
Lfm · bartowski
Params2.7B
Context125K
Q4_K_M1.7 GB
TE
TerminalHorizon 27B
Terminalhorizon · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
LB
LBS 27B
Lbs · bartowski
Params26.9B
Context256K
Q4_K_M17.2 GB
PE
Peach 9B 8k Roleplay
Peach · bartowski
Params8.83B
Context16K
Q4_K_M5.3 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
PR
Bu 30b A3B Preview
Preview · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
LI
Ling 3.0 Flash Sante
Ling · bartowski
Params127B
Context256K
Q4_K_M80.4 GB
EX
EXAONE 3.5 7.8B Instruct
Exaone · bartowski
Params7.8B
Context32K
Q4_K_M4.8 GB
GE
Big Tiger Gemma 27B v3
Gemma · bartowski
Params28.4B
Context128K
Q4_K_M17.3 GB
CO
Command A Plus 05 2026
Command · bartowski
Params218B
Context195K
Q4_K_M135.1 GB
FA
Falcon3 7B Instruct
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
GR
Granite 4.2 30b
Granite · bartowski
Params29.3B
Context128K
Q4_K_M18.0 GB
PH
Phi 4 Reasoning Plus
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
CH
Chronos Divergence 33B
Chronos · bartowski
Params32.5B
Context16K
Q4_K_M19.6 GB
CY
Cydonia 24B v4
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
NO
NousCoder 14B
Nouscoder · bartowski
Params14.8B
Context80K
Q4_K_M9.0 GB
EL
Steelskull L3.3 Electra R1 70b
Electra · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Emma 500 Llama2 7b
Llama · bartowski
Params6.74B
Context4K
Q4_K_M4.1 GB
SK
Skywork OR1 Math 7B
Skywork · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
Mistral Small Drummer 22B
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
MA
magnum v4 27b
Magnum · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
IN
InternVL3_5 4B
Internvl · bartowski
Params4.41B
Context40K
Q4_K_M2.7 GB
SN
Snowpiercer 15B v4
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
WO
WorldSim Opus 3.6 35B A3B
Worldsim · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
GE
Gemma 3 12b It Qat
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
QVQ 72B Preview
Qwen · bartowski
Params72.7B
Context125K
Q4_K_M47.4 GB
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
Gemma 2 Ataraxy 9B
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
SK
Sky T1 32B Preview
Sky · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB