GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
NO
North Mini Code 1.0
North · bartowski
Params30.5B
Context488K
Q4_K_M18.7 GB
AE
AesCode 32B
Aescode · bartowski
Params32.8B
Context256K
Q4_K_M20.5 GB
DA
Darwin 27B RSI
Darwin · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
PH
phi3.5 gutenberg 4B
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
AR
Artemis 31B v1.1
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
QW
JetBrains Qwen3.8 3.6 27B Blend
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
OL
OLMo 2 1124 13B Instruct
OLMo · bartowski
Params13.7B
Context4K
Q4_K_M8.4 GB
QW
Qwen2 VL 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
PH
Phi 3.1 mini 4k instruct
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · bartowski
Params6.9B
Context4K
Q4_K_M4.2 GB
FA
Fara1.5 4B
Fara · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
NE
Nemotron Cascade 2 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
MI
Codestral-22B-v0.1
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Qwen3 235B A22B Instruct 2507
Qwen · bartowski
Params235B
Context256K
Q4_K_M142.6 GB
HO
Holo4 35B A3B
Holo · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
RO
Rocinante 12B v1.1
Rocinante · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3.1 8B Lexi Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · bartowski
Params8.19B
Context128K
Q4_K_M5.0 GB
DO
Dots3 Note Prev
Dots · bartowski
Params280B
Context512K
Q4_K_M171.1 GB
PH
Phi 3.5 Mini instruct_Uncensored
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Swift Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M125.6 GB
QW
cerebras/Qwen3-Coder-REAP-25B-A3B
Qwen · bartowski
Params25B
Context256K
Q4_K_M15.2 GB
AN
Anubis 70B v1.2
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
PH
Phi 3.1 mini 128k instruct
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
Agnes 3.0 Qwen
Qwen · bartowski
Params180B
Context1024K
Q4_K_M127.1 GB
QW
Qwen3 4B Instruct 2507 Heretic
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
MI
Ministral 3 14B Instruct 2512
Mistral · bartowski
Params13.5B
Context256K
Q4_K_M8.2 GB
LI
Ling 3.0 Flash
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB