GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
LA
Lamarck 14B v0.7
Lamarck · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
Llama Krikri 8B Instruct
Llama · bartowski
Params8.2B
Context128K
Q4_K_M5.0 GB
TE
Teuken 7B Instruct Research v0.4
Teuken · bartowski
Params7.45B
Context4K
Q4_K_M5.0 GB
IN
JanusCoderV 7B
InternLM · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
GR
Granite 4.0 Tiny Preview
Granite · bartowski
Params6.67B
Context1024K
Q4_K_M4.1 GB
HU
HuatuoGPT O1 8B
Huatuogpt · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
IN
Inf O1 Pi0
Inf · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
miniG
Minig · bartowski
Params9.5B
Context1024K
Q4_K_M6.3 GB
QW
Rombos Coder V2.5 Qwen 14b
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
PO
Pokee_Research_7B
Pokee · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
JA
Jan Code 4b
Jan · bartowski
Params4.41B
Context256K
Q4_K_M2.8 GB
FO
ReadyArt Forgotten Safeword 12B 3.6
Forgotten · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
TI
TinyR1 32B Preview
Tinyr · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
WA
Wayfarer 12b
Wayfarer · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
MA
Trappu Magnum Picaro 0.7 v2 12b
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CA
calme-3.2-instruct-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
EX
EXAONE 4.0.1 32B
Exaone · bartowski
Params32B
Context128K
Q4_K_M19.3 GB
AB
Absolute_Zero_Reasoner Coder 7b
Absolute · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
KR
Krutrim 2 Instruct
Krutrim · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
TE
Tessa T1 14B
Tessa · bartowski
Params14.8B
Context117K
Q4_K_M9.0 GB
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · bartowski
Params8B
Context1024K
Q4_K_M4.9 GB
DA
Steelskull L3.3 Damascus R1
Damascus · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
BI
BigQwen2.5 Echo 47B Instruct
Bigqwen · bartowski
Params47.4B
Context32K
Q4_K_M28.6 GB
JA
Jan Nano
Jan · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
GR
Granite Embedding 30m English
Granite · bartowski
Params30M
Context512
Q4_K_M0.0 GB
ME
MS Meadowlark 22B
Meadowlark · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
NE
NeuralDaredevil-8B-abliterated
Neuraldaredevil · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
VI
Virtuoso Small v2
Virtuoso · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
CA
CalmeRys 78B Orpo v0.1
Calmerys · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
DE
DeepSeek R1 ReDistill Qwen 1.5B v1.0
DeepSeek · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB