GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LA
Lamarck 14B v0.7
Lamarck · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
LL
Llama Krikri 8B Instruct
Llama · bartowski
Params8.2B
Context128K
Q4_K_M5.0 GB
GGUF
TE
Teuken 7B Instruct Research v0.4
Teuken · bartowski
Params7.45B
Context4K
Q4_K_M5.0 GB
GGUF
IN
JanusCoderV 7B
InternLM · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
CodingVision
GR
Granite 4.0 Tiny Preview
Granite · bartowski
Params6.67B
Context1024K
Q4_K_M4.1 GB
GGUF
HU
HuatuoGPT O1 8B
Huatuogpt · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
IN
Inf O1 Pi0
Inf · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
MI
miniG
Minig · bartowski
Params9.5B
Context1024K
Q4_K_M6.3 GB
GGUF
QW
Rombos Coder V2.5 Qwen 14b
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
PO
Pokee_Research_7B
Pokee · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
GGUF
JA
Jan Code 4b
Jan · bartowski
Params4.41B
Context256K
Q4_K_M2.8 GB
CodingTool use
FO
ReadyArt Forgotten Safeword 12B 3.6
Forgotten · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
TI
TinyR1 32B Preview
Tinyr · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
WA
Wayfarer 12b
Wayfarer · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
MA
Trappu Magnum Picaro 0.7 v2 12b
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CA
calme-3.2-instruct-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
GGUF
EX
EXAONE 4.0.1 32B
Exaone · bartowski
Params32B
Context128K
Q4_K_M19.3 GB
GGUF
AB
Absolute_Zero_Reasoner Coder 7b
Absolute · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
KR
Krutrim 2 Instruct
Krutrim · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TE
Tessa T1 14B
Tessa · bartowski
Params14.8B
Context117K
Q4_K_M9.0 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · bartowski
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
DA
Steelskull L3.3 Damascus R1
Damascus · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
BI
BigQwen2.5 Echo 47B Instruct
Bigqwen · bartowski
Params47.4B
Context32K
Q4_K_M28.6 GB
GGUF
JA
Jan Nano
Jan · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
GR
Granite Embedding 30m English
Granite · bartowski
Params30M
Context512
Q4_K_M0.0 GB
Embedding
ME
MS Meadowlark 22B
Meadowlark · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
NE
NeuralDaredevil-8B-abliterated
Neuraldaredevil · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
VI
Virtuoso Small v2
Virtuoso · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
CA
CalmeRys 78B Orpo v0.1
Calmerys · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
GGUF
DE
DeepSeek R1 ReDistill Qwen 1.5B v1.0
DeepSeek · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use

Keep browsing