GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2-0.5B-Instruct
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
GE
Gemma 3 40b
Gemma · bartowski
Params39.8B
Context128K
Q4_K_M24.3 GB
GGUF
IN
InternLM2
InternLM · bartowski
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
RE
ozone research Reverb 14b
Reverb · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
AR
Archaeo 12B V2
Archaeo · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MA
magnum 32b v1
Magnum · bartowski
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
RE
Reasoning 0.5b
Reasoning · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Reasoning
ST
Stellar Odyssey 12b v0.0
Stellar · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama 3.1 Tulu 3 70B SFT
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NO
2B_or_not_2B
Not · bartowski
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
NQLSG Qwen2.5 14B MegaFusion v5 Roleplay Duplicate
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
RoleplayTool use
EU
L3-70B-Euryale-v2.1
Euryale · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
AN
Andromeda 70B
Andromeda · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
NA
Nautilus 70B v0.1
Nautilus · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
BE
35b-beta-long
Beta · bartowski
Params35B
Context125K
Q4_K_M21.5 GB
Tool use
OP
Oprius 3.0 1.1B
Oprius · bartowski
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
FA
Fallen Command A 111B v1.1
Fallen · bartowski
Params111B
Context256K
Smallest26.8 GB
GGUF
QW
Openbuddy Qwen2.5Coder 32b V24.1Q
Qwen · bartowski
Params32.8B
Context195K
Q4_K_M19.9 GB
Coding
MA
MN Magnum v2.5 18.5B Kto Instruct
Magnum · bartowski
Params18.5B
Context1000K
Q4_K_M11.2 GB
GGUF
LL
Llama3.1 8B Cobalt
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
WikiHow Mistral Instruct 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Crab DPO
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
QW
smirki UIGEN T1.1 Qwen 7B
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
Meta-Llama-3-120B-Instruct
Llama · bartowski
Params122B
Context8K
Q4_K_M73.2 GB
GGUF
QW
Amoral Cogito v1 Preview Qwen 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
AC
AceInstruct 1.5B
Aceinstruct · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
DE
FuseO1 DeepSeekR1 Qwen2.5 Coder 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingTool use
LL
Negative_LLAMA_70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
WH
WhiteRabbitNeo 7B v1.5a
Whiterabbitneo · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
NE
NemoReRemix 12B
Nemoreremix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing