GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
VE
Velvet Eclipse 4x12B v0.2
Velvet · bartowski
Params38.7B
Context1000K
Q4_K_M23.5 GB
Tool use
SN
Snowpiercer 15B v2
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
GGUF
MI
MiMo V2.5 Pro
Mimo · bartowski
Params1020B
Context1024K
Q4_K_M622.9 GB
CodingReasoningTool use
CO
Yi Coder 1.5B
Coder · bartowski
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
GE
RiverCub Gemma 3 27B
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
LF
LFM2 350M Math
Lfm · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
QW
Qwen1.5-32B-Chat
Qwen · bartowski
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
LL
Llama 3.1 70B Instruct Lorablated Creative Writer
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
JA
AI21 Jamba2 3B
Jamba · bartowski
Params3.2B
Context256K
Q4_K_M1.9 GB
Tool use
AS
Assistant_Pepe_8B
Assistant · bartowski
Params8.04B
Context1048K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Instruct-8B-SimPO
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
JE
Jedi 3B 1080p
Jedi · bartowski
Params3.09B
Context125K
Q4_K_M1.9 GB
Tool useVision
CA
Nitral AI Captain Eris Violet GRPO v0.420
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LI
Linkbricks Horizon AI Japanese Pro V3 70B
Linkbricks · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
Qwen2 Math 7B Instruct
Qwen · bartowski
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
QW
QwQ 32B ArliAI RpR v1
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.9 GB
ReasoningTool use
OL
olmOCR 7B 0225 Preview
OLMo · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
EX
EXAONE 3.5 2.4B Instruct
Exaone · bartowski
Params2.67B
Context32K
Q4_K_M1.6 GB
GGUF
EL
Ellaria 9B
Ellaria · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
Roleplay
QW
Cogito v1 Preview Qwen 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
LL
Human Like LLama3 8B Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HE
HelpingAI2 9B
Helpingai · bartowski
Params8.9B
Context128K
Q4_K_M5.4 GB
Tool use
DA
Dazzling Star Aurora 32b v0.0 Experimental 1130
Dazzling · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
LL
Llama-3-8B-Instruct-Coder-v2
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
SM
SmallThinker 4BA0.6B Instruct
Smallthinker · bartowski
Params4.27B
Context32K
Q4_K_M2.6 GB
Tool use
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · bartowski
Params22.2B
Context64K
Q4_K_M13.3 GB
CodingTool use
LL
Cogito v1 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
NU
NuminaMath-7B-TIR
Numinamath · bartowski
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
MI
Trinity 2 Codestral 22B
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
VI
Virtuoso Small
Virtuoso · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use

Keep browsing