GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
open thoughts OpenThinker 32B
Openthinker · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
SE
T Search
Search · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
ReasoningTool useVision
MI
Mixtral-8x22B-v0.1
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
CA
Cathallama 70B
Cathallama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.5 27B Writer
Qwen · bartowski
Params26.9B
Context256K
Q4_K_M17.5 GB
ReasoningTool use
MI
speechless-instruct-mistral-7b-v0.2
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
GE
GEMMA SUTRA
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
BI
allura org Bigger Body 8b
Bigger · bartowski
Params8.02B
Context32K
Q4_K_M4.9 GB
Roleplay
GE
Gemma 3 Starshine 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
LL
Llama 3 8B Instruct Coder
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
CY
Cydonia 22B v1.1
Cydonia · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
LL
Openbuddy Llama3.3 70b v24.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Rombo LLM V3.1 QWQ 32b
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
MI
General-Stories-Mistral-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AS
L3.1 MS Astoria 70b v2
Astoria · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
Mistral-22B-v0.2
Mistral · bartowski
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · bartowski
Params8B
Context1048K
Q4_K_M4.9 GB
GGUF
HU
HuatuoGPT O1 72B
Huatuogpt · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Reasoning
RE
Reka Flash 3.1
Reka · bartowski
Params20.9B
Context96K
Q4_K_M13.6 GB
GGUF
AQ
Aquif 3.5 8B Think
Aquif · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
OP
OpenThinker3 7B
Openthinker · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
FA
FairyR1 32B
Fairyr · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
MI
cerebras/MiniMax-M2-REAP-172B-A10B
Minimax · bartowski
Params173B
Context192K
Q4_K_M104.6 GB
ReasoningTool use
LL
Llama 3.1 Tulu 3 405B
Llama · bartowski
Params406B
Context128K
Q4_K_M243.1 GB
GGUF
MA
Mawdistical Mawdistic NightLife 24b
Mawdistic · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
AD
I Added Glitter
Added · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
IN
JanusCoder 8B
InternLM · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
CodingReasoningTool use
TI
TildeOpen 30b
Tildeopen · bartowski
Params30.7B
Context64K
Q4_K_M18.5 GB
GGUF
LL
openchat-3.6-8b-20240522
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing