GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Tess-v2.5-Qwen2-72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
PY
Pydevmini1
Pydevmini · bartowski
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
YI
Tess 2.0 Yi 34B 200K
Yi · bartowski
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
NE
NeuralKybalion 7B slerp v3
Neuralkybalion · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Tess-2.0-Llama-3-70B-v0.2
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
BL
blossom-v5.1-9b
Blossom · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
MI
Aethora 7b V1 e 1
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
slimorca-gemma2-9b-fft
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
EveryoneLLM 7b Gemma Base GGUF old
Gemma · bartowski
Params8.54B
Context8K
Q4_K_M5.1 GB
GGUF
HA
Hathor-L3-8B-v.02
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Cerebrum-1.0-8x7b
Mistral · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LL
L3-Aethora-15B-V2
Llama · bartowski
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
LL
llama3-13.45b-Instruct
Llama · bartowski
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF
MI
Oumuamua-7b-instruct-v2
Mistral · bartowski
Params7.33B
Context32K
Q4_K_M4.9 GB
Roleplay
RH
Rhea 72b v0.5
Rhea · bartowski
Params72.3B
Context32K
Q4_K_M43.8 GB
GGUF
QW
Liberated Qwen1.5 7B GGUF old
Qwen · bartowski
Params7.72B
Context32K
Q4_K_M4.8 GB
CodingTool use
MI
Mistral 7B v0.2 hf
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NU
NuExtract
Nuextract · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
MI
Code Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
LL
opus-v1.2-llama-3-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HA
Hathor_Gamma-L3-8B-0.6
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FI
Fireball 12B v1.0
Fireball · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
YI
Hyperion 3.0 Yi 34B
Yi · bartowski
Params34.4B
Context4K
Q4_K_M20.7 GB
Coding
SO
L3-Solana-8B-v1
Solana · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Magic Dolphin 7b
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
PO
Poro 34B chat
Poro · bartowski
Params35.1B
Context7K
Q4_K_M24.8 GB
GGUF
MI
Codestral-RAG-19B-Pruned
Mistral · bartowski
Params19.1B
Context32K
Q4_K_M11.5 GB
Coding
MI
openbuddy mistral 7b v19.1 4k
Mistral · bartowski
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
TE
Tempmotacilla Cinerea 0302
Tempmotacilla · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
BU
Buddy 2B v1
Buddy · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Keep browsing