GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
QW
Tess-v2.5-Qwen2-72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
PY
Pydevmini1
Pydevmini · bartowski
Params4.02B
Context40K
Q4_K_M2.5 GB
YI
Tess 2.0 Yi 34B 200K
Yi · bartowski
Params34.4B
Context195K
Q4_K_M20.7 GB
NE
NeuralKybalion 7B slerp v3
Neuralkybalion · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Tess-2.0-Llama-3-70B-v0.2
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
BL
blossom-v5.1-9b
Blossom · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
MI
Aethora 7b V1 e 1
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
slimorca-gemma2-9b-fft
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
EveryoneLLM 7b Gemma Base GGUF old
Gemma · bartowski
Params8.54B
Context8K
Q4_K_M5.1 GB
HA
Hathor-L3-8B-v.02
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
MI
Cerebrum-1.0-8x7b
Mistral · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
L3-Aethora-15B-V2
Llama · bartowski
Params15B
Context8K
Q4_K_M9.1 GB
LL
llama3-13.45b-Instruct
Llama · bartowski
Params13.3B
Context8K
Q4_K_M8.1 GB
MI
Oumuamua-7b-instruct-v2
Mistral · bartowski
Params7.33B
Context32K
Q4_K_M4.9 GB
RH
Rhea 72b v0.5
Rhea · bartowski
Params72.3B
Context32K
Q4_K_M43.8 GB
QW
Liberated Qwen1.5 7B GGUF old
Qwen · bartowski
Params7.72B
Context32K
Q4_K_M4.8 GB
MI
Mistral 7B v0.2 hf
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
NU
NuExtract
Nuextract · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
MI
Code Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
opus-v1.2-llama-3-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
HA
Hathor_Gamma-L3-8B-0.6
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
FI
Fireball 12B v1.0
Fireball · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
YI
Hyperion 3.0 Yi 34B
Yi · bartowski
Params34.4B
Context4K
Q4_K_M20.7 GB
SO
L3-Solana-8B-v1
Solana · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Magic Dolphin 7b
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
PO
Poro 34B chat
Poro · bartowski
Params35.1B
Context7K
Q4_K_M24.8 GB
MI
Codestral-RAG-19B-Pruned
Mistral · bartowski
Params19.1B
Context32K
Q4_K_M11.5 GB
MI
openbuddy mistral 7b v19.1 4k
Mistral · bartowski
Params7.28B
Context32K
Q4_K_M4.4 GB
TE
Tempmotacilla Cinerea 0302
Tempmotacilla · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
BU
Buddy 2B v1
Buddy · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB