GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
OpenCrystal 12B L3
Opencrystal · bartowski
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
EV
L3-8B-Everything-COT
Everything · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TH
L3-TheSpice-8b-v0.8.3
Thespice · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AU
AutoCoder
Autocoder · bartowski
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
MI
Cerebrum-1.0-8x7b
Mistral · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
HA
Hathor_Aleph-L3-8B-v0.72
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
Tess 7B v2.0
Tess · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama-3-fantasy-writer-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AR
Arcee-Agent
Arcee · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
Tiamat-8b-1.2-Llama-3-DPO
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GP
Gpt Oss 120b
gpt-oss · bartowski
Params117B
Context128K
Smallest63.4 GB
Tool use
LL
Llama 3 8B Stroganoff 2.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
Tess 3 7B SFT
Tess · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
OL
AMD OLMo 1B
OLMo · bartowski
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
MI
Cerebrum 1.0 10.7B
Mistral · bartowski
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
YI
Faro Yi 9B 200K
Yi · bartowski
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
MI
Mistral quiet star demo
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
JSL-MedLlama-3-8B-v1.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IN
InternLM2
InternLM · bartowski
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
QW
Hercules-5.0-Qwen2-1.5B
Qwen · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
AL
AlphaHitchhiker 7B v2
Alphamonarch · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenCerebrum 1.0 7b DPO
Opencerebrum · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
merlinite 7b
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FI
firefunction-v2
Firefunction · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
AI
aixcoder-7b-base
Aixcoder · bartowski
Params7.43B
Context32K
Q4_K_M4.8 GB
Coding
LL
Awanllm-Llama-3-8B-Dolfin-v1.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HA
Hathor_Enigmatica-L3-8B-v0.4
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
Magnaraxy 9b
Magnaraxy · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LU
Lumimaid v0.2 123B
Lumimaid · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
LL
LLAMA-3_8B_Unaligned_Alpha
Llama · bartowski
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF

Keep browsing