GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
MI
Hercules 3.1 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-11.5B-V2
Llama · bartowski
Params11.5B
Context8K
Q4_K_M7.0 GB
NP
NPC LLM 3 8B
Npc · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
ZE
Zebrafish 7B
bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
AE
Aethora 7b v1
Aethora · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hyperion 1.5 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-Ultron
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
CH
K2-Chat
Chat · bartowski
Params65.3B
Context8K
Q4_K_M39.3 GB
PH
phi3-4x4b-v1
Phi · bartowski
Params11.1B
Context4K
Q4_K_M6.7 GB
ET
ML MS Etheris 123B
Etheris · bartowski
Params123B
Context32K
Q4_K_M73.2 GB
MA
Maverick Math 7B
Maverick · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2-Deita-500m
Qwen · bartowski
Params630M
Context128K
Q4_K_M0.5 GB
MI
Mistral Plus 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
TE
Tess 10.7B v2.0
Tess · bartowski
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
mistral orpo alpha
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
EpistemeAI metatune gpt20b R1.1
Metatune · bartowski
Params20.9B
Context128K
Smallest0.0 GB
DE
DeepSeek V3.1 Base
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.9 GB
IC
ICONNAI ICONN 1
Iconnai · bartowski
Params84B
Context32K
Q4_K_M50.9 GB
LF
LFM3 VL 2B
Lfm · bartowski
Params1.73B
Context125K
Q4_K_M1.1 GB