GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Hercules 3.1 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LL
Llama-3-11.5B-V2
Llama · bartowski
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
NP
NPC LLM 3 8B
Npc · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
ZE
Zebrafish 7B
bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AE
Aethora 7b v1
Aethora · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hyperion 1.5 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-Ultron
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CH
K2-Chat
Chat · bartowski
Params65.3B
Context8K
Q4_K_M39.3 GB
GGUF
PH
phi3-4x4b-v1
Phi · bartowski
Params11.1B
Context4K
Q4_K_M6.7 GB
GGUF
ET
ML MS Etheris 123B
Etheris · bartowski
Params123B
Context32K
Q4_K_M73.2 GB
GGUF
MA
Maverick Math 7B
Maverick · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2-Deita-500m
Qwen · bartowski
Params630M
Context128K
Q4_K_M0.5 GB
GGUF
MI
Mistral Plus 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TE
Tess 10.7B v2.0
Tess · bartowski
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
mistral orpo alpha
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
EpistemeAI metatune gpt20b R1.1
Metatune · bartowski
Params20.9B
Context128K
Smallest0.0 GB
GGUF
DE
DeepSeek V3.1 Base
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.9 GB
ReasoningTool use
IC
ICONNAI ICONN 1
Iconnai · bartowski
Params84B
Context32K
Q4_K_M50.9 GB
GGUF
LF
LFM3 VL 2B
Lfm · bartowski
Params1.73B
Context125K
Q4_K_M1.1 GB
CodingReasoningTool use

Keep browsing