GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
MediPhi Instruct
Mediphi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
GL
GLM-5.3-Flash
GLM · BioDec
Params321B
Context1024K
Smallest141.7 GB
GGUF
MI
Blockrank Msmarco Mistral 7b
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
EmbeddingTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
ReasoningTool use
ZA
ZamAI LIama3 Pashto
Zamai · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DO
Dots.Llm1.Inst
Dots · bartowski
Params143B
Context32K
Q4_K_M96.1 GB
GGUF
QW
medc llm based on qwen2.5 i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
SP
SP3F 7B
mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
RI
Ring Lite 2506
Ring · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
GGUF
LI
Ling Coder Lite
Ling · mradermacher
Params16.8B
Context4K
Q4_K_M11.2 GB
Coding
MA
Maple Preview
Maple · phantomic12
Params20.2B
Context128K
Smallest5.9 GB
ReasoningTool use
CA
calme-2.1-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest31.8 GB
GGUF
ON
onsets and frames
Onsets · cstr
Params27M
Context—
Smallest0.0 GB
GGUF
VI
Mythos Nano Final
Vibethinker · Eu-sou
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoningTool use
QW
Huihui Qwen3 30B A3B Abliterated Fusion 7030
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · rax4901
Params284B
Context1024K
Smallest3.8 GB
GGUF
RL
RLVR 8B 0926
Rlvr · mradermacher
Params8.19B
Context320K
Q4_K_M5.0 GB
CodingReasoningTool use
NU
NuExtract 1.5 Smol
Nuextract · bartowski
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
LL
Llama-3-8B-Instruct-80K-QLoRA-Merged
Llama · mradermacher
Params8.03B
Context80K
Q4_K_M4.9 GB
GGUF
LL
KingNish Llama3 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AD
AdaptThink 1.5B Delta0.1
Adaptthink · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
PH
Phi 3 mini 4k instruct Q4 K M
Phi · SixOpen
Params3.82B
Context4K
Q4_K_M4.8 GB
Coding
TI
TinyLlama 1.1B intermediate 1.5T PTBR Instruct v3 8k
Tinyllama · afrideva
Params1.1B
Context8K
Q4_K_M0.7 GB
GGUF
SY
SynLogic Mix 3 32B
Synlogic · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
PH
Moxoff Phi3Mini ORPO i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
MA
MaticGPT
Maticgpt · erfanzar
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
VibeThinker 3B heretic
Qwen · zkxxxx
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoningTool use
LL
LLaMAX3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OR
Ornith 1.5 9B OBLITERATED
Ornith · minte1431
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision

Keep browsing