GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
LLaMAX3 8B Alpaca
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
FA
Fara1.5 9B
Fara · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
DE
deepseek v4.1 flash gguf mirror
DeepSeek · hyukudan
Params755B
Context—
Smallest8.0 GB
GGUF
QW
Qwen 2.5 7B Instruct novel lora
Qwen · cgxjdzz
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GL
GLM 4.6V
GLM · bartowski
Params107B
Context128K
Q4_K_M71.4 GB
ReasoningTool useVision
PU
public poetry 50m
Public · wildfellhall
Params47M
Context1K
Smallest0.1 GB
GGUF
SY
SynLogic 7B Sft Gold v1
Synlogic · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
MiMo V2.6 Distill Qwen 9B Ablit
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool useVision
MI
MiMo V2 Flash
Mimo · bartowski
Params309B
Context256K
Q4_K_M187.1 GB
ReasoningTool use
AS
Asclepio 8B
Asclepio · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash DSpark draft
DeepSeek · YanissAmz
Params19.8B
Context—
Smallest10.9 GB
GGUF
LO
LongCat Flash Lite Sparse Uncensored Heretic Native MTP And LSA Preserved
Longcat · llmfan46
Params69B
Context960K
Q4_K_M41.2 GB
GGUF
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · legraphista
Params14B
Context4K
Smallest3.1 GB
CodingTool use
SI
UI Simulator R Web i1
Simulator · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
JO
JOSIE 2 9B OSS
Josie · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
PH
Phi 3 mini 3.8b 4Bit InstructionTuned Alpaca
Phi · Chituyi
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
LL
UserLM-8b
Llama · Mungert
Params8.03B
Context8K
Q4_K_M5.3 GB
GGUF
GL
GLM 4.7 Flash Impotent Heresy
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
WH
whisper small
Whisper · oxide-lab
Params242M
Context—
Smallest0.1 GB
GGUF
LO
LongCat Flash Lite Uncensored Heretic Native MTP Preserved
Longcat · llmfan46
Params69.1B
Context320K
Q4_K_M40.3 GB
GGUF
CA
calme-2.1-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
HF
hft transformer
Hft · cstr
Params6M
Context—
Smallest0.0 GB
GGUF
IR
irodori tts
Irodori · cstr
Params98M
Context—
Smallest0.0 GB
GGUF
ST
stockmark 100b
Stockmark · mmnga
Params96.2B
Context4K
Smallest20.4 GB
GGUF
PA
MS3.2 PaintedFantasy v4.1 24B Heretic v2
Paintedfantasy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingRoleplay
AU
AutoGLM Phone 9B
Autoglm · BlcaCola
Params9.4B
Context64K
Q4_K_M6.2 GB
Vision
LI
Ling 3.0 Tiny
Ling · WhiskyAKM
Params7.89B
Context128K
Q4_K_M4.8 GB
ReasoningTool use
LL
LLM4Binary.llm4decompile 6.7b v1.5
Llm · DevQuasar-7
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 UNCENSORED VQ
DeepSeek · Baekpica
Params485M
Context—
Smallest1.0 GB
GGUF
LL
LLaDA 1.5
Llada · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
GGUF

Keep browsing