GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
PE
Peach 2.0 9B 8k Roleplay
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
MA
MAmmoTH2 7B
Mammoth · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GU
GUI Owl 1.5 32B Instruct
Gui · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
Vision
GL
GLM 4.6V Flash
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
GGUF
MI
MiMo V2.5
Mimo · bartowski
Params310B
Context1024K
Q4_K_M188.8 GB
Vision
PA
Papagaio
Papagaio · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool use
MI
Mistral Small 3.1 24B RP
Mistral · Aratako
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
MI
Mistral Small 24B Instruct 2501
Mistral · BasedAGI
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
ME
MemeLens VLM
Memelens · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
DE
DeepPresenter 9B
Deeppresenter · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
AL
ALMA 13B
Alma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PH
Phi 3 mini 128k instruct abliterated v3
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
WH
whisper medium
Whisper · oxide-lab
Params764M
Context—
Smallest0.3 GB
GGUF
DE
DeepScaleR 1.5B Preview
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
PH
Phi 3 mini 4k instruct IMat
Phi · legraphista
Params3.82B
Context4K
Smallest0.8 GB
GGUF
LI
Ling 3.1 flash 1019 abliterated
Ling · mrfakename
Params4M
Context256K
Q4_K_M345.7 GB
GGUF
OR
Ornith 1.5 9B OBLITERATED
Ornith · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
LL
perplexity ai r1 1776 distill llama 70b
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
ON
Oneirogen 7B
Oneirogen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LI
LING 3.0 FLASH ABLITERATED
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
Reasoning
MI
Mixtral AI Cyber 4.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
GL
Zai org.GLM 5.3 Flash
GLM · DevQuasar
Params313B
Context1024K
Q4_K_M189.0 GB
Vision
EV
Evolutionstory
Evolutionstory · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
melotts en v3
Melotts · cstr
Params95M
Context—
Smallest0.1 GB
GGUF
ME
MeowGPT 3.5
Meowgpt · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
PH
Phi 4 Heretic
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
NO
Nous Puffin 70B
Nous · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · jacobcarajo
Params14.8B
Context128K
Smallest10.5 GB
ReasoningTool use
SK
SkinTokens GGUF BF16
Skintokens · chibifire
Params29M
Context—
Smallest0.1 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · eaddario
Params7.62B
Context128K
Q4_K_M4.2 GB
Reasoning

Keep browsing