GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
PE
Peach 2.0 9B 8k Roleplay
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
MA
MAmmoTH2 7B
Mammoth · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GU
GUI Owl 1.5 32B Instruct
Gui · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
GL
GLM 4.6V Flash
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
MI
MiMo V2.5
Mimo · bartowski
Params310B
Context1024K
Q4_K_M188.8 GB
PA
Papagaio
Papagaio · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
MI
Mistral Small 3.1 24B RP
Mistral · Aratako
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Small 24B Instruct 2501
Mistral · BasedAGI
Params23.6B
Context32K
Q4_K_M14.3 GB
ME
MemeLens VLM
Memelens · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
DE
DeepPresenter 9B
Deeppresenter · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
AL
ALMA 13B
Alma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
PH
Phi 3 mini 128k instruct abliterated v3
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
WH
whisper medium
Whisper · oxide-lab
Params764M
Context—
Smallest0.3 GB
DE
DeepScaleR 1.5B Preview
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
PH
Phi 3 mini 4k instruct IMat
Phi · legraphista
Params3.82B
Context4K
Smallest0.8 GB
LI
Ling 3.1 flash 1019 abliterated
Ling · mrfakename
Params4M
Context256K
Q4_K_M345.7 GB
OR
Ornith 1.5 9B OBLITERATED
Ornith · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
LL
perplexity ai r1 1776 distill llama 70b
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ON
Oneirogen 7B
Oneirogen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
LI
LING 3.0 FLASH ABLITERATED
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
MI
Mixtral AI Cyber 4.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GL
Zai org.GLM 5.3 Flash
GLM · DevQuasar
Params313B
Context1024K
Q4_K_M189.0 GB
EV
Evolutionstory
Evolutionstory · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
melotts en v3
Melotts · cstr
Params95M
Context—
Smallest0.1 GB
ME
MeowGPT 3.5
Meowgpt · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
PH
Phi 4 Heretic
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
NO
Nous Puffin 70B
Nous · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · jacobcarajo
Params14.8B
Context128K
Smallest10.5 GB
SK
SkinTokens GGUF BF16
Skintokens · chibifire
Params29M
Context—
Smallest0.1 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · eaddario
Params7.62B
Context128K
Q4_K_M4.2 GB