GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
GL
GLM 4.7 Flash REAP 39
GLM · mradermacher
Params19.1B
Context198K
Q4_K_M11.6 GB
FL
Florence 2 base
Florence · antflydb
Params232M
Context—
Smallest0.1 GB
MI
MistralPrism 24B
Mistral · Aratako
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.8 27B DFlash drafter bootstrap
Qwen · mrchuy
Params1.73B
Context256K
Smallest1.8 GB
LI
Ling-1T
Ling · unsloth
Params1000B
Context32K
Q4_K_M604.7 GB
AS
astrollama 3 8b base summary
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
PH
Phi 3 song lyrics 1.0
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 medium 4k instruct IMat
Phi · legraphista
Params14B
Context4K
Smallest3.0 GB
TO
ToolCUA 8B
Toolcua · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
TO
ToriiGate 0.5
Toriigate · SleepVeryHard
Params4.84B
Context—
Smallest0.0 GB
PH
phi 3 22b 128k
Phi · mradermacher
Params22B
Context128K
Q4_K_M13.6 GB
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · cybe42
Params8.19B
Context128K
Q4_K_M5.0 GB
BE
Beck 8B
Beck · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
LL
LightGPT 7B Llama2
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
CH
Chimpgpt Coder Elite
Chimpgpt · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
LL
LightGPT 13B Llama2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
PH
Phi 3 Medium 4k Instruct
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
PR
Prompt Refine
Prompt · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
BL
Q3.5 BlueStar v2 27B Ultra Uncensored Heretic v2
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
OR
Ornith 1.5 35B A3B FULLY OBLITERATED
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
UM
AQUILA Engine v1 i1
Uma · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OR
Ornith 1.5 122B IQ3 XXS 16G64G
Ornith · zephel01
Params125B
Context256K
Smallest0.4 GB
GL
GLM 4.7 Flash NEO CODE Imatrix MAX
GLM · DavidAU
Params30B
Context198K
Q4_K_M18.5 GB
LL
LightGPT 8B Llama3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GL
GLM 4.7 Flash Heretic
GLM · bartowski
Params29.9B
Context198K
Q4_K_M18.5 GB
MA
maple preview
Maple · stamsam
Params20.2B
Context128K
Q4_K_M12.3 GB
DE
DeepSeek V4.1 Flash
DeepSeek · Solstice-AI
Params748B
Context—
Q4_K_M444.7 GB
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
QW
UnifiedReward 2.0 Qwen 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB