GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
GLM 4.7 Flash REAP 39
GLM · mradermacher
Params19.1B
Context198K
Q4_K_M11.6 GB
CodingTool use
FL
Florence 2 base
Florence · antflydb
Params232M
Context—
Smallest0.1 GB
GGUF
MI
MistralPrism 24B
Mistral · Aratako
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
QW
Qwen3.8 27B DFlash drafter bootstrap
Qwen · mrchuy
Params1.73B
Context256K
Smallest1.8 GB
GGUF
LI
Ling-1T
Ling · unsloth
Params1000B
Context32K
Q4_K_M604.7 GB
GGUF
AS
astrollama 3 8b base summary
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
PH
Phi 3 song lyrics 1.0
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 medium 4k instruct IMat
Phi · legraphista
Params14B
Context4K
Smallest3.0 GB
GGUF
TO
ToolCUA 8B
Toolcua · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
Tool use
TO
ToriiGate 0.5
Toriigate · SleepVeryHard
Params4.84B
Context—
Smallest0.0 GB
GGUF
PH
phi 3 22b 128k
Phi · mradermacher
Params22B
Context128K
Q4_K_M13.6 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · cybe42
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
BE
Beck 8B
Beck · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
LL
LightGPT 7B Llama2
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
CH
Chimpgpt Coder Elite
Chimpgpt · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
CodingReasoningTool use
LL
LightGPT 13B Llama2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PH
Phi 3 Medium 4k Instruct
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PR
Prompt Refine
Prompt · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
BL
Q3.5 BlueStar v2 27B Ultra Uncensored Heretic v2
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
OR
Ornith 1.5 35B A3B FULLY OBLITERATED
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
UM
AQUILA Engine v1 i1
Uma · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
OR
Ornith 1.5 122B IQ3 XXS 16G64G
Ornith · zephel01
Params125B
Context256K
Smallest0.4 GB
GGUF
GL
GLM 4.7 Flash NEO CODE Imatrix MAX
GLM · DavidAU
Params30B
Context198K
Q4_K_M18.5 GB
CodingReasoning
LL
LightGPT 8B Llama3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
GL
GLM 4.7 Flash Heretic
GLM · bartowski
Params29.9B
Context198K
Q4_K_M18.5 GB
GGUF
MA
maple preview
Maple · stamsam
Params20.2B
Context128K
Q4_K_M12.3 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · Solstice-AI
Params748B
Context—
Q4_K_M444.7 GB
GGUF
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
QW
UnifiedReward 2.0 Qwen 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision

Keep browsing