GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mmnga
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
CO
Condor 27B
Condor · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
NO
CodeRankLLM
Nomic · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
CodingTool use
FI
Fine R1 7B
Fine · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
DE
Deathlegion Junior AI
Deathlegion · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 UNCENSORED Q8 0
DeepSeek · Adolphsson
Params748B
Context1024K
Smallest508.0 GB
GGUF
QW
SmaliLLM Qwen3 0.6B Finetuned
Qwen · mradermacher
Params752M
Context40K
Q4_K_M0.5 GB
CodingReasoningTool use
MI
mistral 7b sft beta i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 4B RPG Roleplay V2
Qwen · Zlatiik
Params4.02B
Context32K
Q4_K_M2.5 GB
Roleplay
QW
SvS Qwen 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
PH
Phi 4 Mini Reasoning Abliterated
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
UN
unlimited-ocr-2
Unlimited · cstr
Params3.34B
Context—
Smallest3.6 GB
GGUF
PH
Phi 4 ReasoningRP i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
CE
CeluneNorm 0.6B v2.0 Ctx2048
Celunenorm · mradermacher
Params596M
Context2K
Q4_K_M0.4 GB
GGUF
QW
UnifiedReward Flex Qwen3Vl 32b
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Tool useVision
QW
PositiveDetox Qwen3 4B
Qwen · theprint
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
AE
Aeon 360M
Aeon · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
UL
Ulam 1 Small
Ulam · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
ReasoningTool use
QW
Qwen3 Next 256E Abliterated Instruct
Qwen · mradermacher
Params41B
Context256K
Q4_K_M25.0 GB
Tool use
HO
Hormoz
Hormoz · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
OR
Ornith-1.5-35B
Ornith · mistrjirka
Params35.5B
Context256K
Smallest6.9 GB
ReasoningTool use
LI
Ling 3.0 Flash VL
Ling · mradermacher
Params124B
Context128K
Q4_K_M75.3 GB
ReasoningTool useVision
SY
SynLogic 7B
Synlogic · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
SW
Swe Oec 7b
Swe · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
SE
Seed Coder 8B Base
Seed · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
Coding
LL
Meta Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RL
rlve opd teacher R1Distill 058 MaxDifferentGroupPairDivision 20261025
Rlve · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool useVision
QW
GAD GPT 5 Chat Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use

Keep browsing