GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
NU
NuExtract tiny
Nuextract · mradermacher
Params464M
Context32K
Q4_K_M0.3 GB
GGUF
VI
ImageQuality R1 v1
Visualquality · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningTool use
RL
rlve opd teacher R1Distill 004 Path NoGoingBack Counting 20261025
Rlve · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
AD
AdaptThink 7B delta0.05
Adaptthink · tinyopsec
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
GL
THUDM/GLM-4-32B-Base-0414
GLM · DevQuasar-12
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
QW
Qwen SEA LION v4 8B VL
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
UnifiedReward Think Qwen3Vl 4b
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool useVision
GL
GLM 5.3 Flash GM E32
GLM · cgg507
Params321B
Context1024K
Q4_K_M207.4 GB
ReasoningRoleplayTool use
OH
Ohm MythosNano
Ohm · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoningTool use
LI
Ling 3.0 tiny MXFP4 MOE
Ling · noctrex
Params7.89B
Context128K
Smallest4.9 GB
ReasoningTool use
GU
GUI Actor Verifier 2B
Gui · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
GG
ggml CLIP ViT B 32 laion2B s34B b79K
Ggml · mys
Params151M
Context—
Smallest0.0 GB
GGUF
IN
InternVL2_5 1B
Internvl · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
CodingTool useVision
TI
ModelCloud Tinyllama 15M Stories
Tinyllama · tensorblock
Params15M
Context256
Smallest0.0 GB
GGUF
GL
GLM 4.7 Flash Ultimate Uncensored Heretic
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
PH
Phi 3 Mini 128k Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
QU
quantum circuit qubo 3B
Quantum · mradermacher
Params3.4B
Context32K
Q4_K_M2.1 GB
Tool use
LI
Ling flash 2.0 i1
Ling · mradermacher
Params103B
Context32K
Smallest0.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · DuoNeural
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
GE
Gemma 2 2B Indian Law i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
CobrIX 1.0 Coder Full 72B A18B
Qwythos · CobrIX
Params71.8B
Context1024K
Q4_K_M43.7 GB
Coding
RE
RealSafe R1 32B
Realsafe · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
QW
Majority Voting Qwen3 4B Base
Qwen · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
ReasoningTool use
SU
SuperDeepseek V4 Flash abliterated IK
Superdeepseek · KeinNiemand
Params284B
Context1024K
Smallest65.4 GB
GGUF
PH
Moxoff Phi3Mini DPO i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 mini ITA i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
NE
Next 70b
Next · thelamapi
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
GL
GLM 4.6 Derestricted
GLM · mradermacher
Params357B
Context198K
Smallest130.0 GB
ReasoningTool use
DE
DeepSeek-R1-Distill-Qwen-7B
DeepSeek · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
ReasoningTool use
LL
GAD GPT 5 Chat Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing