GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
UM
CENTAURUS Components v2
Uma · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 9B Chinese Chat Uncensored
Gemma · fengpeisheng1
Params9.24B
Context8K
Smallest5.4 GB
Coding
GL
THUDM/GLM-4-9B-0414
GLM · DevQuasar-12
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
DE
DeepSeek-R1-Distill-Qwen-32B
DeepSeek · Mungert
Params32.8B
Context128K
Q4_K_M20.1 GB
ReasoningTool use
NU
NuExtract tiny Resume Data Extractor
Nuextract · nimendraai
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
KA
KaLM Embedding Multilingual Mini Instruct v1.5
Kalm · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
Embedding
OC
OceanGPT Basic 30B A3B Instruct
Oceangpt · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Tool use
OC
OceanGPT-14B-v0.1
Oceangpt · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
TI
stories converted
Tinyllamas · shibatch
Params24M
Context128
Smallest0.0 GB
GGUF
TH
Thau Agi v2
Thau · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
CE
Celune 1.7B Neutral
Celune · mradermacher
Params1.73B
Context32K
Q4_K_M1.0 GB
Vision
LU
Luna 7B A4B PaperWitch Heresy
Luna · mradermacher
Params6.71B
Context256K
Q4_K_M4.1 GB
ReasoningRoleplayTool use
LC
LCARS AI StarTrek Computer
Lcars · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
SA
SAM3DBody cpp onnx models
Sam · AmmarkoV
Params7M
Context—
Smallest0.0 GB
GGUF
OP
OptiMind SFT
Optimind · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
QW
micro-qwen4exp-realqsa-mtp
Qwen · Lynxpda
Params207M
Context256K
Q4_K_M0.1 GB
Vision
QW
Qwen2.5 7B ARPO
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
MO
sapienzanlp_modello-italia-9b
Modello · fbaldassarri
Params8.54B
Context4K
Q4_K_M5.5 GB
GGUF
NU
NuExtract 2.0 4B
Nuextract · numind
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
LL
GlotMAX 101 14B
Llama · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
OR
RegesCore 1.0 9B
Ornith · iBossonline
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
DE
Deepseek R1 14b Cot Math Reasoning Full
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
GL
Huihui GLM 4.5V Abliterated
GLM · mradermacher
Params107B
Context64K
Q4_K_M70.4 GB
ReasoningTool use
QW
Noor ul ilm 7B Qwen 15 3 2026
Qwen · OpenNoorIlm
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
BI
BioMistral Clinical 7B
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
TimeCapsuleLLM v2 llama 1.2B
Llama · ncky
Params1.15B
Context2K
Q4_K_M0.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B 3MPER0RR Abliterated
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
LI
Ling Lite 1.5 2506
Ling · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
Reasoning
GL
GLM-5.2 EXTENSOR Q2_K Experts v1
GLM · amd
Params743B
Context1024K
Smallest258.5 GB
ReasoningTool use
QW
Parm 2 CoT 14B 16k o1 QwQ i1
Qwen · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
CodingReasoning

Keep browsing