GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
OR
Orsta 32B 0326
Orsta · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
PY
PyroNet mini i1
Pyronet · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest206.9 GB
ReasoningTool use
PH
Phi 4 Mini Instruct
Phi · TAKADOX
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
MI
Midm 2.0 Mini Instruct
Midm · mykor
Params2.31B
Context32K
Q4_K_M1.4 GB
Tool use
NE
NeuroBERT Mini
Neurobert · mradermacher
Params11M
Context512
Q4_K_M0.0 GB
Embedding
OC
OceanGPT Basic 30B A3B Thinking
Oceangpt · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
HA
Harrier Oss v1 0.6b
Harrier · lm-kit
Params596M
Context32K
Q4_K_M0.4 GB
ReasoningTool use
BA
e5-base-v2
Base · ChristianAzinn
Params109M
Context512
Q4_K_M0.1 GB
Embedding
GI
GIST Large Embedding v0
Gist · mradermacher
Params334M
Context512
Q4_K_M0.2 GB
Embedding
QW
Qwen2.5 Math 7B Think32k
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
SA
Sarashina2.2 Vision 3b
Sarashina · mradermacher
Params3.36B
Context8K
Q4_K_M2.1 GB
Vision
QW
Phi 4 QwQ i1
Qwen · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
QW
SmaliLLM Qwen2.5 Coder 0.5B Finetuned
Qwen · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
CodingTool use
GL
GLM 4.6V Flash
GLM · AaryanK
Params9.4B
Context128K
Q4_K_M6.2 GB
ReasoningTool useVision
RL
RLinf Math 1.5B
Rlinf · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
VP
VPPO 8B
Vppo · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
CH
Chocolatine Admin 3B SFT v0.3b i1
Chocolatine · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
QW
Qwen3-8B-DFlash-b16
Qwen · Anbeeld
Params1.05B
Context40K
Q4_K_M0.6 GB
CodingEmbeddingReasoning
IN
InternVL2 1B
Internvl · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
CodingVision
VI
VisualPRM 8B V1_1
Visualprm · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
CodingTool useVision
MM
MM R5
mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
AP
Apriel 1.6 15b Thinker Magic_beta Decensored
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningTool use
MI
Nexus IKM Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
MentaLLaMA Chat 7B
Mentallama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
OPRM RgFT 32B
Oprm · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
SV
SVILA 1 4B
Svila · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
Vision
DE
deepseek r1 distill qwen 1.5b
DeepSeek · cortexso
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
LA
Lattice Quark 1.5B SFT
Lattice · oli-mebberson
Params1.5B
Context2K
Q4_K_M0.9 GB
GGUF
CE
Cerebras OPT Fusion
Cerebras · mradermacher
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF

Keep browsing