GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
LLaDA 8B Base
Llada · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
GGUF
LL
SimNPO WMDP llama3 8b
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Heretic
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
SP
Spark 1.5B ScienceWorld
Spark · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
Tool use
GP
Gpt Nyc Small
Gpt · mradermacher
Params125M
Context1K
Q4_K_M0.1 GB
GGUF
QW
Qwen2.5 7B Instruct Fs1 2708
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
FA
FastContext 1.0 4B SFT
Fastcontext · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
AU
authormist originality i1
Authormist · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
BI
Biomni R0 32B Preview
Biomni · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
CodingReasoningTool use
PH
Phi 3.5 MoE Instruct
Phi · second-state
Params41.9B
Context128K
Q4_K_M25.3 GB
Coding
WH
When2Think 1.5B
When · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
MM
mmBERT Base
Mmbert · mykor
Params307M
Context8K
Q4_K_M0.2 GB
GGUF
PH
phi 3 mini 4k instruct.Q4 0
Phi · Jaward
Params3.82B
Context4K
Smallest2.2 GB
Coding
AT
Atlas Flash 1.5B Preview
Atlas · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
QW
Self Certainty Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
ZE
Zephyr 7b Sft Full SPIN Iter0
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HU
Cyber Tiel Coder 35B A3B
Huihui · ArkhAngelLifeJiggy
Params34.7B
Context256K
Q4_K_M22.1 GB
CodingReasoningTool use
GL
GLM 4.7 Flash Ilograph
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
CO
CodeNinja 1.0 OpenChat 7B i1
Codeninja · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
QW
Qwerus 7B
Qwerus · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
LI
Ling Coder Lite Base
Ling · mradermacher
Params16.8B
Context4K
Q4_K_M11.2 GB
Coding
DE
Model Deepseek Ai DeepSeek R1 Distill Qwen 1.5B Cache
DeepSeek · Alcoft
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
PH
Phi 4 Mini Reasoning Heretic
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
LL
Cakrawala Llama 3.1 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
PI
PIPer 8B RL Only
Piper · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
LL
LLaDA 8B Instruct
Llada · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
GGUF
MI
Mistroll 7B v2.2 i1
Mistroll · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MM
MMaDA 8B MixCoT
Mmada · mradermacher
Params8.08B
Context4K
Q4_K_M5.0 GB
GGUF
OR
Orsta 7B
Orsta · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
BG
bge-base-zh-v1.5
BGE · CompendiumLabs
Params102M
Context512
Q4_K_M0.1 GB
Embedding

Keep browsing