GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 2B Claude Opus 4.6 High Resoning Base
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
RA
rank zephyr 7b v1 full
Rank · tinyopsec
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
QW
Self Certainty Qwen3 8B Base
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
IN
InnoSpark VPC RM 32B
Innospark · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
JI
JiRackUltra_32b
Jirackultra · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
LI
Ling Coder Lite
Ling · mradermacher
Params16.8B
Context4K
Q4_K_M11.2 GB
Coding
SA
SashaSheykina gpt2 finetuned cXg nl to code
Sashasheykina · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
Coding
QW
Qwen 0.6b Coder
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
CodingReasoningTool use
NA
Minnow OCR 1B
Nano · mradermacher
Params891M
Context128K
Q4_K_M0.5 GB
ReasoningTool useVision
PH
Phi 4 Empathetic i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
Phi 3 Mini 4k Grammar Correction
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
VI
Vision DeepResearch 8B
Vision · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
PositiveDetox Qwen2.5 14B
Qwen · theprint
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
GL
GLM 5.3 Flash
GLM · ZHUOZA
Params321B
Context1024K
Smallest104.9 GB
ReasoningTool useVision
VI
VibeThinker 3B
Vibethinker · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoningTool use
ZE
Zenith 3B
Zenith · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
EL
elephant 1
Elephant · magnitudedev
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
GR
Groot 280B A16B 261023
Groot · GrootTeam
Params477B
Context1024K
Smallest8.5 GB
GGUF
TY
Type o1 mini instruct
Type · kd13
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QW
Es Qwen Math Base 7b 3k Stage2 6k T4 Ds_O2_Aug Kl0.01 Step480
Qwen · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
ReasoningTool use
MI
StructLM 7B Mistral
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
deepsex 34b
Deepsex · TriadParty
Params34.4B
Context4K
Smallest19.5 GB
Coding
QW
Qwen3 Next 416E Abliterated Instruct
Qwen · mradermacher
Params65.2B
Context256K
Q4_K_M39.7 GB
Tool use
SE
SeaLLMs v3 1.5B Chat Uncensored
Seallms · BlossomsAI
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
MY
Myth 4B
Myth · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool use
DE
tngtech.DeepSeek TNG R1T2 Chimera BF16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
Tool use
NO
Noor Fatima 01 gpt2 finetuned summary
Noor · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
QW
Qwen2 VL PRISM DPO
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
RE
ReasonFlux PRM 1.5B
Reasonflux · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
Tool use

Keep browsing