GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
AS
Astrollama 3 8b Chat_Summary
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
NE
Neuraltranslate 27b Mt Nah Es v1
Neuraltranslate · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GL
GLM 4.7 Flash Derestricted
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
Roleplay
LL
NPO SAM WMDP llama3 8b instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CA
CalmeRys 78B Orpo v0.1 i1
Calmerys · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
CA
CAT Translate 7b
Cat · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
YI
yihao llm 7b i1
Yihao · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
GL
Glm-4.7-Flash
GLM · bloopez
Params30B
Context198K
Smallest59.9 GB
GGUF
MA
MAmmoTH2-8x7B
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Uncensored Reasoner
DeepSeek · h34v7
Params7.61B
Context128K
Q4_K_M4.7 GB
Reasoning
CH
Chatterbox TTS Persian
Chatterbox · mazrba
Params264M
Context—
Smallest0.4 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · tekosML
Params284B
Context1024K
Smallest86.7 GB
GGUF
OH
Ohm MythosNano
Ohm · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
Tool use
MA
MAmmoTH2 7B Plus
Mammoth · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YU
yulan-team_yulan-chat-2-13b-fp16
Yulan · TheBloke
Params13.2B
Context8K
Q4_K_M8.0 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B Uncensored v2
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
QW
LightGPT 7B Qwen2
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
DE
DeepSeek V4 Pro 0813
DeepSeek · qtum
Params1570B
Context—
Smallest1.7 GB
GGUF
QW
Qwen3 4B ORPO Advertisement
Qwen · yothinS
Params4B
Context40K
Smallest1.7 GB
GGUF
WA
WavTokenizer Large Speech 75token
Wavtokenizer · ggml-org
Params65M
Context8K
Smallest0.1 GB
GGUF
TI
Tiny LLM
Tiny · mradermacher
Params13M
Context1K
Q4_K_M0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · 6block
Params284B
Context—
Smallest10.9 GB
GGUF
CH
Chocolatine 14B Instruct 4k DPO
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
ST
starcoder2-15b-instruct-rpgle
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
Coding
OH
Ohm MythosHeretic
Ohm · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
Tool use
OR
Ornith 1.5 35B A3B 3MPER0RR Abliterated
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
LL
Llama Doctor 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
PH
Phi 4 Mini Instruct Abliterated
Phi · Melvin56
Params3.84B
Context128K
Q4_K_M2.5 GB
Coding

Keep browsing