GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
AS
Astrollama 3 8b Chat_Summary
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
NE
Neuraltranslate 27b Mt Nah Es v1
Neuraltranslate · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GL
GLM 4.7 Flash Derestricted
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
LL
NPO SAM WMDP llama3 8b instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CA
CalmeRys 78B Orpo v0.1 i1
Calmerys · mradermacher
Params78B
Context32K
Smallest24.3 GB
PH
Phi 3.5 Mini Instruct
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
CA
CAT Translate 7b
Cat · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
YI
yihao llm 7b i1
Yihao · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GL
Glm-4.7-Flash
GLM · bloopez
Params30B
Context198K
Smallest59.9 GB
MA
MAmmoTH2-8x7B
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
DE
DeepSeek R1 Distill Qwen 7B Uncensored Reasoner
DeepSeek · h34v7
Params7.61B
Context128K
Q4_K_M4.7 GB
CH
Chatterbox TTS Persian
Chatterbox · mazrba
Params264M
Context—
Smallest0.4 GB
DE
DeepSeek V4 Flash
DeepSeek · tekosML
Params284B
Context1024K
Smallest86.7 GB
OH
Ohm MythosNano
Ohm · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
MA
MAmmoTH2 7B Plus
Mammoth · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
YU
yulan-team_yulan-chat-2-13b-fp16
Yulan · TheBloke
Params13.2B
Context8K
Q4_K_M8.0 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored v2
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
LightGPT 7B Qwen2
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek V4 Pro 0813
DeepSeek · qtum
Params1570B
Context—
Smallest1.7 GB
QW
Qwen3 4B ORPO Advertisement
Qwen · yothinS
Params4B
Context40K
Smallest1.7 GB
WA
WavTokenizer Large Speech 75token
Wavtokenizer · ggml-org
Params65M
Context8K
Smallest0.1 GB
TI
Tiny LLM
Tiny · mradermacher
Params13M
Context1K
Q4_K_M0.0 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · 6block
Params284B
Context—
Smallest10.9 GB
CH
Chocolatine 14B Instruct 4k DPO
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
ST
starcoder2-15b-instruct-rpgle
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
OH
Ohm MythosHeretic
Ohm · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
OR
Ornith 1.5 35B A3B 3MPER0RR Abliterated
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Llama Doctor 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
PH
Phi 4 Mini Instruct Abliterated
Phi · Melvin56
Params3.84B
Context128K
Q4_K_M2.5 GB