GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
ME
MediPhi Instruct
Mediphi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
GL
GLM-5.3-Flash
GLM · BioDec
Params321B
Context1024K
Smallest141.7 GB
MI
Blockrank Msmarco Mistral 7b
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
ZA
ZamAI LIama3 Pashto
Zamai · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
DO
Dots.Llm1.Inst
Dots · bartowski
Params143B
Context32K
Q4_K_M96.1 GB
QW
medc llm based on qwen2.5 i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
SP
SP3F 7B
mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
RI
Ring Lite 2506
Ring · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
LI
Ling Coder Lite
Ling · mradermacher
Params16.8B
Context4K
Q4_K_M11.2 GB
MA
Maple Preview
Maple · phantomic12
Params20.2B
Context128K
Smallest5.9 GB
CA
calme-2.1-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest31.8 GB
ON
onsets and frames
Onsets · cstr
Params27M
Context—
Smallest0.0 GB
VI
Mythos Nano Final
Vibethinker · Eu-sou
Params3.09B
Context128K
Q4_K_M1.9 GB
QW
Huihui Qwen3 30B A3B Abliterated Fusion 7030
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · rax4901
Params284B
Context1024K
Smallest3.8 GB
RL
RLVR 8B 0926
Rlvr · mradermacher
Params8.19B
Context320K
Q4_K_M5.0 GB
NU
NuExtract 1.5 Smol
Nuextract · bartowski
Params1.71B
Context8K
Q4_K_M1.1 GB
LL
Llama-3-8B-Instruct-80K-QLoRA-Merged
Llama · mradermacher
Params8.03B
Context80K
Q4_K_M4.9 GB
LL
KingNish Llama3 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
AD
AdaptThink 1.5B Delta0.1
Adaptthink · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
PH
Phi 3 mini 4k instruct Q4 K M
Phi · SixOpen
Params3.82B
Context4K
Q4_K_M4.8 GB
TI
TinyLlama 1.1B intermediate 1.5T PTBR Instruct v3 8k
Tinyllama · afrideva
Params1.1B
Context8K
Q4_K_M0.7 GB
SY
SynLogic Mix 3 32B
Synlogic · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
PH
Moxoff Phi3Mini ORPO i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
MA
MaticGPT
Maticgpt · erfanzar
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
VibeThinker 3B heretic
Qwen · zkxxxx
Params3.09B
Context128K
Q4_K_M1.9 GB
LL
LLaMAX3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
OR
Ornith 1.5 9B OBLITERATED
Ornith · minte1431
Params9.2B
Context256K
Q4_K_M5.8 GB