GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mmnga
Params7.62B
Context128K
Q4_K_M4.7 GB
CO
Condor 27B
Condor · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
NO
CodeRankLLM
Nomic · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
FI
Fine R1 7B
Fine · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
DE
Deathlegion Junior AI
Deathlegion · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek V4.1 Flash 1017 UNCENSORED Q8 0
DeepSeek · Adolphsson
Params748B
Context1024K
Smallest508.0 GB
QW
SmaliLLM Qwen3 0.6B Finetuned
Qwen · mradermacher
Params752M
Context40K
Q4_K_M0.5 GB
MI
mistral 7b sft beta i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 4B RPG Roleplay V2
Qwen · Zlatiik
Params4.02B
Context32K
Q4_K_M2.5 GB
QW
SvS Qwen 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
PH
Phi 4 Mini Reasoning Abliterated
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
UN
unlimited-ocr-2
Unlimited · cstr
Params3.34B
Context—
Smallest3.6 GB
PH
Phi 4 ReasoningRP i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
CE
CeluneNorm 0.6B v2.0 Ctx2048
Celunenorm · mradermacher
Params596M
Context2K
Q4_K_M0.4 GB
QW
UnifiedReward Flex Qwen3Vl 32b
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
PositiveDetox Qwen3 4B
Qwen · theprint
Params4.02B
Context256K
Q4_K_M2.5 GB
AE
Aeon 360M
Aeon · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
UL
Ulam 1 Small
Ulam · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
QW
Qwen3 Next 256E Abliterated Instruct
Qwen · mradermacher
Params41B
Context256K
Q4_K_M25.0 GB
HO
Hormoz
Hormoz · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
OR
Ornith-1.5-35B
Ornith · mistrjirka
Params35.5B
Context256K
Smallest6.9 GB
LI
Ling 3.0 Flash VL
Ling · mradermacher
Params124B
Context128K
Q4_K_M75.3 GB
SY
SynLogic 7B
Synlogic · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
SW
Swe Oec 7b
Swe · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
SE
Seed Coder 8B Base
Seed · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
LL
Meta Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
RL
rlve opd teacher R1Distill 058 MaxDifferentGroupPairDivision 20261025
Rlve · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
GAD GPT 5 Chat Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB