GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
LL
LLaMAX2-7B-MetaMath
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
HU
hyvid
Hunyuanvideo · calcuis
Params12.8B
Context—
Q4_K_M7.9 GB
NE
Next 1b
Next · mattritchey
Params1B
Context32K
Q4_K_M0.8 GB
OM
OmniDimen 2 20B Emotion
Omnidimen · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
PH
Phi 3 mini 128k instruct
Phi · mmnga
Params3.82B
Context128K
Q4_K_M2.4 GB
NO
Nous Capybara 7B
Nous · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
MA
tiger-lab_mammoth-coder-34b
Mammoth · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
DE
DeepSeek V4 Flash 0731 ROCmFP3
DeepSeek · Lucebox
Params284B
Context1024K
Smallest98.3 GB
DE
Deepseek-R1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB
RI
Ring Mini 2.0
Ring · inclusionAI
Params16.3B
Context32K
Q4_K_M9.9 GB
PH
Borea Phi 3.5 Mini Instruct Jp
Phi · mmnga
Params3.82B
Context128K
Q4_K_M2.4 GB
TO
ToolSpace 8B
Toolspace · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
OT
Other Test GGUFs
Other · ToastyPigeon
Params27.3B
Context256K
Smallest9.5 GB
PH
migtissera Tess v2.5 Phi 3 medium 128k 14B
Phi · RichardErkhov
Params14B
Context128K
Q4_K_M8.6 GB
ST
StructLM-7B
Structlm · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
SH
shisa v2.1 unphi4 14b
Shisa · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
CO
Concept 7b V1 Full
Concept · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
PH
calme-2.1-phi3.5-4b
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
Lebanese Llama 3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
OR
Ornith 1.5 35B A3B BigBang MTP
Ornith · EryriLabs
Params1.86B
Context256K
Q4_K_M21.2 GB
DE
DeepPresenter 9B
Deeppresenter · Forceless
Params8.95B
Context256K
Q4_K_M5.6 GB
CH
Chocolatine 14B Instruct DPO v1.1 i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
CY
BaronLLM Offensive Security abliterated
Cybersecurity · huihui-ai
Params8B
Context—
Smallest6.6 GB
OP
OpenResearcher 30B A3B
Openresearcher · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · second-state
Params1.78B
Context128K
Q4_K_M1.1 GB
FU
functionary small v3.2
Functionary · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
JP
jpacifico Chocolatine 14B Instruct DPO v1.2
Jpacifico · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
DE
DeepSeek-V4-Flash-DSpark-Drafter
DeepSeek · alessandrobologna
Params19.8B
Context—
Smallest7.0 GB
SK
SkinTokens TokenRig
Skintokens · LocalAI-io
Params29M
Context—
Smallest0.1 GB