GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
DE
DeepSeek OCR 2
DeepSeek · SandLogicTechnologies
Params2.93B
Context8K
Smallest1.4 GB
AT
Atomight V2.2 UltraThink 0.5B
Atomight · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
QW
SmaliLLM Qwen2.5 Coder 0.5B Instruct Finetuned
Qwen · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
AC
AceSearcher 14B
Acesearcher · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
4yo1 llama3 eng ko 8 llama
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
OR
Ornith-1.5-397B
Ornith · vultr
Params396B
Context256K
Q4_K_M264.4 GB
DE
DeepSeek V4 Flash Vision Uncensored
DeepSeek · orcarouter
Params284B
Context1024K
Smallest156.4 GB
MI
miocodec v2 44k
Miocodec · cstr
Params132M
Context—
Smallest0.1 GB
FA
VideoThinker R1 Bias 3B
Falcon · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
FU
FusionNet
Fusionnet · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
NE
Next2 0.8b
Next · thelamapi
Params752M
Context256K
Q4_K_M0.5 GB
OL
olmOCR 7B Thai v3
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
DU
Ai Dungeon Large En
Dungeon · mradermacher
Params1.56B
Context1K
Q4_K_M1.1 GB
QW
Kuvera 8B Qwen3 v0.2.1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
OR
Orbit
Orbit · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
OP
OpenResearcher 30B A3B
Openresearcher · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
GP
gpt2 open instruct v1 i1
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
KA
Karga DPO v0.1
Karga · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB
MU
Murasaki APE Aligner 2B
Murasaki · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
HA
Harrier Oss v1 270m
Harrier · mykor
Params268M
Context32K
Q4_K_M0.3 GB
PH
Phi 4 Reasoning
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
KI
Kimi Dev 72B
Kimi · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
RL
RLAnything Alf 7B
Rlanything · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
KI
Kimi K3 0.40B
Kimi · mradermacher
Params389M
Context4K
Q4_K_M0.3 GB
QW
Majority Voting Qwen3 8B Base
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
SP
SpydazWebAI QuietStar Project i1
Spydazwebai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
SOLAR 10B Nector DPO Jawade
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GT
Gte Large Zh
Gte · mradermacher
Params324M
Context512
Q4_K_M0.2 GB
LI
inclusionAI.Ling Coder Lite
Ling · DevQuasar-12
Params16.8B
Context4K
Q4_K_M11.2 GB
QW
Majority Voting Qwen3 8B Base DAPO14k
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB