GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek OCR 2
DeepSeek · SandLogicTechnologies
Params2.93B
Context8K
Smallest1.4 GB
GGUF
AT
Atomight V2.2 UltraThink 0.5B
Atomight · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
ReasoningTool use
QW
SmaliLLM Qwen2.5 Coder 0.5B Instruct Finetuned
Qwen · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
CodingTool use
AC
AceSearcher 14B
Acesearcher · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
LL
4yo1 llama3 eng ko 8 llama
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OR
Ornith-1.5-397B
Ornith · vultr
Params396B
Context256K
Q4_K_M264.4 GB
ReasoningTool useVision
DE
DeepSeek V4 Flash Vision Uncensored
DeepSeek · orcarouter
Params284B
Context1024K
Smallest156.4 GB
ReasoningTool useVision
MI
miocodec v2 44k
Miocodec · cstr
Params132M
Context—
Smallest0.1 GB
GGUF
FA
VideoThinker R1 Bias 3B
Falcon · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
ReasoningVision
FU
FusionNet
Fusionnet · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
NE
Next2 0.8b
Next · thelamapi
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
OL
olmOCR 7B Thai v3
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
DU
Ai Dungeon Large En
Dungeon · mradermacher
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
QW
Kuvera 8B Qwen3 v0.2.1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
OR
Orbit
Orbit · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
OP
OpenResearcher 30B A3B
Openresearcher · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
GP
gpt2 open instruct v1 i1
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
KA
Karga DPO v0.1
Karga · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB
Tool use
MU
Murasaki APE Aligner 2B
Murasaki · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
HA
Harrier Oss v1 270m
Harrier · mykor
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
PH
Phi 4 Reasoning
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
KI
Kimi Dev 72B
Kimi · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
CodingTool use
RL
RLAnything Alf 7B
Rlanything · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
KI
Kimi K3 0.40B
Kimi · mradermacher
Params389M
Context4K
Q4_K_M0.3 GB
GGUF
QW
Majority Voting Qwen3 8B Base
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
SP
SpydazWebAI QuietStar Project i1
Spydazwebai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
SOLAR 10B Nector DPO Jawade
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GT
Gte Large Zh
Gte · mradermacher
Params324M
Context512
Q4_K_M0.2 GB
Embedding
LI
inclusionAI.Ling Coder Lite
Ling · DevQuasar-12
Params16.8B
Context4K
Q4_K_M11.2 GB
Coding
QW
Majority Voting Qwen3 8B Base DAPO14k
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use

Keep browsing