GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
lightblue reranker 0.5 bin filt
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
EmbeddingTool use
RA
raspberry 3B
Raspberry · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
CA
Catmind 1.2b
Catmind · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
LF
LFM2.5 24B A2B
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
ReasoningTool use
QW
Sakura Qwen Image 2.1 Turbo
Qwen · webmp3
Params7.12B
Context—
Q4_K_M4.1 GB
GGUF
WI
WizardLM 7B Uncensored
Wizardlm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GE
Gemma 3 TAIDE 12b Chat 2602
Gemma · audreyt
Params13.2B
Context128K
Q4_K_M8.2 GB
GGUF
BO
Borealis 4b
Borealis · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
MI
openbmb MiniCPM5 2B MLX GGUF F16
MiniCPM · sigmanih
Params2.52B
Context128K
Smallest5.0 GB
ReasoningTool use
LL
Meta-Llama-3-120B-Instruct
Llama · bartowski
Params122B
Context8K
Q4_K_M73.2 GB
GGUF
LL
Llama3 stanford encyclopedia philosophy QA i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SA
Satella-30B-A3B
Satella · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
CodingReasoningTool use
GR
Grug 12B
Grug · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningTool use
LF
LFM2 350M Extract
Lfm · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
MY
MythoLogic L2 13b i1
Mythologic · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
TW
Twilight-Miqu-146B
Twilight · mradermacher
Params146B
Context32K
Smallest30.6 GB
GGUF
PH
phi 2 uncensored
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
QW
Qwen1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
FA
Models Tiiuae Falcon3 10B Instruct
Falcon · MaziyarPanahi
Params10.3B
Context32K
Smallest7.1 GB
GGUF
MI
Minecraftism 4B Uncensored
Minecraftism · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
WH
WhiteRabbitNeo 7B v1.5a
Whiterabbitneo · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
KA
Kanana 2 30B A3B Instruct
Kanana · ohora23
Params30.7B
Context32K
Q4_K_M18.6 GB
ReasoningTool use
LF
LFM2.5 24B A2B
Lfm · prithivMLmods
Params24B
Context128K
Q4_K_M14.5 GB
ReasoningTool use
BO
Borealis 1b
Borealis · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
QW
ru it vacancy extractor qwen3 1.7b
Qwen · alekseevpavel04
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
OP
openthaigpt1.5 7b instruct i1
Openthaigpt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
IC
IceLatteRP-7b
Icelatterp · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Swift Qwen3.8 27b Terse Coder
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningVision
CO
C4Ai Command R7B 12 2024
Command R · duyntnet
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
PO
Poppy_Porpoise-1.4-L3-8B
Poppy · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing