GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LI
lightblue reranker 0.5 bin filt
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
RA
raspberry 3B
Raspberry · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CA
Catmind 1.2b
Catmind · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
LF
LFM2.5 24B A2B
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
QW
Sakura Qwen Image 2.1 Turbo
Qwen · webmp3
Params7.12B
Context—
Q4_K_M4.1 GB
WI
WizardLM 7B Uncensored
Wizardlm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GE
Gemma 3 TAIDE 12b Chat 2602
Gemma · audreyt
Params13.2B
Context128K
Q4_K_M8.2 GB
BO
Borealis 4b
Borealis · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
MI
openbmb MiniCPM5 2B MLX GGUF F16
MiniCPM · sigmanih
Params2.52B
Context128K
Smallest5.0 GB
LL
Meta-Llama-3-120B-Instruct
Llama · bartowski
Params122B
Context8K
Q4_K_M73.2 GB
LL
Llama3 stanford encyclopedia philosophy QA i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
Satella-30B-A3B
Satella · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
GR
Grug 12B
Grug · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
LF
LFM2 350M Extract
Lfm · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
MY
MythoLogic L2 13b i1
Mythologic · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
TW
Twilight-Miqu-146B
Twilight · mradermacher
Params146B
Context32K
Smallest30.6 GB
PH
phi 2 uncensored
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
QW
Qwen1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
FA
Models Tiiuae Falcon3 10B Instruct
Falcon · MaziyarPanahi
Params10.3B
Context32K
Smallest7.1 GB
MI
Minecraftism 4B Uncensored
Minecraftism · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
WH
WhiteRabbitNeo 7B v1.5a
Whiterabbitneo · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
KA
Kanana 2 30B A3B Instruct
Kanana · ohora23
Params30.7B
Context32K
Q4_K_M18.6 GB
LF
LFM2.5 24B A2B
Lfm · prithivMLmods
Params24B
Context128K
Q4_K_M14.5 GB
BO
Borealis 1b
Borealis · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
QW
ru it vacancy extractor qwen3 1.7b
Qwen · alekseevpavel04
Params1.72B
Context40K
Q4_K_M1.1 GB
OP
openthaigpt1.5 7b instruct i1
Openthaigpt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
IC
IceLatteRP-7b
Icelatterp · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Swift Qwen3.8 27b Terse Coder
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CO
C4Ai Command R7B 12 2024
Command R · duyntnet
Params8.03B
Context8K
Q4_K_M5.1 GB
PO
Poppy_Porpoise-1.4-L3-8B
Poppy · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB