GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
FI
Firefly v4
Firefly · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningRoleplayTool use
TA
TableLLM 13b
Tablellm · duyntnet
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
SE
SeaLLMs v3 1.5B
Seallms · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
LF
LFM2 ColBERT 350M
Lfm · LiquidAI
Params353M
Context125K
Q4_K_M0.2 GB
EmbeddingTool use
LF
LFM2 1.2B RAG
Lfm · QuantFactory
Params1.3B
Context125K
Q4_K_M0.8 GB
GGUF
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · second-state
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
LF
LFM3 VL 2B Surgical Abliterated
Lfm · medismera
Params1.73B
Context125K
Q4_K_M1.1 GB
CodingReasoningTool use
LF
LFM3-1.7B-uncensored-abl48
Lfm · rSalone
Params1.73B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
BA
bagel 8b v1.0
Bagel · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingRoleplayTool use
LF
LFM2.5 8B A1B Heretic
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
CodingReasoningTool use
LL
Meta-Llama-3-70B-Instruct
Llama · qwp4w3hyb
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
NE
Nekomata 7b Pfn Qfin
Nekomata · RichardErkhov
Params7.72B
Context32K
Q4_K_M4.9 GB
GGUF
NE
Nemotron Cascade 2 30B A3B Heretic Ara Uncensored
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
QW
Qwen2-72B-Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest22.7 GB
GGUF
CI
Cicikus v3 1.4B
Cicikus · mradermacher
Params1.36B
Context128K
Q4_K_M0.9 GB
Reasoning
NA
Narwhal-7b-v3
Narwhal · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
models--google--gemma-2b-it
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
TR
Trinity Nano Preview
Trinity · mradermacher
Params6.12B
Context128K
Q4_K_M3.8 GB
Tool use
RE
ReasonFlux F1 7B i1
Reasonflux · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
MU
Glimmer 30B 2026 Knowledge
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
ReasoningTool use
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Roleplay
ER
Eris Daturamix 7b v2 GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
Llama-3-SauerkrautLM-8b-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Latxa Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.8 Flash Next ROCmFP4 FAST
Qwen · kingjones777
Params177B
Context256K
Smallest94.4 GB
ReasoningTool use
SE
Sekhmet_Aleph L3.1 8B v0.1
Sekhmet · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
IN
InternVL2_5 78B MPO
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool use
QW
QVQ 72B Preview
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
GGUF
AF
AfriqueQwen 14B Fact Full
Afriqueqwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use

Keep browsing