GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
FI
Firefly v4
Firefly · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
TA
TableLLM 13b
Tablellm · duyntnet
Params13B
Context16K
Q4_K_M7.9 GB
SE
SeaLLMs v3 1.5B
Seallms · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
LF
LFM2 ColBERT 350M
Lfm · LiquidAI
Params353M
Context125K
Q4_K_M0.2 GB
LF
LFM2 1.2B RAG
Lfm · QuantFactory
Params1.3B
Context125K
Q4_K_M0.8 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · second-state
Params8.89B
Context1024K
Q4_K_M6.5 GB
LF
LFM3 VL 2B Surgical Abliterated
Lfm · medismera
Params1.73B
Context125K
Q4_K_M1.1 GB
LF
LFM3-1.7B-uncensored-abl48
Lfm · rSalone
Params1.73B
Context256K
Q4_K_M1.1 GB
BA
bagel 8b v1.0
Bagel · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LF
LFM2.5 8B A1B Heretic
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
LL
Meta-Llama-3-70B-Instruct
Llama · qwp4w3hyb
Params70.6B
Context8K
Q4_K_M42.5 GB
NE
Nekomata 7b Pfn Qfin
Nekomata · RichardErkhov
Params7.72B
Context32K
Q4_K_M4.9 GB
NE
Nemotron Cascade 2 30B A3B Heretic Ara Uncensored
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
QW
Qwen2-72B-Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest22.7 GB
CI
Cicikus v3 1.4B
Cicikus · mradermacher
Params1.36B
Context128K
Q4_K_M0.9 GB
NA
Narwhal-7b-v3
Narwhal · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
models--google--gemma-2b-it
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
TR
Trinity Nano Preview
Trinity · mradermacher
Params6.12B
Context128K
Q4_K_M3.8 GB
RE
ReasonFlux F1 7B i1
Reasonflux · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
MU
Glimmer 30B 2026 Knowledge
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
ER
Eris Daturamix 7b v2 GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-SauerkrautLM-8b-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 8B Instruct
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Latxa Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.8 Flash Next ROCmFP4 FAST
Qwen · kingjones777
Params177B
Context256K
Smallest94.4 GB
SE
Sekhmet_Aleph L3.1 8B v0.1
Sekhmet · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
IN
InternVL2_5 78B MPO
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
QVQ 72B Preview
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
AF
AfriqueQwen 14B Fact Full
Afriqueqwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB