GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama nemotron embed 1b v2
Llama · sabafallah
Params1.24B
Context128K
Q4_K_M0.8 GB
Embedding
YI
Yi 34B
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
GE
Fallen Gemma3 4B v1
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
LF
LFM2.5 2.6B Tema_Q Abliterated
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
GGUF
QW
Qwen3.8 Flash Next NVFP4
Qwen · magnitudedev
Params177B
Context256K
Smallest127.8 GB
ReasoningTool useVision
DE
deepseek llm 67b chat i1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
ST
Step3 VL 10B
Step · seanbailey518
Params8.19B
Context64K
Q4_K_M5.0 GB
Vision
DE
deepseek-coder-1.3b-instruct
DeepSeek · duyntnet
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
LL
nvidia.Llama 3 1 Nemotron Ultra 253B v1
Llama · DevQuasar-13
Params253B
Context128K
Q4_K_M150.9 GB
GGUF
MI
Mistral Small 22B ArliAI RPMax v1.1
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
KI
Kimodo-G1-SEED-v1
Kimodo · LocalAI-io
Params284M
Context—
Smallest1.1 GB
GGUF
MY
MythoMax L2 13b
Mythomax · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
LL
Llama3-18B-lingyang-v1
Llama · mradermacher
Params18.1B
Context1024K
Q4_K_M10.9 GB
GGUF
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
OR
ddh0_orcamaid-v2-fix-13b-32k
Orcamaid · TheBloke
Params13B
Context32K
Q4_K_M7.9 GB
GGUF
LT
LTX Video 0.9.6 dev
Ltx · city96
Params1.92B
Context—
Q4_K_M1.3 GB
GGUF
GL
Glm 4 9b Chat 1m
GLM · bartowski
Params9.48B
Context1024K
Q4_K_M6.3 GB
GGUF
DR
drama-3
Drama · Frosty40
Params—
Context—
Smallest24.3 GB
GGUF
LL
Bio Medical Llama 3 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
RU
RusMind Vspyshka 4.7
Rusmind · DICPlay
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
BO
Borealis 12b
Borealis · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
MI
adamo1139_mistral-7b-aezakmi-v1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 VL 72B Instruct Heretic
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
CodingVision
NE
Dory1.0 4B BF16 Llamacpp
Nemotron · cloudnathan5
Params3.98B
Context256K
Q4_K_M2.4 GB
GGUF
LF
LFM3-Audio-2B
Lfm · AtomicChat
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
MY
MythoMax L2 13b i1
Mythomax · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
TE
migtissera_tess-m-v1.3
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
LL
llama nemotron embed 1b v2
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Embedding
SH
Shisutemu Masuta Q3 32B
Shisutemu · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF

Keep browsing