GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LL
llama nemotron embed 1b v2
Llama · sabafallah
Params1.24B
Context128K
Q4_K_M0.8 GB
YI
Yi 34B
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GE
Fallen Gemma3 4B v1
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
LF
LFM2.5 2.6B Tema_Q Abliterated
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
QW
Qwen3.8 Flash Next NVFP4
Qwen · magnitudedev
Params177B
Context256K
Smallest127.8 GB
DE
deepseek llm 67b chat i1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
ST
Step3 VL 10B
Step · seanbailey518
Params8.19B
Context64K
Q4_K_M5.0 GB
DE
deepseek-coder-1.3b-instruct
DeepSeek · duyntnet
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
nvidia.Llama 3 1 Nemotron Ultra 253B v1
Llama · DevQuasar-13
Params253B
Context128K
Q4_K_M150.9 GB
MI
Mistral Small 22B ArliAI RPMax v1.1
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
KI
Kimodo-G1-SEED-v1
Kimodo · LocalAI-io
Params284M
Context—
Smallest1.1 GB
MY
MythoMax L2 13b
Mythomax · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
LL
Llama3-18B-lingyang-v1
Llama · mradermacher
Params18.1B
Context1024K
Q4_K_M10.9 GB
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
OR
ddh0_orcamaid-v2-fix-13b-32k
Orcamaid · TheBloke
Params13B
Context32K
Q4_K_M7.9 GB
LT
LTX Video 0.9.6 dev
Ltx · city96
Params1.92B
Context—
Q4_K_M1.3 GB
GL
Glm 4 9b Chat 1m
GLM · bartowski
Params9.48B
Context1024K
Q4_K_M6.3 GB
DR
drama-3
Drama · Frosty40
Params—
Context—
Smallest24.3 GB
LL
Bio Medical Llama 3 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
RU
RusMind Vspyshka 4.7
Rusmind · DICPlay
Params7.52B
Context128K
Q4_K_M5.3 GB
BO
Borealis 12b
Borealis · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
MI
adamo1139_mistral-7b-aezakmi-v1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 VL 72B Instruct Heretic
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
NE
Dory1.0 4B BF16 Llamacpp
Nemotron · cloudnathan5
Params3.98B
Context256K
Q4_K_M2.4 GB
LF
LFM3-Audio-2B
Lfm · AtomicChat
Params1.73B
Context125K
Q4_K_M1.1 GB
MY
MythoMax L2 13b i1
Mythomax · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
TE
migtissera_tess-m-v1.3
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
llama nemotron embed 1b v2
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
SH
Shisutemu Masuta Q3 32B
Shisutemu · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB