GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
BE
Behemoth 123B v1
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
NO
Nous Hermes 2 SUS Chat 34B Slerp
Nous · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
ME
adaptllm_medicine-llm-13b
Medicine · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LL
Llama 3 Open Ko 8B
Llama · LiteLLMs
Params8B
Context8K
Q4_K_M4.9 GB
CO
codegeex4-all-9b
Codegeex · zai-org
Params9.4B
Context128K
Q4_K_M6.3 GB
YI
dragon yi 6B v0
Yi · TheBloke
Params6.06B
Context4K
Q4_K_M3.7 GB
MI
MiniMax-M3.1-Flash
Minimax · AMAImedia
Params426B
Context1024K
Q4_K_M258.1 GB
CH
CHEETAH 350M Merged
Cheetah · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
DE
Deepseek Coder 1.3b Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
QW
Swift 1.5 Qwen3.8 Flash Next MTP for GGUF and NVFP4
Qwen · adriandj3
Params2.61B
Context256K
Smallest2.8 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · legraphista
Params8.41B
Context8K
Smallest2.1 GB
EX
EXAONE Deep 7.8B
Exaone · bartowski
Params7.8B
Context32K
Q4_K_M4.8 GB
FA
Falcon-H1-7B-Instruct
Falcon · unsloth
Params7.59B
Context256K
Q4_K_M4.6 GB
FL
Flux2 Klein 9b Uncensored Text Encoder
Flux · QiE2035
Params8.19B
Context40K
Smallest3.3 GB
LL
Llama 3 Open Ko 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
EX
EXAONE Deep 32B
Exaone · bartowski
Params32B
Context32K
Q4_K_M19.3 GB
QW
ThinkingCap Qwen3.8 27B Uncensored Heretic
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.5 GB
FA
Falcon H1 Tiny Tool Calling 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB
IS
Ising Calibration 1 35B A3B
Ising · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LF
LFM2 24B A2B
Lfm · NexaAI
Params23.8B
Context125K
Q4_K_M14.4 GB
QW
Qwen Image 2.1 PE T2I
Qwen · Moseyanling
Params8.95B
Context256K
Q4_K_M5.6 GB
FA
Falcon3 7B Instruct Heretic
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FU
Fun-ASR-MLT-Nano-2512
Fun · cstr
Params985M
Context—
Smallest0.9 GB
QW
Qwen3.5 27B Marvin DPO V2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen2 VL 72B Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
HO
Holotron4 30B A3B
Holotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
YI
brucethemoose_yi-34b-200k-dare-merge-v5
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
IN
Internlm2 Math Plus 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · duyntnet
Params1.54B
Context32K
Q4_K_M1.0 GB
FO
Foundation Sec 1.1 8B Instruct
Foundation · mradermacher
Params8.03B
Context64K
Q4_K_M4.9 GB