GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
BE
Behemoth 123B v1
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
NO
Nous Hermes 2 SUS Chat 34B Slerp
Nous · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
ME
adaptllm_medicine-llm-13b
Medicine · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Llama 3 Open Ko 8B
Llama · LiteLLMs
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CO
codegeex4-all-9b
Codegeex · zai-org
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
YI
dragon yi 6B v0
Yi · TheBloke
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
MI
MiniMax-M3.1-Flash
Minimax · AMAImedia
Params426B
Context1024K
Q4_K_M258.1 GB
GGUF
CH
CHEETAH 350M Merged
Cheetah · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
DE
Deepseek Coder 1.3b Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
QW
Swift 1.5 Qwen3.8 Flash Next MTP for GGUF and NVFP4
Qwen · adriandj3
Params2.61B
Context256K
Smallest2.8 GB
ReasoningTool use
MI
Mistral NeMo Minitron 8B Base
Mistral · legraphista
Params8.41B
Context8K
Smallest2.1 GB
GGUF
EX
EXAONE Deep 7.8B
Exaone · bartowski
Params7.8B
Context32K
Q4_K_M4.8 GB
GGUF
FA
Falcon-H1-7B-Instruct
Falcon · unsloth
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
FL
Flux2 Klein 9b Uncensored Text Encoder
Flux · QiE2035
Params8.19B
Context40K
Smallest3.3 GB
Coding
LL
Llama 3 Open Ko 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
EX
EXAONE Deep 32B
Exaone · bartowski
Params32B
Context32K
Q4_K_M19.3 GB
GGUF
QW
ThinkingCap Qwen3.8 27B Uncensored Heretic
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
FA
Falcon H1 Tiny Tool Calling 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB
Tool use
IS
Ising Calibration 1 35B A3B
Ising · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
LF
LFM2 24B A2B
Lfm · NexaAI
Params23.8B
Context125K
Q4_K_M14.4 GB
GGUF
QW
Qwen Image 2.1 PE T2I
Qwen · Moseyanling
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
FA
Falcon3 7B Instruct Heretic
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FU
Fun-ASR-MLT-Nano-2512
Fun · cstr
Params985M
Context—
Smallest0.9 GB
GGUF
QW
Qwen3.5 27B Marvin DPO V2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
QW
Qwen2 VL 72B Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Vision
HO
Holotron4 30B A3B
Holotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
GGUF
YI
brucethemoose_yi-34b-200k-dare-merge-v5
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
IN
Internlm2 Math Plus 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · duyntnet
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
FO
Foundation Sec 1.1 8B Instruct
Foundation · mradermacher
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF

Keep browsing