GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
MI
Codestral 22B v0.1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
HU
hy3d
Hunyuan · calcuis
Params1.11B
Context—
Q4_K_M0.6 GB
LL
llama2 7b chat uncensored i1
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Llama3 DocChat 1.0 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.8-Flash-Next Q4-D6 (Q4 experts, ~6.2-bit dense)
Qwen · flaviodelgrosso
Params180B
Context256K
Smallest175.2 GB
LF
LFM3 1.7B
Lfm · ngquocvinh
Params1.73B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.8 Flash Next Heretic 2
Qwen · spiritfather
Params177B
Context256K
Smallest2.8 GB
MI
Midnight Miqu 103B v1.0 i1
Midnight · mradermacher
Params103B
Context32K
Smallest22.0 GB
OR
Orca2myth7.2
Orca · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
SQ
sqlcoder
Sqlcoder · TheBloke
Params15.8B
Context8K
Q4_K_M10.0 GB
LT
ltxv 13b 0.9.7 distilled
Ltx · ThePun1sher
Params13B
Context—
Q4_K_M8.8 GB
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
GR
Groot 65B A6B 261023
Groot · mradermacher
Params118B
Context256K
Q4_K_M79.7 GB
PL
lilloukas_platypus-30b
Platypus · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
LF
Lfm2-1.2B
Lfm · unsloth
Params1.17B
Context32K
Q4_K_M0.7 GB
LL
nvidia Llama 3 3 Nemotron Super 49B v1 5
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
QW
Qwen1.5 MoE A2.7B Chat
Qwen · duyntnet
Params14.3B
Context32K
Q4_K_M9.5 GB
ID
ideogram 4
Ideogram · molbal
Params9.28B
Context—
Smallest5.6 GB
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · bartowski
Params15.7B
Context160K
Q4_K_M10.4 GB
QW
Qwen3.8 Flash Next MTP
Qwen · Joakimpalm-Zen
Params3.88B
Context256K
Smallest4.2 GB
LF
LFM3 1.7B
Lfm · bartowski
Params1.73B
Context256K
Q4_K_M1.1 GB
QW
Qwen 3.8 flash next heretic 3.78bpw
Qwen · soyaakinohara
Params177B
Context256K
Smallest83.6 GB
IN
Internlm2_5 7b Chat 1m
InternLM · duyntnet
Params7.74B
Context256K
Q4_K_M4.7 GB
NE
NeuTTS Nano
Neutts · BricksDisplay
Params262M
Context2K
Q4_K_M0.2 GB
WI
WizardLM 30B Uncensored Guanaco SuperCOT 30b
Wizardlm · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
KU
Kuchiki 1.1 L2 7B
Kuchiki · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Katy 27B
Qwen · sirfyyn
Params1.92B
Context256K
Smallest0.0 GB
TU
sd turbo
Turbo · samoudi
Params1.3B
Context—
Smallest1.8 GB
LF
Lfm25 24b
Lfm · PollardWeights
Params24B
Context128K
Smallest5.8 GB
SC
ajibawa-2023_scarlett-7b
Scarlett · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB