GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
BA
bahasa-4b-v2
Bahasa · mradermacher
Params3.95B
Context32K
Q4_K_M2.5 GB
TU
allenai_tulu-2-dpo-13b
Tulu · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
KE
KernelLLM
Kernelllm · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
MI
Minitron 8B Base
Minitron · legraphista
Params8.27B
Context4K
Smallest3.6 GB
QW
MARTHA LXVIII.21b_QWEN 3.5 3.6_prune_27b 3.6_base
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
MA
Magicoder S DS 6.7B
Magicoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
HA
Hathor_Stable-v0.2-L3-8B
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Swift Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
YI
Yi 6B
Yi · TheBloke
Params6.06B
Context4K
Q4_K_M3.7 GB
QW
Qwen Qwen2.5 Coder 14B Instruct
Qwen · sigmanih
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
ThinkingCap Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ST
stable code 3b
Stable · QuantFactory
Params2.8B
Context16K
Q4_K_M1.7 GB
LL
Meta-Llama-3-8B-Instruct
Llama · duyntnet
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.8 Flash Next
Qwen · python-jo
Params177B
Context256K
Q4_K_M1.9 GB
LF
LFM2.5 24B A2B
Lfm · richardyoung
Params24B
Context128K
Q4_K_M14.5 GB
QW
Spark X2.5 4B Therapy InterleavedThink Qwen38FlashNext MiniMaxM3 GLM5.3 ZCode SFT8K MultiDPO v3h
Qwen · denjhang
Params4.1B
Context1024K
Q4_K_M2.6 GB
MI
SlimHercules-4.0-Mistral-7B-v0.2
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3_1 Nemotron 51B Instruct
Llama · ymcki
Params51.5B
Context128K
Q4_K_M31.0 GB
YI
Capybara Tess Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
IQ
IQuest Coder V1 40B Instruct
Iquest · AaryanK
Params39.8B
Context128K
Q4_K_M24.0 GB
IN
InternLM2
InternLM · mradermacher
Params7.74B
Context256K
Q4_K_M4.7 GB
QW
Arch Router
Qwen · katanemo
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
meta-llama-13b
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LL
Meta Llama 3 70B Instruct
Llama · QuantFactory
Params70.6B
Context8K
Q4_K_M42.5 GB
AI
Airoboros L2 7b Gpt4 M2.0
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
DR
Drex v2.0
Drex · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
NE
ThinkingCap NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
QW
Qwen1.5-110B-Chat
Qwen · second-state
Params111B
Context32K
Q4_K_M67.2 GB
MY
Mythomax L2 13b Q4 K M
Mythomax · Clevyby
Params13B
Context4K
Q4_K_M8.1 GB
LT
Nz LTX25 weights
Ltx · Rootport
Params21B
Context—
Smallest14.7 GB