GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
JE
Jeff_Geema
Jeff · arunb74
Params4.63B
Context128K
Q4_K_M3.4 GB
LF
LFM2.5 2.6B
Lfm · lmstudio-community
Params2.7B
Context125K
Q4_K_M1.7 GB
NE
Nemostein 3 Nano Omni 30b A3B
Nemostein · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
HO
HOT Step CPP PP VAE
Hot · scragnog
Params169M
Context—
Smallest0.3 GB
MA
magnum 32b v1
Magnum · bartowski
Params32.5B
Context32K
Q4_K_M19.7 GB
OP
OpenCoder 1.5B Base
Opencoder · mradermacher
Params1.91B
Context4K
Q4_K_M1.4 GB
OL
OLMo-1.7-7B-hf
OLMo · duyntnet
Params6.89B
Context4K
Q4_K_M4.2 GB
VI
Vistral-7B-Chat
Vistral · duyntnet
Params7.29B
Context32K
Q4_K_M4.4 GB
FO
foundation 1
Foundation · thepatch
Params1.06B
Context—
Q4_K_M0.1 GB
MI
MiniMax M2.5
Minimax · mradermacher
Params229B
Context192K
Q4_K_M138.3 GB
NE
NVIDIA-Nemotron-Nano-12B-v2
Nemotron · Mungert
Params12.3B
Context1024K
Q4_K_M7.9 GB
EP
calderaai_30b-epsilon
Epsilon · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
OR
orca mini v3 13B
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AP
Apollo V0.1 4B Thinking
Apollo · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
BL
Blue-Orchid-2x7b
Blue · duyntnet
Params12.9B
Context8K
Q4_K_M7.8 GB
CH
chujiezheng tulu 2 dpo 13b ExPO
Chujiezheng · RichardErkhov
Params13B
Context8K
Q4_K_M7.9 GB
ME
Google.Medgemma 4b It
Medgemma · DevQuasar
Params3.88B
Context128K
Q4_K_M2.5 GB
MO
Moonshine Tiny (Japanese)
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
QW
Qwen2.5 VL 7B Surg CholecT50
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
UN
UNfilteredAI-1B
Unfilteredai · mradermacher
Params1.06B
Context2K
Q4_K_M0.6 GB
GU
timdettmers_guanaco-65b
Guanaco · TheBloke
Params65.3B
Context2K
Q4_K_M39.3 GB
LF
LFM2.5 350M
Lfm · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
LF
LFM2.5 8B A1B
Lfm · Mungert
Params8.47B
Context125K
Smallest0.0 GB
ID
IdeaLens
Idealens · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
FA
Falcon3 7B Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
LL
Llama 3 Instruct 8B SPPO Iter3 imatrix
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Yi 6B 200K Llama
Llama · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB
KI
MythoMax L2 Kimiko v2 13b imatrix
Kimi · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
MI
cerebras/MiniMax-M2-REAP-139B-A10B
Minimax · DevQuasar
Params139B
Context192K
Q4_K_M84.2 GB
QW
Qwen3.5 27B Marvin V2 Stage4 Antirep DPO
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB