GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
Mew1 2.6B
Mew · mradermacher
Params2.7B
Context125K
Q4_K_M1.7 GB
ReasoningRoleplayTool use
PA
Palette RP 1.2B Instruct 2609 v0.5
Palette · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
RoleplayTool use
LL
Llama 3 Ko 8B Instruct
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AP
Apollo 1 4B
Apollo · mradermacher
Params4.02B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
LF
lfm3 vld 2b multipass
Lfm · webbrain-one
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
AN
TheDrummer Anubis Pro 105B v1
Anubis · bartowski
Params105B
Context128K
Q4_K_M63.0 GB
Tool use
YI
Platypus Yi 34b
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
SQ
sqlcoder2
Sqlcoder · TheBloke
Params15.8B
Context8K
Q4_K_M10.0 GB
Coding
FA
Falcon3 7B Base
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
VI
Virtuoso Large
Virtuoso · arcee-ai
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
CO
Confucius R2t2 Comfy
Confucius · t8star
Params1.72B
Context64K
Smallest1.8 GB
Vision
LL
Einstein-v6.1-Llama3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
MI
MiniMax M3
Minimax · AesSedai
Params426B
Context1024K
Q4_K_M264.3 GB
ReasoningTool useVision
CU
CursorCore DS 1.3B LC i1
Cursorcore · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
HU
Hunyuan A13B Instruct
Hunyuan · gabriellarson
Params80.4B
Context256K
Q4_K_M48.8 GB
ReasoningTool use
HU
Huihui LFM2.5 1.2B Thinking Abliterated
Huihui · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
CH
Chat_Noir
Chat · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LL
Meta-Llama-3-8B
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AG
Agentic 30B A3B
Agentic · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
ReasoningTool use
GL
glm-4-9b-chat
GLM · second-state
Params9.4B
Context128K
Q4_K_M6.3 GB
CodingTool use
CO
Code 290k 6.7B Instruct
Code · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
Einstein-v4-Qwen-1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
CodingTool use
MI
Mistral Small Instruct 2409
Mistral · legraphista
Params22.2B
Context128K
Smallest4.8 GB
Tool use
HA
Hathor_Unstable-L3-8B-v0.3
Hathor · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HE
HelpingAI flash
Helpingai · QuantFactory
Params2.24B
Context4K
Q4_K_M1.4 GB
GGUF
NE
Neural una cybertron 7b imatrix
Neural · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TR
Trinity Nano Base
Trinity · mradermacher
Params6.12B
Context128K
Q4_K_M3.8 GB
Tool use
QW
Qwen 72B
Qwen · mradermacher
Params72.3B
Context32K
Q4_K_M45.1 GB
GGUF
LL
Llama-3-Open-Ko-8B-Instruct-preview
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
magnum 32b v1
Magnum · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF

Keep browsing