GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
HU
Huihui LFM2 24B A2B Abliterated
Huihui · mradermacher
Params23.8B
Context125K
Q4_K_M14.4 GB
GGUF
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Embedding
MI
miqu 1 103b i1
Miqu · mradermacher
Params103B
Context32K
Smallest22.0 GB
GGUF
OR
Orca 2 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PA
Pantheon Rp Pure 1.6.2 22b Small
Pantheon · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
Roleplay
QW
Qwen Image 2.1
Qwen · azukivc
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
QW
Qwen1.5-0.5B-Chat
Qwen · second-state
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
LL
llm compiler 13b
Llm · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
Meta Llama 3 70B Instruct 64k i1
Llama · mradermacher
Params70.6B
Context64K
Q4_K_M42.5 GB
GGUF
FA
Falcon3 1B Instruct Abliterated
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
DE
deepseek llm 67b base i1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
ME
MedASR
Medasr · handy-computer
Params105M
Context—
Q4_K_M0.1 GB
GGUF
IS
Ising Calibration 1.5 31B
Ising · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
KI
Kimi-K2-Instruct-0905
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
GGUF
LI
sd3.5 lite
Lite · calcuis
Params2.47B
Context—
Q4_K_M1.8 GB
GGUF
EX
EXAONE Deep 2.4B
Exaone · bartowski
Params2.41B
Context32K
Q4_K_M1.5 GB
GGUF
DU
Dusk-Miqu-70B
Dusk · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
QW
Minecraftism 4B Thinking Uncensored
Qwen · mr-sus
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
YI
brucethemoose_caplattessdolxaboros-yi-34b-200k-dare-ties-highdensity
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
HU
hyvid i2v
Hunyuanvideo · calcuis
Params123M
Context—
Q4_K_M7.7 GB
GGUF
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · Edmon02
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
MI
MiniMaxAI_MiniMax M2.5
Minimax · lmstudio-community
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · tiiuae
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
RU
RusMind.Моментум 3.2
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
LT
ltx2
Ltx · gguf-org
Params11.8B
Context128K
Smallest4.8 GB
GGUF
YI
ehartford_dolphin-2.2-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen1.5-14B-Chat-AWQ-fp16
Qwen · Qwen
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
RU
RusMind 4.5.5 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Smallest9.3 GB
ReasoningTool use
DA
Dart Math Dsmath 7b Prop2Diff
Dart · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
CY
Cydonia 22B v1
Cydonia · TheDrummer
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF

Keep browsing