GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
HU
Huihui LFM2 24B A2B Abliterated
Huihui · mradermacher
Params23.8B
Context125K
Q4_K_M14.4 GB
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
MI
miqu 1 103b i1
Miqu · mradermacher
Params103B
Context32K
Smallest22.0 GB
OR
Orca 2 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
PA
Pantheon Rp Pure 1.6.2 22b Small
Pantheon · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
QW
Qwen Image 2.1
Qwen · azukivc
Params7.12B
Context—
Q4_K_M4.6 GB
QW
Qwen1.5-0.5B-Chat
Qwen · second-state
Params620M
Context32K
Q4_K_M0.4 GB
LL
llm compiler 13b
Llm · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
LL
Meta Llama 3 70B Instruct 64k i1
Llama · mradermacher
Params70.6B
Context64K
Q4_K_M42.5 GB
FA
Falcon3 1B Instruct Abliterated
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
DE
deepseek llm 67b base i1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
ME
MedASR
Medasr · handy-computer
Params105M
Context—
Q4_K_M0.1 GB
IS
Ising Calibration 1.5 31B
Ising · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
KI
Kimi-K2-Instruct-0905
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
LI
sd3.5 lite
Lite · calcuis
Params2.47B
Context—
Q4_K_M1.8 GB
EX
EXAONE Deep 2.4B
Exaone · bartowski
Params2.41B
Context32K
Q4_K_M1.5 GB
DU
Dusk-Miqu-70B
Dusk · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
QW
Minecraftism 4B Thinking Uncensored
Qwen · mr-sus
Params4.02B
Context256K
Q4_K_M2.5 GB
YI
brucethemoose_caplattessdolxaboros-yi-34b-200k-dare-ties-highdensity
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
HU
hyvid i2v
Hunyuanvideo · calcuis
Params123M
Context—
Q4_K_M7.7 GB
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · Edmon02
Params6.91B
Context4K
Q4_K_M4.2 GB
MI
MiniMaxAI_MiniMax M2.5
Minimax · lmstudio-community
Params230B
Context192K
Q4_K_M138.3 GB
FA
Falcon3 7B Instruct
Falcon · tiiuae
Params7.46B
Context32K
Q4_K_M4.6 GB
RU
RusMind.Моментум 3.2
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB
LT
ltx2
Ltx · gguf-org
Params11.8B
Context128K
Smallest4.8 GB
YI
ehartford_dolphin-2.2-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen1.5-14B-Chat-AWQ-fp16
Qwen · Qwen
Params14.2B
Context32K
Q4_K_M9.2 GB
RU
RusMind 4.5.5 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Smallest9.3 GB
DA
Dart Math Dsmath 7b Prop2Diff
Dart · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
CY
Cydonia 22B v1
Cydonia · TheDrummer
Params22.2B
Context128K
Q4_K_M13.3 GB