GGUF models by Lucy-in-the-Sky
265 GGUF models quantized by Lucy-in-the-Sky on Hugging Face. Sizes run from 494M to 46.7B parameters. The longest trained context is 1000K tokens.
DE
UncensoredLM DeepSeek R1 Distill Qwen 14B Q6 K
DeepSeek · Lucy-in-the-Sky
Params14.2B
Context128K
Smallest11.7 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · Lucy-in-the-Sky
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2.5 3B Instruct
Qwen · Lucy-in-the-Sky
Params3.09B
Context32K
Smallest2.5 GB
BL
BlackSheep RP 12B
Blacksheep · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest10.1 GB
DE
Deepseek Moe 16b Base
DeepSeek · Lucy-in-the-Sky
Params16.4B
Context4K
Smallest17.4 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · Lucy-in-the-Sky
Params14.8B
Context128K
Smallest12.1 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · Lucy-in-the-Sky
Params3.09B
Context32K
Smallest2.2 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · Lucy-in-the-Sky
Params14.8B
Context128K
Smallest15.7 GB
QW
Qwen2.5 Coder 32B Instruct Abliterated
Qwen · Lucy-in-the-Sky
Params32.8B
Context32K
Smallest12.3 GB
CO
C4Ai Command R7B 12 2024
Command R · Lucy-in-the-Sky
Params8.03B
Context8K
Smallest4.0 GB
GR
Granite 3.1 2b Instruct
Granite · Lucy-in-the-Sky
Params2.53B
Context128K
Q4_K_M1.5 GB
AY
Aya 23 35B
Aya · Lucy-in-the-Sky
Params35B
Context8K
Smallest13.8 GB
MI
Mistral Nemo Base 2407
Mistral · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest10.1 GB
AY
Aya Expanse 32b
Aya · Lucy-in-the-Sky
Params32.3B
Context8K
Smallest34.3 GB
HE
NSFW 3B Q8 0
Helvete · Lucy-in-the-Sky
Params2.8B
Context4K
Smallest3.0 GB
DA
DAN L3 R1 8B
Dan · Lucy-in-the-Sky
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · Lucy-in-the-Sky
Params3.09B
Context32K
Smallest3.3 GB
GR
Granite 3.1 2b Instruct
Granite · Lucy-in-the-Sky
Params2.53B
Context128K
Smallest2.1 GB
DA
DAN L3 R1 8B
Dan · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest8.5 GB
DE
DeepSeek V2 Lite
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest16.7 GB
LL
Llama 3.2 3B Instruct Abliterated
Llama · Lucy-in-the-Sky
Params3.61B
Context128K
Smallest3.0 GB
XO
XortronCriminalComputingConfig
Xortroncriminalcomputingconfig · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest8.9 GB
GE
Gemma 3 27b It Abliterated
Gemma · Lucy-in-the-Sky
Params27B
Context128K
Q4_K_M16.5 GB
XO
XortronCriminalComputingConfig
Xortroncriminalcomputingconfig · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest25.1 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · Lucy-in-the-Sky
Params1.78B
Context128K
Smallest1.3 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · Lucy-in-the-Sky
Params7.62B
Context986K
Smallest8.1 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest8.9 GB
NS
NSFW flash Q6 K
Nsfw · Lucy-in-the-Sky
Params2.24B
Context4K
Smallest1.8 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · Lucy-in-the-Sky
Params32.8B
Context32K
Smallest12.3 GB
OL
olmOCR 7B 0225 Preview
OLMo · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest3.0 GB