GGUF models by Lucy-in-the-Sky

265 GGUF models quantized by Lucy-in-the-Sky on Hugging Face. Sizes run from 494M to 46.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
.\BlackSheep
Qwen · Lucy-in-the-Sky
Params14.8B
Context128K
Smallest5.8 GB
Tool use
GE
Gemma 9B Chat Q4 K M
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mistral Small 24B Base 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest8.9 GB
GGUF
AY
Aya Expanse 32b
Aya · Lucy-in-the-Sky
Params32.3B
Context8K
Smallest12.8 GB
GGUF
CO
C4Ai Command R 08 2024
Command R · Lucy-in-the-Sky
Params32.3B
Context128K
Smallest34.3 GB
GGUF
GE
Gemma 2 Ataraxy v4d 9B Q8 0
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
Gemma 2 Ataraxy v4d 9B Q2 K
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Smallest3.8 GB
GGUF
BL
BlackSheep RP 12B
Blacksheep · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest13.0 GB
Roleplay
LL
Deep Reasoning Llama 3.2 Overthinker 3B Q8 0
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Smallest3.4 GB
Reasoning
OP
Zephyr 7b Beta
Opeai · Lucy-in-the-Sky
Params7.24B
Context32K
Smallest7.7 GB
GGUF
OP
Zephyr 7b Beta
Opeai · Lucy-in-the-Sky
Params7.24B
Context32K
Smallest5.9 GB
GGUF
XO
XortronUncensored 4 20 2025
Xortronuncensored · Lucy-in-the-Sky
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
DE
DeepSeek-R1-Distill-Qwen-1.5B-DPO
DeepSeek · Lucy-in-the-Sky
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
IN
INTELLECT 2
Intellect · Lucy-in-the-Sky
Params32.8B
Context40K
Q4_K_M19.9 GB
ReasoningTool use
ET
EtherealAurora 12B
Etherealaurora · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · Lucy-in-the-Sky
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
AR
Arcee Blitz
Arcee · Lucy-in-the-Sky
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LL
BlackSheep Llama3.2 3B
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Smallest3.4 GB
Tool use
CO
C4Ai Command R7B 12 2024
Command R · Lucy-in-the-Sky
Params8.03B
Context8K
Smallest8.5 GB
Tool use
GE
Gemma 2 Ataraxy v4d 9B Q6 K
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Smallest7.6 GB
GGUF
AR
Arcee Blitz
Arcee · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest25.1 GB
GGUF
BA
BADMISTRAL 1.5B Q6 K
Badmistral · Lucy-in-the-Sky
Params1.55B
Context8K
Smallest1.3 GB
GGUF
XO
XortronUncensored 4 20 2025
Xortronuncensored · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest25.1 GB
GGUF
CH
MN Chthonia 12B Q6 K
Chthonia · Lucy-in-the-Sky
Params12.2B
Context128K
Smallest10.1 GB
Tool use
DE
Deepseek Math 7b Instruct
DeepSeek · Lucy-in-the-Sky
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF

Keep browsing