GGUF models by Lucy-in-the-Sky

265 GGUF models quantized by Lucy-in-the-Sky on Hugging Face. Sizes run from 494M to 46.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
XO
XortronUncensored 4 20 2025
Xortronuncensored · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest19.3 GB
GGUF
BL
BlackSheep RP 12B
Blacksheep · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest4.8 GB
Roleplay
CH
MN Chthonia 12B Q4 K M
Chthonia · Lucy-in-the-Sky
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
QW
QwQ 32B Preview
Qwen · Lucy-in-the-Sky
Params32.8B
Context32K
Smallest12.3 GB
ReasoningTool use
BA
BADMISTRAL 1.5B Q4 K M
Badmistral · Lucy-in-the-Sky
Params1.55B
Context8K
Q4_K_M0.9 GB
GGUF
OL
olmOCR 7B 0225 Preview
OLMo · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest8.1 GB
GGUF
GE
gemma-3-4b-it-codeforces-SFT
Gemma · Lucy-in-the-Sky
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
LL
Deep Reasoning Llama 3.2 Overthinker 3B Q6 K
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Smallest2.6 GB
Reasoning
DE
DeepScaleR 1.5B Preview
Deepscaler · Lucy-in-the-Sky
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
VI
Virtuoso Lite
Virtuoso · Lucy-in-the-Sky
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
VI
Virtuoso Lite
Virtuoso · Lucy-in-the-Sky
Params10.3B
Context32K
Smallest3.9 GB
Tool use
LU
Lumimaid v0.2 12B Q8 0
Lumimaid · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
VI
Virtuoso Lite
Virtuoso · Lucy-in-the-Sky
Params10.3B
Context32K
Smallest8.5 GB
Tool use
IN
INTELLECT 1 Instruct
Intellect · Lucy-in-the-Sky
Params10.2B
Context8K
Smallest4.0 GB
Coding
MI
Mistral Small 24B Base 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest25.1 GB
GGUF
AY
Aya Expanse 32b
Aya · Lucy-in-the-Sky
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · Lucy-in-the-Sky
Params8.19B
Context128K
Smallest8.7 GB
ReasoningTool use
LL
Llama 3.2 3B Overthinker Q8 0
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Smallest3.4 GB
Reasoning
QW
.\BlackSheep
Qwen · Lucy-in-the-Sky
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
MI
Mistral Small 24B Instruct 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
SW
SWE Dev 7B
Swe · Lucy-in-the-Sky
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
BU
BuddyGlassNeverSleeps Q4 K M
Buddyglassneversleeps · Lucy-in-the-Sky
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Ministral 8B Instruct 2410
Mistral · Lucy-in-the-Sky
Params8.02B
Context32K
Smallest3.2 GB
Tool use
MI
Mistral Nemo Instruct 2407
Mistral · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest10.1 GB
Tool use
PH
Phi 3 Mini 128k Instruct
Phi · Lucy-in-the-Sky
Params3.82B
Context128K
Smallest4.1 GB
Coding
AY
Aya 23 8B
Aya · Lucy-in-the-Sky
Params8.03B
Context8K
Smallest3.4 GB
GGUF
LU
Lumimaid v0.2 12B Q2 K
Lumimaid · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
LL
BlackSheep Llama3.2 3B
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Smallest2.6 GB
Tool use
LL
Dolphin 3.0 Llama 3.2 3B
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
IN
INTELLECT 2
Intellect · Lucy-in-the-Sky
Params32.8B
Context40K
Smallest26.9 GB
ReasoningTool use

Keep browsing