GGUF models by Lucy-in-the-Sky

265 GGUF models quantized by Lucy-in-the-Sky on Hugging Face. Sizes run from 494M to 46.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
HE
NSFW 3B Q6 K
Helvete · Lucy-in-the-Sky
Params2.8B
Context4K
Smallest2.3 GB
GGUF
DE
UncensoredLM DeepSeek R1 Distill Qwen 14B Q4 K M
DeepSeek · Lucy-in-the-Sky
Params14.2B
Context128K
Q4_K_M8.6 GB
ReasoningTool use
CO
C4Ai Command R v01
Command R · Lucy-in-the-Sky
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
CO
C4Ai Command R 08 2024
Command R · Lucy-in-the-Sky
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
XO
XortronCriminalComputingConfig
Xortroncriminalcomputingconfig · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest16.8 GB
GGUF
PH
Phi 4 Abliterated
Phi · Lucy-in-the-Sky
Params14.7B
Context16K
Smallest5.5 GB
GGUF
QW
Josiefied Qwen2.5 7B Instruct Abliterated v2
Qwen · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest8.1 GB
Tool use
OL
OLMo 2 0325 32B
OLMo · Lucy-in-the-Sky
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
SW
SWE Dev 7B
Swe · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest8.1 GB
Tool use
GR
Granite 3.1 2b Instruct
Granite · Lucy-in-the-Sky
Params2.53B
Context128K
Smallest2.7 GB
Tool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · Lucy-in-the-Sky
Params14.8B
Context128K
Smallest5.8 GB
ReasoningTool use
DE
DeepSeek V2 Lite
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · Lucy-in-the-Sky
Params1.54B
Context32K
Smallest1.6 GB
Tool use
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest16.7 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest8.9 GB
Reasoning
BE
Bellatrix Tiny 0.5B
Bellatrix · Lucy-in-the-Sky
Params494M
Context32K
Smallest0.5 GB
Tool use
TA
UI TARS 1.5 7B
Tars · Lucy-in-the-Sky
Params7.62B
Context125K
Smallest8.1 GB
Tool useVision
DA
Darkest muse v1 Q4 K M
Darkest · Lucy-in-the-Sky
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
IN
INTELLECT 1 Fp32
Intellect · Lucy-in-the-Sky
Params10.2B
Context8K
Smallest4.0 GB
GGUF
BL
BlackSheep RP 12B
Blacksheep · Lucy-in-the-Sky
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
DE
DeepSeek V2 Lite Chat
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest16.7 GB
GGUF
LU
Lumimaid v0.2 12B Q4 K M
Lumimaid · Lucy-in-the-Sky
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 Math 1.5B Instruct
Qwen · Lucy-in-the-Sky
Params1.54B
Context4K
Smallest1.6 GB
Tool use
DE
DeepSeek V2 Lite
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest6.4 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct
Qwen · Lucy-in-the-Sky
Params32.8B
Context32K
Smallest26.9 GB
CodingTool use
DE
Deepseek Moe 16b Base
DeepSeek · Lucy-in-the-Sky
Params16.4B
Context4K
Smallest6.7 GB
GGUF
GE
Gemma 3 27b It Abliterated
Gemma · Lucy-in-the-Sky
Params27B
Context128K
Smallest22.2 GB
Vision
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · Lucy-in-the-Sky
Params14.8B
Context32K
Smallest12.1 GB
Tool use
BU
BuddyGlassNeverSleeps methheadmethod v0.2 Q8 0
Buddyglassneversleeps · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest8.5 GB
Tool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · Lucy-in-the-Sky
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use

Keep browsing