GGUF models by Lucy-in-the-Sky

265 GGUF models quantized by Lucy-in-the-Sky on Hugging Face. Sizes run from 494M to 46.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
.\BlackSheep
Qwen · Lucy-in-the-Sky
Params14.8B
Context128K
Smallest15.7 GB
Tool use
MI
Mistral Small 24B Instruct 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest25.1 GB
Reasoning
MI
Mistral Nemo Base 2407
Mistral · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
CO
C4Ai Command R 08 2024
Command R · Lucy-in-the-Sky
Params32.3B
Context128K
Smallest26.5 GB
GGUF
DE
DeepSeek V2 Lite Q6 K
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest14.1 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest8.9 GB
GGUF
GE
Gemma Evo 10B Q3 K M
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Smallest4.8 GB
GGUF
BU
BuddyGlassNeverSleeps methheadmethod v0.2 Q6 K
Buddyglassneversleeps · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest6.6 GB
Tool use
GR
Granite 3.1 8b Instruct
Granite · Lucy-in-the-Sky
Params8.17B
Context128K
Smallest8.7 GB
Tool use
SY
SystemGemma2 27b It
Systemgemma · Lucy-in-the-Sky
Params27.2B
Context32K
Smallest10.4 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · Lucy-in-the-Sky
Params494M
Context32K
Smallest0.5 GB
Tool use
LL
BlackSheep Llama3.2 3B
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
DE
Deepseek Math 7b Instruct
DeepSeek · Lucy-in-the-Sky
Params6.91B
Context4K
Smallest7.3 GB
GGUF
OL
OLMo 2 0325 32B Instruct Q4 K M
OLMo · Lucy-in-the-Sky
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
DE
DeepSeek-R1-Distill-Qwen-1.5B-DPO
DeepSeek · Lucy-in-the-Sky
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
BU
BuddyGlassNeverSleeps Q6 K
Buddyglassneversleeps · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest6.6 GB
Tool use
GE
Gemma 9B Chat Q8 0
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Smallest9.8 GB
GGUF
AY
Aya Expanse 8b
Aya · Lucy-in-the-Sky
Params8.03B
Context8K
Smallest3.4 GB
GGUF
QW
QwQ 32B Preview
Qwen · Lucy-in-the-Sky
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSWE Preview
Deepswe · Lucy-in-the-Sky
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
QW
.\BlackSheep
Qwen · Lucy-in-the-Sky
Params14.8B
Context128K
Smallest12.1 GB
Tool use
MI
Sage Ft Mixtral 8x7b
Mistral · Lucy-in-the-Sky
Params46.7B
Context32K
Smallest22.5 GB
GGUF
GE
Gemma Evo 10B Q2 K
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Smallest3.8 GB
GGUF
ET
EtherealAurora 12B
Etherealaurora · Lucy-in-the-Sky
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
BA
BADMISTRAL 1.5B Q8 0
Badmistral · Lucy-in-the-Sky
Params1.55B
Context8K
Smallest1.7 GB
GGUF
VI
Virtuoso Small v2
Virtuoso · Lucy-in-the-Sky
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
DE
Deepseek Moe 16b Chat
DeepSeek · Lucy-in-the-Sky
Params16.4B
Context4K
Smallest8.5 GB
GGUF
CO
C4Ai Command R 08 2024
Command R · Lucy-in-the-Sky
Params32.3B
Context128K
Smallest12.8 GB
GGUF
OP
Zephyr 7b Beta
Opeai · Lucy-in-the-Sky
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.2 3B Overthinker Q6 K
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Smallest2.6 GB
Reasoning

Keep browsing