GGUF models by Lucy-in-the-Sky
265 GGUF models quantized by Lucy-in-the-Sky on Hugging Face. Sizes run from 494M to 46.7B parameters. The longest trained context is 1000K tokens.
QW
.\BlackSheep
Qwen · Lucy-in-the-Sky
Params14.8B
Context128K
Smallest15.7 GB
MI
Mistral Small 24B Instruct 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest25.1 GB
MI
Mistral Nemo Base 2407
Mistral · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest4.8 GB
CO
C4Ai Command R 08 2024
Command R · Lucy-in-the-Sky
Params32.3B
Context128K
Smallest26.5 GB
DE
DeepSeek V2 Lite Q6 K
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest14.1 GB
MI
Mistral Small 24B Instruct 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest8.9 GB
GE
Gemma Evo 10B Q3 K M
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Smallest4.8 GB
BU
BuddyGlassNeverSleeps methheadmethod v0.2 Q6 K
Buddyglassneversleeps · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest6.6 GB
GR
Granite 3.1 8b Instruct
Granite · Lucy-in-the-Sky
Params8.17B
Context128K
Smallest8.7 GB
SY
SystemGemma2 27b It
Systemgemma · Lucy-in-the-Sky
Params27.2B
Context32K
Smallest10.4 GB
QW
Qwen2.5 0.5B Instruct
Qwen · Lucy-in-the-Sky
Params494M
Context32K
Smallest0.5 GB
LL
BlackSheep Llama3.2 3B
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Q4_K_M2.0 GB
DE
Deepseek Math 7b Instruct
DeepSeek · Lucy-in-the-Sky
Params6.91B
Context4K
Smallest7.3 GB
OL
OLMo 2 0325 32B Instruct Q4 K M
OLMo · Lucy-in-the-Sky
Params32.2B
Context4K
Q4_K_M19.5 GB
DE
DeepSeek-R1-Distill-Qwen-1.5B-DPO
DeepSeek · Lucy-in-the-Sky
Params1.78B
Context128K
Q4_K_M1.1 GB
BU
BuddyGlassNeverSleeps Q6 K
Buddyglassneversleeps · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest6.6 GB
GE
Gemma 9B Chat Q8 0
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Smallest9.8 GB
AY
Aya Expanse 8b
Aya · Lucy-in-the-Sky
Params8.03B
Context8K
Smallest3.4 GB
QW
QwQ 32B Preview
Qwen · Lucy-in-the-Sky
Params32.8B
Context32K
Q4_K_M19.9 GB
DE
DeepSWE Preview
Deepswe · Lucy-in-the-Sky
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
.\BlackSheep
Qwen · Lucy-in-the-Sky
Params14.8B
Context128K
Smallest12.1 GB
MI
Sage Ft Mixtral 8x7b
Mistral · Lucy-in-the-Sky
Params46.7B
Context32K
Smallest22.5 GB
GE
Gemma Evo 10B Q2 K
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Smallest3.8 GB
ET
EtherealAurora 12B
Etherealaurora · Lucy-in-the-Sky
Params12.2B
Context1000K
Q4_K_M7.5 GB
BA
BADMISTRAL 1.5B Q8 0
Badmistral · Lucy-in-the-Sky
Params1.55B
Context8K
Smallest1.7 GB
VI
Virtuoso Small v2
Virtuoso · Lucy-in-the-Sky
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
Deepseek Moe 16b Chat
DeepSeek · Lucy-in-the-Sky
Params16.4B
Context4K
Smallest8.5 GB
CO
C4Ai Command R 08 2024
Command R · Lucy-in-the-Sky
Params32.3B
Context128K
Smallest12.8 GB
OP
Zephyr 7b Beta
Opeai · Lucy-in-the-Sky
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.2 3B Overthinker Q6 K
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Smallest2.6 GB