GGUF models by Lucy-in-the-Sky
265 GGUF models quantized by Lucy-in-the-Sky on Hugging Face. Sizes run from 494M to 46.7B parameters. The longest trained context is 1000K tokens.
LL
Skywork O1 Open Llama3.1 8B
Llama · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest8.5 GB
MI
Mistral Small 24B Base 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest19.3 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · Lucy-in-the-Sky
Params14.8B
Context32K
Smallest5.8 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · Lucy-in-the-Sky
Params1.78B
Context128K
Smallest1.9 GB
DE
deepthought 8b abliterated Q8 0
Deepthought · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest8.5 GB
BU
BuddyGlassNeverSleeps methheadmethod v0.2 Q4 K M
Buddyglassneversleeps · Lucy-in-the-Sky
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Deep Reasoning Llama 3.2 Overthinker 3B Q4 K M
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.2 3B Instruct Abliterated
Llama · Lucy-in-the-Sky
Params3.61B
Context128K
Smallest3.8 GB
QW
Qwen2.5 3B Instruct
Qwen · Lucy-in-the-Sky
Params3.09B
Context32K
Smallest3.3 GB
CO
C4Ai Command R7B 12 2024
Command R · Lucy-in-the-Sky
Params8.03B
Context8K
Q4_K_M5.1 GB
DE
DeepSeek V2 Lite Chat
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Q4_K_M10.4 GB
CO
C4Ai Command R7B 12 2024
Command R · Lucy-in-the-Sky
Params8.03B
Context8K
Smallest3.4 GB
MI
Ministral 8B Instruct 2410
Mistral · Lucy-in-the-Sky
Params8.02B
Context32K
Q4_K_M4.9 GB
PY
Pygmalion 2 13b
Pygmalion · Lucy-in-the-Sky
Params13B
Context4K
Smallest4.9 GB
CO
C4Ai Command R v01
Command R · Lucy-in-the-Sky
Params35B
Context128K
Smallest37.2 GB
CE
MN 12B Celeste V1.9 Q2 K
Celeste · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest4.8 GB
GE
Gemma 2 Ataraxy v4d 9B Q4 K M
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Q4_K_M5.8 GB
DA
DAN L3 R1 8B
Dan · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest6.6 GB
OL
olmOCR 7B 0225 Preview
OLMo · Lucy-in-the-Sky
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
Mistral Small 24B Instruct 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest25.1 GB
CH
Chronos Hermes 13b v2
Chronos · Lucy-in-the-Sky
Params13B
Context4K
Smallest4.9 GB
AR
Arcee Blitz
Arcee · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest19.3 GB
VI
Virtuoso Lite
Virtuoso · Lucy-in-the-Sky
Params10.3B
Context32K
Smallest11.0 GB
AY
Aya Expanse 8b
Aya · Lucy-in-the-Sky
Params8.03B
Context8K
Smallest8.5 GB
MI
Mistral Small 24B Base 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest16.8 GB
VI
Virtuoso Small v2
Virtuoso · Lucy-in-the-Sky
Params14.8B
Context128K
Smallest5.8 GB
MI
Mistral Small 24B Instruct 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest19.3 GB
LL
Llama 3.1 Tulu 3 8B abliterated Q8 0
Llama · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest8.5 GB
MI
Mistral Nemo Instruct 2407
Mistral · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest4.8 GB
GR
Granite 3.1 8b Instruct
Granite · Lucy-in-the-Sky
Params8.17B
Context128K
Smallest6.7 GB