GGUF models by Lucy-in-the-Sky
265 GGUF models quantized by Lucy-in-the-Sky on Hugging Face. Sizes run from 494M to 46.7B parameters. The longest trained context is 1000K tokens.
MI
Mistral Small 24B Base 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest11.5 GB
XO
XortronCriminalComputingConfig
Xortroncriminalcomputingconfig · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest11.5 GB
DE
UncensoredLM DeepSeek R1 Distill Qwen 14B Q8 0
DeepSeek · Lucy-in-the-Sky
Params14.2B
Context128K
Smallest15.1 GB
MI
Sage Ft Mixtral 8x7b
Mistral · Lucy-in-the-Sky
Params46.7B
Context32K
Smallest17.3 GB
MI
Ministral 8B Instruct 2410
Mistral · Lucy-in-the-Sky
Params8.02B
Context32K
Smallest6.6 GB
OL
olmOCR 7B 0225 Preview
OLMo · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest6.3 GB
MI
Mistral Nemo Base 2407
Mistral · Lucy-in-the-Sky
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Gemma 2 9b It SimPO
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Q4_K_M5.8 GB
TA
UI TARS 7B DPO
Tars · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest8.1 GB
QW
Qwen2.5 1.5B Instruct
Qwen · Lucy-in-the-Sky
Params1.54B
Context32K
Smallest1.3 GB
DE
DeepScaleR 1.5B Preview
Deepscaler · Lucy-in-the-Sky
Params1.78B
Context128K
Smallest1.5 GB
GE
Gemma 2 9b It SimPO
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Smallest9.8 GB
DE
deepthought 8b abliterated Q4 K M
Deepthought · Lucy-in-the-Sky
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSWE Preview
Deepswe · Lucy-in-the-Sky
Params32.8B
Context40K
Smallest12.3 GB
QW
Qwen2.5 Coder 3B
Qwen · Lucy-in-the-Sky
Params3.09B
Context32K
Smallest3.3 GB
CO
C4Ai Command R7B 12 2024
Command R · Lucy-in-the-Sky
Params8.03B
Context8K
Smallest6.6 GB
CE
Celeste 12B V1.6 Q2 K
Celeste · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest4.8 GB
DE
DeepSeek V2 Lite Chat
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest6.4 GB
QW
Dolphin3.0 Qwen2.5 1.5B
Qwen · Lucy-in-the-Sky
Params1.54B
Context128K
Smallest1.3 GB
LL
Llama 3.2 3B Overthinker Q4 K M
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · Lucy-in-the-Sky
Params32.8B
Context32K
Smallest34.8 GB
LL
Skywork O1 Open Llama3.1 8B
Llama · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest6.6 GB
OP
OpenCodeInterpreter DS 1.3B
Opencodeinterpreter · Lucy-in-the-Sky
Params1.35B
Context16K
Smallest1.4 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · Lucy-in-the-Sky
Params14.8B
Context32K
Smallest15.7 GB
MI
Mistral Small 24B Base 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Q4_K_M14.3 GB
PY
Pygmalion 2 13b
Pygmalion · Lucy-in-the-Sky
Params13B
Context4K
Smallest13.8 GB
VI
Virtuoso Small v2
Virtuoso · Lucy-in-the-Sky
Params14.8B
Context128K
Smallest15.7 GB
MI
Ministral 8B Instruct 2410
Mistral · Lucy-in-the-Sky
Params8.02B
Context32K
Smallest8.5 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · Lucy-in-the-Sky
Params3.09B
Context32K
Smallest3.3 GB
AY
Aya Expanse 8b
Aya · Lucy-in-the-Sky
Params8.03B
Context8K
Q4_K_M5.1 GB