GGUF models by Lucy-in-the-Sky

265 GGUF models quantized by Lucy-in-the-Sky on Hugging Face. Sizes run from 494M to 46.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Skywork O1 Open Llama3.1 8B
Llama · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest8.5 GB
Tool use
MI
Mistral Small 24B Base 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest19.3 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct
Qwen · Lucy-in-the-Sky
Params14.8B
Context32K
Smallest5.8 GB
CodingTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · Lucy-in-the-Sky
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
deepthought 8b abliterated Q8 0
Deepthought · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest8.5 GB
Tool use
BU
BuddyGlassNeverSleeps methheadmethod v0.2 Q4 K M
Buddyglassneversleeps · Lucy-in-the-Sky
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Deep Reasoning Llama 3.2 Overthinker 3B Q4 K M
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Q4_K_M2.0 GB
Reasoning
LL
Llama 3.2 3B Instruct Abliterated
Llama · Lucy-in-the-Sky
Params3.61B
Context128K
Smallest3.8 GB
Tool use
QW
Qwen2.5 3B Instruct
Qwen · Lucy-in-the-Sky
Params3.09B
Context32K
Smallest3.3 GB
Tool use
CO
C4Ai Command R7B 12 2024
Command R · Lucy-in-the-Sky
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
DE
DeepSeek V2 Lite Chat
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
CO
C4Ai Command R7B 12 2024
Command R · Lucy-in-the-Sky
Params8.03B
Context8K
Smallest3.4 GB
Tool use
MI
Ministral 8B Instruct 2410
Mistral · Lucy-in-the-Sky
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
PY
Pygmalion 2 13b
Pygmalion · Lucy-in-the-Sky
Params13B
Context4K
Smallest4.9 GB
GGUF
CO
C4Ai Command R v01
Command R · Lucy-in-the-Sky
Params35B
Context128K
Smallest37.2 GB
GGUF
CE
MN 12B Celeste V1.9 Q2 K
Celeste · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
GE
Gemma 2 Ataraxy v4d 9B Q4 K M
Gemma · Lucy-in-the-Sky
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
DA
DAN L3 R1 8B
Dan · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest6.6 GB
Reasoning
OL
olmOCR 7B 0225 Preview
OLMo · Lucy-in-the-Sky
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest25.1 GB
GGUF
CH
Chronos Hermes 13b v2
Chronos · Lucy-in-the-Sky
Params13B
Context4K
Smallest4.9 GB
Tool use
AR
Arcee Blitz
Arcee · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest19.3 GB
GGUF
VI
Virtuoso Lite
Virtuoso · Lucy-in-the-Sky
Params10.3B
Context32K
Smallest11.0 GB
Tool use
AY
Aya Expanse 8b
Aya · Lucy-in-the-Sky
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MI
Mistral Small 24B Base 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest16.8 GB
GGUF
VI
Virtuoso Small v2
Virtuoso · Lucy-in-the-Sky
Params14.8B
Context128K
Smallest5.8 GB
Tool use
MI
Mistral Small 24B Instruct 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest19.3 GB
GGUF
LL
Llama 3.1 Tulu 3 8B abliterated Q8 0
Llama · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · Lucy-in-the-Sky
Params12.2B
Context1000K
Smallest4.8 GB
Tool use
GR
Granite 3.1 8b Instruct
Granite · Lucy-in-the-Sky
Params8.17B
Context128K
Smallest6.7 GB
Tool use

Keep browsing