GGUF models by Lucy-in-the-Sky

265 GGUF models quantized by Lucy-in-the-Sky on Hugging Face. Sizes run from 494M to 46.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 27b It
Gemma · Lucy-in-the-Sky
Params27.2B
Context8K
Smallest10.4 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1
Mistral · Lucy-in-the-Sky
Params46.7B
Context32K
Smallest17.3 GB
GGUF
DE
Deepseek Moe 16b Chat
DeepSeek · Lucy-in-the-Sky
Params16.4B
Context4K
Smallest6.7 GB
GGUF
BU
BuddyGlassNeverSleeps Q8 0
Buddyglassneversleeps · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest8.5 GB
Tool use
DE
Deepseek Math 7b Instruct
DeepSeek · Lucy-in-the-Sky
Params6.91B
Context4K
Smallest5.7 GB
GGUF
DE
DeepSeek V2 Lite Chat
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest14.1 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct
Qwen · Lucy-in-the-Sky
Params14.8B
Context32K
Smallest12.1 GB
CodingTool use
CH
Chronos Hermes 13b v2
Chronos · Lucy-in-the-Sky
Params13B
Context4K
Smallest13.8 GB
Tool use
LL
Dolphin 3.0 Llama 3.2 3B
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Smallest2.3 GB
CodingTool use
GE
Gemma 2 2b It
Gemma · Lucy-in-the-Sky
Params2.61B
Context8K
Smallest2.8 GB
GGUF
GR
Granite 3.1 8b Instruct
Granite · Lucy-in-the-Sky
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Dolphin3.0 Qwen2.5 3B
Qwen · Lucy-in-the-Sky
Params3.09B
Context32K
Smallest2.5 GB
CodingTool use
MI
Mistral Small 24B Instruct 2501
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest19.3 GB
Reasoning
TA
UI TARS 1.5 7B
Tars · Lucy-in-the-Sky
Params7.62B
Context125K
Smallest6.3 GB
Tool useVision
LL
Dolphin 3.0 Llama 3.2 3B
Llama · Lucy-in-the-Sky
Params3.21B
Context128K
Smallest3.4 GB
CodingTool use
GE
Gemma 2 2b
Gemma · Lucy-in-the-Sky
Params2.61B
Context8K
Smallest2.8 GB
Tool use
AR
Arcee Blitz
Arcee · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest8.9 GB
GGUF
QW
Qwen2.5 3B
Qwen · Lucy-in-the-Sky
Params3.09B
Context32K
Smallest3.3 GB
Tool use
MA
Marco o1 Q6 K
Marco · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest6.3 GB
GGUF
VI
Virtuoso Small v2
Virtuoso · Lucy-in-the-Sky
Params14.8B
Context128K
Smallest12.1 GB
Tool use
DE
DeepScaleR 1.5B Preview
Deepscaler · Lucy-in-the-Sky
Params1.78B
Context128K
Smallest1.9 GB
Tool use
TA
UI TARS 7B SFT
Tars · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest8.1 GB
Vision
GE
gemma-3-4b-it-codeforces-SFT
Gemma · Lucy-in-the-Sky
Params3.88B
Context128K
Smallest4.1 GB
Reasoning
XO
XortronCriminalComputingConfig
Xortroncriminalcomputingconfig · Lucy-in-the-Sky
Params23.6B
Context32K
Smallest19.3 GB
GGUF
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · Lucy-in-the-Sky
Params14.8B
Context32K
Smallest5.8 GB
Tool use
LL
Llama 3.1 Tulu 3 8B abliterated Q4 K M
Llama · Lucy-in-the-Sky
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
Deepseek Moe 16b Base
DeepSeek · Lucy-in-the-Sky
Params16.4B
Context4K
Smallest14.7 GB
GGUF
QW
Dolphin3.0 Qwen2.5 1.5B
Qwen · Lucy-in-the-Sky
Params1.54B
Context128K
Smallest1.6 GB
CodingTool use
DE
UncensoredLM DeepSeek R1 Distill Qwen 14B Q2 K
DeepSeek · Lucy-in-the-Sky
Params14.2B
Context128K
Smallest5.6 GB
ReasoningTool use
MI
Sage Ft Mixtral 8x7b
Mistral · Lucy-in-the-Sky
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF

Keep browsing