GGUF models by DevQuasar-3

61 GGUF models quantized by DevQuasar-3 on Hugging Face. Sizes run from 14M to 1000B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Math 1.5B Instruct
Qwen · DevQuasar-3
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
MI
MiniCPM3 4B
MiniCPM · DevQuasar-3
Params4.07B
Context32K
Q4_K_M2.5 GB
Tool use
SA
Sarvam 1
Sarvam · DevQuasar-3
Params2.53B
Context8K
Q4_K_M1.5 GB
Tool use
DI
Alibaba pai.DistilQwen2 7B Instruct
Distilqwen · DevQuasar-3
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GL
LongCite glm4 9b
GLM · DevQuasar-3
Params10.5B
Context128K
Q4_K_M10.7 GB
GGUF
NU
numind.NuExtract tiny
Nuextract · DevQuasar-3
Params464M
Context32K
Q4_K_M0.3 GB
GGUF
LL
Zhengyi.LLaMA Mesh
Llama · DevQuasar-3
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AT
Atlas Chat 27B
Atlas · DevQuasar-3
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
LL
Facebook.Layerskip Llama2 13B
Llama · DevQuasar-3
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
MI
Mistral Small Instruct 2409
Mistral · DevQuasar-3
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
LL
mukaj.Llama 3.1 Hawkish 8B
Llama · DevQuasar-3
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
NU
NuExtract v1.5
Nuextract · DevQuasar-3
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GE
INSAIT Institute.BgGPT Gemma 2 27B IT v1.0
Gemma · DevQuasar-3
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
MI
mistralai.Mistral Large Instruct 2411
Mistral · DevQuasar-3
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
DA
datagemma rag 27b it
Datagemma · DevQuasar-3
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
ST
VongolaChouko.Starcannon Unleashed 12B v1.0
Starcannon · DevQuasar-3
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DI
Alibaba pai.DistilQwen2 1.5B Instruct
Distilqwen · DevQuasar-3
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
EpistemeAI.Fireball Meta Llama 3.1 8B Instruct Agent 0.005 128K code COT
Llama · DevQuasar-3
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
PY
Pythia 14m
Pythia · DevQuasar-3
Params14M
Context2K
Q4_K_M0.0 GB
GGUF
AR
arcee ai.Arcee VyLinh
Arcee · DevQuasar-3
Params3.4B
Context32K
Q4_K_M2.1 GB
Tool use
SU
allura org.G2 9B Sugarquill v0
Sugarquill · DevQuasar-3
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TI
SakanaAI.TinySwallow 1.5B Instruct
Tinyswallow · DevQuasar-3
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
MI
MegaBeam Mistral 7B 512k
Mistral · DevQuasar-3
Params7.24B
Context512K
Q4_K_M4.4 GB
GGUF
PH
Haesteining.Phi3smallv5
Phi · DevQuasar-3
Params5.63B
Context128K
Q4_K_M3.5 GB
GGUF
DE
Deepseek ai.DeepSeek R1 Zero.bf16
DeepSeek · DevQuasar-3
Params671B
Context160K
Smallest244.0 GB
ReasoningTool use
SU
arcee ai.SuperNova Medius
Supernova · DevQuasar-3
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
DA
DavidAU.MN GRAND Gutenberg Lyra4 Lyra 23B V2
Davidau · DevQuasar-3
Params22.9B
Context1000K
Q4_K_M13.8 GB
Tool use
LW
LargeWorldModel.LWM Text 1M
Lwm · DevQuasar-3
Params6.74B
Context1024K
Q4_K_M4.1 GB
GGUF
LL
EpistemeAI.Fireball Meta Llama 3.1 8B Instruct Agent 0.004 128K code COT
Llama · DevQuasar-3
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LL
Llama 3 8B ProLong 64k Instruct
Llama · DevQuasar-3
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF

Keep browsing