GGUF models by DevQuasar-5

95 GGUF models quantized by DevQuasar-5 on Hugging Face. Sizes run from 135M to 479B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
sail.Sailor2 20B Chat
Sailor · DevQuasar-5
Params19.2B
Context32K
Q4_K_M11.6 GB
GGUF
AT
Athene V2 Chat
Athene · DevQuasar-5
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
GR
Ibm Granite.Granite 3.0 2b Instruct
Granite · DevQuasar-5
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
QW
Qwen.Qwen2.5 Coder 3B
Qwen · DevQuasar-5
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
LL
O1 OPEN.OpenO1 LLama 8B v0.1
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
EX
LGAI EXAONE.EXAONE 3.5 32B Instruct
Exaone · DevQuasar-5
Params32B
Context32K
Q4_K_M19.3 GB
GGUF
LL
EmTpro01.CodeLlama 7b java 16bit
Llama · DevQuasar-5
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MA
AIDC AI.Marco o1
Marco · DevQuasar-5
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen.QwQ 32B Preview
Qwen · DevQuasar-5
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
LL
nvidia.OpenMath2 Llama3.1 70B
Llama · DevQuasar-5
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Isotonic.reasoning Llama3.2 1b
Llama · DevQuasar-5
Params1.24B
Context128K
Q4_K_M0.8 GB
ReasoningTool use
DE
Deepseek ai.DeepSeek R1 Distill Qwen 32B
DeepSeek · DevQuasar-5
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
HU
Huihui ai.EXAONE 3.5 32B Instruct Abliterated
Huihui · DevQuasar-5
Params32B
Context32K
Q4_K_M19.3 GB
GGUF
AR
katanemo.Arch Function 1.5B
Arch · DevQuasar-5
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
DR
driaforall.Dria Agent A 3B
Dria · DevQuasar-5
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
LL
Sparse Llama 3.1 8B 2of4
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
QwQ 32B Preview
Qwen · DevQuasar-5
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
EU
PRIME RL.Eurus 2 7B PRIME
Eurus · DevQuasar-5
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
WH
h2oai.whitehouse
Whitehouse · DevQuasar-5
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
LL
nvidia.Llama 3.1 Nemotron 70B Instruct HF
Llama · DevQuasar-5
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
SA
sail.Sailor 0.5B Chat
Sailor · DevQuasar-5
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
OL
allenai.OLMo 7B 1024 Preview
OLMo · DevQuasar-5
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
LL
NousResearch.Llama 3.2 1B
Llama · DevQuasar-5
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
DR
driaforall.Dria Agent A 7B
Dria · DevQuasar-5
Params7B
Context32K
Q4_K_M4.7 GB
Tool use
LL
Llama3 ChatQA 2 8B
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
SimpleBerry.LLaMA O1 Base 1127
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Bio Medical Llama 3 8B CoT 012025
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
NU
NuExtract 1.5 Smol
Nuextract · DevQuasar-5
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
OL
allenai.OLMo 2 1124 13B Instruct
OLMo · DevQuasar-5
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF

Keep browsing