GGUF models by DevQuasar-7

104 GGUF models quantized by DevQuasar-7 on Hugging Face. Sizes run from 362M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
allenai.Llama 3.1 Tulu 3 405B
Llama · DevQuasar-7
Params406B
Context128K
Q4_K_M243.1 GB
GGUF
FA
tiiuae.Falcon3 1B Base
Falcon · DevQuasar-7
Params1.67B
Context4K
Q4_K_M1.1 GB
GGUF
BE
prithivMLmods.Bellatrix Tiny 1B v2
Bellatrix · DevQuasar-7
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
BU
flair.bueble lm 2b
Bueble · DevQuasar-7
Params2.07B
Context8K
Q4_K_M1.3 GB
GGUF
WA
Wayfarer 12b
Wayfarer · DevQuasar-7
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
DE
internlm.OREAL DeepSeek R1 Distill Qwen 7B
DeepSeek · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
Alibaba NLP.gte Qwen1.5 7B Instruct
Qwen · DevQuasar-7
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
DE
Huihui ai.DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · DevQuasar-7
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
VI
Virtuoso Small v2
Virtuoso · DevQuasar-7
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
XW
Xwen 7B Chat
Xwen · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
SI
simplescaling.s1.1 32B
DevQuasar-7
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
MI
nbeerbower.mistral nemo gutenberg3 12B
Mistral · DevQuasar-7
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SI
simplescaling.s1 32B
DevQuasar-7
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
QW
Qwen.Qwen2.5 Math 1.5B
Qwen · DevQuasar-7
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use

Keep browsing