GGUF models by DevQuasar-7
104 GGUF models quantized by DevQuasar-7 on Hugging Face. Sizes run from 362M to 406B parameters. The longest trained context is 1024K tokens.
LL
allenai.Llama 3.1 Tulu 3 405B
Llama · DevQuasar-7
Params406B
Context128K
Q4_K_M243.1 GB
FA
tiiuae.Falcon3 1B Base
Falcon · DevQuasar-7
Params1.67B
Context4K
Q4_K_M1.1 GB
BE
prithivMLmods.Bellatrix Tiny 1B v2
Bellatrix · DevQuasar-7
Params1.24B
Context128K
Q4_K_M0.8 GB
BU
flair.bueble lm 2b
Bueble · DevQuasar-7
Params2.07B
Context8K
Q4_K_M1.3 GB
WA
Wayfarer 12b
Wayfarer · DevQuasar-7
Params12.2B
Context128K
Q4_K_M7.5 GB
DE
internlm.OREAL DeepSeek R1 Distill Qwen 7B
DeepSeek · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Alibaba NLP.gte Qwen1.5 7B Instruct
Qwen · DevQuasar-7
Params7.72B
Context32K
Q4_K_M4.8 GB
DE
Huihui ai.DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · DevQuasar-7
Params70.6B
Context128K
Q4_K_M42.5 GB
VI
Virtuoso Small v2
Virtuoso · DevQuasar-7
Params14.8B
Context128K
Q4_K_M9.0 GB
XW
Xwen 7B Chat
Xwen · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
SI
simplescaling.s1.1 32B
DevQuasar-7
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
nbeerbower.mistral nemo gutenberg3 12B
Mistral · DevQuasar-7
Params12.2B
Context1000K
Q4_K_M7.5 GB
SI
simplescaling.s1 32B
DevQuasar-7
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen.Qwen2.5 Math 1.5B
Qwen · DevQuasar-7
Params1.54B
Context4K
Q4_K_M1.0 GB