GGUF models by DevQuasar-6

110 GGUF models quantized by DevQuasar-6 on Hugging Face. Sizes run from 362M to 102B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama3.1 8B ShiningValiant2
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Alibaba pai.Qwen2 1.5B Instruct Refine
Qwen · DevQuasar-6
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
MI
sapienzanlp.Minerva 3B Base v1.0
Minerva · DevQuasar-6
Params2.89B
Context16K
Q4_K_M1.8 GB
GGUF
HU
FreedomIntelligence.HuatuoGPT O1 7B
Huatuogpt · DevQuasar-6
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
Llama3.1 8B PlumCode
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
FA
tiiuae.Falcon3 10B Base
Falcon · DevQuasar-6
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
LL
allenai.Llama 3.1 Tulu 3 8B SFT no wildchat data
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
meditsolutions.Llama 3.2 SUN 2.5B Chat
Llama · DevQuasar-6
Params2.47B
Context128K
Q4_K_M1.5 GB
Tool use
YU
Yulan team.YuLan Mini
Yulan · DevQuasar-6
Params2.42B
Context28K
Q4_K_M1.8 GB
GGUF
LL
allenai.Llama 3.1 Tulu 3 8B SFT no persona data
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
prithivMLmods.QwQ LCoT 3B Instruct
Qwen · DevQuasar-6
Params3.09B
Context32K
Q4_K_M1.9 GB
ReasoningTool use
OL
amd.AMD OLMo 1B SFT DPO
OLMo · DevQuasar-6
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
FI
HuggingFaceTB.finemath Ablation Finemath 4plus
Finemath · DevQuasar-6
Params3.21B
Context4K
Q4_K_M2.0 GB
GGUF
FA
tiiuae.Falcon3 1B Instruct
Falcon · DevQuasar-6
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
NA
qingy2024.NaturalLM 7B Instruct
Naturallm · DevQuasar-6
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
DR
DRT O1 7B
Drt · DevQuasar-6
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
OX
oxyapi.oxy 1 small
Oxy · DevQuasar-6
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
OX
oxyapi.oxy 1 micro
Oxy · DevQuasar-6
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
OL
amd.AMD OLMo 1B SFT
OLMo · DevQuasar-6
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
LL
meditsolutions.Llama 3.2 SUN 1B Chat
Llama · DevQuasar-6
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use

Keep browsing