GGUF models by DevQuasar-6
110 GGUF models quantized by DevQuasar-6 on Hugging Face. Sizes run from 362M to 102B parameters. The longest trained context is 1000K tokens.
OP
knoveleng.Open RS1
Open · DevQuasar-6
Params1.78B
Context128K
Q4_K_M1.1 GB
GR
Ibm Granite.Granite 3.1 3b A800M Base
Granite · DevQuasar-6
Params3.3B
Context128K
Q4_K_M2.0 GB
MO
moxin org.moxin llm 7b
Moxin · DevQuasar-6
Params8.11B
Context32K
Q4_K_M4.9 GB
SP
PowerInfer.SparseQwen2 7B
Sparseqwen · DevQuasar-6
Params7.62B
Context128K
Q4_K_M4.7 GB
EU
PRIME RL.EurusPRM Stage2
Eurusprm · DevQuasar-6
Params7.62B
Context4K
Q4_K_M4.7 GB
FI
HuggingFaceTB.finemath Ablation Owm
Finemath · DevQuasar-6
Params3.21B
Context4K
Q4_K_M2.0 GB
GR
Ibm Granite.Granite 3.1 8b Base
Granite · DevQuasar-6
Params8.17B
Context128K
Q4_K_M4.9 GB
DE
Deci.DeciLM 6b
Decilm · DevQuasar-6
Params5.72B
Context4K
Q4_K_M3.4 GB
PH
Orion Zhen.Phi 4 Abliterated
Phi · DevQuasar-6
Params14.7B
Context16K
Q4_K_M9.1 GB
TR
prithivMLmods.Triangulum 5B
Triangulum · DevQuasar-6
Params5.41B
Context8K
Q4_K_M3.4 GB
HE
DavidAU.L3.1 RP Hero BigTalker 8B
Hero · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
FI
HuggingFaceTB.finemath Ablation Finemath Infimath 3plus
Finemath · DevQuasar-6
Params3.21B
Context4K
Q4_K_M2.0 GB
LL
moreh.Llama 3 Motif 102B
Llama · DevQuasar-6
Params102B
Context32K
Q4_K_M61.3 GB
FI
HuggingFaceTB.finemath Ablation Finemath Infimath 4plus
Finemath · DevQuasar-6
Params3.21B
Context4K
Q4_K_M2.0 GB
OO
Oolel v0.1
Oolel · DevQuasar-6
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
prithivMLmods.Llama Chat Summary 3.2 3B
Llama · DevQuasar-6
Params3.21B
Context128K
Q4_K_M2.0 GB
GR
ibm granite.granite 3.0 8b lora intrinsics v0.1
Granite · DevQuasar-6
Params8.17B
Context4K
Q4_K_M4.9 GB
PH
matteogeniaccio.phi 4
Phi · DevQuasar-6
Params14.7B
Context16K
Q4_K_M9.1 GB
GR
Ibm Granite.Granite Guardian 3.1 8b
Granite · DevQuasar-6
Params8.17B
Context128K
Q4_K_M4.9 GB
EU
PRIME RL.EurusPRM Stage1
Eurusprm · DevQuasar-6
Params7.62B
Context4K
Q4_K_M4.7 GB
LL
nvidia.Llama 3_1 Nemotron 51B Instruct
Llama · DevQuasar-6
Params51.5B
Context128K
Q4_K_M31.0 GB
QW
Qwen.QVQ 72B Preview
Qwen · DevQuasar-6
Params72.7B
Context125K
Q4_K_M47.4 GB
EA
Etri Lirs.Eagle 3b Preview
Eagle · DevQuasar-6
Params3.1B
Context16K
Q4_K_M1.9 GB
SA
sail.Sailor2 1B Chat
Sailor · DevQuasar-6
Params988M
Context32K
Q4_K_M0.7 GB
FA
Tiiuae.Falcon 7b
Falcon · DevQuasar-6
Params7.22B
Context2K
Q4_K_M5.0 GB
LL
NaniDAO.Llama 3.3 70B Instruct ablated
Llama · DevQuasar-6
Params70.6B
Context128K
Q4_K_M42.5 GB
FI
HuggingFaceTB.finemath Ablation 3plus 160B
Finemath · DevQuasar-6
Params3.21B
Context4K
Q4_K_M2.0 GB
SE
pentagoniac.SEMIKONG 70B
Semikong · DevQuasar-6
Params70.6B
Context8K
Q4_K_M42.5 GB
VE
Alfitaria.Q25 1.5B VeoLu
Veolu · DevQuasar-6
Params1.78B
Context32K
Q4_K_M1.1 GB
FI
HuggingFaceTB.finemath Ablation 4plus 160B
Finemath · DevQuasar-6
Params3.21B
Context4K
Q4_K_M2.0 GB