GGUF models by Danielrahmai1991
49 GGUF models quantized by Danielrahmai1991 on Hugging Face. Sizes run from 1.24B to 14.8B parameters. The longest trained context is 128K tokens.
LL
llama3_model__gguf_v3
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
QW
qwen2.5 law v3.1
Qwen · Danielrahmai1991
Params3.09B
Context32K
Q4_K_M1.9 GB
LL
findemo_gguf_v2
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GE
gemma2 9b law with val v1
Gemma · Danielrahmai1991
Params9.24B
Context8K
Smallest6.6 GB
LL
trendModel_gguf
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
SU
mergeModel_gguf_v1
Sujet · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
LL
findemo_gguf_v1
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
QW
qwen2.5 law v5.3
Qwen · Danielrahmai1991
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
model2
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
LL
llama3_model__gguf_v2
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
LL
findemo_gguf_v5
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
LL
basic_gguf_v1
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
SU
mergeModel_gguf_v3
Sujet · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
QW
qwen2.5 7b law with val
Qwen · Danielrahmai1991
Params7.62B
Context128K
Smallest5.4 GB
LL
model1
Llama · Danielrahmai1991
Params13B
Context4K
Smallest13.8 GB
CE
Cerebras
Cerebras · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
LL
llama3_model__gguf_v1
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
QA
QAModel_v2_openorca_gguf
Qamodel · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
QW
qwen2.5 law v5
Qwen · Danielrahmai1991
Params3.09B
Context32K
Q4_K_M1.9 GB