GGUF models by Danielrahmai1991

49 GGUF models quantized by Danielrahmai1991 on Hugging Face. Sizes run from 1.24B to 14.8B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama3_model__gguf_v3
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GGUF
QW
qwen2.5 law v3.1
Qwen · Danielrahmai1991
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
LL
findemo_gguf_v2
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GGUF
GE
gemma2 9b law with val v1
Gemma · Danielrahmai1991
Params9.24B
Context8K
Smallest6.6 GB
GGUF
LL
trendModel_gguf
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GGUF
SU
mergeModel_gguf_v1
Sujet · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
findemo_gguf_v1
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GGUF
QW
qwen2.5 law v5.3
Qwen · Danielrahmai1991
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
model2
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
llama3_model__gguf_v2
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
findemo_gguf_v5
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
basic_gguf_v1
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GGUF
SU
mergeModel_gguf_v3
Sujet · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GGUF
QW
qwen2.5 7b law with val
Qwen · Danielrahmai1991
Params7.62B
Context128K
Smallest5.4 GB
GGUF
LL
model1
Llama · Danielrahmai1991
Params13B
Context4K
Smallest13.8 GB
GGUF
CE
Cerebras
Cerebras · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
llama3_model__gguf_v1
Llama · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GGUF
QA
QAModel_v2_openorca_gguf
Qamodel · Danielrahmai1991
Params8.03B
Context8K
Smallest8.5 GB
GGUF
QW
qwen2.5 law v5
Qwen · Danielrahmai1991
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use

Keep browsing