GGUF models by devisri050
93 GGUF models quantized by devisri050 on Hugging Face. Sizes run from 23M to 14.8B parameters. The longest trained context is 128K tokens.
EF
T5 Efficient Xxl
Efficient · devisri050
Params11.3B
Context512
Smallest12.1 GB
QW
qwen2.5 11B Mzy Q8 0
Qwen · devisri050
Params11.3B
Context32K
Smallest12.1 GB
FL
Flan T5 Large
Flan · devisri050
Params783M
Context512
Smallest0.5 GB
MI
Mistral 7B v0.3
Mistral · devisri050
Params7.25B
Context32K
Smallest4.1 GB
EF
T5 Efficient Xxl
Efficient · devisri050
Params11.3B
Context512
Smallest6.4 GB
LA
LaMini Flan T5 783M
Lamini · devisri050
Params783M
Context512
Q4_K_M0.5 GB
BE
Bert Base Uncased
Bert · devisri050
Params109M
Context512
Q4_K_M0.1 GB
T5
t5 3b Q8 0
devisri050
Params2.85B
Context512
Smallest3.0 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · devisri050
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen2.5 1.5B
Qwen · devisri050
Params1.54B
Context128K
Smallest1.6 GB
FA
Falcon3 10B Base
Falcon · devisri050
Params10.3B
Context32K
Smallest6.0 GB
T5
t5 3b Q4 0
devisri050
Params2.85B
Context512
Smallest1.6 GB
MI
Mistral 7B v0.3
Mistral · devisri050
Params7.25B
Context32K
Smallest4.1 GB
DE
mt5 xl Q8 0
Devisri · devisri050
Params3.74B
Context512
Smallest4.0 GB
GE
Gemma 3 1b It
Gemma · devisri050
Params1B
Context32K
Q4_K_M0.8 GB
T5
t5 3b Q4 K M
devisri050
Params2.85B
Context512
Q4_K_M1.8 GB
XX
Mt5 Xxl
Xxl · devisri050
Params12.9B
Context512
Smallest13.7 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · devisri050
Params7.62B
Context128K
Smallest8.1 GB
SM
T5 Small
Small · devisri050
Params61M
Context512
Smallest0.1 GB
LL
Llama 3.2 3B
Llama · devisri050
Params3.21B
Context128K
Smallest1.9 GB
GE
Gemma 3 1b It
Gemma · devisri050
Params1B
Context32K
Smallest0.8 GB
MI
Mistral 7B v0.3
Mistral · devisri050
Params7.25B
Context32K
Q4_K_M4.4 GB
EF
T5 Efficient Xxl
Efficient · devisri050
Params11.3B
Context512
Q4_K_M7.2 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · devisri050
Params1.78B
Context128K
Smallest1.1 GB
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · devisri050
Params1.1B
Context2K
Smallest1.2 GB
GE
Gemma 3 1b It
Gemma · devisri050
Params1B
Context32K
Smallest0.7 GB
FL
Flan T5 Large
Flan · devisri050
Params783M
Context512
Smallest0.5 GB
FL
Flan T5 Large
Flan · devisri050
Params783M
Context512
Q4_K_M0.5 GB
QW
Qwen2.5 1.5B
Qwen · devisri050
Params1.54B
Context128K
Smallest0.9 GB
LL
Llama 3.2 1B
Llama · devisri050
Params1.24B
Context128K
Smallest1.3 GB