GGUF models by devisri050

93 GGUF models quantized by devisri050 on Hugging Face. Sizes run from 23M to 14.8B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
EF
T5 Efficient Xxl
Efficient · devisri050
Params11.3B
Context512
Smallest12.1 GB
GGUF
QW
qwen2.5 11B Mzy Q8 0
Qwen · devisri050
Params11.3B
Context32K
Smallest12.1 GB
GGUF
FL
Flan T5 Large
Flan · devisri050
Params783M
Context512
Smallest0.5 GB
Coding
MI
Mistral 7B v0.3
Mistral · devisri050
Params7.25B
Context32K
Smallest4.1 GB
GGUF
EF
T5 Efficient Xxl
Efficient · devisri050
Params11.3B
Context512
Smallest6.4 GB
GGUF
LA
LaMini Flan T5 783M
Lamini · devisri050
Params783M
Context512
Q4_K_M0.5 GB
GGUF
BE
Bert Base Uncased
Bert · devisri050
Params109M
Context512
Q4_K_M0.1 GB
GGUF
T5
t5 3b Q8 0
devisri050
Params2.85B
Context512
Smallest3.0 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · devisri050
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
QW
Qwen2.5 1.5B
Qwen · devisri050
Params1.54B
Context128K
Smallest1.6 GB
Tool use
FA
Falcon3 10B Base
Falcon · devisri050
Params10.3B
Context32K
Smallest6.0 GB
GGUF
T5
t5 3b Q4 0
devisri050
Params2.85B
Context512
Smallest1.6 GB
GGUF
MI
Mistral 7B v0.3
Mistral · devisri050
Params7.25B
Context32K
Smallest4.1 GB
GGUF
DE
mt5 xl Q8 0
Devisri · devisri050
Params3.74B
Context512
Smallest4.0 GB
GGUF
GE
Gemma 3 1b It
Gemma · devisri050
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
T5
t5 3b Q4 K M
devisri050
Params2.85B
Context512
Q4_K_M1.8 GB
GGUF
XX
Mt5 Xxl
Xxl · devisri050
Params12.9B
Context512
Smallest13.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · devisri050
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
SM
T5 Small
Small · devisri050
Params61M
Context512
Smallest0.1 GB
GGUF
LL
Llama 3.2 3B
Llama · devisri050
Params3.21B
Context128K
Smallest1.9 GB
GGUF
GE
Gemma 3 1b It
Gemma · devisri050
Params1B
Context32K
Smallest0.8 GB
GGUF
MI
Mistral 7B v0.3
Mistral · devisri050
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
EF
T5 Efficient Xxl
Efficient · devisri050
Params11.3B
Context512
Q4_K_M7.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · devisri050
Params1.78B
Context128K
Smallest1.1 GB
ReasoningTool use
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · devisri050
Params1.1B
Context2K
Smallest1.2 GB
Coding
GE
Gemma 3 1b It
Gemma · devisri050
Params1B
Context32K
Smallest0.7 GB
GGUF
FL
Flan T5 Large
Flan · devisri050
Params783M
Context512
Smallest0.5 GB
Coding
FL
Flan T5 Large
Flan · devisri050
Params783M
Context512
Q4_K_M0.5 GB
Coding
QW
Qwen2.5 1.5B
Qwen · devisri050
Params1.54B
Context128K
Smallest0.9 GB
Tool use
LL
Llama 3.2 1B
Llama · devisri050
Params1.24B
Context128K
Smallest1.3 GB
GGUF

Keep browsing