GGUF models by devisri050

93 GGUF models quantized by devisri050 on Hugging Face. Sizes run from 23M to 14.8B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 1B
Llama · devisri050
Params1.24B
Context128K
Smallest0.8 GB
GGUF
ST
Stable Code 3b
Stable · devisri050
Params2.8B
Context16K
Smallest1.6 GB
Coding
LA
LaMini Flan T5 783M
Lamini · devisri050
Params783M
Context512
Smallest0.5 GB
GGUF
IN
InternVL3_5 14B
Internvl · devisri050
Params14.8B
Context40K
Smallest15.7 GB
CodingVision
PH
Phi 3.5 Mini Instruct
Phi · devisri050
Params3.82B
Context128K
Smallest2.2 GB
Coding
FA
Falcon3 10B Base
Falcon · devisri050
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
QW
qwen2.5 11B Mzy Q4 0
Qwen · devisri050
Params11.3B
Context32K
Smallest6.5 GB
GGUF
LL
Llama 3.2 3B
Llama · devisri050
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
FA
Falcon3 10B Base
Falcon · devisri050
Params10.3B
Context32K
Smallest5.9 GB
GGUF
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · devisri050
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
QW
qwen2.5 11B Mzy Q4 K S
Qwen · devisri050
Params11.3B
Context32K
Smallest6.6 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · devisri050
Params1.1B
Context2K
Smallest0.6 GB
Coding
QW
Qwen2.5 0.5B
Qwen · devisri050
Params494M
Context32K
Smallest0.5 GB
Tool use
BE
Bert Base Uncased
Bert · devisri050
Params109M
Context512
Smallest0.1 GB
GGUF
EF
T5 Efficient Xxl
Efficient · devisri050
Params11.3B
Context512
Smallest6.4 GB
GGUF
QW
Qwen2.5 0.5B
Qwen · devisri050
Params494M
Context32K
Smallest0.4 GB
Tool use
LL
Llama 3.2 3B
Llama · devisri050
Params3.21B
Context128K
Smallest1.9 GB
GGUF
LL
Llama 3.2 3B
Llama · devisri050
Params3.21B
Context128K
Smallest3.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · devisri050
Params3.82B
Context128K
Smallest4.1 GB
Coding
MI
Mistral NeMo Minitron 8B Base
Mistral · devisri050
Params8.41B
Context8K
Smallest4.9 GB
GGUF
AL
all MiniLM L6 v2 Q8 0
All · devisri050
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
AL
all MiniLM L6 v2 Q4 0
All · devisri050
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
AL
all MiniLM L6 v2 Q4 K M
All · devisri050
Params23M
Context512
Q4_K_M0.0 GB
CodingEmbedding
T5
t5 3b Q4 K S
devisri050
Params2.85B
Context512
Smallest1.6 GB
GGUF
AL
all MiniLM L6 v2 Q4 K S
All · devisri050
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · devisri050
Params1.1B
Context2K
Smallest0.6 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · devisri050
Params1.1B
Context2K
Smallest0.6 GB
Coding
FL
Flan T5 Large
Flan · devisri050
Params783M
Context512
Smallest0.8 GB
Coding
MI
Mistral 7B v0.3
Mistral · devisri050
Params7.25B
Context32K
Smallest7.7 GB
GGUF
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · devisri050
Params1.1B
Context2K
Smallest0.6 GB
Coding

Keep browsing