GGUF models by devisri050
93 GGUF models quantized by devisri050 on Hugging Face. Sizes run from 23M to 14.8B parameters. The longest trained context is 128K tokens.
LL
Llama 3.2 1B
Llama · devisri050
Params1.24B
Context128K
Smallest0.8 GB
ST
Stable Code 3b
Stable · devisri050
Params2.8B
Context16K
Smallest1.6 GB
LA
LaMini Flan T5 783M
Lamini · devisri050
Params783M
Context512
Smallest0.5 GB
IN
InternVL3_5 14B
Internvl · devisri050
Params14.8B
Context40K
Smallest15.7 GB
PH
Phi 3.5 Mini Instruct
Phi · devisri050
Params3.82B
Context128K
Smallest2.2 GB
FA
Falcon3 10B Base
Falcon · devisri050
Params10.3B
Context32K
Q4_K_M6.3 GB
QW
qwen2.5 11B Mzy Q4 0
Qwen · devisri050
Params11.3B
Context32K
Smallest6.5 GB
LL
Llama 3.2 3B
Llama · devisri050
Params3.21B
Context128K
Q4_K_M2.0 GB
FA
Falcon3 10B Base
Falcon · devisri050
Params10.3B
Context32K
Smallest5.9 GB
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · devisri050
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
qwen2.5 11B Mzy Q4 K S
Qwen · devisri050
Params11.3B
Context32K
Smallest6.6 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · devisri050
Params1.1B
Context2K
Smallest0.6 GB
QW
Qwen2.5 0.5B
Qwen · devisri050
Params494M
Context32K
Smallest0.5 GB
BE
Bert Base Uncased
Bert · devisri050
Params109M
Context512
Smallest0.1 GB
EF
T5 Efficient Xxl
Efficient · devisri050
Params11.3B
Context512
Smallest6.4 GB
QW
Qwen2.5 0.5B
Qwen · devisri050
Params494M
Context32K
Smallest0.4 GB
LL
Llama 3.2 3B
Llama · devisri050
Params3.21B
Context128K
Smallest1.9 GB
LL
Llama 3.2 3B
Llama · devisri050
Params3.21B
Context128K
Smallest3.4 GB
PH
Phi 3.5 Mini Instruct
Phi · devisri050
Params3.82B
Context128K
Smallest4.1 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · devisri050
Params8.41B
Context8K
Smallest4.9 GB
AL
all MiniLM L6 v2 Q8 0
All · devisri050
Params23M
Context512
Smallest0.0 GB
AL
all MiniLM L6 v2 Q4 0
All · devisri050
Params23M
Context512
Smallest0.0 GB
AL
all MiniLM L6 v2 Q4 K M
All · devisri050
Params23M
Context512
Q4_K_M0.0 GB
T5
t5 3b Q4 K S
devisri050
Params2.85B
Context512
Smallest1.6 GB
AL
all MiniLM L6 v2 Q4 K S
All · devisri050
Params23M
Context512
Smallest0.0 GB
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · devisri050
Params1.1B
Context2K
Smallest0.6 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · devisri050
Params1.1B
Context2K
Smallest0.6 GB
FL
Flan T5 Large
Flan · devisri050
Params783M
Context512
Smallest0.8 GB
MI
Mistral 7B v0.3
Mistral · devisri050
Params7.25B
Context32K
Smallest7.7 GB
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · devisri050
Params1.1B
Context2K
Smallest0.6 GB