GGUF models by gaianet
231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.
ST
stablelm-2-zephyr-1_6b
Stablelm · gaianet
Params1.64B
Context4K
Smallest1.2 GB
LL
Vitalik ETH Llama2 7B Chat
Llama · gaianet
Params6.74B
Context4K
Smallest4.8 GB
LL
Llama3-8B-Chinese-Chat
Llama · gaianet
Params8.03B
Context8K
Smallest5.7 GB
TE
Tessa T1 32B
Tessa · gaianet
Params32.8B
Context117K
Q4_K_M19.9 GB
QW
gte-Qwen1.5-7B-instruct
Qwen · gaianet
Params7.72B
Context32K
Smallest5.5 GB
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · gaianet
Params70.6B
Context8K
Q4_K_M42.5 GB
GI
GIST-large-Embedding-v0
Gist · gaianet
Params334M
Context512
Smallest0.2 GB
GR
GritLM 8x7B
Gritlm · gaianet
Params1.61B
Context32K
Smallest1.2 GB
QW
Qwen1.5-0.5B-Chat
Qwen · gaianet
Params620M
Context32K
Smallest0.5 GB
LL
Llama 3 8B Lexi Uncensored
Llama · gaianet
Params8.03B
Context8K
Smallest5.7 GB
BG
bge-large-en-v1.5
BGE · gaianet
Params334M
Context512
Smallest0.2 GB
GE
gemma-1.1-2b-it
Gemma · gaianet
Params2.51B
Context8K
Smallest1.8 GB
BL
blockchain 7b
Blockchain · gaianet
Params6.74B
Context4K
Smallest4.8 GB
LL
Meta-Llama-3-8B-Instruct
Llama · gaianet
Params8.03B
Context8K
Smallest5.7 GB
QW
Qwen1.5-1.8B-Chat
Qwen · gaianet
Params1.84B
Context32K
Smallest1.4 GB
LL
llama-3-Korean-Bllossom-8B
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
VI
vitalik.eth 7b
Vitalik · gaianet
Params32M
Context512
Smallest0.1 GB
LL
Llama 2 13B Chat
Llama · gaianet
Params13B
Context4K
Smallest9.2 GB
QW
Qwen1.5-4B-Chat
Qwen · gaianet
Params3.95B
Context32K
Smallest2.8 GB
QW
Qwen1.5-7B-Chat
Qwen · gaianet
Params7.72B
Context32K
Smallest5.5 GB
LL
Llama 2 7B Chat
Llama · gaianet
Params6.74B
Context4K
Smallest4.8 GB