GGUF models by gaianet

231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
stablelm-2-zephyr-1_6b
Stablelm · gaianet
Params1.64B
Context4K
Smallest1.2 GB
GGUF
LL
Vitalik ETH Llama2 7B Chat
Llama · gaianet
Params6.74B
Context4K
Smallest4.8 GB
GGUF
LL
Llama3-8B-Chinese-Chat
Llama · gaianet
Params8.03B
Context8K
Smallest5.7 GB
GGUF
TE
Tessa T1 32B
Tessa · gaianet
Params32.8B
Context117K
Q4_K_M19.9 GB
Tool use
QW
gte-Qwen1.5-7B-instruct
Qwen · gaianet
Params7.72B
Context32K
Smallest5.5 GB
GGUF
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · gaianet
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
GI
GIST-large-Embedding-v0
Gist · gaianet
Params334M
Context512
Smallest0.2 GB
Embedding
GR
GritLM 8x7B
Gritlm · gaianet
Params1.61B
Context32K
Smallest1.2 GB
GGUF
QW
Qwen1.5-0.5B-Chat
Qwen · gaianet
Params620M
Context32K
Smallest0.5 GB
GGUF
LL
Llama 3 8B Lexi Uncensored
Llama · gaianet
Params8.03B
Context8K
Smallest5.7 GB
GGUF
BG
bge-large-en-v1.5
BGE · gaianet
Params334M
Context512
Smallest0.2 GB
Embedding
GE
gemma-1.1-2b-it
Gemma · gaianet
Params2.51B
Context8K
Smallest1.8 GB
GGUF
BL
blockchain 7b
Blockchain · gaianet
Params6.74B
Context4K
Smallest4.8 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · gaianet
Params8.03B
Context8K
Smallest5.7 GB
GGUF
QW
Qwen1.5-1.8B-Chat
Qwen · gaianet
Params1.84B
Context32K
Smallest1.4 GB
GGUF
LL
llama-3-Korean-Bllossom-8B
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
VI
vitalik.eth 7b
Vitalik · gaianet
Params32M
Context512
Smallest0.1 GB
GGUF
LL
Llama 2 13B Chat
Llama · gaianet
Params13B
Context4K
Smallest9.2 GB
GGUF
QW
Qwen1.5-4B-Chat
Qwen · gaianet
Params3.95B
Context32K
Smallest2.8 GB
GGUF
QW
Qwen1.5-7B-Chat
Qwen · gaianet
Params7.72B
Context32K
Smallest5.5 GB
GGUF
LL
Llama 2 7B Chat
Llama · gaianet
Params6.74B
Context4K
Smallest4.8 GB
GGUF

Keep browsing