GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Undi95/Meta-Llama-3-8B-Instruct-hf
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
sanghwa-na/llama2-13b.kor.v2
Llama · featherless-ai-quants
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
QW
Hachipo/Qwen2.5-Coder-0.5B-Instruct_BIFT_manywords_2000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
AL
AgentPublic/albertlight-7b
Albertlight · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OU
nitky/Oumuamua-10.7b-alpha-RP
Oumuamua · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
Roleplay
QW
Echelon-AI/Med-Qwen2-7B
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
SW
FredrikBL/SwedishBeagle-dare
Swedishbeagle · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
wang7776/Mistral-7B-Instruct-v0.2-sparsity-10
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
haoranxu/X-ALMA-13B-Pretrain
Alma · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
TheBloke/CodeLlama-13B-Python-fp16
Llama · featherless-ai-quants
Params13B
Context16K
Q4_K_M7.9 GB
Coding
SO
kyujinpy/SOLAR-Platypus-10.7B-v2
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
Qwen/Qwen2.5-7B
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
HA
PotatoOff/HamSter-0.2
Hamster · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FI
xkbang/FineLlama-3.1-8B
Finellama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AN
Biomimicry-AI/ANIMA-Nectar-v2
Anima · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
aisingapore/llama3-8b-cpt-sea-lionv2.1-instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
freewheelin/free-llama3-dpo-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TH
cgato/L3-TheSpice-8b-v0.8.3
Thespice · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RE
Undi95/ReMM-v2.2-L2-13B
Remm · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen/Qwen2.5-Coder-14B
Qwen · featherless-ai-quants
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use
LO
royallab/MN-LooseCannon-12B-v2
Loosecannon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PO
Nitral-AI/Poppy_Porpoise-v0.7-L3-8B
Poppy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
chujiezheng/Llama3-8B-Chinese-Chat-ExPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
RLHFlow/LLaMA3-SFT-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
theprint/ReWiz-Qwen-2.5-14B
Qwen · featherless-ai-quants
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
LL
aifeifei798/llama3-8B-DarkIdol-2.2-Uncensored-1048K
Llama · featherless-ai-quants
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
ME
MiniMoog/Mergerix-7b-v0.5
Mergerix · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
ruslanmv/Medical-Llama3-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
ziniuli/Mistral-7B-ReMax-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
mlabonne/Hermes-3-Llama-3.1-8B-lorablated
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing