GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
ajibawa-2023/Uncensored-Frank-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
UN
fblgit/UNA-POLAR-10.7B-InstructMath-v1
Una · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
HA
Nitral-AI/Hathor_Stable-v0.2-L3-8B
Hathor · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
openchat/openchat-3.6-8b-20240522
Openchat · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
CE
nothingiisreal/L3.1-8B-Celeste-V1.5
Celeste · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
SH
FelixChao/ShadowNeural-7B-v1
Shadowneural · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
mergekit-community/Fimburs11V3
Fimburs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
melino2000/tiny-llama-merge-evo-server
Llama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
HK
hyokwan/hkcode-solar-youtube-merged
Hkcode · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
DiscoResearch/Llama3-German-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
scb10x/llama-3-typhoon-v1.5x-8b-instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AL
clinic-research/Aligner-Med
Aligner · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
GraySwanAI/Llama-3-8B-Instruct-RR
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Hachipo/Qwen2.5-Coder-0.5B-Instruct_MIFT-en_manywords_8000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
DE
NaniDAO/deepseek-r1-qwen-2.5-32B-ablated
DeepSeek · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
HA
PotatoOff/HamSter-0.1
Hamster · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
chlee10/T3Q-Mistral-Orca-Math-dpo-v2.0
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
KingNish/Llama-3.2-1B-Instruct
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
TI
wamegabe/tinyllama-wame-4bit-curi2
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
TH
Liangmingxin/ThetaWave-7B-sft
Thetawave · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
vicgalle/CarbonBeagle-11B-truthy
Carbonbeagle · featherless-ai-quants
Params10.7B
Context32K
Q4_K_M6.5 GB
QW
Hachipo/Qwen2.5-Coder-0.5B-Instruct_PIFT-enja_manywords_8000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
CE
nothingiisreal/MN-12B-Celeste-V1.9
Celeste · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
TI
Deathsquad10/TinyLlama-repeat
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen/Qwen2.5-0.5B
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
CO
vicgalle/ConfigurableBeagle-11B
Configurablebeagle · featherless-ai-quants
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
BlouseJury/Mistral-7B-Discord-0.2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
FU
meetkai/functionary-small-v3.2
Functionary · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SVECTOR-CORPORATION/Akshara-8B-Llama-Multilingual-V0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
BR
dhanushreddy29/BrokenKeyboard
Brokenkeyboard · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB