GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LU
Nekochu/Luminia-13B-v3
Luminia · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
TI
philimon/TinyLlama-gsm8k-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
SY
FPHam/Sydney_Overthinker_13b_HF
Sydney · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GW
prithivMLmods/GWQ2b
Gwq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
vicgalle/Configurable-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
aws-prototyping/MegaBeam-Mistral-7B-300k
Mistral · featherless-ai-quants
Params7.24B
Context282K
Q4_K_M4.4 GB
LL
gradientai/Llama-3-8B-Instruct-262k
Llama · featherless-ai-quants
Params8.03B
Context256K
Q4_K_M4.9 GB
DE
eldoprano/DeepSeek-R1-Distill-Llama-8B-abliterated
DeepSeek · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
TroyDoesAI/Mermaid_PythonCoder
Mermaid · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
CO
Commencis/Commencis-LLM
Commencis · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Apel-sin/rewiz-qwen-2.5-14b
Qwen · featherless-ai-quants
Params14.8B
Context128K
Q4_K_M9.0 GB
HE
Weyaxi/HelpSteer-filtered-7B
Helpsteer · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
vicgalle/Humanish-Roleplay-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
SI
williamlcn/17718_simpo_16_1
Simpo · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
Weni/ZeroShot-3.3.34-Mistral-7b-Multilanguage-3.3.0-merged
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
BAAI/Infinity-Instruct-3M-0625-Llama3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
selfcorrexp/llama3_non_delete_rr40k_2e6_bz32_ep3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
EX
FogTeams/experiment-45-intelligent-layer-2-plus-exp-39-data
Experiment · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
OG
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v4-test
Ogno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SF
skarnam/SFT_fft_DARE_Resta
Sft · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
princeton-nlp/Llama-3-Instruct-8B-SimPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Hachipo/Qwen2.5-Coder-0.5B-Instruct_PIFT-enja_manywords_6000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
TI
yuiseki/tinyllama-it-wikipedia-1.5T-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
FR
freewheelin/free-solar-evo-v0.11
Free · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
informatiker/Qwen2-7B-Instruct-abliterated
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
EN
Johstracke/engllama
Engllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Hachipo/Qwen2.5-Coder-0.5B-Instruct_PIFT-enja_manywords_4000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
AP
FreedomIntelligence/Apollo-2B
Apollo · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
JunchengXie/Llama-2-13b-chat-hf-gpt-4-80k
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
FS
sfairXC/FsfairX-Zephyr-Chat-v0.1
Fsfairx · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB