GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
SE
FelixChao/Sectumsempra-7B-DPO
Sectumsempra · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
vicgalle/Unsafe-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
google/gemma-2b-aps-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
ST
nothingiisreal/MN-12B-Starcannon-v3
Starcannon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Sao10K/14B-Qwen2.5-Freya-x1
Qwen · featherless-ai-quants
Params14.8B
Context32K
Q4_K_M9.0 GB
WE
PetroGPT/WestSeverus-7B-DPO
Westseverus · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
rombodawg/Rombos-Coder-V2.5-Qwen-7b
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
hfl/llama-3-chinese-8b-instruct-v3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
google/codegemma-1.1-2b
Codegemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
KI
genne/kiwi_solar_merge_ties2_dpo
Kiwi · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
SL
abacusai/Slerp-CM-mist-dpo
Slerp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ja-ck/Mistral-instruct-Y24-v5
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
Kukedlc/NeuralSynthesis-7B-v0.3
Neuralsynthesis · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Kortix/FastApply-7B-v1.0
Fastapply · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
SO
AIdenU/SOLAR-10.7b-ko-Y24_v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
flammenai/Mahou-1.2a-mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
PO
ChaoticNeutrals/Poppy_Porpoise-1.4-L3-8B
Poppy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
vicgalle/Configurable-Llama-3-8B-v0.3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
chujiezheng/LLaMA3-iterative-DPO-final-ExPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TI
ambrosfitz/tinyllama-history-chat_v0.2.1ps
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
PatronusAI/Llama-3-Patronus-Lynx-8B-Instruct-v1.1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
BU
TeeZee/Buttocks-7B-v1.1
Buttocks · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen/Qwen2.5-14B-Instruct-1M
Qwen · featherless-ai-quants
Params14.8B
Context986K
Q4_K_M9.0 GB
LL
mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
google/gemma-2b-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
CH
bunnycore/Chimera-Apex-7B
Chimera · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
DO
ChaoticNeutrals/Domain-Fusion-L3-8B
Domain · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
unsloth/Qwen2-1.5B-Instruct
Qwen · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
EX
yam-peleg/Experiment27-7B
Experiment · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB