GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
SA
VAGOsolutions/SauerkrautLM-Nemo-12b-Instruct
Sauerkrautlm · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Orion-zhen/Qwen2.5-7B-Instruct-Uncensored
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
unsloth/Qwen2.5-Coder-0.5B
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
Sao10K/14B-Qwen2.5-Kunou-v1
Qwen · featherless-ai-quants
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
unsloth/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
Sao10K/L3-8B-Stheno-v3.3-32K
Stheno · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
LC
LeroyDyer/LCARS_AI_StarTrek_Computer
Lcars · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
unsloth/Qwen2.5-Coder-14B
Qwen · featherless-ai-quants
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
huihui-ai/Qwen2.5-0.5B-Instruct-abliterated-v3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
MI
vikash06/mistral_v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Vikhrmodels/Vikhr-Llama-3.2-1B-Instruct
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
nvidia/OpenMath2-Llama3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
CO
google/codegemma-2b
Codegemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
Qwen/Qwen2.5-7B-Instruct
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
WE
senseable/WestLake-7B-v2
Westlake · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
nerdyface/llama-v1
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
aifeifei798/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Joseph717171/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
mistralai/Mistral-Nemo-Instruct-2407
Mistral · featherless-ai-quants
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Vivacem/Mistral-7B-MMIQC
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
tokyotech-llm/Llama-3-Swallow-8B-Instruct-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
jeffmeloy/Qwen2.5-7B-nerd-uncensored-v1.0
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
aifeifei798/llama3-8B-DarkIdol-2.1-Uncensored-32K
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
LeroyDyer/Mixtral_AI_Cyber_Matrix_2_0
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen/Qwen2.5-32B-Instruct
Qwen · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
PatronusAI/Llama-3-Patronus-Lynx-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
unsloth/Qwen2.5-Coder-0.5B-Instruct
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
UL
mlabonne/UltraMerge-7B
Ultramerge · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Locutusque/OpenCerebrum-1.0-7b-DPO
Opencerebrum · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB