GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
SF
aryolotfi/SFT_gsm8k_rho-math-1b-v0.1_epoch_3_global_step_87
Sft · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
OpenLLMAI/Llama-2-13b-sft-model-ocra-500k
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
LL
mylesgoose/Llama-3.2-1B-Instruct-abliterated
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
DA
Edentns/DataVortexS-10.7B-dpo-v1.0
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
PH
Sayan01/Phi35-1B-OWM-20
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
SA
kyujinpy/Sakura-SOLAR-Instruct
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
SE
SeaLLMs/SeaLLMs-v3-1.5B
Seallms · featherless-ai-quants
Params1.54B
Context128K
Q4_K_M1.0 GB
HA
sosoai/hansoldeco-SOLAR-10.7B
Hansoldeco · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
WI
BarryFutureman/WildMarcoroni-Variant1-7B
Wildmarcoroni · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
Danielbrdz/Barcenas-2x10.7b-Korean
Barcenas · featherless-ai-quants
Params7.24B
Context4K
Q4_K_M4.4 GB
SA
kyujinpy/Sakura-SOLRCA-Math-Instruct-DPO-v1
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
CH
mlabonne/ChimeraLlama-3-8B-v3
Chimerallama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
mlabonne/Gemmalpaca-2B
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
OH
Delta-Vector/Ohashi-NeMo-12B
Ohashi · featherless-ai-quants
Params12.2B
Context128K
Q4_K_M7.5 GB
TI
ZainabF/tinyllama-colorist-v2
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
TI
tmd-rahul/tinyllama-chatbot-merged-v8
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
ZE
mlabonne/Zebrafish-7B
Zebrafish · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
unsloth/Qwen2-7B-Instruct
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
kaitchup/Mayonnaise-4in1-02
Mayonnaise · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
VE
Dorian2B/Vera-Instruct
Vera · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
XGenerationLab/XiYanSQL-QwenCoder-32B-2504
Qwen · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
OP
mayacinka/Open-StaMis-v02-stock
Open · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
arcee-ai/Llama-3.1-SuperNova-Lite
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.25_0.5_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Gabrielmsidik/llama-2025-02-26-2155
Llama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
NI
Nitral-AI/Eris_PrimeV4.20-Vision-32k-7B
Nitral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CE
AetherResearch/Cerebrum-1.0-7b
Cerebrum · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
KoboldAI/Mistral-7B-Erebus-v3
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB