GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
ME
mergekit-community/mergekit-slerp-crxrtap
Mergekit · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
picAIso/TARS-8B-llama-REMIX-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Sao10K/L3-8B-Stheno-v3.2
Stheno · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
VO
PetroGPT/Voldemort-10B-DPO
Voldemort · featherless-ai-quants
Params10.7B
Context8K
Q4_K_M6.5 GB
TE
migtissera/Tess-7B-v2.0
Tess · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
kevin009/babyllama-v0.6
Babyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
TE
Byungchae/k2s3_test_0002
Test · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
AL
Alsebay/Narumashi-11B-v0.9
Alsebay · featherless-ai-quants
Params10.7B
Context8K
Q4_K_M6.5 GB
LL
swap-uniba/LLaMAntino-3-ANITA-8B-Inst-DPO-ITA
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SF
aryolotfi/SFT_gsm8k_rho-math-1b-v0.1_epoch_5_global_step_145
Sft · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
DE
Deepnoid/deep-solar-v2.0.7
Deepnoid · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
KN
kno10/ende-chat-0.0.4
Kno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
Edentns/DataVortexS-10.7B-v1.0
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
FA
FelixChao/Faraday-7B
Faraday · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
datek/Qwen-Qwen1.5-1.8B-1717852331
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
LL
Trelis/Llama-3.2-1B-Instruct-MATH-3ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
fireworks-ai/llama-3-firefunction-v2
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
MA
NGalrion/MarinaraSpaghetti-NemoMix-Unleashed-12B-chat
Marinaraspaghetti · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
bhenrym14/mistral-7b-platypus-fp16
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Locutusque/Hyperion-2.0-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
kihoonlee/STOCK_SOLAR-10.7B
Stock · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
PE
NotoriousH2/peft-solar-10.7B-v1.0
Peft · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
WE
vishnukv/WestSeverusJaskier-OpenOrca
Westseverusjaskier · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
WE
BarryFutureman/WestLakeX-7B-EvoMerge-Variant2
Westlakex · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SH
NExtNewChattingAI/shark_tank_ai_7b_v2
Shark · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Kukedlc/NeuralKrishna-7B-V2-DPO
Neuralkrishna · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
farooqkhan2840503/gemma-Instruct-Finetune-simpleinput_20_0.001
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
OpenRLHF/Llama-3-8b-rlhf-100k
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
AIdenU/LLAMA-2-13b-koen-Y24_v1.0
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
BY
Byungchae/k2s3_test_0000
Byungchae · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB