GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
AdrienB134/Llama-3-8B-ASN-alpha
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
princeton-nlp/Llama-3-Instruct-8B-KTO-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Hachipo/qwen2.5-0.5B_PIFT-enja_manywords_8000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
HanningZhang/Llama3-sft-more-corr-rr60k-2ep
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
KeyonZeng/lion-llama3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AB
TheSkullery/AbL3In-15B
Abl · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
LL
tarabukinivan/llama3.2
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
ST
VongolaChouko/Starcannon-Unleashed-12B-v1.0
Starcannon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
SO
macadeliccc/SOLAR-10.7b-Instruct-truthy-dpo
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
chlee10/T3Q-LLM3-Llama3-sft1.0-dpo1.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
tokyotech-llm/Llama-3-Swallow-70B-Instruct-v0.1
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
bunnycore/LLama-3.1-8B-Matrix
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
meta-llama/Meta-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
akshit-Gupta/llamaitnew_merged-FinetunedByAG
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LI
AnatoliiPotapov/T-lite-0.1
Lite · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GO
Goekdeniz-Guelmez/J.O.S.I.E.v4o-8b-stage1-beta1
Goekdeniz · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
ping98k/gemma-han-2b
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Mohit-3430/Ai-PL_Gemma_Legal-Areas
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
MAISAAI/gemma-2b-coder
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
sridhar1111111111111111/gemma2B-It-Coding-Finetuned
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
AMindToThink/gemma-2-2b_RMU_cyber-forget-corpus_s100_a500_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
AL
alielfilali01/Q2AW1M-1111
featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
AL
mlabonne/AlphaMonarch-7B
Alphamonarch · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
somosnlp/Sam_Diagnostic
Sam · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
Heoni/v3_pt_ep1_sft_5_based_on_llama3_1_8b_20240828
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
unsloth/Qwen2.5-32B-Instruct
Qwen · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
OpenBuddy/openbuddy-llama3-8b-v21.2-32k
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
TriAiExperiments/SFR-Iterative-DPO-LLaMA-3-8B-R
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Kukedlc/Smart-LLaMa-3-8b-Python-v4
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
johnsnowlabs/JSL-Med-Sft-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB