GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
PW
pwork7/rlhflow_mix_dart_iter1
Pwork · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Edgerunners/meta-llama-3-8b-instruct-hf-ortho-baukit-5fail-500total
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
sdhan/SD_SOLAR_10.7B_v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
komi77/qwen2.5-0.5B_ed_gauss_linear_25-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
turboderp/llama3-turbcat-instruct-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
Sumail/Derrick42
Derrick · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
Trendyol/Trendyol-LLM-8b-chat-v2.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
TEL-LLM/gemma-2-2b-TEL-QA
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
sarthak-nik/gemma2b_peft_dare
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
ishaanxgupta/gemma-2-2bit-quantised
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
IC
icefog72/IceTeaRP-7b
Icetearp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MC
williamlcn/6851_mcq_8_8
Mcq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Kukedlc/LLama-3-8b-Maths
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
4yo1/llama3-eng-ko-8b-sl2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
OR
orkungedik/SAP_basis_RAG_v0.1
Orkungedik · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
AU
saishf/Aura-Uncensored-OAS-8B-L3
Aura · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Hachipo/Qwen2.5-Coder-0.5B-Instruct_PIFT-jaen_manywords_4000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
Manojb/Meta-Llama-3.1-8B-Instruct-hf
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
AstroMLab/AstroSage-8B
Astrosage · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
OpenBuddy/openbuddy-llama3.1-8b-v22.1-131k
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Blackroot/Llama-3-LongStory
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
OG
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v2
Ogno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Eric111/CatunaMayo-DPO
Catunamayo · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Undi95/Llama-3-LewdPlay-8B-evo
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
zetasepic/Qwen2.5-72B-Instruct-abliterated-v2
Qwen · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
ST
Nitral-AI/Stanta-Lelemon-Maid-7B
Stanta · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
upstage/SOLAR-10.7B-Instruct-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GE
shishirsv/gemma-ft-medical
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
lemon-mint/gemma-2b-translation-v0.123
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_40k_2_1ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB