GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PW
pwork7/rlhflow_mix_dart_iter1
Pwork · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Edgerunners/meta-llama-3-8b-instruct-hf-ortho-baukit-5fail-500total
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
sdhan/SD_SOLAR_10.7B_v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
komi77/qwen2.5-0.5B_ed_gauss_linear_25-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
turboderp/llama3-turbcat-instruct-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
Sumail/Derrick42
Derrick · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
Trendyol/Trendyol-LLM-8b-chat-v2.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
TEL-LLM/gemma-2-2b-TEL-QA
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
sarthak-nik/gemma2b_peft_dare
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
ishaanxgupta/gemma-2-2bit-quantised
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
IC
icefog72/IceTeaRP-7b
Icetearp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MC
williamlcn/6851_mcq_8_8
Mcq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Kukedlc/LLama-3-8b-Maths
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
4yo1/llama3-eng-ko-8b-sl2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OR
orkungedik/SAP_basis_RAG_v0.1
Orkungedik · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AU
saishf/Aura-Uncensored-OAS-8B-L3
Aura · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Hachipo/Qwen2.5-Coder-0.5B-Instruct_PIFT-jaen_manywords_4000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
LL
Manojb/Meta-Llama-3.1-8B-Instruct-hf
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AS
AstroMLab/AstroSage-8B
Astrosage · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
OpenBuddy/openbuddy-llama3.1-8b-v22.1-131k
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Blackroot/Llama-3-LongStory
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OG
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v2
Ogno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Eric111/CatunaMayo-DPO
Catunamayo · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Undi95/Llama-3-LewdPlay-8B-evo
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
zetasepic/Qwen2.5-72B-Instruct-abliterated-v2
Qwen · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
ST
Nitral-AI/Stanta-Lelemon-Maid-7B
Stanta · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
upstage/SOLAR-10.7B-Instruct-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GE
shishirsv/gemma-ft-medical
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
lemon-mint/gemma-2b-translation-v0.123
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_40k_2_1ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use

Keep browsing