GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
mdobbali/Qwen2.5-7B-Instruct-131K
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
GE
MergeMerge/gemma-2-2B-allenai-tulu-3-sft-full-mix
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
nayohan/llama3-instrucTrans-enko-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
MergeBench/gemma-2-2b-it_safety
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
dhanush-radhakrishna/gemma-2-2b-it-Heisenberg
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
grimjim/Llama-3-Instruct-8B-SimPO-SPPO-Iter3-merge
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Ja-ck/Mistral-instruct-IPO-Y24-v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RE
InsultedByMathematics/rebel_ultrafeedback
Rebel · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BI
Kabster/BioMistral-MedicalQA-FT
Biomistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_PPO_Skywork_20k_1_2ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
FU
meetkai/functionary-small-v2.5
Functionary · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
tfabron/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
tachyphylaxis/Meta-Llama-3.1-Chat-Uncensored
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
Fizzarolli/Nemo_Pony_2-merged
Nemo · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
GE
AMindToThink/gemma-2-2b_RMU_s200_a300_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
winwithpartner/immi_llama_1
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
RLHFlow/Llama3-SFT-v2.0-epoch3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
AIDX-ktds/ktdsbaseLM-v0.10-onbased-llama3.1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
AIRRC/ELN-Llama-1B-base
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Kukedlc/LLaMa-3-8b-Spanish-RAG-v2.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
nbeerbower/llama-3-stella-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
WeMake/Llama-3-8B-Instruct-V41-1048k
Llama · featherless-ai-quants
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
DD
lalagi2/v0.8_76ddc0
Ddc · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
rinna/qwen2.5-bakeneko-32b-instruct-v2
Qwen · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
QW
akshit-Gupta/qwen-fullnew_merged-FinetunedByAG
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
NE
ckoozzzu/new3
New · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
rinna/qwen2.5-bakeneko-32b-instruct
Qwen · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
WP
WPAI-INC/WPAIGPT-fse-patterns-1
Wpaigpt · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
LL
SillyTilly/Meta-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
BatirayErbayVodafone/testl
Testl · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing