GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
wisenut-nlp-team/wisenut-llama-3-8B-0.6-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
rombodawg/Meta-Llama-3.1-8B-Instruct-reuploaded
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SO
chihoonlee10/T3Q-ko-solar-dpo-v3.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
IN
InsultedByMathematics/infoNCA_ultrafeedback_update_201
Infonca · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
saishf/Merge-Mayhem-L3-V2
Merge · featherless-ai-quants
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF
LL
Dampfinchen/Llama-3-8B-Ultra-Instruct-SaltSprinkle
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
pgajo/Gemma-2B-SA-AILC-Lectures-2024
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
Qwen/Qwen2.5-72B
Qwen · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
LL
braindao/iq-code-evmind-v1-llama3-code-8b-instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
ISTA-DASLab/Meta-Llama-3-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
Fischerboot/ll3-c3-merged
Merged · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Locutusque/Llama-3-Orca-2.0-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
mii-community/zefiro-7b-dpo-ITA
Mii · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
theGhoul21/srl-base-irpo-290924-16bit-v0.1-iter1-llama-3.2-1b
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
GH
ghost-x/ghost-7b-v0.9.0
Ghost · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
RobBossJR/gemma-medical_qa-Finetune
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
amills157/gemma-2-2b-shell
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
knowledgator/Qwen2-0.5Bchp-300000
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
LL
nbeerbower/KawaiiMahou-llama3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
UN
ClaudioItaly/Underground
Underground · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
goktugkoksal/qwen2-0.5b
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
Gunulhona/Hermes-Llama-Merge
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
KU
Loyola/kulmistral-7b-it
Kulmistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CR
DrDrek/crewai-finetuned-model
Crewai · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
HE
hejiahuanle/a
featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PA
Gryphe/Pantheon-RP-1.6-12b-Nemo-KTO
Pantheon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
LL
haqishen/Llama-3-8B-Japanese-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PO
ChaoticNeutrals/Poppy_Porpoise-v0.4-L3-8B
Poppy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
aisingapore/llama3-8b-cpt-sea-lionv2-base
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
picAIso/TARS-8B-llama-REMIX
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing