GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
hfl/llama-3-chinese-8b-instruct-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ajibawa-2023/SlimOrca-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ChillyMango/llama-3.2-1b-kurtis
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_DPO_10k_1_3ep_4bit
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
jdqqjr/llama3-8b-instruct-uncensored-JR
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
magnifi/qwen2-rephrase-classify-multitask-v5
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
nbeerbower/llama-3-bophades-v2-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
frostsg/my-Llama-3.2-1B-Instruct
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Locutusque/Llama-3-Yggdrasil-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HE
DavidAU/L3.1-RP-Hero-Dirty_Harry-8B
Hero · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
FL
chanwit/flux-7b-v0.2
Flux · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
notadib/Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Chang-Hoo/llama3-alpaca-tuned-and-merged
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Cas-Warehouse/Llama-3-Mopeyfied-Psychology-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
sardukar/physiogemma-2b
Physiogemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
BU
Mihaiii/Bucharest-0.1
Bucharest · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SO
PracticeLLM/SOLAR-tail-10.7B-Merge-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
shleeeee/mistral-ko-OpenOrca-Platypus-v2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_PIFT-enja_manywords_3000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
Nhoodie/Meta-Llama-3-8B-Uninstruct-function-calling-json-mode-model_stock-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
taylorj94/Llama-3.2-1B
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QW
knowledgator/Qwen2-0.5Bchp-15k
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
GE
sparky353454/gemma-2-2b-it-gsm8k-merged
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
knowledgator/Qwen2-0.5Bchp-570k
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
QW
unsloth/Qwen2.5-72B-Instruct
Qwen · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
SI
SicariusSicariiStuff/Zion_Alpha
Sicariussicariistuff · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
picAIso/TARS-8B-llama-TIEMIX
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
lemon07r/Lllama-3-RedElixir-8B
Lllama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
NousResearch/Hermes-2-Pro-Llama-3-70B
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use

Keep browsing