GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
BA
Sumail/Barista05
Barista · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
petkopetkov/gemma-2-2b-bg
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
macadeliccc/Samantha-Qwen-2-7B
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
QW
AiCloser/Qwen2.5-32B-AGI
Qwen · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
NaoS2/qwen2.5-0.5B_drop_low20_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
HE
hexinran09/xr_dat_test_part2
Hexinran · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
VityaVitalich/Llama3.1-8b-instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
muscle-memory/llama_3_math
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Azure99/blossom-v5-llama3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Locutusque/Apollo-2.0-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
BAAI/Infinity-Instruct-3M-0613-Llama3-70B
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_PIFT-enja_manywords_6000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
OP
timberrific/open-bio-med-merge
Open · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
migtissera/Tess-2.0-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
gradientai/Llama-3-70B-Instruct-Gradient-1048k
Llama · featherless-ai-quants
Params70.6B
Context1024K
Q4_K_M42.5 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_1.0_1.0_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
winglian/Llama-3-8b-64k-PoSE
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
crimsonjoo/Llama3-Ko-LON-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
RLHFlow/LLaMA3-SFT
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AS
Steelskull/L3.1-MS-Astoria-70b-v2
Astoria · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
TI
niryuu/tinyllama-task003_mctaco_question_generation_event_duration-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
sanghwa-na/llama2-13b.kor.v1
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
jaydee29/gemma2-2b-it-merged2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
RefalMachine/llama3_darulm_20_05_24_part1-2_128000_unigram_mean_init_03_07_24
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ceiteach/chart-no-pretrain-llama31-merged-unsloth
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_1k_1_2ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MA
kaitchup/Mayonnaise-4in1-022
Mayonnaise · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
AIGym/Llama-3-8B-Instruct-Gradient-1048k-Agent
Llama · featherless-ai-quants
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_DPO_140k_1_20ep_deneme
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
gohsyi/Llama-3.2-1B
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use

Keep browsing