GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AR
Xclbr7/Arcanum-12b
Arcanum · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
NE
spow12/MK_Nemo_12B
Nemo · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
manupande21/llama3.2-1B_PMC-finetuned-full-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
gradientai/Llama-3-70B-Instruct-Gradient-524k
Llama · featherless-ai-quants
Params70.6B
Context512K
Q4_K_M42.5 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.15_0.05_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
BI
skfrost19/BioMistralMerged
Biomistralmerged · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
detakarang/tinyllama-sql-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
BI
varox34/Bio-Saul-Dolphin-Beagle-Breadcrumbs
Bio · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.75_0.75_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
AwanLLM/Llama-3-8B-Cumulus-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
MergeBench-2B/gemma-2-2b-it_dartmath_2epoch_0512
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
HU
yweslakarep/huh-1
Huh · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
dreamgen/llama3-8b-instruct-align-test2-kto
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
BeaverAI/mistral-doryV2-12b
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ME
memevis/try9
Memevis · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DA
Danilas/Hf3
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AN
anthracite-org/magnum-12b-v2
Anthracite · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Omartificial-Intelligence-Space/Arabic-llama3.1-16bit-FT
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
princeton-nlp/Llama-3-Base-8B-SFT-KTO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
unsloth/Meta-Llama-3.1-70B-Instruct
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
EV
Knobi3/EvoMerge1
Evomerge · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
ShadNygren BioTechFineTuneTest DrugAdverseEffects SIDERv1 then v2 then v3 then v2a then v3a
Biotechfinetunetest · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.1
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top_4000_pythonblock_ja_en
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
abluesky0223/finetuned-llama-summarizer-duplicate
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
ckoozzzu/new1
New · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
vietanhdev/llama-3.2-1B-finetuned-finetome-100k-fp16
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
AN
anthracite-org/magnum-v4-12b
Anthracite · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
BI
speakleash/Bielik-7B-v0.1
Bielik · featherless-ai-quants
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing