GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Ayushnangia/llama3_2_8B_to_1B_test
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Kukedlc/Smart-LLama-3-8b-Python-v5
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
komi77/qwen2.5-0.5B_ed_gauss_linear_20-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
bofenghuang/Meta-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
NousResearch/Hermes-3-Llama-3.1-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
amd/Meta-Llama-3-8B_fp8_quark
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
rmihaylov/Llama-3-DARE-v3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
abhinand/gemma-2b-tamil
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
thangtest/Llama-3.2-1B-Instruct
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
princeton-nlp/Llama-3-Instruct-8B-SLiC-HF
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
leafspark/Llama-3.1-8B-MultiReflection-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
aisingapore/llama3-8b-cpt-sea-lionv2-instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
c1park/20240105_mistral-step50
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Defetya/gemma-2b-ru
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
DA
Edentns/DataVortexS-10.7B-dpo-v1.5
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
SEOKDONG/llama3.1_korean_v1.2_sft_by_aidx
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AN
aniket49/Aniket-gpt_v1.1
Aniket · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
jphme/em_german_leo_mistral
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
ChaoticNeutrals/Eris_Floramix_DPO_7B
Chaoticneutrals · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
AwanLLM/Awanllm-Llama-3-8B-Dolfin-v0.6-Abliterated
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GU
inflatebot/guns-and-roses-r1
Guns · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
QW
hdve/Qwen-Qwen1.5-1.8B-1717276349
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
LL
Saxo/Linkbricks-Horizon-AI-Ko-llama3-Instruct-dpo-8B-base
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
NaoS2/qwen2.5-0.5B_drop_uni10_edu_instruct-3_2
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
abluesky0223/finetuned-llama-summarizer
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
TE
iustinnn/test-model
Test · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CA
Doctor-Shotgun/CalliopeDS-L2-13B
Calliopeds · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
OwenArli/Awanllm-Llama-3-8B-Dolfin-v0.6-Abliterated
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KO
KOCDIGITAL/Kocdigital-LLM-8b-v0.1
Kocdigital · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Crystalcareai/Meta-llama-3.1-8b-instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing