GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
ystemsrx/Qwen2-Boundless
Qwen · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
GE
sarthak-nik/gemma2b_full_ft_dare
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
beomi/Llama-3-Open-Ko-8B-Instruct-preview
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
satpalsr/Meta-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SE
SeaLLMs/SeaLLMs-v3-7B-Chat
Seallms · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MI
arnavgrg/mistral-7b-nf4-fp16-upscaled
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Saxo/Linkbricks-Horizon-AI-Korean-llama3.1-sft-dpo-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
leekanghoun1/llm_exercise
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
ModelCloud/Llama3.2-1B-Instruct
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
dhmeltzer/Llama-2-13b-hf-ds_eli5_1024_r_64_alpha_16_merged
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
yaojialzc/Gigi-Llama3-8B-Chinese-zh
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SP
cstr/Spaetzle-v69-7b
Spaetzle · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
BlackFear/llama-3.2-1b-sorucevap
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
spow12/Llama3_ko_4.2_sft
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EV
FPHam/L3-8B-Everything-COT
Everything · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AR
arcee-ai/Arcee-Spark
Arcee · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top75
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
aifeifei798/DarkIdol-Llama-3.1-8B-Instruct-1.1-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Saxo/Linkbricks-Horizon-AI-Nous-Hermes-3-Llama3.1-Korean-cpt-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
Mr-Vicky-01/Gemma2B-Finetuned-CoverLetter
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
scb10x/llama-3-typhoon-v1.5-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
coconana/Qwen-Qwen1.5-1.8B-1717129922
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
SI
williamlcn/17718_simpo_32_16_05e_0317
Simpo · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SP
neuralmagic/SparseLlama-3-8B-pruned_50.2of4
Sparsellama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
WE
Weni/WeniGPT-2.2.3-Zephyr-7B-merged-LLM_Base_2.0.3_SFT
Wenigpt · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
cstr/llama3-8b-spaetzle-v33
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
grimjim/llama-3-aaditya-OpenBioLLM-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
tomasonjo/text2cypher-demo-16bit
Text · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
winninghealth/WiNGPT2-Llama-3-8B-Chat
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing