GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
vicgalle/Roleplay-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
GE
google/gemma-1.1-2b-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MA
bunnycore/Maverick-8B
Maverick · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CR
Cran-May/T.E-8.1
featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
AnimateBow4809/qwen2-math-0.5B-full-2
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_20k_2_2ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
EN
Enno-Ai/ennodata-raw-pankajmathur-13b-peft
Ennodata · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MA
GalrionSoftworks/MagnusIntellectus-12B-v1
Magnusintellectus · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
FA
Kortix/FastApply-1.5B-v1.0
Fastapply · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
zJuu/Qwen-Qwen2-0.5B-1718015356
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
LL
nayohan/llama3-8b-it-translation-sharegpt-en-ko
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Slavic1135/Gemma-2b-it-gen_poem
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
failspy/Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
MergeBench-2B/gemma-2-2b-it_mtl
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
mzbac/llama-3-8B-Instruct-function-calling-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
rinna/llama-3-youko-70b-instruct
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
GE
AMindToThink/gemma-2-2b-it_RMU_s400_a1200_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QU
quantumaikr/quantum-v0.01
Quantum · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
axolotl-ai-co/romulus-mistral-nemo-12b-simpo
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SO
ArianAskari/SOLID-SFT-WoDPO-MixQV2-Zephyr-7b-beta
Solid · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
CallComply/SOLAR-10.7B-Instruct-v1.0-128k
Solar · featherless-ai-quants
Params10.7B
Context128K
Q4_K_M6.5 GB
GGUF
CO
SvalTek/L3-ColdBrew-SpicyReflect
Coldbrew · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CA
botbot-ai/CabraLlama3-8b
Cabrallama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
Bacon666/Phenom-12B-0.1
Phenom · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
JoPmt/Llama-3.2-1B-Instruct
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Poonawala/Llama-3.2-1B
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
GE
unsloth/gemma-1.1-2b-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_40k_2_3ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_10k_1_2ep_4bit
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
OpenPipe/Hermes-2-Theta-Llama-3-8B-32k
Llama · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
Tool use

Keep browsing