GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
GE
AliMaatouk/Gemma-2B-Tele
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
SO
Chan2chan1/solar_test_240517_16bit
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_selec1000_pythonblock_ja_en
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
VIRNECT/llama-3-Korean-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ResplendentAI/Kei_Llama3_8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
XX
ankhamun/xxxI-Ixxx
Xxxi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.75_0.5_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Brillibits/Instruct_Llama3_8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
tdrussell/Llama-3-70B-Instruct-Storywriter
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
TA
Sao10K/L3-8B-Tamamo-v1
Tamamo · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
rayonlabs/Qwen2-0.5B-MATH-8a7b1c44-45ee-44f3-934d-ddc8b6e082f1
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GE
williamlcn/gemmaloraall
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
HE
inflatebot/L3-8B-Helium3-baseLlama
Helium · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
princeton-nlp/Llama-3-Instruct-8B-DPO-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TI
xw17/TinyLlama-1.1B-Chat-v1.0_finetuned_s01_3
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
nbeerbower/llama-3-bophades-v3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
knowledgator/Qwen2-0.5Bchp-20000
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
LL
tanliboy/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
lemon-mint/gemma-2b-translation-v0.102
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
tokyotech-llm/Llama-3.1-Swallow-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
KISTI-KONI/KONI-Llama3-8B-20240630
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ME
MiniMoog/Mergerix-7b-v0.2
Mergerix · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
Delta-Vector/Control-8B
Delta · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
nztinversive/llama3.2-1B-HeartDiseasePrediction
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
MO
leesalminen/model-3
Model · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen/Qwen2-7B
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
PA
AIFT/PACK-13b-v1.1
Pack · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
LL
xiaodongguaAIGC/xdg-llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
zeroblu3/NeuralPoppy-EVO-L3-8B
Neuralpoppy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
rudykrol/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB