GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
QW
NaoS2/qwen2.5-0.5B_linear25_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LY
nbeerbower/Lyra4-Gutenberg-12B
Lyra · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
shresthagarwal/Llama-3.2-1B-Instruct-LineItem
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
HE
inflatebot/L3-8B-Helium3
Helium · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
MathGenie/MathCoder2-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
flammenai/Mahou-1.2a-llama3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
SteelStorage/llama-3-cat-8b-instruct-v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
HA
Sao10K/L3.1-70B-Hanami-x1
Hanami · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
VE
VeriUs/VeriUS-LLM-8b-v0.2
Verius · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TI
yifanxie/tireless-seagull-1-1
Tireless · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
AN
decapoda-research/Antares-11b-v1
Antares · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
AI-Sweden-Models/Llama-3-8B-instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Etherll/Herplete-LLM-Llama-3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
akshit-Gupta/qwen-new_merged-FinetunedByAG
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
TI
whynlp/tinyllama-zh
Tinyllama · featherless-ai-quants
Params1.24B
Context2K
Q4_K_M0.8 GB
LL
abhinand/Llama-3-Galen-8B-32k-v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
hiieu/Meta-Llama-3-8B-Instruct-function-calling-json-mode
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
braindao/iq-code-evmind-v2-llama3-code-8b-instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
HA
ChaoticNeutrals/Hathor_Tahsin-L3-8B-v0.9
Hathor · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Muadil/Llama-3.2-1B-Instruct_sum_PPO_Skywork_50.0k_2_1ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
IC
icefog72/IceCaffeLatteRP-7b
Icecaffelatterp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top20000_codeonly
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
nbeerbower/llama-3-gutenberg-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
BU
TeeZee/Buttocks-7B-v1.0
Buttocks · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
RH
core-outline/rheia
Rheia · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
Weyaxi/Einstein-v6.1-LLama3-8B-Instruct-Ties
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Muadil/Llama-3.2-1B-Instruct_sum_DPO_40k_4_3ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
teddylee777/Llama-3-Open-Ko-8B-Instruct-teddynote
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
komi77/qwen2.5-0.5B_ed_gauss_freq_15-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
OP
Darkknight535/OpenCrystal-15B-L3-v3
Opencrystal · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB