GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
SC
FelixChao/Scorpio-7B
Scorpio · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
PK
PKU-ONELab/Themis
Pku · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
T3Q-LLM/T3Q-LLM2-sft1.2
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
nbeerbower/llama-3-slerp-kraut-dragon-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
osllmai-community/Llama-3.2-1B-Instruct
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
T3Q-LLM/T3Q-LLM2-CV-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
VAGOsolutions/Llama-3.1-SauerkrautLM-70b-Instruct
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
stewy33/acc_rd_ttt-Llama-3.2-1B-Instruct
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
NurtureAI/Meta-Llama-3-8B-Instruct-64k
Llama · featherless-ai-quants
Params8.03B
Context64K
Q4_K_M4.9 GB
LL
NeverSleep/Llama-3-Lumimaid-70B-v0.1
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
datek/Qwen-Qwen1.5-1.8B-1717418994
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
SV
SvalTek/SpicedTahsin
Svaltek · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
MergeBench/gemma-2-2b_instruction
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
NE
mlabonne/NeuralDaredevil-7B
Neuraldaredevil · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
Edentns/DataVortexS-10.7B-dpo-v1.2
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
SW
SWE-bench/SWE-agent-LM-32B
Swe · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
SuperPowerMz/SON_Mistral-7B-QLoRA-Peft
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MY
gihong99/Myrrh_solar_10.7b_3.0
Myrrh · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
SongTonyLi/Llama-3.2-1B-Instruct-CPT-D1_chosen-pref-mix2
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.15_0.15_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.5_0.5_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
AL
Alsebay/test-model
Alsebay · featherless-ai-quants
Params10.7B
Context8K
Q4_K_M6.5 GB
LL
yhavinga/Boreas-Llama-3-8B-chat-16k-checkpoint
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
pwork7/llama31_it_prm_2e6_bz32_1epoch_conversation
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
FU
fusionbase/fusion-guide-12b-0.1
Fusion · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
picAIso/MIX1
Mix · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TE
migtissera/Tess-XS-v1.1
Tess · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
DatToad/Chuluun-Qwen2.5-72B-v0.08
Qwen · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
NE
M4-ai/neural-chat-mini-v2.2-1.8B
Neural · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
LL
4yo1/llama3-eng-ko-8b-sl3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB