GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
WI
tklohj/WindyFloLLM
Windyflollm · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
hamxea/Mistral-7B-v0.1-activity-fine-tuned-v2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KO
Khetterman/Kosmos-8B-v1
Kosmos · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Hachipo/Qwen2.5-0.5B_inst_ja_8250
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
Montecarlo2024/Llama3.2_1b-Instruct_Function-v0.1
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
YR
yrju/ultra_llm_merged
Yrju · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
GalrionSoftworks/Canidori-12B-v1
Canidori · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
braindao/iq-code-evmind-v1-llama3-8b-instruct
Llama · featherless-ai-quants
Params8.03B
Context256K
Q4_K_M4.9 GB
Coding
LL
Zardos/nil_Llama-3-8B-Instruct_v0.1.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AW
maldv/Awqward2.5-32B-Instruct
Awqward · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
LL
nk2t/Llama-3-8B-Instruct-japanese-nk2t-v0.3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
leo35100523/Llama-3.2-1B-distill
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
ET
invisietch/EtherealRainbow-v0.3-8B
Etherealrainbow · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
MergeMerge/gemma-2-2B-allenai-tulu-3-sft-algebra
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top_3000_codeonly_en
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
GE
lemon-mint/gemma-2b-translation-v0.140
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
rombodawg/Rombos-LLM-V2.5-Qwen-7b
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
CU
Khetterman/CursedMatrix-8B-v9
Cursedmatrix · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
somosnlp/GemmaColRAC-AeroExpert
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
SI
SicariusSicariiStuff/Zion_Alpha_Instruction_Tuned
Sicariussicariistuff · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CorticalStack/mistral-7b-openhermes-sft
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
GE
JalilH/fine_tuned_gemma
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_40k_4_1ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
chihoonlee10/T3Q-LLM-MG-DPO-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
CorticalStack/mistral-7b-openhermes-2.5-sft
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
NE
MarinaraSpaghetti/Nemomix-v4.0-12B
Nemomix · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_PPO_Skywork_20.0k_2_3ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
raincandy-u/Llama-3-8b.UNLEASHED
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
dddsaty/SOLAR_Merge_Adapter_DPO_Orca
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
Saxo/Linkbricks-Horizon-AI-Korean-Mistral-Nemo-sft-dpo-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use

Keep browsing