GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
SO
ArianAskari/SOLID-SFT-DPO-MixQV3-SOLIDRejected-SFTChosen-Zephyr-7b-beta
Solid · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
allura-org/MN-12b-RP-Ink
Ink · featherless-ai-quants
Params12.2B
Context128K
Q4_K_M7.5 GB
CO
Edens-Gate/control-12B-e2
Control · featherless-ai-quants
Params12.2B
Context128K
Q4_K_M7.5 GB
VA
Value4AI/ValueLlama-3-8B
Valuellama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TH
cgato/L3-TheSpice-8b-v0.1.3
Thespice · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TH
TheHierophant/Fimbulvetr-11B-Attention-V0.1-test
Thehierophant · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Metin/LLaMA-3-8B-Instruct-TR-DPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
rombodawg/rombos_Replete-Coder-Llama3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
rasa/cmd_gen_llama_3.1_8b_calm_demo
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
leekh7624/Llama-3-Open-Ko-8B-Instruct-sample
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
rinna/deepseek-r1-distill-qwen2.5-bakeneko-32b
DeepSeek · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
T3Q-LLM-Product/T3Q-LLM2-Solar-10.7B-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
CY
cypienai/cymist2-v01-SFT
Cymist · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
TW
mlabonne/TwinLlama-3.1-8B
Twinllama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
kaist-ai/mistral-orpo-beta
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
DI
sawadikab/diet-manager
Diet · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
RohitSuresh15/llama3.2_1b-medical-v1
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
SongTonyLi/Llama-3.2-1B-Instruct-SFT-D_chosen-pref-mix5
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Envoid/L3.1-8B-Llamoutcast
Llamoutcast · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
birgermoell/Llama-3-dare_ties
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
nbeerbower/llama-3-stinky-v2-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
nbeerbower/Mahou-Gutenberg-Nemo-12B
Mahou · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
DA
DavidAU/L3-Dark-Planet-8B-V2-Eight-Orbs-Of-Power
Dark · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
pt-sk/ll-3.2-1B_Instruct
Instruct · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
NE
UsernameJustAnother/Nemo-12B-Marlin-v8
Nemo · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
TI
Ninjacart/tinyllama-sms_parsert-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Undi95/Meta-Llama-3-70B-Instruct-hf
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
OwenArli/ArliAI-Llama-3-8B-Dolfin-v0.3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB