GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
KR
kromcomp/L3-Ceto-Epith-Humanity.A-v0.1-8B
Kromcomp · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ES
v000000/MN-12B-Estrella-v2.2
Estrella · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
MCES10/code-gen-gemma-2-2b-it
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
CR
Cran-May/Test2_SLIDE
Cran · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
komi77/qwen2.5-0.5B_educational_instruct_gause_freq_max5.8p-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
SA
Samee-ur/NeuralPipe-7B-slerp-DPO
Samee · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TM
Tgratzi/TMA-TinyLlama-tuned
Tma · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
SF
aryolotfi/SFT_gsm8k_rho-math-1b-v0.1_epoch_4_global_step_116
Sft · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
GE
Satwik11/gemma-2b-mt-Hindi-Fintuned
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
longtc/llama3.2-1B
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
youjunhyeok/llama3-koen-sft-dpo-v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
KnutJaegersberg/Llama-3-Deita-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
nirajandhakal/gemma-2b-base
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
SU
crestf411/L3.1-8B-sunfall-stheno-v0.6.1
Sunfall · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
minpeter/Llama-3.2-1B-AlternateTokenizer-tool-chatml
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
SO
Cartinoe5930/SOLAR-10.7B-iDUS-1layer
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
muscle-memory/head-tuned-llama-from-qwen-math
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SF
williamlcn/17718_sft_32_sh_0317
Sft · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
magnifi/qwen2-rephrase-classify-multitask-news-correction
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
SA
sail/Sailor-1.8B-Chat
Sailor · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
LL
KISTI-KONI/KONI-Llama3.1-70B-Instruct-20241115
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
disi-unibo-nlp/llama3.2-1B-SFT-medqa-triples-cot
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
QW
WDong/qwen1.5-1.8B-seed-sft
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
LL
NESPED-GEN/Llama-3.2-text2SQL-alias
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
QW
Qwen/Qwen2-72B
Qwen · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
XE
Xenon1/Xenon-4
Xenon · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
wons/mistral-7B-test-v0.2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
adamo1139/Mistral-7B-AEZAKMI-v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
T3Q-LLM/T3Q-LLM2-FP-v2.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SA
DreadPoor/Satyr-7B-Model_Stock
Satyr · featherless-ai-quants
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing