GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
DARUSHKA2161/gemma-2-2b-it-lockal
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
TI
xw17/TinyLlama-1.1B-Chat-v1.0_finetuned_4
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
RefalMachine/ruadapt_mistral7b_full_vo_1e4
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
tmd-rahul/tinyllama-chatbot-merged-v3
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
FI
alexkahng/fin-llm-dpo-lora
Fin · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
adalbertojunior/Llama-3-8B-Dolphin-Portuguese
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
kajuyerim/Llama-3.1-8B-Instruct-Financial-Sentiment-Analysis
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
princeton-nlp/Llama-3-Instruct-8B-KTO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Edgerunners/meta-llama-3-8b-instruct-hf-ortho-baukit-2fail-128total
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CA
Nitral-AI/Captain-Eris-Diogenes_Twilight-V0.420-12B
Captain · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
GE
GuelGaMesh01/gemma-2b-it-finetuned-mental-health-qa
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
TA
BanusreeM/tamil-english-qa-full
Tamil · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
SE
PetroGPT/Severus-7B-DPO
Severus · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KU
SanjiWatsuki/Kunoichi-DPO-v2-7B
Kunoichi · featherless-ai-quants
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Rombo-Org/Rombo-LLM-V2.5-Qwen-14b
Qwen · featherless-ai-quants
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
QW
Dreamkeeper/merged_lora_qwen2
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
BA
jondurbin/bagel-dpo-1.1b-v0.3
Bagel · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Qwen/Qwen1.5-1.8B
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
LL
Zhengyi/LLaMA-Mesh
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Samvardhan777/gemma-2b-mt-German-to-English
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MR
MrRobotoAI/MrRoboto-BASE-v1-7b
Mrroboto · featherless-ai-quants
Params7.24B
Context512K
Q4_K_M4.4 GB
GGUF
BU
aiplanet/buddhi-128k-chat-7b
Buddhi · featherless-ai-quants
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
FN
jambroz/FNCARLplus-7b
Fncarlplus · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Vikhrmodels/Vikhr-Llama3.1-8B-Instruct-R-21-09-24
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TI
tmd-rahul/tinyllama-chatbot-merged-v6
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
ON
gustavecortal/oneirogen-0.5B
Oneirogen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
QW
Qwen/Qwen2-Math-7B-Instruct
Qwen · featherless-ai-quants
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
MI
ewqr2130/mistral-inst-v02-dpo
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_MIFT-ja_manywords_4000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
OW
Sayan01/TL-OWM-CLM
Owm · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing