GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
ER
ChaoticNeutrals/Eris_PrimeV4.20-Vision-32k-7B
Eris · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
Vision
GE
AliMaatouk/Gemma-2B-Tele-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
trashpanda-org/QwQ-32B-Snowdrop-v0
Qwen · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.8 GB
ReasoningTool use
MI
flammenai/Flammades-Mistral-Nemo-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
NE
OpenBuddy/openbuddy-nemotron-70b-v23.1-131k
Nemotron · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
SA
priyanshi27dixit/SAFETY_PEFT_VECTOR
Safety · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SO
ArianAskari/SOLID-SFT-DPO-MixQV3-SOLIDChosen-SFTRejected-Zephyr-7b-beta
Solid · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
mlabonne/Meta-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top_2000_pythonblock_ja
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
knowledgator/Qwen2-0.5Bchp-690k
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
LL
PathFinderKR/Waktaverse-Llama-3-KO-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
1024m/gemma-2-2b-it-Base
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
DA
PocketDoc/Dans-PersonalityEngine-v1.0.0-8b
Dans · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
coconana/Qwen-Qwen1.5-1.8B-1717809121
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
LL
Fischerboot/LLama3-Lexi-Aura-3Some-SLERP-SLERP-15B
Llama · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
CO
williamlcn/6851_32_16_0318_combined_ep1
Combined · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_MIFT-en_manywords_2000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
BAAI/Infinity-Instruct-3M-0625-Qwen2-7B
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
princeton-nlp/Llama-3-Instruct-8B-RDPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
princeton-nlp/Llama-3-Instruct-8B-SimPO-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BL
cookinai/Blitz-v0.1
Blitz · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen/Qwen1.5-32B-Chat
Qwen · featherless-ai-quants
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
MC
williamlcn/6851_mcq_64_64
Mcq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
magnifi/qwen2-rephrase-classify-multitask-v8
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
OW
Sayan01/TL-OWM-CLM-SFT
Owm · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
Sayan01/Phi3-TL-ORCAMEL-5
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
Sayan01/Phi3-TL-ORCAMEL-KL
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
aixsatoshi/Llama-3-youko-8b-instruct-chatvector
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LU
NeverSleep/Lumimaid-v0.2-8B
Lumimaid · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
DeepMount00/Qwen2-1.5B-Ita
Qwen · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF

Keep browsing