GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
nvidia/OpenMath-Mistral-7B-v0.1-hf
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
decem/Dionysus-Mistral-m3-v5
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
h2oai/h2ogpt-gm-7b-mistral-chat-sft-dpo-rag-v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
SongTonyLi/Llama-3.2-1B-Instruct-SFT-D_chosen-pref-mix6
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
AL
Alphacode-AI/Alphallama3-8B_v2
Alphallama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
MaziyarPanahi/calme-2.2-llama3.1-70b
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
realPCH/240104_mistral_lora
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IR
iRyanBell/ARC1
Iryanbell · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
BlouseJury/Mistral-7B-Discord-0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
AIDX-ktds/ktdsbaseLM-v0.13-onbased-llama3.1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.5_0.75_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
RefalMachine/llama3_darulm_20_05_24_part1-2_128000_bpe_mean_init_03_07_24
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ZE
Weyaxi/zephyr-beta-Nebula-v2-7B
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.5_0.75_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
SongTonyLi/Llama-3.2-1B-Instruct-SFT-D_chosen-Magpie
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LY
divinetaco/L3.3-70B-Lycosa-v0.2
Lycosa · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
GE
AMindToThink/gemma-2-2b-it_RMU_s400_a1200_layer11
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SI
ABX-AI/Silver-Sun-11B
Silver · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LO
lodrick-the-lafted/Kudzu-8B
Lodrick · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
NLPark/Test0_SLIDE
Test · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DO
Weyaxi/Dolphin-Nebula-7B
Dolphin · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EC
NingLab/eCeLLM-L
Ecellm · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top10000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
AT
CVP164/ATAK-2
Atak · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
DA
ProdeusUnity/Dazzling-Star-Aurora-70b-v0.0-Experimental-0123
Dazzling · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
T3Q-LLM/T3Q-LLM2-sft1.3
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
KaraKaraWitch/SteyrCannon-Qwen2.5-72b
Qwen · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
LL
fanherodev/Llama-3.2-1B-Instruct
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
CA
AtAndDev/CapybaraMarcoroni-7B
Capybaramarcoroni · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
uukuguy/speechless-mistral-moloras-7b
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing