GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
ST
bluuwhale/L3-SthenoMaidBlackroot-8B-V1
Sthenomaidblackroot · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
PR
Loyola/practice-kullmmistral-7b
Practice · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Flolight/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
selfcorrexp2/llama3_sft_balanced_rr60k_train_on_corr_ep3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ryzen88/Llama-3-70b-Arimas-story-RP-V2.0
Llama · featherless-ai-quants
Params70.6B
Context256K
Q4_K_M42.5 GB
RE
ResplendentAI/Nymph_8B
Resplendentai · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
williamlcn/gemmaonlysft
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
RE
usmanxia/resonance-it-ft
Resonance · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
DataPilot/Llama3.1-ArrowSE-v0.4
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
grimjim/Llama-3-Luminurse-v0.2-OAS-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SE
ChaoticNeutrals/Sekhmet_Bet-L3.1-8B-v0.2
Sekhmet · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
abeja/ABEJA-Qwen2.5-7b-Japanese-v0.1
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
KaraKaraWitch/Matsutei-Qwen2.5-72b
Qwen · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
nk2t/Llama-3-8B-Instruct-japanese-nk2t-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
sophosympatheia/New-Dawn-Llama-3-70B-32K-v1.0
Llama · featherless-ai-quants
Params70.6B
Context32K
Q4_K_M42.5 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer15
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
CE
nothingiisreal/Celeste-12B-V1.6
Celeste · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
williamlcn/gen_mcq
Gen · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
DA
PocketDoc/Dans-DangerousWinds-V1.1.0-12b
Dans · featherless-ai-quants
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Locutusque/ChatHercules-2.5-Mistral-7B-DPO
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.15_0.25_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
OneGate/Llama3-OGSQL-FT-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
CI
daneggertmoeller/CircularConstructionGPT-1
Circularconstructiongpt · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
shigureui/lightnovel_cpt
Lightnovel · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
almorin/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
AL
allknowingroger/TripleMerge2-7B-Ties
Allknowingroger · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
rombodawg/Rombos-LLM-V2.6-Qwen-14b
Qwen · featherless-ai-quants
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top_4000_pythonblock_ja
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
MI
WebraftAI/synapsellm-7b-mistral-v0.3-preview
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
BI
speakleash/Bielik-7B-Instruct-v0.1
Bielik · featherless-ai-quants
Params7.24B
Context4K
Q4_K_M4.4 GB