GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
2A
2A2I-R/L500MT
featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.15_0.15_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
AT
Nexusflow/Athene-70B
Athene · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
AS
SteelStorage/L3.1-MS-Astoria-70b-v2
Astoria · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
harangstar/Llama3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MC
williamlcn/3400_mcq
Mcq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
tesser-ai/Tesser-Llama-3-Ko-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
empower-dev/llama3-empower-functions-large-v1.1
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DI
WaltonFuture/Diabetica-7B
Diabetica · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
NE
Kukedlc/NeuralSynthesis-7b-v0.4-slerp
Neuralsynthesis · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LM
Yhyu13/LMCocktail-10.7B-v1
Lmcocktail · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
KaraKaraWitch/Llama-ProgressPushDoll-3.3-70Bees
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NI
Nitral-AI/Hathor_Tahsin-L3-8B-v0.85
Nitral · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
NousResearch/Meta-Llama-3.1-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.25_0.25_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
priyanshi27dixit/gemma2-sft-peft
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SY
v000000/SyntheticMoist-11B-v2
Syntheticmoist · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
manbull/Qwen-Qwen1.5-1.8B-1717497140
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
LL
lamliki/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MI
nbeerbower/mistral-nemo-gutenberg3-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
AwanLLM/Awanllm-Llama-3-8B-Dolfin-v0.3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
richard-park/llama-3-8B-inst-unsloth-ko-merged-1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
cloudyu/Meta-Llama-3-70B-Instruct-DPO
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
HI
hiig-piai/simba_best_092024
Hiig · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
tokyotech-llm/Llama-3-Swallow-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SH
NExtNewChattingAI/shark_tank_ai_7_b
Shark · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
princeton-nlp/Mistral-7B-Base-SFT-SimPO
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CU
jwkweon/CUBOX-SOLAR-DPO-v0.3
Cubox · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
princeton-nlp/Llama-3-Instruct-8B-RDPO-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing