GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
JU
OpenSafetyLab/MD-Judge-v0.1
Judge · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KA
kakaocorp/kanana-1.5-8b-base
Kanana · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
CH
FallenMerick/Chunky-Lemon-Cookie-11B
Chunky · featherless-ai-quants
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
SI
StatPan/SinGung7B-DPO-v0.1-2200
Singung · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
CerebrumTech/cere-llama-3-8b-tr
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
imsanjoykb/text2ormQuery-odoo-orm-v1-24B-merged-fp32
Text · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
EC
Echelon-AI/medbotlm-v0.2
Echelon · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
chainup244/Qwen-Qwen1.5-1.8B-1718006865
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_10k_1_2ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
netcat420/MFANN-llama3.1-abliterated-v2
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Infinirc/Infinirc-Llama3-8B-2G-Release-v1.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
TheSkullery/llama-3-cat-8b-instruct-v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
AnimateBow4809/qwen2-0.5b-math-lora-big
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
LL
huihui-ai/Meta-Llama-3.1-8B-Instruct-abliterated
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
KONIexp/v3_1_pt_ep1_sft_5_based_on_llama3_1_8b_final_data_20241019
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
mdobbali/Qwen2.5-14B-Instruct-131K
Qwen · featherless-ai-quants
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
LL
princeton-nlp/Llama-3-Base-8B-SFT
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AV
avylor/mh_feedback_model
Avylor · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_PPO_Skywork_10.0k_2_1ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
TR
Muhammad2003/TriMistral-7B-SLERP
Trimistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Locutusque/Hyperion-3.0-Mistral-7B-DPO
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_DPO_1k_1_1ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_40k_2_2ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
AS
ProdeusUnity/Astral-Fusion-8b-v0.0
Astral · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct_selec_4000_pythonblock_ja
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
Locutusque/llama-3-neural-chat-v2.2-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DiscoResearch/Llama3-DiscoLeo-Instruct-8B-32k-v0.1
Llama · featherless-ai-quants
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF
AN
Hastagaras/Anjir-8B-L3
Anjir · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
Kukedlc/NeuralLLaMa-3-8b-DT-v0.1
Neuralllama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
DevWorld/Gemago-2b
Gemago · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF

Keep browsing