GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
akshit-Gupta/llama1Bredmerged-FinetunedByAG
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top3000_pythonblock_ja_en
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
OwenArli/ArliAI-Llama-3-8B-Cumulus-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
chainup244/Qwen-Qwen1.5-1.8B-1718071906
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
MC
drudilorenzo/mcqa_sft
Mcqa · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
MA
micaebe/math-self-play-0.5B
Math · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
HA
ChaoticNeutrals/Hathor_Respawn-L3-8B-v0.8
Hathor · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.25_0.25_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MF
netcat420/MFANNv0.17.10
Mfannv · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
LL
Dampfinchen/Llama-3-8B-Ultra-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
heegyu/Mistral-7B-v0.1-OKI-v20231124-1e-5
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
lizchu413/phase1_qwen2.5_0.5b_csn
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
SO
sophosympatheia/Sophos-eva-euryale-v1.0
Sophos · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
MaziyarPanahi/calme-2.7-qwen2-7b
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
irlab-udc/Llama-3.1-8B-Instruct-Galician
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
AMindToThink/gemma-2-2b-it_RMU_s200_a300_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
AMindToThink/gemma-2-2b-it_RMU_s200_a1200_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top2000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
SA
VAGOsolutions/SauerkrautLM-SOLAR-Instruct
Sauerkrautlm · featherless-ai-quants
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
QW
NaoS2/qwen2.5-0.5B_uni20_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
GE
Salvatale/gemma-2b-chiesa
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
amazon/MegaBeam-Mistral-7B-300k
Mistral · featherless-ai-quants
Params7.24B
Context282K
Q4_K_M4.4 GB
GGUF
QR
maldv/QReasoner2.5-32B-Instruct
Qreasoner · featherless-ai-quants
Params32.8B
Context40K
Q4_K_M19.9 GB
ReasoningTool use
MI
devhyun88/ku-mistral-7b-PGO-v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LO
lodrick-the-lafted/Rummage-8B
Lodrick · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
SkyOrbis/SKY-Ko-Llama3-8B-lora
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct-2
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
We-Want-GPU/SOLAR-10.7B-orca-alpaca-gpt4-lora-653
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
walidmess/llama3_finnance3
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing