GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
alfredplpl/Llama-3-8B-Instruct-Ja
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
oieieio/Qwen2.5-Coder-0.5B-Instruct
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
DE
KnutJaegersberg/Deita-32b
Deita · featherless-ai-quants
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
SO
martyn/solar-megamerge-dare-10.7b-v1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TI
Jgdshkovi/tinyllama-finetuned-for-p1-v0
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
dhmeltzer/Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SO
Changgil/K2S3-SOLAR-11b-v4.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SK
SkyOrbis/SKY-Ko-Solar-10.7B-lora
Sky · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TI
ambrosfitz/TinyLlama-1.1B-Chat-yawp
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
Radu1999/Mistral-Instruct-Ukrainian-SFT
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SH
fingerclose/Shelly
Shelly · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
SakanaAI/Llama-3-8B-Instruct-CycleQD-CS
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
skarnam/gemma-2-2b-it-unaligned
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
TheDrummer/Llama-3SOME-8B-v2
Llama · featherless-ai-quants
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
AL
allura-org/TQ2.5-14B-Aletheia-v1
Aletheia · featherless-ai-quants
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
AS
Steelskull/L3-MS-Astoria-70b
Astoria · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
ResplendentAI/SOVL_Llama3_8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_1k_1_2ep_4bit
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
ST
ChaoticNeutrals/Stanta-Lelemon-Maid-7B
Stanta · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
SillyTilly/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
IN
internlm/SWE-Fixer-Retriever-7B
InternLM · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
TH
Ai-Thalli/Ai-Thalli-Telugu-Model
Thalli · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
dhmeltzer/Llama-2-13b-hf-ds_wiki_1024_full_r_64_alpha_16_merged
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
CorticalStack/mistral-7b-metamathqa-sft
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct_selec5000_pythonblock_dataselection_enja
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
DE
lex-hue/Delexa-Instruct-V0.1-7b
Delexa · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CA
ChaoticNeutrals/Captain-Eris_Twilight-V0.420-12B
Captain · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
Dampfinchen/Llama-3.1-8B-Ultra-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing