GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TE
test 7B slerp
Test · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
DP
Albertfares DPO_MCQA_model_3_03_07_08
Dpo · tensorblock
Params752M
Context32K
Smallest0.3 GB
Coding
TI
Tippy Toppy 7b
Tippy · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
KO
kosolra wiki QA 1epoch
Kosolra · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
RE
Reyna Mini 1.8B v0.2
Reyna · tensorblock
Params1.84B
Context32K
Smallest0.8 GB
Coding
ME
MetaModel
Metamodel · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
GR
Ibm Granite Granite 3.1 1b A400M Instruct
Granite · tensorblock
Params1.33B
Context128K
Smallest0.5 GB
Tool use
HE
HelpingAI 3
Helpingai · tensorblock
Params10.3B
Context32K
Smallest3.9 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Llama 2 Tiny 4kv Heads 4layers Random
Llama · tensorblock
Params9M
Context4K
Smallest0.0 GB
GGUF
TU
TucanoBR Tucano 1b1
Tucano · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
LL
llama3.2 typhoon2 1b instruct
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
Tool use
LL
Braindao Iq Code Evmind v2 Llama3 Code 8b Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Coding
SO
Summerstars SolaraV2 Coder 0511
Solarav · tensorblock
Params362M
Context8K
Smallest0.2 GB
Coding
PA
Paraphrase
Paraphrase · tensorblock
Params248M
Context512
Smallest0.1 GB
GGUF
MI
SciPhi SciPhi Self RAG Mistral 7B 32k
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AZ
Azzurro
Azzurro · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Dreamgen Preview Opus v1.2 Llama 3 8b Instruct Run3.5 Epoch2.5
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
Yi Ko 6B
Mixed · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
LL
llama3 8b spaetzle v37
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SL
SlimMelodicMaid
Slimmelodicmaid · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
mistral 7b nf4 fp16 upscaled
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MA
Magicoder DS 6.7B
Magicoder · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
LL
tartuNLP Llammas Base
Llammas · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
reflect_llama8B_llama-mstlrg-om2-80k_sft-t2_lr1e-6
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
OG
Ogno Monarch Jaskier Merge 7b
Ogno · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Tool use
LL
CYFRAGOVPL Llama PLLuM 8B Chat
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
GE
ENERGY DRINK LOVE gemma 2 9b dpo v4 hq
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
DA
DareBeagle 7B
Darebeagle · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
NU
NucleusAI Nucleus 22B Token 500B
Nucleus · tensorblock
Params21.8B
Context2K
Smallest8.1 GB
GGUF

Keep browsing