GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Codellama 7b
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
GE
Gemma2 Farsi
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
GGUF
LL
Open_Llama_3B_V2
Llama · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
GGUF
LL
Llama 3 Instruct 8B SLiC HF
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
NP
NPC LLM 3 8B
Npc · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
GGUF
OR
NewstaR 7B Orfini
Orfini · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Masani SFT_modgsm8k_Llama 3.2 3B_epoch_1_global_step_25
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
GGUF
ME
Unsloth Medgemma 27b Text It
Medgemma · tensorblock
Params27B
Context128K
Smallest10.5 GB
ReasoningVision
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · tensorblock
Params4.51B
Context128K
Smallest1.8 GB
Tool use
LL
Yujiepan Llama 3.3 Tiny Random Dim64
Llama · tensorblock
Params8M
Context128K
Smallest0.0 GB
Tool use
LL
Llama 3.1 Tulu 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
PA
Gryphe Pantheon Proto RP 1.8 30B A3B
Pantheon · tensorblock
Params30.5B
Context32K
Smallest11.3 GB
Roleplay
LL
Masani SFT_gsm8k t2_Llama 3.2 1B_epoch_1_global_step_15
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
GGUF
LL
Llama 2 Koen 13b
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
CL
CleverGirl 20b
Clevergirl · tensorblock
Params20B
Context4K
Smallest7.4 GB
GGUF
CA
calme-3.2-instruct-3b
Calme · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
TI
Felladrin TinyMistral 248M Chat v2
Tinymistral · tensorblock
Params248M
Context2K
Smallest0.1 GB
GGUF
SO
Kyujinpy SOLAR Platypus 10.7B v1
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
llama3 8b sft ultrafb
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
TE
k2s3 test 24001
Test · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
SA
Sambanovasystems SambaLingo Thai Base
Sambalingo · tensorblock
Params6.95B
Context4K
Smallest2.7 GB
GGUF
PY
TehVenom Pygmalion Vicuna 1.1 7b
Pygmalion · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
SA
Saiga_Tlite_8B_Abliterated_Sft_M1_D9
Saiga · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
TaylorAI Flash Llama 1B Zombie
Llama · tensorblock
Params1.28B
Context4K
Smallest0.5 GB
GGUF
MI
mistral ft optimized 1227
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Collaiborator MEDLLM Llama 3 8B v1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
OR
orthogonal 2x7B base
Orthogonal · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
GGUF
LL
Llama 3 8b It Ko Chang
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
EX
Yam Peleg Experiment25 7B
Experiment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ST
stackexchange physics
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF

Keep browsing