GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
OL
Allenai OLMo 7B SFT Hf
OLMo · tensorblock
Params6.89B
Context2K
Smallest2.6 GB
GGUF
MI
mistral ko OpenOrca Platypus v1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QV
Vikhrmodels QVikhr 3 4B Instruction
Qvikhr · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
ReasoningTool use
LL
jpacifico French Alpaca Llama3 8B Instruct v1.0
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
CO
CohereForAI C4Ai Command R 08 2024
Command R · tensorblock
Params32.3B
Context128K
Smallest12.8 GB
GGUF
GR
Instructlab Granite 7b Lab
Granite · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
BE
Beomi Yi Ko 6B
tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
MI
MixtureofMerges MoE 4x7b v5
Mixtureofmerges · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
GGUF
IT
OldBirdAZ Itab Llm
Itab · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
TR
Truthful DPO MOE 19B
Truthful · tensorblock
Params19.2B
Context4K
Smallest7.1 GB
GGUF
XL
FINDA FIT xllama instruct
Xllama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
GGUF
TI
TinyLlama 1.1B step 50K 105b
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
Coding
TY
Scb10X Typhoon 7b Instruct 02 19 2024
Typhoon · tensorblock
Params7.27B
Context32K
Smallest2.7 GB
GGUF
QW
Qwen2.5 Coder 1.5B
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
Coding
DE
Huihui Ai DeepSeek R1 Distill Qwen Coder 32B Fusion 9010
DeepSeek · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
CodingReasoningTool use
CA
CantoneseLLMChat v1.0 7B
Cantonesellmchat · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
EV
Evangelion 7B
Evangelion · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llama 3.1 Swallow 8B Instruct v0.3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GP
gpt2 platypus dolly guanaco
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
LL
DeepMount00 Llama 3.1 8b ITA
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Moondriller Llama2 13B Eugeneparkthebest
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
ST
Starling LM 7B alpha
Starling · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
QW
Soob3123 GrayLine Qwen3 8B
Qwen · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
ReasoningTool use
LL
calme-3.1-llamaloi-3b
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
MI
Optimum Mistral 1.1b Testing
Mistral · tensorblock
Params1.1B
Context32K
Smallest0.4 GB
GGUF
ST
StopCarbon ko 10.7B v3
Stopcarbon · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
DA
PocketDoc Dans PersonalityEngine V1.3.0 12b
Dans · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
CodingRoleplay
AL
alignment handbook zephyr 7b ppo 5e7step 102
Alignment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
OL
Allenai OLMo 7B 0724 Instruct Hf
OLMo · tensorblock
Params6.89B
Context4K
Smallest2.6 GB
GGUF
GR
Ibm Granite Granite 20b Functioncalling
Granite · tensorblock
Params20.1B
Context8K
Smallest7.9 GB
GGUF

Keep browsing