GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Smaug Llama 3 70B Instruct
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
LE
DeepMount00 Lexora Lite 3B_v2
Lexora · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
QW
Mlabonne Qwen3 4B Abliterated
Qwen · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
ReasoningTool use
LL
KnutJaegersberg Walter Llama 1B
Llama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
ST
starcoder2 chat
StarCoder · tensorblock
Params7.17B
Context16K
Smallest2.8 GB
Coding
SO
ft solar 10.7b v2.1 dpo
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
TE
TeenyTinyLlama 460m Chat
Teenytinyllama · tensorblock
Params468M
Context2K
Smallest0.2 GB
GGUF
QW
Qwen QwQ 32B Preview
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
ReasoningTool use
MI
MiniCPM 2B 128k
MiniCPM · tensorblock
Params3.01B
Context64K
Smallest1.3 GB
Coding
MI
mistral 7b uncensored
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
DE
Deepseek Ai Deepseek Coder 7b Base v1.5
DeepSeek · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
Coding
YI
01 Ai Yi 6B 200K
Yi · tensorblock
Params6.06B
Context195K
Smallest2.3 GB
GGUF
MI
Dolphin3.0 R1 Mistral 24B
Mistral · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
CodingReasoningTool use
MA
maestrale chat v0.2 alpha sft
Maestrale · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Chargoddard Yi 6B Llama
Llama · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF
PH
hackint0sh phi 3 clinical
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · tensorblock
Params135M
Context2K
Smallest0.1 GB
Tool use
LL
scb10x llama3.1 typhoon2 8b instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
ME
Mediquad 4x7b
Mediquad · tensorblock
Params19.7B
Context8K
Smallest7.2 GB
GGUF
CH
ChatFrame Uncensored Instruct Small
Chatframe · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
QW
Openbuddy Qwen2.5Llamaify 7b v23.1 200k
Qwen · tensorblock
Params7.62B
Context195K
Smallest3.0 GB
GGUF
ZE
Zephyr 7b Beta
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AT
Atlas Chat 9B
Atlas · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
LL
Openbuddy Llama3 8b v21.1 8k
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GE
INSAIT Institute BgGPT Gemma 2 9B IT v1.0
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
Coding
SM
SmolLM2 135M
SmolLM · tensorblock
Params135M
Context8K
Smallest0.1 GB
GGUF
LL
Codellama CodeLlama 70b Python Hf
Llama · tensorblock
Params69B
Context4K
Smallest25.5 GB
Coding
TO
Llm Agents Tora Code 7b v1.0
Tora · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
QW
Deepcogito Cogito v1 Preview Qwen 14B
Qwen · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
ReasoningTool use

Keep browsing