GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Smaug Llama 3 70B Instruct
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
LE
DeepMount00 Lexora Lite 3B_v2
Lexora · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
QW
Mlabonne Qwen3 4B Abliterated
Qwen · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
LL
KnutJaegersberg Walter Llama 1B
Llama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
ST
starcoder2 chat
StarCoder · tensorblock
Params7.17B
Context16K
Smallest2.8 GB
SO
ft solar 10.7b v2.1 dpo
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
TE
TeenyTinyLlama 460m Chat
Teenytinyllama · tensorblock
Params468M
Context2K
Smallest0.2 GB
QW
Qwen QwQ 32B Preview
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
MI
MiniCPM 2B 128k
MiniCPM · tensorblock
Params3.01B
Context64K
Smallest1.3 GB
MI
mistral 7b uncensored
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DE
Deepseek Ai Deepseek Coder 7b Base v1.5
DeepSeek · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
YI
01 Ai Yi 6B 200K
Yi · tensorblock
Params6.06B
Context195K
Smallest2.3 GB
MI
Dolphin3.0 R1 Mistral 24B
Mistral · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
MA
maestrale chat v0.2 alpha sft
Maestrale · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Chargoddard Yi 6B Llama
Llama · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
PH
hackint0sh phi 3 clinical
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
SM
SmolLM 135M Instruct
SmolLM · tensorblock
Params135M
Context2K
Smallest0.1 GB
LL
scb10x llama3.1 typhoon2 8b instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ME
Mediquad 4x7b
Mediquad · tensorblock
Params19.7B
Context8K
Smallest7.2 GB
CH
ChatFrame Uncensored Instruct Small
Chatframe · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
QW
Openbuddy Qwen2.5Llamaify 7b v23.1 200k
Qwen · tensorblock
Params7.62B
Context195K
Smallest3.0 GB
ZE
Zephyr 7b Beta
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
AT
Atlas Chat 9B
Atlas · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
LL
Openbuddy Llama3 8b v21.1 8k
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GE
INSAIT Institute BgGPT Gemma 2 9B IT v1.0
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
PH
Phi 3 Mini 4k Instruct
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
SM
SmolLM2 135M
SmolLM · tensorblock
Params135M
Context8K
Smallest0.1 GB
LL
Codellama CodeLlama 70b Python Hf
Llama · tensorblock
Params69B
Context4K
Smallest25.5 GB
TO
Llm Agents Tora Code 7b v1.0
Tora · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
QW
Deepcogito Cogito v1 Preview Qwen 14B
Qwen · tensorblock
Params14.8B
Context128K
Smallest5.8 GB