GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Silomay Llama 3.2 3b Model
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
GGUF
MI
MIAOAI Qa Retailpro
Miaoai · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
ME
Haebo Meow Clovax v3
Meow · tensorblock
Params1.59B
Context128K
Smallest0.7 GB
GGUF
OL
Allenai OLMo 2 0325 32B
OLMo · tensorblock
Params32.2B
Context4K
Smallest12.0 GB
GGUF
QW
Winglian Qwen3 4b Math
Qwen · tensorblock
Params4.02B
Context32K
Smallest1.7 GB
ReasoningTool use
SU
L3.1 8B sunfall v0.6.1 dpo
Sunfall · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
MA
Marcoro14 7B slerp
Marcoro · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AL
BSC LT ALIA 40b
Alia · tensorblock
Params40.4B
Context4K
Smallest15.7 GB
Coding
TI
TinyLLama 4x1.1B MoE
Tinyllama · tensorblock
Params3.38B
Context2K
Smallest1.3 GB
GGUF
NE
NemoReRemix 12B
Nemoreremix · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
TR
Voicelab Trurl 2 13b Academic
Trurl · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
GR
Ibm Granite Granite 3b Code Instruct 128k
Granite · tensorblock
Params3.48B
Context125K
Smallest1.3 GB
CodingTool use
PH
MoxoffSrL Moxoff Phi3Mini ORPO
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
LL
llama3 generative qa 2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama 3.3 70B Instruct Abliterated
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Tool use
SE
semcoder 1030
Semcoder · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
PU
Puma 3B
Puma · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
GGUF
LL
Kimjaewon Open Llama 2 Ko 7b Kullm
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
GGUF
NE
Yodayo Ai Nephra_V1.0
Nephra · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
NE
NeuralHermes MoE 2x7B
Neuralhermes · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
Tool use
CU
Custom KoLLM 13B v8
Custom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
LL
4yo1 Llama3 Pre1 Pre2 Inst3 Lora3 Mergkit Base
Llama · tensorblock
Params7.99B
Context8K
Smallest3.2 GB
GGUF
LL
llama2 7b raw sft
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Nellyw888 VeriReason codeLlama 7b RTLCoder Verilog GRPO Reasoning Tb
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
CodingReasoning
MI
Mistral 7B Instruct v0.2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
JA
Hadadrjt JARVIS
Jarvis · tensorblock
Params14.8B
Context40K
Smallest5.8 GB
ReasoningTool use
LL
TheBloke CodeLlama 34B Instruct Fp16
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
QW
Qwen2.5 Coder 7B Instruct 20
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
CodingTool use
LO
LongAlpaca 13B
Longalpaca · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
MI
malaysian mistral 7b 32k instructions v4
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF

Keep browsing