GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Ank028 Llama 3.2 1B Instruct Commonsense_Qa
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
GGUF
GP
Openai Community Gpt2
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
LL
llama 2 7b ruyallm
Llama · tensorblock
Params6.84B
Context4K
Smallest2.6 GB
GGUF
LL
Infinirc Infinirc Llama3 8B 2G Release v1.0
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
RE
redpajama 3b chat
Redpajama · tensorblock
Params2.78B
Context5K
Smallest1.1 GB
GGUF
LL
llama3 passthrough chat
Llama · tensorblock
Params11.5B
Context8K
Smallest4.5 GB
GGUF
ME
Abacusai MetaMath Bagel 34b v0.2 C1500
Metamath · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
AG
Agentlm 7b
Agentlm · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
DU
DuckDB NSQL 7B v0.1
Duckdb · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
GGUF
LL
Llama3.3 70B CogniLink
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Reasoning
OP
Infly OpenCoder 1.5B Base
Opencoder · tensorblock
Params1.91B
Context4K
Smallest1.1 GB
Coding
SA
Equall Saul 7B Base
Saul · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ST
stealth v1.2
Stealth · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
PY
Pythia 31m
Pythia · tensorblock
Params31M
Context2K
Smallest0.0 GB
GGUF
CH
ds chat reflection adamw iter1
Chat · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
GGUF
QW
Stpete2 Qwen2.5 0.5B Gsm8K Sft
Qwen · tensorblock
Params16M
Context32K
Smallest0.0 GB
Reasoning
PH
wafl phi3.5 mini instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
KO
Ewof Koishi Instruct 3b
Koishi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
YU
Yulan Team YuLan Mini
Yulan · tensorblock
Params2.42B
Context28K
Smallest1.5 GB
Coding
LL
Codellama CodeLlama 34b Python Hf
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
SM
SmolLM 1.7B Instruct
SmolLM · tensorblock
Params1.71B
Context2K
Smallest0.7 GB
Tool use
LL
Hfl Llama 3 Chinese 8b Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GP
gpt2 alpaca gpt4
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
QW
Tongyi Zhiwen QwenLong L1 32B
Qwen · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
MU
Multiverse4FM Multiverse 32B
Multiverse · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
Tool use
MI
Nilq Mistral 1L Mini
Mistral · tensorblock
Params4M
Context2K
Smallest0.0 GB
GGUF
LL
Llama 3 SauerkrautLM 8b Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
Midnight Miqu 70b v1.5
Midnight · tensorblock
Params69B
Context32K
Smallest25.5 GB
GGUF
FA
Tiiuae Falcon3 Mamba 7B Instruct
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
GGUF
DE
Huihui Ai DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
ReasoningTool use

Keep browsing