GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Ank028 Llama 3.2 1B Instruct Commonsense_Qa
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
GP
Openai Community Gpt2
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
LL
llama 2 7b ruyallm
Llama · tensorblock
Params6.84B
Context4K
Smallest2.6 GB
LL
Infinirc Infinirc Llama3 8B 2G Release v1.0
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
RE
redpajama 3b chat
Redpajama · tensorblock
Params2.78B
Context5K
Smallest1.1 GB
LL
llama3 passthrough chat
Llama · tensorblock
Params11.5B
Context8K
Smallest4.5 GB
ME
Abacusai MetaMath Bagel 34b v0.2 C1500
Metamath · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
AG
Agentlm 7b
Agentlm · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
DU
DuckDB NSQL 7B v0.1
Duckdb · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
LL
Llama3.3 70B CogniLink
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
OP
Infly OpenCoder 1.5B Base
Opencoder · tensorblock
Params1.91B
Context4K
Smallest1.1 GB
SA
Equall Saul 7B Base
Saul · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ST
stealth v1.2
Stealth · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
PY
Pythia 31m
Pythia · tensorblock
Params31M
Context2K
Smallest0.0 GB
CH
ds chat reflection adamw iter1
Chat · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
QW
Stpete2 Qwen2.5 0.5B Gsm8K Sft
Qwen · tensorblock
Params16M
Context32K
Smallest0.0 GB
PH
wafl phi3.5 mini instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
KO
Ewof Koishi Instruct 3b
Koishi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
YU
Yulan Team YuLan Mini
Yulan · tensorblock
Params2.42B
Context28K
Smallest1.5 GB
LL
Codellama CodeLlama 34b Python Hf
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
SM
SmolLM 1.7B Instruct
SmolLM · tensorblock
Params1.71B
Context2K
Smallest0.7 GB
LL
Hfl Llama 3 Chinese 8b Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GP
gpt2 alpaca gpt4
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
QW
Tongyi Zhiwen QwenLong L1 32B
Qwen · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
MU
Multiverse4FM Multiverse 32B
Multiverse · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
MI
Nilq Mistral 1L Mini
Mistral · tensorblock
Params4M
Context2K
Smallest0.0 GB
LL
Llama 3 SauerkrautLM 8b Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
Midnight Miqu 70b v1.5
Midnight · tensorblock
Params69B
Context32K
Smallest25.5 GB
FA
Tiiuae Falcon3 Mamba 7B Instruct
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
DE
Huihui Ai DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · tensorblock
Params70.6B
Context128K
Smallest26.4 GB