GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AI
AIFT AIFT Ko Orca Plat Yi Ko 6b v1.2 Dpo 2
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
CO
iq code evmind 7b instruct v0.2411.0
Code · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
CodingTool use
TA
RUCKBReasoning TableLLM 13b
Tablellm · tensorblock
Params13B
Context16K
Smallest4.9 GB
CodingReasoning
MI
Mini DPO test02
Mini · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llama2 13b Dpo v3
Llama · tensorblock
Params13.2B
Context4K
Smallest4.9 GB
GGUF
MO
MoE Merging
Moe · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
GGUF
GE
Gemma 7b
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
GGUF
AI
AISquare Instruct yi ko 6b v0.9.30
Aisquare · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
LL
Beomi EXAONE 3.5 7.8B Instruct Llamafied
Llama · tensorblock
Params7.82B
Context32K
Smallest3.1 GB
GGUF
ST
Starling LM 7B beta
Starling · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
LL
Skywork Skywork Critic Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
PH
Katuni4Ka Tiny Random Phi3
Phi · tensorblock
Params3M
Context4K
Smallest0.0 GB
GGUF
LL
llm4decompile 1.3b
Llm · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
Coding
AC
FreedomIntelligence AceGPT v2 8B Chat
Acegpt · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
TI
Maykeye TinyLLama v0
Tinyllama · tensorblock
Params5M
Context2K
Smallest0.0 GB
GGUF
NE
OpenReasoning Nemotron 32B
Nemotron · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
CodingReasoning
LU
Lumina 3.5
Lumina · tensorblock
Params18.5B
Context32K
Smallest6.8 GB
GGUF
QW
Firefly Qwen1.5 En 7b
Qwen · tensorblock
Params7.72B
Context32K
Smallest3.1 GB
GGUF
TE
test model
Test · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
llama3 eng ko 8 llama
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GH
Ghost 7b v0.9.0
Ghost · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LI
Lix 14B v0.1
Lix · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
Tool use
Q2
Q2AW1M 0000
tensorblock
Params7.62B
Context128K
Smallest3.0 GB
GGUF
IN
Internlm Internlm2_5 7b Chat 1m
InternLM · tensorblock
Params7.74B
Context256K
Smallest3.0 GB
GGUF
LL
SEOKDONG Llama3.1_Korean_V1.1_Sft_By_Aidx
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
NE
neural chat 7b v3 3
Neural · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
GR
Ibm Granite Granite Guardian 3.0 2b
Granite · tensorblock
Params2.53B
Context8K
Smallest1.0 GB
GGUF
LL
Danielbrdz Barcenas Llama3 8b ORPO
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
BA
Bagel Hermes 34B Slerp
Bagel · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
Tool use
BL
Bigscience Bloomz 1b1
Bloomz · tensorblock
Params1.45B
Context2K
Smallest0.7 GB
Coding

Keep browsing