GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Aisingapore Llama3.1 8b Cpt Sea Lionv3 Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Uncensored_llama_3.2_3b_safetensors
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
GGUF
FA
falcon mamba 7b instruct
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
GGUF
VI
prithivMLmods Viper Coder v1.5 R999
Viper · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
CodingTool use
OL
hamishivi OLMo 1B 0724 SFT hf
OLMo · tensorblock
Params1.28B
Context4K
Smallest0.5 GB
GGUF
QW
Qwen Qwen1.5 14B Chat
Qwen · tensorblock
Params14.2B
Context32K
Smallest5.9 GB
GGUF
OP
openchat openchat v3.2 super
Openchat · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
BL
Bigscience Bloomz 560m
Bloomz · tensorblock
Params816M
Context2K
Smallest0.4 GB
Coding
MI
mistral ko llm
Mistral · tensorblock
Params758M
Context32K
Smallest0.3 GB
GGUF
LL
Meta Llama Meta Llama Guard 2 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
CH
ChatTime 1 7B Chat
Chattime · tensorblock
Params6.82B
Context4K
Smallest2.6 GB
GGUF
MI
MiniLlama 1.8b Chat v0.1
Minillama · tensorblock
Params1.89B
Context2K
Smallest0.7 GB
Tool use
MI
romulus mistral nemo 12b simpo
Mistral · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
LL
Unsloth Llama 3.1 Nemotron Nano 4B v1.1
Llama · tensorblock
Params4.51B
Context128K
Smallest1.8 GB
Tool use
GR
Ibm Granite Granite 3.0 3b A800M Base
Granite · tensorblock
Params3.37B
Context4K
Smallest1.3 GB
GGUF
SO
SOLAR math 2x10.7b v0.2
Solar · tensorblock
Params19.2B
Context4K
Smallest7.1 GB
GGUF
AQ
KurmaAI AQUA 7B
Aqua · tensorblock
Params7.25B
Context32K
Smallest2.7 GB
GGUF
ME
Intelligent Internet II Medical 8B
Medical · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
GGUF
ST
Starcannon Unleashed 12B v1.0
Starcannon · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
LL
Imone Llama 3 8B Fixed Special Embedding
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Embedding
PH
phi 2 pytdml
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
Coding
SL
slim sentiment
Slim · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
DI
Distilbert Distilgpt2
Distilgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
GGUF
AL
alignment handbook zephyr 7b sft full dpo 5e7 cont1
Alignment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SU
supermario v2
Supermario · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Juungwon Llama 3 Instruction Constructionsafety
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
WiNGPT2 Llama 3 8B Base
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
FA
Tiiuae Falcon 40b
Falcon · tensorblock
Params41.8B
Context2K
Smallest15.8 GB
GGUF
KO
KoSOLAR v0.2 gugutypus 10.7B
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
QW
Vi Qwen2 1.5B RAG
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
GGUF

Keep browsing