GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Aisingapore Llama3.1 8b Cpt Sea Lionv3 Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Uncensored_llama_3.2_3b_safetensors
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
FA
falcon mamba 7b instruct
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
VI
prithivMLmods Viper Coder v1.5 R999
Viper · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
OL
hamishivi OLMo 1B 0724 SFT hf
OLMo · tensorblock
Params1.28B
Context4K
Smallest0.5 GB
QW
Qwen Qwen1.5 14B Chat
Qwen · tensorblock
Params14.2B
Context32K
Smallest5.9 GB
OP
openchat openchat v3.2 super
Openchat · tensorblock
Params13B
Context4K
Smallest4.9 GB
BL
Bigscience Bloomz 560m
Bloomz · tensorblock
Params816M
Context2K
Smallest0.4 GB
MI
mistral ko llm
Mistral · tensorblock
Params758M
Context32K
Smallest0.3 GB
LL
Meta Llama Meta Llama Guard 2 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
CH
ChatTime 1 7B Chat
Chattime · tensorblock
Params6.82B
Context4K
Smallest2.6 GB
MI
MiniLlama 1.8b Chat v0.1
Minillama · tensorblock
Params1.89B
Context2K
Smallest0.7 GB
MI
romulus mistral nemo 12b simpo
Mistral · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
LL
Unsloth Llama 3.1 Nemotron Nano 4B v1.1
Llama · tensorblock
Params4.51B
Context128K
Smallest1.8 GB
GR
Ibm Granite Granite 3.0 3b A800M Base
Granite · tensorblock
Params3.37B
Context4K
Smallest1.3 GB
SO
SOLAR math 2x10.7b v0.2
Solar · tensorblock
Params19.2B
Context4K
Smallest7.1 GB
AQ
KurmaAI AQUA 7B
Aqua · tensorblock
Params7.25B
Context32K
Smallest2.7 GB
ME
Intelligent Internet II Medical 8B
Medical · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
ST
Starcannon Unleashed 12B v1.0
Starcannon · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
LL
Imone Llama 3 8B Fixed Special Embedding
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
PH
phi 2 pytdml
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
SL
slim sentiment
Slim · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
DI
Distilbert Distilgpt2
Distilgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
AL
alignment handbook zephyr 7b sft full dpo 5e7 cont1
Alignment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SU
supermario v2
Supermario · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Juungwon Llama 3 Instruction Constructionsafety
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
WiNGPT2 Llama 3 8B Base
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
FA
Tiiuae Falcon 40b
Falcon · tensorblock
Params41.8B
Context2K
Smallest15.8 GB
KO
KoSOLAR v0.2 gugutypus 10.7B
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
QW
Vi Qwen2 1.5B RAG
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB