GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
OL
Allenai OLMo 7B SFT Hf
OLMo · tensorblock
Params6.89B
Context2K
Smallest2.6 GB
MI
mistral ko OpenOrca Platypus v1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QV
Vikhrmodels QVikhr 3 4B Instruction
Qvikhr · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
LL
jpacifico French Alpaca Llama3 8B Instruct v1.0
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
CO
CohereForAI C4Ai Command R 08 2024
Command R · tensorblock
Params32.3B
Context128K
Smallest12.8 GB
GR
Instructlab Granite 7b Lab
Granite · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
BE
Beomi Yi Ko 6B
tensorblock
Params6.18B
Context2K
Smallest2.4 GB
MI
MixtureofMerges MoE 4x7b v5
Mixtureofmerges · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
IT
OldBirdAZ Itab Llm
Itab · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
TR
Truthful DPO MOE 19B
Truthful · tensorblock
Params19.2B
Context4K
Smallest7.1 GB
XL
FINDA FIT xllama instruct
Xllama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
TI
TinyLlama 1.1B step 50K 105b
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
TY
Scb10X Typhoon 7b Instruct 02 19 2024
Typhoon · tensorblock
Params7.27B
Context32K
Smallest2.7 GB
QW
Qwen2.5 Coder 1.5B
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
DE
Huihui Ai DeepSeek R1 Distill Qwen Coder 32B Fusion 9010
DeepSeek · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
CA
CantoneseLLMChat v1.0 7B
Cantonesellmchat · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
EV
Evangelion 7B
Evangelion · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 3.1 Swallow 8B Instruct v0.3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GP
gpt2 platypus dolly guanaco
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
LL
DeepMount00 Llama 3.1 8b ITA
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Moondriller Llama2 13B Eugeneparkthebest
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
ST
Starling LM 7B alpha
Starling · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
QW
Soob3123 GrayLine Qwen3 8B
Qwen · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
LL
calme-3.1-llamaloi-3b
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
MI
Optimum Mistral 1.1b Testing
Mistral · tensorblock
Params1.1B
Context32K
Smallest0.4 GB
ST
StopCarbon ko 10.7B v3
Stopcarbon · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
DA
PocketDoc Dans PersonalityEngine V1.3.0 12b
Dans · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
AL
alignment handbook zephyr 7b ppo 5e7step 102
Alignment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
OL
Allenai OLMo 7B 0724 Instruct Hf
OLMo · tensorblock
Params6.89B
Context4K
Smallest2.6 GB
GR
Ibm Granite Granite 20b Functioncalling
Granite · tensorblock
Params20.1B
Context8K
Smallest7.9 GB