GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
HE
HelpSteer filtered 7B
Helpsteer · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SO
Jingyeom SOLAR_KO_1.3_deup
Solar · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
GGUF
PY
Vandijklab C2S Pythia 410m Diverse Single And Multi Cell Tasks
Pythia · tensorblock
Params405M
Context8K
Smallest0.2 GB
GGUF
QW
Qwenvergence 14B v13 Prose DS
Qwen · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
Tool use
MI
Opt lora8 mistral 22b model 25k grb new
Mistral · tensorblock
Params22.2B
Context128K
Smallest8.3 GB
Tool use
VE
Zigeng R1 VeriThinker 7B
Verithinker · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
ReasoningTool use
OL
Allenai OLMo 2 0425 1B Instruct
OLMo · tensorblock
Params1.48B
Context4K
Smallest0.6 GB
GGUF
MI
MiniMerlin 3B
Minimerlin · tensorblock
Params3.02B
Context4K
Smallest1.2 GB
Coding
LL
T3Q LLM3 Llama3 Sft1.0
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
MinaMila Llama_8B_Unlearned_Unbalanced_Gender_2Nd_1E 6_1.0_0.5_0.25_0.25_epoch2
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
ZE
zephyr 7b sft full orpo
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
Qwen2 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
GGUF
GE
Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
LL
Hpcai Tech Colossal LLaMA 2 7b Base
Llama · tensorblock
Params7.04B
Context4K
Smallest2.7 GB
GGUF
MI
Mistralai Ministral 8B Instruct 2410
Mistral · tensorblock
Params8.02B
Context32K
Smallest3.2 GB
Tool use
LL
Llama 3.1 Swallow 8B v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
ST
Starcoder2 7b
StarCoder · tensorblock
Params7.17B
Context16K
Smallest2.8 GB
Coding
ME
AdaptLLM Medicine LLM 13B
Medicine · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
BI
Speakleash Bielik 7B Instruct v0.1
Bielik · tensorblock
Params7.24B
Context4K
Smallest2.7 GB
GGUF
OO
Oolel v0.1
Oolel · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
NE
NeuralSynthesis 7B v0.3
Neuralsynthesis · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Felladrin Minueza 2 96M Instruct Variant 02
Minueza · tensorblock
Params96M
Context4K
Smallest0.1 GB
GGUF
JA
Stabilityai Japanese Stablelm 3b 4e1t Instruct
Japanese · tensorblock
Params2.8B
Context4K
Smallest1.1 GB
GGUF
KU
Kunoichi 7B
Kunoichi · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
LL
kykim0 llama3 8b ultrachat sft
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
PL
Pfnet Plamo 13b Instruct Nc
Plamo · tensorblock
Params13.1B
Context4K
Smallest4.9 GB
GGUF
OL
Allenai OLMoE 1B 7B 0924
OLMo · tensorblock
Params6.92B
Context4K
Smallest2.6 GB
GGUF
SO
Tanitan2 SOLAR 10.7B Instruct STOCK_SOLAR Ties
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
HU
FreedomIntelligence HuatuoGPT O1 7B
Huatuogpt · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
ReasoningTool use
QW
OpenR1-Qwen-7B-French
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
ReasoningTool use

Keep browsing