GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
HE
HelpSteer filtered 7B
Helpsteer · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SO
Jingyeom SOLAR_KO_1.3_deup
Solar · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
PY
Vandijklab C2S Pythia 410m Diverse Single And Multi Cell Tasks
Pythia · tensorblock
Params405M
Context8K
Smallest0.2 GB
QW
Qwenvergence 14B v13 Prose DS
Qwen · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
MI
Opt lora8 mistral 22b model 25k grb new
Mistral · tensorblock
Params22.2B
Context128K
Smallest8.3 GB
VE
Zigeng R1 VeriThinker 7B
Verithinker · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
OL
Allenai OLMo 2 0425 1B Instruct
OLMo · tensorblock
Params1.48B
Context4K
Smallest0.6 GB
MI
MiniMerlin 3B
Minimerlin · tensorblock
Params3.02B
Context4K
Smallest1.2 GB
LL
T3Q LLM3 Llama3 Sft1.0
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
MinaMila Llama_8B_Unlearned_Unbalanced_Gender_2Nd_1E 6_1.0_0.5_0.25_0.25_epoch2
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ZE
zephyr 7b sft full orpo
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
Qwen2 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
GE
Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
LL
Hpcai Tech Colossal LLaMA 2 7b Base
Llama · tensorblock
Params7.04B
Context4K
Smallest2.7 GB
MI
Mistralai Ministral 8B Instruct 2410
Mistral · tensorblock
Params8.02B
Context32K
Smallest3.2 GB
LL
Llama 3.1 Swallow 8B v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
ST
Starcoder2 7b
StarCoder · tensorblock
Params7.17B
Context16K
Smallest2.8 GB
ME
AdaptLLM Medicine LLM 13B
Medicine · tensorblock
Params13B
Context2K
Smallest4.9 GB
BI
Speakleash Bielik 7B Instruct v0.1
Bielik · tensorblock
Params7.24B
Context4K
Smallest2.7 GB
OO
Oolel v0.1
Oolel · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
NE
NeuralSynthesis 7B v0.3
Neuralsynthesis · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Felladrin Minueza 2 96M Instruct Variant 02
Minueza · tensorblock
Params96M
Context4K
Smallest0.1 GB
JA
Stabilityai Japanese Stablelm 3b 4e1t Instruct
Japanese · tensorblock
Params2.8B
Context4K
Smallest1.1 GB
KU
Kunoichi 7B
Kunoichi · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
LL
kykim0 llama3 8b ultrachat sft
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
PL
Pfnet Plamo 13b Instruct Nc
Plamo · tensorblock
Params13.1B
Context4K
Smallest4.9 GB
OL
Allenai OLMoE 1B 7B 0924
OLMo · tensorblock
Params6.92B
Context4K
Smallest2.6 GB
SO
Tanitan2 SOLAR 10.7B Instruct STOCK_SOLAR Ties
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
HU
FreedomIntelligence HuatuoGPT O1 7B
Huatuogpt · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
QW
OpenR1-Qwen-7B-French
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB