GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
OL
Allenai OLMo 2 0425 1B RLVR1
OLMo · tensorblock
Params1.48B
Context4K
Smallest0.6 GB
ST
stackexchange literature
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
LNGYEYXR Llama 3.1 8B Lora Pt New
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GE
Gemma 2b
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
NE
OpenReasoning Nemotron 7B
Nemotron · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
FA
FractalAIResearch Fathom R1 14B
Fathom · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
LI
Liph.42
Liph · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
QW
Qwen Qwen2 Math 7B Instruct
Qwen · tensorblock
Params7.62B
Context4K
Smallest3.0 GB
MA
MadMix v0.2
Madmix · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
llama2 7b chat hf v4
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
V2Ray Llama 3 70B
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
BA
Bagel 8x7b v0.2
Bagel · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
BI
Speakleash Bielik 7B v0.1
Bielik · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
TU
Udkai Turdus
Turdus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
Llama 3 Open Ko 8B Instruct seongi ver0710
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
PA
Vamsi T5_Paraphrase_Paws
Paraphrase · tensorblock
Params223M
Context512
Smallest0.1 GB
LL
Mikael110 Llama 2 13b Guanaco Fp16
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
SP
SpecAI
Specai · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
LL
Llama 3 8B Magpie Align SFT v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
ST
starcoder2 15b instruct v0.1
StarCoder · tensorblock
Params16B
Context16K
Smallest6.2 GB
LL
Fireball Alpaca Llama3.1.08 8B Philos C R1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
QW
Qwen2 Math 7B
Qwen · tensorblock
Params7.62B
Context4K
Smallest3.0 GB
LL
Masani SFT_gsm8k_Llama 3.2 3B_epoch_1_global_step_29
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
MI
Openbuddy Mistral2 7b v20.3 32k
Mistral · tensorblock
Params7.28B
Context32K
Smallest2.7 GB
LL
Llama 3 Instruct 8B RRHF v0.2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
NE
NeuralLLaMa 3 8b ORPO v0.3
Neuralllama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
Mixtral 7Bx5 MoE 30B
Mistral · tensorblock
Params29.8B
Context32K
Smallest10.9 GB