GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
OL
Allenai OLMo 2 0425 1B RLVR1
OLMo · tensorblock
Params1.48B
Context4K
Smallest0.6 GB
GGUF
ST
stackexchange literature
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
LNGYEYXR Llama 3.1 8B Lora Pt New
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
GE
Gemma 2b
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
GGUF
NE
OpenReasoning Nemotron 7B
Nemotron · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
CodingReasoning
FA
FractalAIResearch Fathom R1 14B
Fathom · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
ReasoningTool use
LI
Liph.42
Liph · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
QW
Qwen Qwen2 Math 7B Instruct
Qwen · tensorblock
Params7.62B
Context4K
Smallest3.0 GB
GGUF
MA
MadMix v0.2
Madmix · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
llama2 7b chat hf v4
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
V2Ray Llama 3 70B
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
BA
Bagel 8x7b v0.2
Bagel · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
CodingRoleplay
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
BI
Speakleash Bielik 7B v0.1
Bielik · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
TU
Udkai Turdus
Turdus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Llama 3 Open Ko 8B Instruct seongi ver0710
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
PA
Vamsi T5_Paraphrase_Paws
Paraphrase · tensorblock
Params223M
Context512
Smallest0.1 GB
GGUF
LL
Mikael110 Llama 2 13b Guanaco Fp16
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
SP
SpecAI
Specai · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
LL
Llama 3 8B Magpie Align SFT v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
ST
starcoder2 15b instruct v0.1
StarCoder · tensorblock
Params16B
Context16K
Smallest6.2 GB
Coding
LL
Fireball Alpaca Llama3.1.08 8B Philos C R1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ReasoningTool use
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
QW
Qwen2 Math 7B
Qwen · tensorblock
Params7.62B
Context4K
Smallest3.0 GB
GGUF
LL
Masani SFT_gsm8k_Llama 3.2 3B_epoch_1_global_step_29
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
GGUF
MI
Openbuddy Mistral2 7b v20.3 32k
Mistral · tensorblock
Params7.28B
Context32K
Smallest2.7 GB
GGUF
LL
Llama 3 Instruct 8B RRHF v0.2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
NE
NeuralLLaMa 3 8b ORPO v0.3
Neuralllama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
Mixtral 7Bx5 MoE 30B
Mistral · tensorblock
Params29.8B
Context32K
Smallest10.9 GB
GGUF

Keep browsing