GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
markrodrigo Llama 3.1 8B Instruct Spatial SQL 1.0
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
CodingTool use
LL
Llama 3 8B Web
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
OO
Oopsung Yi Ko F v1
tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
SA
SauerkrautLM UNA SOLAR Instruct
Sauerkrautlm · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
PL
ko platypus 13b control
Platypus · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
MI
Mixtral 11Bx2 MoE 19B
Mistral · tensorblock
Params19.2B
Context4K
Smallest7.1 GB
GGUF
DE
Agentica Org DeepSWE Preview
Deepswe · tensorblock
Params32.8B
Context40K
Smallest12.3 GB
ReasoningTool use
LL
Onnx Internal Testing Tiny Random LlamaForCausalLM
Llama · tensorblock
Params4M
Context128K
Smallest0.0 GB
GGUF
MI
Mistral NeMo Minitron 8B Chat
Mistral · tensorblock
Params8.41B
Context8K
Smallest3.3 GB
Tool use
NA
Narwhal 7b v3
Narwhal · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
PsychoCounsel Llama3 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
MI
Multilingual mistral
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
NU
NuExtract 1.5 tiny
Nuextract · tensorblock
Params494M
Context32K
Smallest0.3 GB
Tool use
VI
Lorinma yi6B_Vicuna
Vicuna · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF
LL
Suzume Llama 3 8B Multilingual
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
SherlockAssistant Mistral 7B Instruct Ukrainian
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
FL
flux 7b v0.2
Flux · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
TR
Voicelab Trurl 2 13b
Trurl · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Datajuicer LLaMA 1B Dj Refine 150B
Llama · tensorblock
Params1.35B
Context2K
Smallest0.6 GB
Coding
LU
Undi95 Lumimaid Magnum v4 12B
Lumimaid · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
Tool use
TI
tiny random stablelm
Tiny · tensorblock
Params35M
Context4K
Smallest0.0 GB
GGUF
EX
FogTeams experiment 45 intelligent layer 2 plus exp 39 data
Experiment · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
CA
calme-3.1-instruct-3b
Calme · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
UN
Proto Llm Uniwiz 7B v0.1
Uniwiz · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
PE
ViraIntelligentDataMining PersianLLaMA 13B
Persianllama · tensorblock
Params13.3B
Context4K
Smallest5.0 GB
GGUF
LL
Undi95 Meta Llama 3 8B Hf
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
OL
tiny random olmo
OLMo · tensorblock
Params58M
Context2K
Smallest0.0 GB
GGUF
DE
Deepseek Ai Deepseek Coder 1.3b Base
DeepSeek · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
Coding
MO
Miracle085 Model 6
Model · tensorblock
Params1.64B
Context4K
Smallest0.7 GB
GGUF

Keep browsing