GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
markrodrigo Llama 3.1 8B Instruct Spatial SQL 1.0
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3 8B Web
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OO
Oopsung Yi Ko F v1
tensorblock
Params6.18B
Context2K
Smallest2.4 GB
LL
Llama 3.1 SuperNova Lite
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
SA
SauerkrautLM UNA SOLAR Instruct
Sauerkrautlm · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
PL
ko platypus 13b control
Platypus · tensorblock
Params13B
Context2K
Smallest4.9 GB
MI
Mixtral 11Bx2 MoE 19B
Mistral · tensorblock
Params19.2B
Context4K
Smallest7.1 GB
DE
Agentica Org DeepSWE Preview
Deepswe · tensorblock
Params32.8B
Context40K
Smallest12.3 GB
LL
Onnx Internal Testing Tiny Random LlamaForCausalLM
Llama · tensorblock
Params4M
Context128K
Smallest0.0 GB
MI
Mistral NeMo Minitron 8B Chat
Mistral · tensorblock
Params8.41B
Context8K
Smallest3.3 GB
NA
Narwhal 7b v3
Narwhal · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
PsychoCounsel Llama3 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
MI
Multilingual mistral
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
NU
NuExtract 1.5 tiny
Nuextract · tensorblock
Params494M
Context32K
Smallest0.3 GB
VI
Lorinma yi6B_Vicuna
Vicuna · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
LL
Suzume Llama 3 8B Multilingual
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
SherlockAssistant Mistral 7B Instruct Ukrainian
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
FL
flux 7b v0.2
Flux · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
TR
Voicelab Trurl 2 13b
Trurl · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
Datajuicer LLaMA 1B Dj Refine 150B
Llama · tensorblock
Params1.35B
Context2K
Smallest0.6 GB
LU
Undi95 Lumimaid Magnum v4 12B
Lumimaid · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
TI
tiny random stablelm
Tiny · tensorblock
Params35M
Context4K
Smallest0.0 GB
EX
FogTeams experiment 45 intelligent layer 2 plus exp 39 data
Experiment · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
CA
calme-3.1-instruct-3b
Calme · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
UN
Proto Llm Uniwiz 7B v0.1
Uniwiz · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
PE
ViraIntelligentDataMining PersianLLaMA 13B
Persianllama · tensorblock
Params13.3B
Context4K
Smallest5.0 GB
LL
Undi95 Meta Llama 3 8B Hf
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OL
tiny random olmo
OLMo · tensorblock
Params58M
Context2K
Smallest0.0 GB
DE
Deepseek Ai Deepseek Coder 1.3b Base
DeepSeek · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
MO
Miracle085 Model 6
Model · tensorblock
Params1.64B
Context4K
Smallest0.7 GB