GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QV
Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO
Qvikhr · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
Tool use
LL
AIDXteam ktdsbaseLM v0.15 onbased llama3.1
Llama · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
Tool use
EV
Totally Not An Llm EverythingLM 13b 16k
Everythinglm · tensorblock
Params13B
Context16K
Smallest4.9 GB
GGUF
DA
Edentns DataVortexS 10.7B Dpo v1.11
Datavortexs · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
RE
SenseLLM ReflectionCoder CL 34B
Reflectioncoder · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
PY
Vandijklab C2S Pythia 410m Cell Type Prediction
Pythia · tensorblock
Params405M
Context4K
Smallest0.2 GB
GGUF
QW
calme-2.6-qwen2-7b
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
PY
pythia 160m dolphin extended
Pythia · tensorblock
Params162M
Context2K
Smallest0.1 GB
GGUF
RH
Rho Math 7b v0.1
Rho · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
CA
CantoneseLLM 6B preview202402
Cantonesellm · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF
RA
CarrotAI Rabbit Ko 15B Instruct
Rabbit · tensorblock
Params15.1B
Context32K
Smallest5.7 GB
GGUF
AL
AlphaMist7B slr v4 slow
Alphamist · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llama 3.2 3B Instruct wame 16bit
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
ST
Stripped_Marcoroni_70B_2
Stripped · tensorblock
Params20.2B
Context4K
Smallest7.5 GB
GGUF
MI
Martyn Mixtral Megamerge Dare 8x7b v2
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
PH
phibode 3 mini 4k ultraalpaca
Phibode · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
ZE
Weyaxi Zephyr Beta Nebula v2 7B
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SO
SOLAR 10.7B v1.5
Solar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
MA
MagpieLM 4B SFT v0.1
Magpielm · tensorblock
Params4.51B
Context128K
Smallest1.8 GB
GGUF
MI
EmbeddedLLM Mistral 7B Merge 14 v0.5
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Embedding
ST
stackexchange engineering
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Open_Llama_3B_600Bt_Preview
Llama · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
GGUF
NE
Ckoozzzu New3
New · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
NE
Neural Chat 7b v3 3 Int4 Ov
Neural · tensorblock
Params7B
Context32K
Smallest0.0 GB
GGUF
ST
StopCarbon 10.7B v4
Stopcarbon · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
SO
solar merge test 1
Solar · tensorblock
Params19.3B
Context4K
Smallest7.1 GB
GGUF
YI
Brucethemoose Yi 34B 200K DARE Merge v5
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
KY
Kyro n1 3B
Kyro · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Reasoning
LL
Llama 3 OpenBioMed 8B slerp v0.3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF

Keep browsing