GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
QV
Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO
Qvikhr · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
LL
AIDXteam ktdsbaseLM v0.15 onbased llama3.1
Llama · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
EV
Totally Not An Llm EverythingLM 13b 16k
Everythinglm · tensorblock
Params13B
Context16K
Smallest4.9 GB
DA
Edentns DataVortexS 10.7B Dpo v1.11
Datavortexs · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
RE
SenseLLM ReflectionCoder CL 34B
Reflectioncoder · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
PY
Vandijklab C2S Pythia 410m Cell Type Prediction
Pythia · tensorblock
Params405M
Context4K
Smallest0.2 GB
QW
calme-2.6-qwen2-7b
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
PY
pythia 160m dolphin extended
Pythia · tensorblock
Params162M
Context2K
Smallest0.1 GB
RH
Rho Math 7b v0.1
Rho · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
CA
CantoneseLLM 6B preview202402
Cantonesellm · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
RA
CarrotAI Rabbit Ko 15B Instruct
Rabbit · tensorblock
Params15.1B
Context32K
Smallest5.7 GB
AL
AlphaMist7B slr v4 slow
Alphamist · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 3.2 3B Instruct wame 16bit
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
ST
Stripped_Marcoroni_70B_2
Stripped · tensorblock
Params20.2B
Context4K
Smallest7.5 GB
MI
Martyn Mixtral Megamerge Dare 8x7b v2
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
PH
phibode 3 mini 4k ultraalpaca
Phibode · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
LL
Llama 3.2 3B Instruct
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
ZE
Weyaxi Zephyr Beta Nebula v2 7B
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SO
SOLAR 10.7B v1.5
Solar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
MA
MagpieLM 4B SFT v0.1
Magpielm · tensorblock
Params4.51B
Context128K
Smallest1.8 GB
MI
EmbeddedLLM Mistral 7B Merge 14 v0.5
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ST
stackexchange engineering
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Open_Llama_3B_600Bt_Preview
Llama · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
NE
Ckoozzzu New3
New · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
NE
Neural Chat 7b v3 3 Int4 Ov
Neural · tensorblock
Params7B
Context32K
Smallest0.0 GB
ST
StopCarbon 10.7B v4
Stopcarbon · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
SO
solar merge test 1
Solar · tensorblock
Params19.3B
Context4K
Smallest7.1 GB
YI
Brucethemoose Yi 34B 200K DARE Merge v5
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
KY
Kyro n1 3B
Kyro · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
LL
Llama 3 OpenBioMed 8B slerp v0.3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB