GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
TE
test 7B slerp
Test · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DP
Albertfares DPO_MCQA_model_3_03_07_08
Dpo · tensorblock
Params752M
Context32K
Smallest0.3 GB
TI
Tippy Toppy 7b
Tippy · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
KO
kosolra wiki QA 1epoch
Kosolra · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
RE
Reyna Mini 1.8B v0.2
Reyna · tensorblock
Params1.84B
Context32K
Smallest0.8 GB
ME
MetaModel
Metamodel · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GR
Ibm Granite Granite 3.1 1b A400M Instruct
Granite · tensorblock
Params1.33B
Context128K
Smallest0.5 GB
HE
HelpingAI 3
Helpingai · tensorblock
Params10.3B
Context32K
Smallest3.9 GB
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
Llama 2 Tiny 4kv Heads 4layers Random
Llama · tensorblock
Params9M
Context4K
Smallest0.0 GB
TU
TucanoBR Tucano 1b1
Tucano · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
LL
llama3.2 typhoon2 1b instruct
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
LL
Braindao Iq Code Evmind v2 Llama3 Code 8b Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SO
Summerstars SolaraV2 Coder 0511
Solarav · tensorblock
Params362M
Context8K
Smallest0.2 GB
PA
Paraphrase
Paraphrase · tensorblock
Params248M
Context512
Smallest0.1 GB
MI
SciPhi SciPhi Self RAG Mistral 7B 32k
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
AZ
Azzurro
Azzurro · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Dreamgen Preview Opus v1.2 Llama 3 8b Instruct Run3.5 Epoch2.5
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
Yi Ko 6B
Mixed · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
LL
llama3 8b spaetzle v37
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SL
SlimMelodicMaid
Slimmelodicmaid · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
mistral 7b nf4 fp16 upscaled
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MA
Magicoder DS 6.7B
Magicoder · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
LL
tartuNLP Llammas Base
Llammas · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
reflect_llama8B_llama-mstlrg-om2-80k_sft-t2_lr1e-6
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
OG
Ogno Monarch Jaskier Merge 7b
Ogno · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
CYFRAGOVPL Llama PLLuM 8B Chat
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GE
ENERGY DRINK LOVE gemma 2 9b dpo v4 hq
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
DA
DareBeagle 7B
Darebeagle · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
NU
NucleusAI Nucleus 22B Token 500B
Nucleus · tensorblock
Params21.8B
Context2K
Smallest8.1 GB