GGUF models by IntelligentEstate
48 GGUF models quantized by IntelligentEstate on Hugging Face. Sizes run from 1.54B to 14.8B parameters. The longest trained context is 986K tokens.
LL
Thoth Warding Llama 3B IQ5 K S
Llama · IntelligentEstate
Params3.21B
Context128K
Smallest2.3 GB
VE
Jaberwocky VEGA qwn25 Q 8 0
Veolu · IntelligentEstate
Params1.78B
Context32K
Smallest1.9 GB
AD
Keg Party 3B Q8 0
Adelie · IntelligentEstate
Params3.61B
Context128K
Smallest3.8 GB
CH
Chocolatine THE KEYS iq4 k m
Chocolatine · IntelligentEstate
Params3.82B
Context128K
Smallest2.4 GB
QW
Replicant Operator ed Qw25 Q8 0
Qwen · IntelligentEstate
Params3.09B
Context32K
Smallest3.3 GB
DE
Oreal R1 7b q5 k s imat
DeepSeek · IntelligentEstate
Params7.62B
Context128K
Smallest5.3 GB
MI
fblgit miniclaus qw1.5B UNAMGS Q8 0
Miniclaus · IntelligentEstate
Params1.78B
Context128K
Smallest1.9 GB
QW
Fast Dolphin QwenStar 1.5B Q8
Qwen · IntelligentEstate
Params1.54B
Context128K
Smallest1.6 GB
BL
FromTheAshes IQ4 NL
Blarenegv · IntelligentEstate
Params7.62B
Context128K
Smallest4.4 GB
NE
Gambit 7B Q4 K M
Nemotron · IntelligentEstate
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Dolphin3.0 QwenStar 3B Q8
Qwen · IntelligentEstate
Params3.09B
Context32K
Smallest3.3 GB
QW
Qweniversal Studios 1M 7B iQ4 K M
Qwen · IntelligentEstate
Params7.62B
Context986K
Q4_K_M4.7 GB
QW
Shrewd Operator dlp Q2.5 3b iQ4 n l
Qwen · IntelligentEstate
Params3.09B
Context32K
Smallest1.8 GB
MI
Miniclaus qw1.5B UNAMGS
Miniclaus · IntelligentEstate
Params1.54B
Context128K
Smallest1.6 GB
QW
Tangu 3B Qwenstar Q8
Qwen · IntelligentEstate
Params3.4B
Context32K
Smallest3.6 GB
VA
Super Warding 4o4 vpr2 Qw25 Q4k m
Vapor · IntelligentEstate
Params7.62B
Context128K
Q4_K_M4.7 GB
ME
MediMesh Instruct 3B Q 8
Medit · IntelligentEstate
Params3.82B
Context128K
Smallest4.1 GB
IN
Vega QwQ 7B Q5K S
InternLM · IntelligentEstate
Params7.62B
Context128K
Smallest5.3 GB