GGUF models by IntelligentEstate

48 GGUF models quantized by IntelligentEstate on Hugging Face. Sizes run from 1.54B to 14.8B parameters. The longest trained context is 986K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Thoth Warding Llama 3B IQ5 K S
Llama · IntelligentEstate
Params3.21B
Context128K
Smallest2.3 GB
RoleplayTool use
VE
Jaberwocky VEGA qwn25 Q 8 0
Veolu · IntelligentEstate
Params1.78B
Context32K
Smallest1.9 GB
Tool use
AD
Keg Party 3B Q8 0
Adelie · IntelligentEstate
Params3.61B
Context128K
Smallest3.8 GB
GGUF
CH
Chocolatine THE KEYS iq4 k m
Chocolatine · IntelligentEstate
Params3.82B
Context128K
Smallest2.4 GB
GGUF
QW
Replicant Operator ed Qw25 Q8 0
Qwen · IntelligentEstate
Params3.09B
Context32K
Smallest3.3 GB
CodingTool use
DE
Oreal R1 7b q5 k s imat
DeepSeek · IntelligentEstate
Params7.62B
Context128K
Smallest5.3 GB
ReasoningTool use
MI
fblgit miniclaus qw1.5B UNAMGS Q8 0
Miniclaus · IntelligentEstate
Params1.78B
Context128K
Smallest1.9 GB
Tool use
QW
Fast Dolphin QwenStar 1.5B Q8
Qwen · IntelligentEstate
Params1.54B
Context128K
Smallest1.6 GB
CodingTool use
BL
FromTheAshes IQ4 NL
Blarenegv · IntelligentEstate
Params7.62B
Context128K
Smallest4.4 GB
Tool use
NE
Gambit 7B Q4 K M
Nemotron · IntelligentEstate
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
QW
Dolphin3.0 QwenStar 3B Q8
Qwen · IntelligentEstate
Params3.09B
Context32K
Smallest3.3 GB
CodingTool use
QW
Qweniversal Studios 1M 7B iQ4 K M
Qwen · IntelligentEstate
Params7.62B
Context986K
Q4_K_M4.7 GB
ReasoningTool use
QW
Shrewd Operator dlp Q2.5 3b iQ4 n l
Qwen · IntelligentEstate
Params3.09B
Context32K
Smallest1.8 GB
CodingTool use
MI
Miniclaus qw1.5B UNAMGS
Miniclaus · IntelligentEstate
Params1.54B
Context128K
Smallest1.6 GB
Tool use
QW
Tangu 3B Qwenstar Q8
Qwen · IntelligentEstate
Params3.4B
Context32K
Smallest3.6 GB
Reasoning
VA
Super Warding 4o4 vpr2 Qw25 Q4k m
Vapor · IntelligentEstate
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
ME
MediMesh Instruct 3B Q 8
Medit · IntelligentEstate
Params3.82B
Context128K
Smallest4.1 GB
GGUF
IN
Vega QwQ 7B Q5K S
InternLM · IntelligentEstate
Params7.62B
Context128K
Smallest5.3 GB
ReasoningTool use

Keep browsing