GGUF models by YorkieOH10

82 GGUF models quantized by YorkieOH10 on Hugging Face. Sizes run from 134M to 46.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama 3.1 8B Instruct Hf
Llama · YorkieOH10
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · YorkieOH10
Params8.03B
Context128K
Smallest8.5 GB
GGUF
NO
Nomic Embed Text v1.5
Nomic · YorkieOH10
Params137M
Context2K
Smallest0.1 GB
Embedding
LL
Meta Llama 3.1 8B Instruct abliterated Q8 0
Llama · YorkieOH10
Params8.03B
Context8K
Smallest8.5 GB
GGUF
QW
Qwen2.5 14B Uncensored Instruct Q4 K M
Qwen · YorkieOH10
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
GR
granite-8b-code-instruct
Granite · YorkieOH10
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
LL
Hermes 3 Llama 3.1 8B
Llama · YorkieOH10
Params8.03B
Context128K
Smallest8.5 GB
RoleplayTool use
BG
bge reranker v2 m3 Q8 0
BGE · YorkieOH10
Params568M
Context8K
Smallest0.6 GB
Embedding
LL
Llama-3-8B-LexiFun-Uncensored-V1
Llama · YorkieOH10
Params8.03B
Context8K
Smallest8.5 GB
Roleplay
DE
deepseek-coder-1.3B-kexer
DeepSeek · YorkieOH10
Params1.35B
Context16K
Smallest1.4 GB
Coding
QW
Qwen2-7B-Multilingual-RP
Qwen · YorkieOH10
Params7.62B
Context32K
Smallest8.1 GB
Roleplay
GR
granite-8b-code-instruct
Granite · YorkieOH10
Params8.05B
Context4K
Smallest8.6 GB
CodingTool use
DE
deepseek-coder-6.7B-kexer
DeepSeek · YorkieOH10
Params6.74B
Context16K
Smallest7.2 GB
Coding
QW
Qwen2-7B-Multilingual-RP
Qwen · YorkieOH10
Params7.62B
Context32K
Q4_K_M4.7 GB
Roleplay
PH
phi 3 on mac Q2 K
Phi · YorkieOH10
Params3.82B
Context4K
Smallest1.4 GB
GGUF
GL
GLM Z1 9B 0414
GLM · YorkieOH10
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
GR
granite-3b-code-instruct
Granite · YorkieOH10
Params3.48B
Context2K
Smallest3.7 GB
CodingTool use
PH
Phi 3.5 Mini Instruct
Phi · YorkieOH10
Params3.82B
Context128K
Smallest4.1 GB
Coding
GR
granite 34b code instruct Q8 0
Granite · YorkieOH10
Params33.7B
Context8K
Smallest35.9 GB
CodingTool use
GR
granite 34b code base Q8 0
Granite · YorkieOH10
Params33.7B
Context8K
Smallest35.9 GB
Coding
GP
GPT-NeoX-20B-Erebus
Gpt · YorkieOH10
Params20.6B
Context2K
Smallest21.9 GB
GGUF
GR
granite 20b code instruct Q8 0
Granite · YorkieOH10
Params20.1B
Context8K
Smallest21.4 GB
CodingTool use
AC
AceInstruct 7B
Aceinstruct · YorkieOH10
Params7.62B
Context128K
Smallest8.1 GB
Coding
PH
phi 3 on mac Q5 K S
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.6 GB
GGUF
PH
phi 3 on mac Q3 K L
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.1 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · YorkieOH10
Params6.06B
Context4K
Smallest6.4 GB
GGUF
PH
phi 3 on mac Q4 K S
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.2 GB
GGUF
ST
starcoder2-15b-instruct-v0.1
StarCoder · YorkieOH10
Params16B
Context16K
Smallest17.0 GB
Coding
LL
LongWriter Llama3.1 8b
Llama · YorkieOH10
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PH
phi 3 on mac Q3 K S
Phi · YorkieOH10
Params3.82B
Context4K
Smallest1.7 GB
GGUF

About YorkieOH10 on Hugging Face

YorkieOH10 has published 82 GGUF models that ggufmodels.com tracks, across families such as Llama, Phi and Granite. The most downloaded are Meta Llama 3.1 8B Instruct Hf, Meta Llama 3.1 8B Instruct and Nomic Embed Text v1.5.

The quants YorkieOH10 publishes most often are Q8_0 (53), Q4_K_M (17), Q5_K_M (3) and Q6_K (1). Their Q4_K_M files range from 2.4 to 28.4 GB. Parameter counts run from 134M to 46.7B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has YorkieOH10 published?

82 models are listed here, mainly from the Llama, Phi and Granite families. The most downloaded is Meta Llama 3.1 8B Instruct Hf.

Which quants does YorkieOH10 publish?

The most common are Q8_0 (53 models), Q4_K_M (17 models), Q5_K_M (3 models) and Q6_K (1 models).

Keep browsing