GGUF models by YorkieOH10

82 GGUF models quantized by YorkieOH10 on Hugging Face. Sizes run from 134M to 46.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Coder 3B
Qwen · YorkieOH10
Params3.09B
Context32K
Smallest3.3 GB
CodingTool use
LL
Artificium llama3.1 8B 001 Q4 K M
Llama · YorkieOH10
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.0 1b
Granite · YorkieOH10
Params1.63B
Context128K
Smallest1.7 GB
GGUF
PH
phi 3 on mac Q6 K
Phi · YorkieOH10
Params3.82B
Context4K
Smallest3.1 GB
GGUF
PH
phi 3 on mac Q4 K M
Phi · YorkieOH10
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 3 on mac Q5 K M
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.8 GB
GGUF
PH
phi 3 on mac Q4 0
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.2 GB
GGUF
PH
phi 3 on mac Q3 K M
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.0 GB
GGUF
GR
granite 20b code base Q8 0
Granite · YorkieOH10
Params20.1B
Context8K
Smallest21.4 GB
Coding
AY
Aya Expanse 8b
Aya · YorkieOH10
Params8.03B
Context8K
Smallest8.5 GB
GGUF
OR
Orca Agent v0.1
Orca · YorkieOH10
Params14.8B
Context40K
Smallest15.7 GB
Coding
YI
dolphin-2.9.1-yi-1.5-34b
Yi · YorkieOH10
Params34.4B
Context8K
Smallest36.5 GB
CodingTool use
YI
Yi-1.5-34B-Chat
Yi · YorkieOH10
Params34.4B
Context4K
Smallest36.5 GB
GGUF
PH
phi 3 on mac Q5 0
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.6 GB
GGUF
AL
AlchemistCoder-DS-6.7B
Alchemistcoder · YorkieOH10
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
PH
phi 3 on mac Q8 0
Phi · YorkieOH10
Params3.82B
Context4K
Smallest4.1 GB
GGUF
CO
CodeQwen1.5-7B-Chat
Codeqwen · YorkieOH10
Params7.25B
Context64K
Smallest7.7 GB
GGUF
GR
granite-8b-code-base
Granite · YorkieOH10
Params8.05B
Context4K
Smallest8.6 GB
Coding
MA
Marco o1 Q4 K M
Marco · YorkieOH10
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
Llama-3-Instruct-8B-SimPO
Llama · YorkieOH10
Params8.03B
Context8K
Smallest8.5 GB
GGUF
GR
granite-3b-code-base
Granite · YorkieOH10
Params3.48B
Context2K
Smallest3.7 GB
Coding
LL
Llama-3-8B-Instruct-Coder-v2
Llama · YorkieOH10
Params8.03B
Context8K
Smallest8.5 GB
Coding
GE
Gemma 2b
Gemma · YorkieOH10
Params2.51B
Context8K
Smallest2.7 GB
GGUF
MI
Mistral-7B-Base-SFT-SimPO
Mistral · YorkieOH10
Params7.24B
Context32K
Smallest7.7 GB
GGUF
MI
Mixtral-Instruct-ITR-8x7B
Mistral · YorkieOH10
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
UN
UNA-ThePitbull-21.4-v1
Una · YorkieOH10
Params21.4B
Context32K
Q4_K_M12.9 GB
GGUF
QW
Qwen2-7B-Multilingual-RP
Qwen · YorkieOH10
Params7.62B
Context32K
Smallest5.4 GB
Roleplay
AR
Arcanum 12b
Arcanum · YorkieOH10
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
LL
LongWriter Llama3.1 8b
Llama · YorkieOH10
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MI
Mistral Small Instruct 2409
Mistral · YorkieOH10
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF

Keep browsing