GGUF models by MoMonir

42 GGUF models quantized by MoMonir on Hugging Face. Sizes run from 2.51B to 14B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TR
translategemma 4b it
Translategemma · MoMonir
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
DE
deepseek coder 6.7b chat and function calling
DeepSeek · MoMonir
Params6.74B
Context16K
Q4_K_M4.1 GB
CodingTool use
PH
Phi 3 mini 128k instruct
Phi · MoMonir
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
GE
openhermes gemma 2b it
Gemma · MoMonir
Params2.51B
Context8K
Smallest2.1 GB
Tool use
LL
llava llama 3 8b v1 1
Llama · MoMonir
Params8.03B
Context8K
Q4_K_M4.9 GB
Vision
MI
dolphin mistral instruct 7b
Mistral · MoMonir
Params7.24B
Context32K
Smallest5.1 GB
GGUF
GE
gemma 4 12B it
Gemma · MoMonir
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GO
Google_Translategemma 12b It
Google · MoMonir
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
YI
Yi-1.5-6B-Chat
Yi · MoMonir
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
LL
dolphin-2.9-llama3-8b
Llama · MoMonir
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
GR
granite-8b-code-instruct
Granite · MoMonir
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
LL
openchat-3.6-8b-20240522
Llama · MoMonir
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
codegeex4-all-9b
Codegeex · MoMonir
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · MoMonir
Params14B
Context128K
Q4_K_M8.6 GB
Coding
LL
Hermes-2-Pro-Llama-3-8B
Llama · MoMonir
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
QW
Qwen2-7B-Instruct
Qwen · MoMonir
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
CO
codegemma-1.1-7b-it
Codegemma · MoMonir
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
LL
dolphin 2.9 llama3 8b 1m
Llama · MoMonir
Params8.03B
Context1024K
Q4_K_M4.9 GB
CodingTool use
EX
Mistroll 7B v2.2
Experiment · MoMonir
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
CodeQwen1.5-7B-Chat
Codeqwen · MoMonir
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
AY
aya-23-8B
Aya · MoMonir
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
MI
SFR Embedding Mistral
Mistral · MoMonir
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
CO
Coxcomb
Coxcomb · MoMonir
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
phi 2 super
Phi · MoMonir
Params2.78B
Context2K
Smallest2.0 GB
GGUF
LL
Llama-3-8B-Web
Llama · MoMonir
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
gte-Qwen1.5-7B-instruct
Qwen · MoMonir
Params7.72B
Context32K
Q4_K_M4.8 GB
Embedding
WA
wavecoder-ultra-6.7b
Wavecoder · MoMonir
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama3 ChatQA 1.5 8B
Llama · MoMonir
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AU
AutoCoder_S_6.7B
Autocoder · MoMonir
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MU
multi verse model
Multi · MoMonir
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

About MoMonir on Hugging Face

MoMonir has published 42 GGUF models that ggufmodels.com tracks, across families such as Llama, Phi and Gemma. The most downloaded are translategemma 4b it, deepseek coder 6.7b chat and function calling and Phi 3 mini 128k instruct.

The quants MoMonir publishes most often are Q5_K_M (40), Q6_K (38), Q4_K_M (34) and Q8_0 (10). Their Q4_K_M files range from 1.6 to 8.6 GB. Parameter counts run from 2.51B to 14B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has MoMonir published?

42 models are listed here, mainly from the Llama, Phi and Gemma families. The most downloaded is translategemma 4b it.

Which quants does MoMonir publish?

The most common are Q5_K_M (40 models), Q6_K (38 models), Q4_K_M (34 models) and Q8_0 (10 models).

Keep browsing