GGUF models by keisuke-miyako

302 GGUF models quantized by keisuke-miyako on Hugging Face. Sizes run from 23M to 14.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Reranker 0.6B gguf q8 0
Qwen · keisuke-miyako
Params596M
Context40K
Smallest0.6 GB
EmbeddingReasoningTool use
PH
Phi 3.5 Mini Instruct
Phi · keisuke-miyako
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PA
paraphrase multilingual mpnet base v2 gguf q8 0
Paraphrase · keisuke-miyako
Params277M
Context512
Smallest0.3 GB
GGUF
TE
Ternary-Bonsai-4B
Ternary · keisuke-miyako
Params4.41B
Context—
Smallest1.2 GB
GGUF
HA
Hammer2.1 1.5b gguf q4 k m
Hammer · keisuke-miyako
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
DE
DeepSeek R1 Distill Qwen2.5 7B gguf q4 k m
DeepSeek · keisuke-miyako
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
MI
Ministral 3 3B Reasoning 2512 gguf q4 k m
Mistral · keisuke-miyako
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool useVision
FA
Falcon H1 7B Instruct gguf q4 k m
Falcon · keisuke-miyako
Params7.59B
Context256K
Q4_K_M4.6 GB
Tool use
LF
LFM2.5 1.2B Instruct gguf q8 0
Lfm · keisuke-miyako
Params1.17B
Context125K
Smallest1.2 GB
Tool use
GE
gemma 3 270m it gguf q4 k m
Gemma · keisuke-miyako
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
gemma 3 270m it gguf q8 0
Gemma · keisuke-miyako
Params268M
Context32K
Smallest0.3 GB
GGUF
GR
granite embedding multilingual r2
Granite · keisuke-miyako
Params312M
Context32K
Smallest0.1 GB
Embedding
QW
Qwen3 1.7B gguf q4 k m
Qwen · keisuke-miyako
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
MU
multilingual e5 base gguf q8 0
Multilingual · keisuke-miyako
Params277M
Context512
Smallest0.3 GB
GGUF
EL
ELYZA Diffusion Instruct 1.0 Dream 7B gguf q4 k m
Elyza · keisuke-miyako
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
MM
mmBERT Base
Mmbert · keisuke-miyako
Params307M
Context8K
Smallest0.6 GB
GGUF
RU
ruri v3 130m gguf q8 0
Ruri · keisuke-miyako
Params132M
Context8K
Smallest0.1 GB
GGUF
ZE
zerank 2 gguf q4 k m
Zerank · keisuke-miyako
Params4.02B
Context40K
Q4_K_M2.5 GB
EmbeddingReasoningTool use
SM
SmolLM3 3B gguf q4 k m
SmolLM · keisuke-miyako
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
MM
mmBERT Base
Mmbert · keisuke-miyako
Params307M
Context8K
Smallest0.3 GB
GGUF
NL
nllb-200-distilled-600M
Nllb · keisuke-miyako
Params1.4B
Context—
Smallest2.8 GB
GGUF
MU
multilingual e5 large gguf q8 0
Multilingual · keisuke-miyako
Params559M
Context512
Smallest0.6 GB
GGUF
QW
Qwen3 4B Thinking 2507 gguf q4 k m
Qwen · keisuke-miyako
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
BG
bge m3 lemur r1
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
EmbeddingReasoning
GR
granite embedding english r2 gguf q8 0
Granite · keisuke-miyako
Params149M
Context8K
Smallest0.2 GB
Embedding
NL
nllb-200-1.3B
Nllb · keisuke-miyako
Params2.16B
Context—
Smallest4.3 GB
GGUF
HA
Harrier Oss v1 270m
Harrier · keisuke-miyako
Params268M
Context32K
Smallest0.6 GB
GGUF
SN
snowflake arctic embed l v2.0
Snowflake · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
Embedding
GE
gemma 2 2b jpn it gguf q4 k m
Gemma · keisuke-miyako
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
EL
ELYZA Diffusion Base 1.0 Dream 7B gguf q4 k m
Elyza · keisuke-miyako
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use

Keep browsing