GGUF models by keisuke-miyako
302 GGUF models quantized by keisuke-miyako on Hugging Face. Sizes run from 23M to 14.7B parameters. The longest trained context is 1024K tokens.
PH
Phi 4 reasoning plus gguf q4 k m
Phi · keisuke-miyako
Params14.7B
Context32K
Q4_K_M9.1 GB
QW
Qwen3 Embedding 4B gguf q8 0
Qwen · keisuke-miyako
Params4.02B
Context40K
Smallest4.3 GB
HA
Hammer2.1 0.5b gguf q4 k m
Hammer · keisuke-miyako
Params494M
Context32K
Q4_K_M0.4 GB
ZE
Zerank 1 Small
Zerank · keisuke-miyako
Params1.72B
Context40K
Q4_K_M1.1 GB
JI
jina reranker v1 turbo en gguf q4 k m
Jina · keisuke-miyako
Params38M
Context8K
Q4_K_M0.0 GB
FU
functiongemma 270m it gguf q8 0
Functiongemma · keisuke-miyako
Params268M
Context32K
Smallest0.3 GB
LF
LFM2 1.2B Tool gguf q8 0
Lfm · keisuke-miyako
Params1.17B
Context125K
Smallest1.2 GB
LF
LFM2.5 1.2B Thinking gguf q4 k m
Lfm · keisuke-miyako
Params1.17B
Context125K
Q4_K_M0.7 GB
BG
bge m3 legal euro r4
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
DR
Dream v0 Instruct 7B
Dream · keisuke-miyako
Params7.62B
Context128K
Q4_K_M4.7 GB
MX
Mxbai Embed Large v1
Mxbai · keisuke-miyako
Params334M
Context512
Q4_K_M0.2 GB
LL
Llm Jp 3 3.7b
Llm · keisuke-miyako
Params3.78B
Context4K
Q4_K_M2.3 GB
BG
bge m3 legal euro r28
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
M2
m2m100_418M
keisuke-miyako
Params877M
Context—
Q4_K_M0.5 GB
SA
sarashina embedding v2 1b gguf q4 k m
Sarashina · keisuke-miyako
Params1.41B
Context8K
Q4_K_M0.9 GB
MA
ms marco MiniLM L6 v2 gguf q8 0
Marco · keisuke-miyako
Params23M
Context512
Smallest0.0 GB
MX
Mxbai Rerank Base v2
Mxbai · keisuke-miyako
Params494M
Context32K
Smallest0.5 GB
FA
Falcon3 7B Instruct gguf q4 k m
Falcon · keisuke-miyako
Params7.46B
Context32K
Q4_K_M4.6 GB
PA
paraphrase multilingual mpnet base v2 gguf q4 k m
Paraphrase · keisuke-miyako
Params277M
Context512
Q4_K_M0.2 GB
GE
gemma 3n E4B gguf q4 k m
Gemma · keisuke-miyako
Params6.87B
Context32K
Q4_K_M4.2 GB
SA
sarashina2.2 1b instruct v0.1 gguf q8 0
Sarashina · keisuke-miyako
Params1.41B
Context8K
Smallest1.5 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · keisuke-miyako
Params7.62B
Context128K
Q4_K_M4.7 GB
MX
mxbai-rerank-large-v2
Mxbai · keisuke-miyako
Params1.54B
Context32K
Q4_K_M1.0 GB
TE
Ternary-Bonsai-8B
Ternary · keisuke-miyako
Params8.19B
Context—
Smallest2.2 GB
MU
multilingual e5 large gguf q4 k m
Multilingual · keisuke-miyako
Params559M
Context512
Q4_K_M0.4 GB
FA
Falcon H1 1.5B Instruct gguf q8 0
Falcon · keisuke-miyako
Params1.55B
Context128K
Smallest1.7 GB
PA
paraphrase multilingual mpnet base v2 gguf f16
Paraphrase · keisuke-miyako
Params277M
Context512
Smallest0.6 GB
JA
AI21 Jamba2 3B
Jamba · keisuke-miyako
Params3.2B
Context256K
Q4_K_M1.9 GB
SA
sarashina2.2 3b instruct v0.1 gguf q4 k m
Sarashina · keisuke-miyako
Params3.36B
Context8K
Q4_K_M2.1 GB
RE
reader lm 0.5b gguf q8 0
Reader · keisuke-miyako
Params494M
Context250K
Smallest0.5 GB