GGUF models by Mathieu-Thomas-JOSSET
75 GGUF models quantized by Mathieu-Thomas-JOSSET on Hugging Face. Sizes run from 596M to 23.6B parameters. The longest trained context is 128K tokens.
PH
phi4 finetune finetome 20260211 100630 best trainloss step03900 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
QW
qwen2.5 3b instruct text gguf 20260120 111441
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
PH
phi4 finetune finetome 20260210 111305 best trainloss step01800 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
QW
qwen2.5 1.5b instruct text gguf 20260123 114150
Qwen · Mathieu-Thomas-JOSSET
Params1.54B
Context32K
Smallest1.6 GB
PH
phi4 finetune finetome 20260210 052937 best trainloss step00900 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
QW
qwen2.5 3b instruct text gguf 20260121 021519
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
PH
joke finetome model gguf phi4 20260106 220520
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi4 finetune finetome 20260210 111305 best evalloss step00250 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi4 finetune finetome 20260210 042638 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi4 finetune finetome 20260211 100630 best evalloss step00650 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GE
Gemma 3 Finetune
Gemma · Mathieu-Thomas-JOSSET
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
qwen2.5 3b instruct text gguf 20260120 095909
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
PH
joke finetome model gguf phi4 20260107 021924
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
JO
joke finetome model
Joke · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GE
gemma 3n text gguf2
Gemma · Mathieu-Thomas-JOSSET
Params4.46B
Context32K
Smallest4.8 GB
PH
joke finetome model gguf phi4 20260106 130529
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
joke finetome model gguf phi4 20260106 054747
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
QW
Qwen2_5_7B_Instruct_zyptilium78_gguf_unsloth
Qwen · Mathieu-Thomas-JOSSET
Params7.61B
Context32K
Q4_K_M4.7 GB
QW
qwen2.5 3b instruct text gguf 20260123 140039
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
JO
joke finetome model gguf 20260105 062407
Joke · Mathieu-Thomas-JOSSET
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
qwen2.5 3b instruct text gguf 20260128 045455
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
QW
Qwen2.5 3b Instruct Text Merged 16bit 20260120_095909
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
JO
joke finetome model gguf 20260105 035838
Joke · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
LL
LLMIKE_20260311_193042
Llmike · Mathieu-Thomas-JOSSET
Params8.19B
Context40K
Q4_K_M5.0 GB
MI
Mike_2E 6_E10_20260220_072336
Mike · Mathieu-Thomas-JOSSET
Params3.21B
Context128K
Smallest3.4 GB
QW
qwen2.5 3b instruct text gguf 20260125 063715
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
QW
qwen2.5 3b instruct text gguf 20260123 133719
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
GE
Gemma 3 Finetune
Gemma · Mathieu-Thomas-JOSSET
Params3.88B
Context128K
Smallest4.1 GB
JO
joke finetome model 20260105 030853
Joke · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi4 finetune finetome 20260210 052937 best evalloss step00950 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB