Skip to content

Commit f3fe5c1

Browse files
committed
JOTA paper is added
1 parent b812a67 commit f3fe5c1

2 files changed

Lines changed: 58 additions & 0 deletions

File tree

content/posts/2025.08.JOTA.ja.md

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
---
2+
date: 2025-08-25
3+
publishDate: 2025-08-25
4+
title: Majorization-minimization Bregman proximal gradient algorithms for NMF with the Kullback--Leibler divergence
5+
tags: ["Journal Paper"]
6+
math: true
7+
draft: false
8+
---
9+
10+
Accepted for publication in JOTA.
11+
12+
### Authors:
13+
- Shota Takahashi
14+
- Mirai Tanaka
15+
- Shiro Ikeda
16+
17+
### keywords:
18+
- Nonnegative Matrix Factorization
19+
- Bregman divergence
20+
- proximal gradient algorithm
21+
22+
### URL:
23+
- <a href="https://arxiv.org/abs/2405.11185" target="_blank" rel="noopener">arXiv Link</a>
24+
25+
---
26+
27+
### Abstract:
28+
29+
Nonnegative matrix factorization (NMF) is a popular method in machine learning and signal processing to decompose a given nonnegative matrix into two nonnegative matrices. In this paper, we propose new algorithms, called majorization-minimization Bregman proximal gradient algorithm (MMBPG) and MMBPG with extrapolation (MMBPGe) to solve NMF. These iterative algorithms minimize the objective function and its potential function monotonically. Assuming the Kurdyka--Łojasiewicz property, we establish that a sequence generated by MMBPG(e) globally converges to a stationary point. We apply MMBPG and MMBPGe to the Kullback--Leibler (KL) divergence-based NMF. While most existing KL-based NMF methods update two blocks or each variable alternately, our algorithms update all variables simultaneously. MMBPG and MMBPGe for KL-based NMF are equipped with a separable Bregman distance that satisfies the smooth adaptable property and that makes its subproblem solvable in closed form. Using this fact, we guarantee that a sequence generated by MMBPG(e) globally converges to a Karush--Kuhn--Tucker (KKT) point of KL-based NMF. In numerical experiments, we compare proposed algorithms with existing algorithms on synthetic data and real-world data.

content/posts/2025.08.JOTA.md

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
---
2+
date: 2025-08-25
3+
publishDate: 2025-08-25
4+
title: Majorization-minimization Bregman proximal gradient algorithms for NMF with the Kullback--Leibler divergence
5+
tags: ["Journal Paper"]
6+
math: true
7+
draft: false
8+
---
9+
10+
Accepted for publication in JOTA.
11+
12+
### Authors:
13+
- Shota Takahashi
14+
- Mirai Tanaka
15+
- Shiro Ikeda
16+
17+
### keywords:
18+
- Nonnegative Matrix Factorization
19+
- Bregman divergence
20+
- proximal gradient algorithm
21+
22+
### URL:
23+
- <a href="https://arxiv.org/abs/2405.11185" target="_blank" rel="noopener">arXiv Link</a>
24+
25+
---
26+
27+
### Abstract:
28+
29+
Nonnegative matrix factorization (NMF) is a popular method in machine learning and signal processing to decompose a given nonnegative matrix into two nonnegative matrices. In this paper, we propose new algorithms, called majorization-minimization Bregman proximal gradient algorithm (MMBPG) and MMBPG with extrapolation (MMBPGe) to solve NMF. These iterative algorithms minimize the objective function and its potential function monotonically. Assuming the Kurdyka--Łojasiewicz property, we establish that a sequence generated by MMBPG(e) globally converges to a stationary point. We apply MMBPG and MMBPGe to the Kullback--Leibler (KL) divergence-based NMF. While most existing KL-based NMF methods update two blocks or each variable alternately, our algorithms update all variables simultaneously. MMBPG and MMBPGe for KL-based NMF are equipped with a separable Bregman distance that satisfies the smooth adaptable property and that makes its subproblem solvable in closed form. Using this fact, we guarantee that a sequence generated by MMBPG(e) globally converges to a Karush--Kuhn--Tucker (KKT) point of KL-based NMF. In numerical experiments, we compare proposed algorithms with existing algorithms on synthetic data and real-world data.

0 commit comments

Comments
 (0)