Subgradient algorithm

72 views
Skip to first unread message

j.fal...@gmail.com

unread,
Dec 19, 2014, 11:08:36 AM12/19/14
to manopt...@googlegroups.com
Is there a subgradient algorithm for manopt? I am thinking of minimizing the L1-norm of a matrix. My first guess is smoothing the L1- norm, but maybe there are more sophisticated methods.

BM

unread,
Dec 19, 2014, 9:54:25 PM12/19/14
to manopt...@googlegroups.com
Hello, 

There are a number of sophisticated methods for L1 minimization.
However, at the moment Manopt does not have a subgradient implementation. 

Regards,
BM

j.fal...@gmail.com

unread,
Dec 19, 2014, 11:55:29 PM12/19/14
to manopt...@googlegroups.com
Which L1 - method would you recommend in connection with Manopt?

Nicolas Boumal

unread,
Dec 22, 2014, 5:02:17 AM12/22/14
to manopt...@googlegroups.com
Hello,

Optimization algorithms for nonsmooth cost functions on manifolds is an ongoing research topic. And as Bamdev mentioned, there is nothing yet in Manopt to handle such problems (although Manopt was designed to be able to handle them when algorithms become available).

For now, typically we use smoothing (pseudo-Huber loss, for example), which has its pros and cons.

Sorry that we do not have a more complete answer at the time. If you find a good way to handle your cost function, we woud love to hear about it here, if you wish.

Cheers,
Nicolas

Nicolas Boumal

unread,
Dec 22, 2014, 5:04:27 AM12/22/14
to manopt...@googlegroups.com
In the examples that ship with the manopt release, there is a minimax problem on the sphere that uses a Huber-loss smoothing:

seu...@gmail.com

unread,
Jan 13, 2015, 1:03:36 AM1/13/15
to manopt...@googlegroups.com
Hello Nicolas,

I am trying to use Manopt to solve some optimization problem on complex circle manifolds, it really helps me a lot and I found it a powerful tool!

Furthermore, I want to know some more details about the complex circle manifolds and I asked help from Bamdev, but he told me that you are more familiar with this kind of manifold. So could you please provide me some references about optimization problem on this manifold?

Thank you very much!
Xianghao

Nicolas Boumal

unread,
Jan 13, 2015, 8:36:04 AM1/13/15
to manopt...@googlegroups.com
Hello Xianghao,

This last question seemed more related to your other topic, so I answered there:

Cheers,
Nicolas
Reply all
Reply to author
Forward
0 new messages