Skip to content

A FISTA-type accelerated gradient algorithm for solving smooth nonconvex composite optimization problems

Research output: Contribution to journalArticlepeer-review

In this paper, we describe and establish iteration-complexity of two accelerated composite gradient (ACG) variants to solve a smooth nonconvex composite optimization problem whose objective function is the sum of a nonconvex differentiable function ƒ with a Lipschitz continuous gradient and a simple nonsmooth closed convex function h. When ƒ is convex, the first ACG variant reduces to the well-known FISTA for a specific choice of the input, and hence the first one can be viewed as a natural extension of the latter one to the nonconvex setting. The first variant requires an input pair (M, m) such that ƒ is m-weakly convex, ∇ƒ is M-Lipschitz continuous, and mM (possibly m < M), which is usually hard to obtain or poorly estimated. The second variant on the other hand can start from an arbitrary input pair (M, m) of positive scalars and its complexity is shown to be not worse, and better in some cases, than that of the first variant for a large range of the input pairs. Finally, numerical results are provided to illustrate the efficiency of the two ACG variants.
Original languageEnglish
Pages (from-to)649-679
Number of pages31
JournalComputational Optimization and Applications
Volume79
DOIs
Publication statusPublished - 13 May 2021

Documents

  • A FISTA-type accelerated gradient algorithm AAM

    Rights statement: This is a post-peer-review, pre-copyedit version of an article published in Computational Optimization and Applications. The final authenticated version is available online at: http://dx.doi.org/10.1007/s10589-021-00280-9.

    Accepted author manuscript (Post-print), 397 KB, PDF document

    Due to publisher’s copyright restrictions, this document is not freely available to download from this website until: 13/05/22

Related information

Relations Get citation (various referencing formats)

ID: 27427389