Consider the optimization problem

$$ minlimits_{x, alpha} sum_i alpha_i f_i(x) + g(alpha). $$

I solved the above problem by alternating fixing $x$ solve for $alpha$ and vice versa. When $x$ is fixed, the corresponding optimization with variables $alpha$ is convex and has a closed form solution. When $alpha$ is fixed, the problem is non-convex and it is solved by a gradient descent algorithm (called this problem OP2).

My question is does the above alternative scheme converge (a local optimum) given than OP2 converges to a local optimum. If it is not do you know in which conditions does alternative scheme converge?

Thanks

MathOverflow Asked by user263322 on January 1, 2021

0 Answers0 Asked on December 1, 2020 by yiming-xu

fa functional analysis harmonic analysis linear algebra numerical linear algebra

2 Asked on November 30, 2020

fa functional analysis infinite dimensional manifolds lie groups nuclear spaces rigged hilbert spaces

0 Asked on November 30, 2020 by domotorp

1 Asked on November 28, 2020 by tobias

ca classical analysis and odes co combinatorics differential calculus real analysis

1 Asked on November 28, 2020 by ttip

ag algebraic geometry derived categories homological algebra ra rings and algebras triangulated categories

1 Asked on November 27, 2020 by johnny-t

analytic number theory lattices mg metric geometry nt number theory real analysis

1 Asked on November 26, 2020 by norman-goldstein

9 Asked on November 21, 2020 by frank-thorne

0 Asked on November 19, 2020 by dmitry-vaintrob

ag algebraic geometry algebraic number theory at algebraic topology dg differential geometry hodge theory

2 Asked on November 18, 2020 by lchen

computational complexity graph theory oc optimization and control

2 Asked on November 17, 2020 by joel-david-hamkins

0 Asked on November 14, 2020 by 1

0 Asked on November 9, 2020 by tim-campion

ct category theory higher category theory homotopy theory infinity categories

3 Asked on November 7, 2020 by alekk

1 Asked on November 5, 2020 by aryeh-kontorovich

1 Asked on November 3, 2020 by ippiki-ookami

0 Asked on October 29, 2020 by bruno-peixoto

0 Asked on October 26, 2020 by alex-m

brownian motion pr probability riemannian geometry stochastic calculus stochastic processes

2 Asked on October 25, 2020 by kurisuto-asutora

0 Asked on October 18, 2020 by arkady

Get help from others!

Recent Answers

- kjetil b halvorsen on How to test consistency of responses?
- eric_kernfeld on How to test consistency of responses?
- Philipp on How do i draw a ray in unity
- DMGregory on MouseLook Script “Pops” back to the last value when the script is enabled after being disabled or destroyed
- Justin Markwell on Unity app crashes when using unmodified custom Android manifest (didn’t find class “UnityPlayerActivity”)

Recent Questions

- MouseLook Script “Pops” back to the last value when the script is enabled after being disabled or destroyed
- Unity app crashes when using unmodified custom Android manifest (didn’t find class “UnityPlayerActivity”)
- How do i draw a ray in unity
- How to test consistency of responses?
- How can I understand these variograms?

© 2022 AnswerBun.com. All rights reserved.