Mathematics Stack Exchange
Mathematics Stack Exchange

Questions tagged [convex-analysis]

Convex analysis is the study of properties of convex sets and convex functions. For questions about optimization of convex functions over convex sets, please use the (convex-optimization) tag.

Convex analysis is the study of properties of convex sets and convex functions.

Formally, a set $S$ is convex if, for all $x, y \in S$ and $t \in [0,1]$, $tx + (1-t)y \in S$. Intuitively, this says that for any two points in $S$, the line segment connecting those points is also in $S$.

Formally, a function $f: S \to \mathbb{R}$ defined on a convex set $S$ is convex, if for all $x,y \in S$ and $t \in [0,1]$, $f(tx + (1-t)y) \leq t f(x) + (1-t) f(y)$. Intuitively, this says that, for any two points on the graph of $f$, the line segment connecting those points lies above the graph of $f$.

Some of the more important results in convex analysis include Carathéodory's Theorem, Jensen's Inequality, Minkowski's Theorem, and the supporting hyperplane theorem.

9239 questions
108
votes
11 answers

Prove that every convex function is continuous

A function $f : (a,b) \to \Bbb R$ is said to be convex if $$f(\lambda x+(1-\lambda)y)\le \lambda f(x)+(1-\lambda)f(y)$$ whenever $a < x, y < b$ and $0 < \lambda <1$. Prove that every convex function is continuous. Usually it uses the fact: If $a…
cowik
  • 1,123
  • 3
  • 8
  • 5
57
votes
3 answers

Dual norm intuition

The dual of a norm $\|\cdot \|$ is defined as: $$\|z\|_* = \sup \{ z^Tx \text{ } | \text{ } \|x\| \le 1\}$$ Could anybody give me an intuition of this concept? I know the definition, I am using it to solve problems, but in reality I still lack…
trembik
  • 1,169
  • 1
  • 12
  • 19
51
votes
6 answers

Midpoint-Convex and Continuous Implies Convex

Given that $$f\left(\frac{x+y}{2}\right)\leqslant \frac{f(x)+f(y)}{2}~,$$ how can I show that $f$ is convex. Thanks. Edit: I'm sorry for all the confusion. $f$ is assumed to be continuous on an interval $(a,b)$.
Jack
  • 703
  • 1
  • 7
  • 10
50
votes
5 answers

Geometric intuition of conjugate function

I am looking for a geometric and intuitive explanation of the conjugate function and how it maps to the below analytical formula. $$ f^*(y)= \sup_{x \in \operatorname{dom} f } (y^Tx-f(x))$$
Abhishek Bhatia
  • 1,528
  • 7
  • 22
  • 36
50
votes
2 answers

Is the composition of $n$ convex functions itself a convex function?

Is a set of convex functions closed under composition? I don't necessarily need a proof, but a reference would be greatly appreciated.
Phillip Cloud
  • 627
  • 2
  • 7
  • 9
47
votes
7 answers

How do you prove that $\{ Ax \mid x \geq 0 \}$ is closed?

Let $A$ be a real $m \times n$ matrix. How do you prove that $\{ Ax \mid x \geq 0, x \in \mathbb R^n \}$ is closed (as in, contains all its limit points)? The inequality $x \geq 0$ is interpreted component-wise. This fact is used in some proofs…
littleO
  • 49,907
  • 8
  • 93
  • 165
45
votes
4 answers

cosh x inequality

While reading an article on Hoeffding's Inequality, I came across a curious inequality. Namely $$\cosh x \leq e^{x^2/2} \quad \forall x \in \mathbb{R}$$ I tried many ways to prove it and finally, the Taylor series approach worked: $$e^x = 1 + x +…
Gautam Shenoy
  • 10,148
  • 1
  • 27
  • 65
42
votes
3 answers

Does local convexity imply global convexity?

Question: Under what circumstances does local convexity imply global convexity? Motivation: Classically, a twice differentiable function $f:\mathbb{R} \rightarrow \mathbb{R}$ is convex if and only if the second derivative is nonnegative everywhere.…
Nick Alger
  • 18,009
  • 11
  • 65
  • 89
38
votes
1 answer

The composition of two convex functions is convex

Let $f$ be a convex function on a convex domain $\Omega$ and $g$ a convex non-decreasing function on $\mathbb{R}$. prove that the composition of $g(f)$ is convex on $\Omega$. Under what conditions is $g(f)$ strictly convex. My attempt, since $f$ is…
bobdylan
  • 2,274
  • 5
  • 25
  • 39
36
votes
6 answers

How pathological can a convex function be?

Let $f : \mathbb R \to \mathbb R$ be convex. How weird can $f$ be? I know $f$ can easily be non-differentiable at finitely many points, for example $f(x) = \sum_{i=1}^n | x - c_i|$. Can it be non-differentiable at infinitely many points? Or on a set…
alfalfa
  • 1,479
  • 11
  • 16
34
votes
3 answers

A convex function is differentiable at all but countably many points

Let $f:\Bbb R\to\Bbb R$ be a convex function. Then $f$ is differentiable at all but countably many points. It is clear that a convex function can be non-differentiable at countably many points, for example $f(x)=\int\lfloor x\rfloor\,dx$. I just…
Mario Carneiro
  • 26,791
  • 4
  • 65
  • 134
34
votes
2 answers

Unit Ball with p-norm

I am having trouble understanding the definition of p-norm unit ball. What I know is that for infinity (maximum norm), then it will shape as a square. I need a "click" to understand this, can someone be so kind to explain this to me in simple…
dresden
  • 1,003
  • 1
  • 11
  • 18
34
votes
2 answers

The measurability of convex sets

How to prove the measurability of convex sets in $R^n$ ? I have seen a proof, but too long and not very intuitive.If you have seen any, please post it here.
cjr
  • 341
  • 4
  • 3
33
votes
4 answers

What's the difference between interior and relative interior?

As defined in Convex Optimization written by Stephen Boyd & Lieven Vandenberghe, both interior and relative interior seems to describe a same thing: a set that peels away its boundary points. So, what on earth is the difference between these two…
BioCoder
  • 835
  • 1
  • 9
  • 15
32
votes
3 answers

Example of a function such that $\varphi\left(\frac{x+y}{2}\right)\leq \frac{\varphi(x)+\varphi(y)}{2}$ but $\varphi$ is not convex

Rudin's Real and Complex Analysis Chapter 3 Exercise 4 is: Assume that $\varphi$ is a continuous real function on $(a,b)$ s.t. $$\varphi\left(\frac{x+y}{2}\right)\leq \frac{\varphi(x)+\varphi(y)}{2}$$ for all $x,y\in(a,b)$. Prove that $\varphi$ is…
Jiajun Wu
  • 671
  • 6
  • 10
1
2 3
…
99 100