Statistical Analysis Stack Exchange
Statistical Analysis Stack Exchange

Questions tagged [inverse-problem]

In science an inverse problem is the problem of calculating from a set of observations the causes that produced the observations. Examples are tomography and seismic reconstruction, and many others. Use this tag for statistical methods used with inverse problems.

For a more thorough discussion see wikipedia https://en.wikipedia.org/wiki/Inverse_problem

35 questions
7
votes
2 answers

In GD-optimisation, if the gradient of the error function is w.r.t to the weights, isn't the target value dropped since it's a lone constant?

Suppose we have the absolute difference as an error function: $\mathit{loss}(w) = |m_x(w) - t|$ where $m_x$ is simply some model with input $x$ and weight setting $w$, and $t$ is the target value. In gradient-descent optimisation, the initial idea…
mesllo
  • 579
  • 2
  • 16
4
votes
1 answer

Inferring a Markov chain from its invariant measure

Given a probability measure $p$ on $\{1,\dots,n\}$ assumed to be the invariant measure of some irreducible ergodic Markov chain with unknown transition matrix $P$, i.e., $p = pP$, what (if any) problems about inferring a unique/optimal $P$ have been…
S Huntsman
  • 141
  • 5
3
votes
0 answers

Neural Network Inversion and its consequences

I am currently looking at Federated Learning. Here is a good example from google. The idea is that training happens on multiple devices. This means on one hand that training data never leaves a user (privacy) and on the other hand that it can be run…
Mr.Sh4nnon
  • 581
  • 3
  • 14
3
votes
1 answer

Regression with an unknown dependent variable

I want to know if there is any literature about the following regression problem: $$ Y=X\beta +\epsilon$$ where $Y$ is unknown. But, i know $X$ and the OLS estimator of $\beta$ $$ \hat{\beta}=(X^\top X)^{-1}X^\top Y$$ because i know the value of…
david
  • 31
  • 1
2
votes
1 answer

How to invert/infer a parameter in nonlinear conditional expectation function

I wouldn't be surprised if this question has already been asked, as it sounds like a standard bookwork result. However, I'm not sure I know the language to describe it, and when I type in the the title it doesn't find in similar questions. Feel free…
Marses
  • 291
  • 2
  • 11
2
votes
0 answers

Confusion related to inverse problems in statistics

I am getting started with inverse problems in statistics. However, I didn't something related to it. I was reading this paper http://math.uni-heidelberg.de/studinfo/reiss/CavalierInvProb.pdf. It says The classical problem is the following : let A…
user34790
  • 6,049
  • 6
  • 42
  • 64
2
votes
0 answers

Inverse problem with normal distributions and max

Consider $n$ independent normally distributed random variables $$X_i\sim N(\mu_i,\sigma_i^2)$$ and denote $Y = \max\limits_{1\leq i\leq n}\{X_i\}$. We can define the probabilities, for each $1\leq i\leq n$, $$\tilde{P}_i = \mathbb{P}(X_i=Y)$$ where…
Dennis
  • 31
  • 1
2
votes
0 answers

Can we get the input from a multilayer perceptron based on the output of one of its hidden layers?

I was reading a relatively new paper that proposed to split a nerual networks layers into groups and sending each group to different nodes to train them in a distributed manner. In order to not send sensitive data through the internet, only the…
sgaseretto
  • 121
  • 1
2
votes
0 answers

Machine learning/Deep learning to solve inverse tomographic problem

The typical simplifiled representation of a tomographic system is $y = Ax$, where $y$ is the collected data (sinogram in CT), $A$ is the projection matrix, and $x$ is the unknown image. The closed form solution, which is probably the most popular…
Nick X Tsui
  • 160
  • 4
2
votes
0 answers

Connection between MCMC and Optimization for Inverse/Parameter-Estmation Problems

I've been considering two approaches to solving inverse/parameter-estimation problems, and I'm curious to the connection and/or difference between the two approaches. Set up: Say we have a forward model, $F$, that gives a response, $y$, given some…
kjd
  • 21
  • 1
2
votes
1 answer

L-curve method for regularization parameter selection

I work on PDE inverse problems and I'm interested in how these can be viewed as problems of statistical inference. I'm looking for some model parameters $m$ which minimize the misfit with some data $d$ subject to some physics $G$: $J[m] =…
Daniel Shapero
  • 133
  • 6
1
vote
1 answer

Least square regression with L1 regularization and non-negativity constraint

There are two functions associated by the model $a(x) = \int_{k_1}^{k_2} b(k)\exp(-kx)dk$ where $a(x)$ is the experimental data I have, and $b(k)$ is the information I want to get. Or I can write in a matrix form if k space is discretized: $a =…
shva
  • 31
  • 3
1
vote
1 answer

How to decompose a random walk (array) into its Markov Chain transition matrix?

The algorithm, PageRank, receives a Markov Chain transition matrix (page links from one to another.) Either by random walk, or more efficiently, eigenvectors, the stationary distribution of the Markov Chain can be found, which conveniently ranks…
jbuddy_13
  • 1,578
  • 3
  • 22
1
vote
0 answers

Does blind source separation (ICA) work if channels of mixture are observed asynchronously?

Does Independent Component Analysis (ICA - fastICA, SOBI, etc.) work reliably when applied to a multidimensional mixture (observation) $X = (X^1, \cdots, X^d)$ if the different channels $X^i$ of the observation aren't recorded synchronously? I.e.,…
rmcerafl
  • 45
  • 5
1
vote
1 answer

Estimate the Image Using Multi Many Realizations of Its Convolution with a Known Filters Using Wiener Filter

Suppose we have a corrupted image $Y = H*X + \epsilon$ that is formed by taking an image $X$, convolving it with a point-spread function $H$, and adding gaussian noise $\epsilon$. Then we know that the Wiener Filter can compute the MMSE estimator of…
Sunay Joshi
  • 13
  • 4
1
2 3