Questions tagged [graphical-model]

Also called Probabilistic Graphical Model, used for statistical models expressed via graphs, causal or not. (Nb, "graph" as in graph theory, *not* as in figure or plot).

A graphical model is a probabilistic model which expresses the relationship among random variables using a graph (in the sense of graph theory). The nodes of the graph represent the random variables, while the edges of the graph encode the relationships between them.

Two broad categories of probabilistic graphical models are:

  1. Directed Acyclic Graphs (DAG) also known as Bayesian Networks.
    • DAGs are used to express the factorization of the joint probability distribution.
    • The direction of an edge indicates the conditional independence of random variables in a graph.
  2. Undirected Graphical Model (UGM) also known as Markov Random Fields.
    • UGMs, by definition, allow for cycles, therefore cannot express the induced dependence structure that a DAG can.
    • However, since the dependence structure of certain phenomena is difficult to establish, people use UGMs to express certain types of relationships that are more flexible. Notably, UGMs are used in spatial statistics and image analysis.
483 questions
56
votes
13 answers

Software for drawing bayesian networks (graphical models)

I am searching for [free] software that can produce nice looking graphical models, e.g. Any suggestions would be appreciated.
C. Reed
  • 537
  • 1
  • 8
  • 14
36
votes
3 answers

What's the relation between hierarchical models, neural networks, graphical models, bayesian networks?

They all seem to represent random variables by the nodes and (in)dependence via the (possibly directed) edges. I'm esp interested in a bayesian's point-of-view.
31
votes
4 answers

Where's the graph theory in graphical models?

Introductions to graphical models describe them as "... a marriage between graph theory and probability theory." I get the probability theory part but I have trouble understanding where exactly graph theory fits in. What insights from graph theory…
Vimal
  • 1,047
  • 8
  • 16
26
votes
3 answers

What's the difference between a Markov Random Field and a Conditional Random Field?

If I fix the values of the observed nodes of an MRF, does it become a CRF?
23
votes
2 answers

Next steps after "Bayesian Reasoning and Machine Learning"

I'm currently going through "Bayesian Reasoning and Machine Learning" by David Barber and it is an extremely well written and engaging book for learning the fundamentals. So a question to someone who has already done this. What are the next set of…
user2293
22
votes
1 answer

When do Markov random fields $\neq$ exponential families?

In their textbook, Graphical Models, Exponential Families and Variational Inference, M. Jordan and M. Wainwright discuss the connection between Exponential families and Markov Random Fields (undirected graphical models). I am trying to understand…
Amelio Vazquez-Reina
  • 17,546
  • 26
  • 74
  • 110
21
votes
2 answers

Parameters without defined priors in Stan

I've just started to learn to use Stan and rstan. Unless I've always been confused about how JAGS/BUGS worked, I thought you always had to define a prior distribution of some kind for every parameter in the model to be drawn from. It appears that…
JoFrhwld
  • 2,247
  • 3
  • 20
  • 22
18
votes
3 answers

Understanding d-separation theory in causal Bayesian networks

I am trying to understand the d-Separation logic in Causal Bayesian Networks. I know how the algorithm works, but I don't exactly understand why the "flow of information" works as stated in the algorithm. For example in the graph above, lets think…
Ufuk Can Bicici
  • 2,028
  • 1
  • 17
  • 26
14
votes
4 answers

Do edges in directed acyclic graph represent causality?

I am studying Probabilistic Graphical Models, a book for self-study. Do edges in a directed acyclic graph (DAG) represent causal relations? What if I want to construct a Bayesian network, but I am not sure about the direction of arrows in it? All…
lovekesh
  • 459
  • 5
  • 16
14
votes
3 answers

Strong ignorability: confusion on the relationship between outcomes and treatment

In the research area of potential outcomes and individual treatment effect (ITE) estimation, a common assumption called ''strong ignorability'' is often made. Given a graphical model with the following variables: treatment $T=\{0,1\}$ (e.g. giving…
13
votes
4 answers

Are there any tutorials on Bayesian probability theory or graphical models by example?

I've seen references to learning Bayesian probability theory in R, and I was wondering if there is more like this, perhaps specifically in Python? Geared towards learning Bayesian probability theory, inference, maximum likelihood estimation,…
3ds
  • 61
  • 1
  • 3
12
votes
3 answers

Mathematically modeling neural networks as graphical models

I am struggling to make the mathematical connection between a neural network and a graphical model. In graphical models the idea is simple: the probability distribution factorizes according to the cliques in the graph, with the potentials usually…
12
votes
2 answers

Explanation of I-map in a Markov/Bayesian network

I am finding the concept of an I-map (Independency-map) in the context of Markov networks and Bayesian networks difficult to understand. From Probabilistic Graphical Models, Koller and Friedman, 2009: We first define the set of independencies…
12
votes
2 answers

What is probabilistic inference?

I am reading Chris Bishop's Pattern Recognition and Machine Learning textbook. I came across the term probabilistic inference several times. I have a couple of questions. Is probabilistic inference only applicable in a graphical modelling…
11
votes
3 answers

Why use factor graph for Bayesian inference?

I don't understand why converting a Bayesian network into a factor graph is good for Bayesian inference? My questions are: What is the benefit of using factor graph in Bayesian reasoning? What would happen if we don't use it? Any concrete…
xiaohan2012
  • 6,819
  • 5
  • 18
  • 18
1
2 3
32 33