Statistical Analysis Stack Exchange
Statistical Analysis Stack Exchange

Questions tagged [learning]

25 questions
3
votes
0 answers

How can I model this Bayesian learning process of two types of coins?

(As suggested on the comment, I slightly changed my previous question.) I have $N$ coins and I am testing them one by one if it is fair or not. I know that, if it is unfair, the probability of head will be 2/3. Given that $n=10$, for instance, how…
김찬우
  • 73
  • 6
2
votes
1 answer

Query-By-Committee with abstention

I’ve some difficulties understanding how abstention works in Active Learning. A teacher asked me to implement the active learning algorithm Query-by-Committee which helps a committee to ask the better points to the oracle. I’ve understand how the…
Valentin Dusollier
  • 21
  • 2
2
votes
3 answers

How to conduct linear regression with lots of data?

Say we have an absolutely huge dataset, and it's too much to put it all into one linear regression model to train. How can we go about using all of this data? I was thinking that we could break this up into, say 5 different chunks, and then train on…
Jame Flanagin
  • 21
  • 2
1
vote
1 answer

Reduce or Increase Dimensionality? Machine Learning

I had a question about machine learning and dimensionality. In many machine learning methods, we try to reduce the dimensionality and find a latent space / manifold in which the data can be represented, i.e. neural networks taking in images In other…
DXinhua
  • 13
  • 2
1
vote
1 answer

Limit of Momentum Update Equation

I am self-studying on optimization algorithm on https://d2l.ai/chapter_optimization/momentum.html and couldn't get my head around some derivation: Instead of the standard gradient descent update equation: $$\mathbf{x_t} \leftarrow \mathbf{x}_{t-1}…
WeiShan Ng
  • 113
  • 3
1
vote
0 answers

How to Retrieve Feature Weights and Formula from SVC Classification

I am quite new to skit-learn. I have been working on a SVC Classification problem which seems to be yielded good results. I am using an SVC Polynomial Classifier @ 40 degrees; please see attached (oops can't attach). How can I retrieve the Feature…
Tybalt
  • 23
  • 2
1
vote
1 answer

Affects of including generated data into "real" dataset

I was thinking about what the outcome of the following idea would be. Let's say that we have a Generative Adversarial Network (GAN) that has "successfully" (i.e., Discriminator is not able to differentiate between real and fake) mapped a noise…
Angel Adrian Cantu
  • 11
  • 1
1
vote
1 answer

Clarifications on Generative Adversarial Nets

I have just read the paper https://arxiv.org/pdf/1701.00160.pdf which is a tutorial on GAN. I have a few clarifications: Must the dimension of the output layer of Generator match the input layer of Discriminator so that the following equation is…
onexpeters
  • 13
  • 3
1
vote
0 answers

Recommended machine learning method to solve my problem in sequence prediction

I am pretty new to most algorithms and with there being so many out there, it is hard to choose as a beginner which one to use. Therefore, I am looking for some recommendations here. The problem is as follows: assume different series of treatments…
Jacky Chu
  • 11
  • 1
1
vote
1 answer

Empirical Risk Minimization: why is the rate of convergence important?

In section 4 Empirical Risk Minimzation of the paper Principles of Risk Minimization for Learning Theory by V. Vapnik, the author says the following: In order to solve this problem, the following induction principle is proposed: the risk functional…
The Pointer
  • 1,064
  • 13
  • 35
1
vote
0 answers

Public data and examples for practicing distribution fitting?

Are there public data for practicing distribution fitting and examples? I want to practice parameter estimation with various methods. To do so it would be helpful if there are reliable examples of fitting models to the data so that I can crosscheck…
Nownuri
  • 409
  • 2
  • 8
1
vote
1 answer

Convergence under large set of learning rates

What is the interpretation of a stochastic optimization problem where a gradient descent algorithm is converging under a wide range of learning rate schedules (including ones with quite large initial values, i.e. when taking large gradient steps)?…
Dionysis M
  • 794
  • 6
  • 17
0
votes
0 answers

Learning operating probabilities from interval data

Suppose I have a machine. When the machine is active (operating), it runs for at least $\mu > 0$ time. I know that at some point in the time interval $[l, h]$ ($l, h \in \mathbb R_{\ge 0}, l < h$) the machine was active, but I do not know when, or…
Niels Wouda
  • 158
  • 1
  • 7
0
votes
0 answers

Question about batch learning

If we have 1000 instances and we apply minibatch = 32, then does it mean that during 1 epoch only 32 random updates are going to happen? Or does it mean that all of the 1000 instances are going to be used 32 by 32 random instances?
Balázs Gönczy
  • 1
  • 1
0
votes
0 answers

What do they really mean by class incremental learning

I war reading Class-incremental learning: survey and performance evaluation on image classification. I do not understand clearly what system do we expect at the end. It is 1. or 2. 1. train a model to predict whether inputs belongs to the class A…
Mas A
  • 175
  • 9
1
2