Statistical Analysis Stack Exchange
Statistical Analysis Stack Exchange

Questions tagged [statistical-confidence]

19 questions
5
votes
3 answers

What is the history of $p < 0.05$ or 95% confidence?

I'm wondering what the history of $p < 0.05$ or using a 95% confidence interval is. I know that more nuanced reasoning would argue that there is nothing special about 0.05 or 95% (I think decision theory offers guidance on what level of risk to…
cgmil
  • 647
  • 4
  • 12
2
votes
3 answers

Given a regression model, is there a way to evaluate confidence of a prediction?

What are methods for evaluating the predictive probability or something equivalent in a regression problem? In classification problems a predictive probability will be outputted given an input. For example in a neural network or a logistic…
user8714896
  • 640
  • 2
  • 12
2
votes
2 answers

How would you interpret this p-value in relation to page traffic due to page features?

I'm exploring some manual approaches to understand whether specific changes on a site can be deemed conclusive and statistically significant. I appreciate that any A/B testing platform has a reporting part of doing this job; however, changes have…
Andrea Moro
  • 163
  • 6
1
vote
0 answers

Compare two confidence intervals calculated from same sample

Problem: We have distance between user and a static device(in meters). We have lab tested data where user is actually standing away from device(actual values). Based on these we try to determine what is approximate distance of user(predicted…
camelCase
  • 11
  • 1
1
vote
0 answers

Measuring the confidence of a probability prediction from a binary classifier

I've trained a binary classifier for a language identification problem. The training data is $n$ sentences from language A and $n$ sentences from language B. Such that $n$ sentences are selected uniformly at random from a larger corpus of $N$…
dimid
  • 217
  • 2
  • 7
1
vote
0 answers

How to find confidence in output result given a histogram?

I have this algorithm that spits out a value between two objects. The smaller the value the more similar those objects are in euclidean space. I ran it on hundreds of examples that are true positives, i.e. I know they are similar. I know their lower…
obadul024
  • 11
  • 2
1
vote
0 answers

repeated measurements needed for certainty

A bit of a silly question. We have a model, which can be described as y = M(x) + some significant levels of noise. We see that if we repeat the measurements of y N times, we can see a clear correlation between the measurements and M. However we want…
user1384636
  • 207
  • 1
  • 7
0
votes
0 answers

statistical confidence level based on a sample size

I have 974 samples in front of me. I want to test these samples and ideally I should test all 974 samples. However, testing the sample will break the sample and I cannot afford to break all of them. The manual states that if I test (by pulling to…
Mr.Happy
  • 1
  • 1
0
votes
0 answers

What is the meaning of " Confidence interval of less than 1% of the average value"?

I want to find confidence intervals for my scenario and I see this sentence in many research papers related to my work. " Confidence interval of less than 1% of the average value"? What does it mean? You can also explain this with the example given…
knowledge_seeker
  • 11
  • 1
0
votes
1 answer

Occurrence certainty

I think the best way to ask this question is with a hypothetical situation. Let's say I have a sensor that measures on average one occurrence every 3 days with a standard deviation of about 4. I want to move that sensor to a new unknown location.…
Krits
  • 41
  • 3
0
votes
0 answers

Getting the confidence level of a model score given previous model accuracy

For practical reasons, I want to implement a standard confidence level which represents the probability that a particular instance is in a particular class given a model and the accuracy of that model on a number of examples. Sounds like something…
Joshua M
  • 101
  • 2
0
votes
0 answers

How to categorise data bumps/valleys into actual features or noise?

Here's some data$^1$ denoting the variation of the mean of samples (y-axis) with the no. of samples (x-axis). The uncertainties are $1\sigma$ standard deviation of those samples. Fig1. Graph of the data Clearly the data has a trend. It converges to…
lineage
  • 101
  • 1
0
votes
1 answer

How to treat proportions with different sample sizes as response variable in GLM / GLMM?

For an ecological research project, I am trying to model the effect of different factors on the prevalence of a specific pathogen in ticks. Ticks were collected from around 80 different plots and screened for pathogens. Prevalence is then the…
claritali
  • 1
0
votes
0 answers

Algorithm to determine ability to distinguish phonemes in a foreign language

I am a language teacher and web developer. I took an advanced course in statistics in my last year of high school, but that is many many years ago. I am developing a web app to help learners of a foreign language hear distinctions that do not occur…
James Newton
  • 101
  • 1
0
votes
1 answer

Does the confidence level plus the significance level add to 1?

From reading it seems to me that the significance level is referred to as $\alpha$ and the confidence level is referred to as $1-\alpha$ However I haven't found statements defining each in terms of the other.
Kirsten
  • 439
  • 1
  • 13
1
2