Statistical Analysis Stack Exchange
Statistical Analysis Stack Exchange

Questions tagged [item-analysis]

Item analysis is the process by which responses to a test are used to assess the overall quality of the test, and the quality of the items comprising the test.

20 questions
3
votes
1 answer

Difference between IRT and EFA to find factors

I am learning about Item Response Theory in which items are used to assess ability. In principle, multiple latent abilities may exist and some items test the one, while other items test another. This is similar to Factor Analysis and EFA can be used…
LBogaardt
  • 494
  • 1
  • 4
  • 18
3
votes
0 answers

Is Item Response Theory (IRT) a form of reinforcement learning?

I was doing studies in reinforcement learning and trying to apply it in Computerised Adaptive Testing (CAT). While learning IRT, I felt it is similar to behaviour of RL setting - receiving feedback and adjusting parameters(or learning) in each…
Aljo Jose
  • 423
  • 1
  • 3
  • 10
3
votes
1 answer

How to interpret meaning of regressors in this logistic regression model?

I'm trying to understand the model in this paper where they treat the item response theory model as a form of logistic regression. In the model the probability of getting an item (question) correct is given by $$ P = \frac{1}{1+e^{-Z}} $$ where…
2daaa
  • 247
  • 1
  • 6
2
votes
1 answer

Item analysis Skewness and Kurtosis True False Question

I made a test with 15 true/false Questions and about 100 people answered these questions. Now I'm doing the item analysis in R with the package sjPlot and the function sjt.itemanalysis(). Amongst other things this function returns skewness and…
To Mate
  • 87
  • 3
2
votes
1 answer

Item sampling techniques to reduce processing time for questionnaire

I have a well-crafted draft of a questionnaire, containing 240 items. The average processing time is 20 secs per item, so the entire questionnaire would take around 1 hour 20 min to complete. I want to reduce the estimated processing time down to 30…
Comfort Eagle
  • 243
  • 2
  • 9
2
votes
1 answer

Item Response Theory vs Rasch Model

1) What's the difference between Item Response Theory and Rasch model? 2) What's the pros and cons between them? To me, they seem to be very similar as in they both analyze the performance of students answer questionnaires.
munmunbb
  • 25
  • 5
1
vote
0 answers

simulation of an item response theory 2PL model

I would like to simulate a 2PL probit model. I want to set up some arbitrary item parameters $a=(a_1,...,a_J)$, $b=(b_1,...,b_J)$ and abilities $\theta=(\theta_1,...,\theta_I)$ ($J$ number of items and $I$ number of individuals), then fit a Bayesian…
Ludwig
  • 51
  • 3
1
vote
0 answers

What are the most important components of an item analysis of a MCQ exam?

I'm analyzing results of undergraduate exams that range from 60 to 100 multiple choice questions. The number of students doing any given exam ranges from ~70 to ~1000. In all cases students select from four options: A, B, C, and D. The purpose of…
user1205901 - Reinstate Monica
  • 11,303
  • 26
  • 77
  • 152
0
votes
0 answers

What kind of correlation is this?

I was wondering whether these 2 variables are correlated. According to the analysis, the correlation is 0.89, which is expected, as they are items of the same scale. But I'm having trouble with interpreting this scatter plot.
iic
  • 5
  • 3
0
votes
0 answers

IRT models for repetitive items

I'm looking for literature about IRT models that fit for tests in which items are presented for each examinee more than once and/or different questions are asked for the same item. For example, in the test the item "2+2" is shown twice, first when…
S H
  • 1
  • 1
0
votes
0 answers

DIF: validity of carrying out a t-test on the final sample?

I have run a DIF analysis of a questionnaire, to see how autistic men and women answer differently, with a total sample of 530 autistic men and 530 autistic women. I have a general hypothesis that the questionnaire is biased towards men. I have…
T August
  • 21
  • 3
0
votes
0 answers

DIF: match sample randomly or by age?

I am carrying out a DIF analysis comparing the scores of men and women on a questionnaire. A preliminary ANOVA revealed that when comparing total scores on the test, there is a significant effect of sex, but not of age or an interaction between…
T August
  • 21
  • 3
0
votes
1 answer

item selection procedure for a questionnaire representing several latent variables / constructs

i have drafted 51 items that are supposed to measure 9 distinct but related constructs, and have collected data on this questionnaire from 530 people. ultimately, i want to use these data for a sem. however, given that i devised the items myself,…
heinbl0ed
  • 1
0
votes
1 answer

Accounting for measurement Bias across manufacturers and multiple treatments

I've been trying to figure out the appropriate statistical approach for the following problem from work (simplified here): I've got 5 manufacturers of a drug and each manufacturer makes their own testing kit. Each kit is positively biased for their…
jamesvillarrubia
  • 1
0
votes
0 answers

Internal consistency

I have to analyse a dataset in which there are drugs and used animals based on article review. The datasets looks like this: rat mice dogs ... Drug1 5 10 7 Drug2 3 2 9 …
Drone
  • 1
1
2