Questions tagged [counterbalancing]

A method of controlling for multiple extraneous effects by including all possible combinations within each treatment condition / arm of an experiment.

Counterbalancing is a method of controlling for multiple extraneous effects by including all possible combinations within each treatment condition or arm of an experiment.

21 questions
6
votes
1 answer

Advantages of counterbalancing vs. randomizing stimuli

I'm designing an experiment, in which 40 participants answer 10 questions, 5 in condition $A$ and 5 in condition $B$, and I'm interested in the difference between the two conditions. It's not clear to me what's the best way to allocate questions to…
5
votes
1 answer

Can there be endogeneity?

I am performing a regression in which I suspect there could be endogeneity between the main explanatory variable and the dependent. As a first step I perform an OLS regression and then, to control for the endogeneity, I use a 2SLS regression with an…
5
votes
1 answer

When can I leave counterbalancing factors (between participants) in an ANOVA out of a write up?

The following is a problem that I keep encountering in different forms. For now, I give one example, but I would also be interested in the answers to the more general question. I have a design with a reaction time based dependent variable $Y$, two…
Anne
  • 51
  • 1
3
votes
1 answer

Simple experimental design - should I counterbalance?

I'm designing a pretty simple experiment that goes like this. Participants will be shown a series of stimuli and after viewing each one they will answer a few questions where they will make judgments about the stimulus - all Likert items. There are…
paul
  • 1,342
  • 3
  • 11
  • 16
2
votes
2 answers

Balancing gender in an experiment

Say a study aims to see if two variables A and B are correlated in the general population. It isn't clear to me how extraneous variables like gender should be treated when the sample is selected. Each of the two methods of "controlling" for gender…
z8080
  • 1,598
  • 1
  • 19
  • 38
2
votes
1 answer

2 x 2 mixed anova?

96 participants were randomly assigned to one of the two groups regardless of their motivation level. Participants in both the groups were exposed to both the experimental conditions of gain framed messages and loss framed messages. The only…
anju
  • 21
  • 1
2
votes
1 answer

Would a split-plot ANOVA be appropriate to look for order effects in my data?

I have a study in which 60 subjects took both drug A on one day and drug B on another. The order of drug administration was counterbalanced, such that 30 subjects took drug A on the first day and 30 took drug B on the first day. (Each subject then…
Andy
  • 21
  • 1
2
votes
0 answers

How to compare first to second half of measurements in a counterbalanced behavioral experiment?

I want to compare measurements in two halves of a behavioral experiment to examine for learning effects. My first course of action is to split the measurements in the two halves and then repeat the original MANOVA for this comparison. I am asking to…
Adam SA
  • 591
  • 2
  • 7
  • 16
2
votes
1 answer

Repeated Measures Design but also testing order effects in SPSS

I am a psychology student using SPSS to analyse my data. I have 2 conditions of the IV of treatment (treatment or no treatment) to test pain tolerance levels which is measured by the DV of pulse rate to measure pain. The study used a repeated…
1
vote
0 answers

Asymmetrical Order Effects in Within Subject Design

I am currently running a study with two groups (controll and current psy. disorder). All participants have three conversations, are videotaped and watch the videos of their interactions afterwards, two times. While watching the video, I assess my…
1
vote
2 answers

When does counterbalancing task participation order take care of practice effects?

I'm thinking of a study in which participants are randomly assigned to do task A then task B, or vice-versa. I figured there will be a problem if doing Task A is really good practice for Task B, but doing task B isn't good practice for Task A.…
1
vote
0 answers

Analysing a balanced mixed models design?

I am designing an experiment and I'm in need of some help. Participants are presented with two videos on a website. In one period, a feature (a table of contents for the video) is enabled, while in the other period the feature is disabled. Cognitive…
1
vote
0 answers

Calculate 'order effect'

My experiment has the following setup: Participant completes exercise A. Participant completes exercise B. A counterbalancing design was used to remove (reduce?) the effect of order on the results; so half of the participants started with exercise…
WalterB
  • 53
  • 7
1
vote
0 answers

some suggestions for analyzing two-factor within subject design?

I'm doing a two-factor within-subject design experiment, and the two factors are all categorical variables. factor one has four categories, while factor two has two categories, and is counterbalanced. this lead to a 2*4=8 conditions. the dependent…
1
vote
0 answers

Repeated Measures ANOVA pairing counterbalance issue

I have been conducting all of my analyses on one DV (Quality) using a repeated measures ANOVA, with two variable (Time and Gender) at two levels each. However, it occurred to me today, that this might be incorrect, and here's the problem: Though…
user12347
  • 111
  • 2
1
2