What methods can be used to counterbalance conditions when using a within subjects design?

Design of Experiments > Counterbalancing


What is Counterbalancing?

What methods can be used to counterbalance conditions when using a within subjects design?
Counterbalancing removes confounding variables from an experiment by giving slightly different treatments to different participant groups. For example, you might want to test whether people react positively or negatively to a series of images. They use a left-hand clicker for positive, and a right-hand clicker for negative. Potential problems with this design include the fact that left-handed people might be more inclined to click left and vice-versa. You can remove this potential confounding variable by having a counterbalanced experiment: assigning one group right-hand clickers for positive and a second group left-hand clickers for positive.


Across Subjects Counterbalancing

When one set of treatments is given, but many sequences are used overall, it’s called across subjects counterbalancing. Your participants receive all combinations of treatments in different orders. This is to guard against order effects(the possibility that the position of the treatment in the order of treatments matters) and sequence effects (the possibility that a treatment will be affected by the treatment preceding it). For example, let’s say your study for depression had two treatments: counseling and meditation. You would split your treatment group into two, giving one group counseling, then meditation. The second group would receive meditation first, then counseling.

Reverse Counterbalancing

In a reverse counterbalanced design, all participants receive all treatments twice: first in one order and next in another order. For example: counseling, meditation, meditation, counseling.

Complete Counterbalancing

With this method, each possible sequence is used and each sequence is used the exact same amount of times. For example, let’s say you had treatments 1,2,and 3. There are six possible sequences: 123,231,312,321,213,and 132. You could use the sequence on 6 groups, 12 groups, 18 groups…and so on, as long as you had a multiple of six (so that each sequence is run the same number of times). If you don’t have enough participants to do this (let’s say you had 17 groups instead of 18), it’s called partial counterbalancing. Another possibility is to randomize the allocation of those 6 treatments to your 17 groups: if you do that, then you’re using a randomized partial counterbalanced design.

Latin Square Counterbalancing

This method, which also controls order effects, uses a square to ensure that each treatment only occurs once in any order position (i.e. 1st, 2nd, 3rd). Let’s say you had three treatments 1,2,3. Your square would be:
1st sequence: 1 2 3
2nd sequence: 2 3 1
3rd sequence: 3 1 2.

---------------------------------------------------------------------------

What methods can be used to counterbalance conditions when using a within subjects design?

Need help with a homework or test question? With Chegg Study, you can get step-by-step solutions to your questions from an expert in the field. Your first 30 minutes with a Chegg tutor is free!

Comments? Need to post a correction? Please Contact Us.


Counterbalancing is a technique used to deal with order effects when using a repeated measures design. With counterbalancing, the participant sample is divided in half, with one half completing the two conditions in one order and the other half completing the conditions in the reverse order. E.g., the first 10 participants would complete condition A followed by condition B, and the remaining 10 participants would complete condition B and then A. Any order effects should be balanced out by this technique.

  1. Experimental Design
  2. Within-Subjects Design

By Julia Simkus, published Feb 15, 2022


A within-subjects design, or a within-groups design, is one way that researchers can assign test participants to different treatment groups. In a within-subjects design, each participant experiences every condition of the independent variable.

Researchers test the same participants repeatedly across all treatments to assess for differences between the variables. Within-subjects designs do not have a control group as all participants are tested both before and after they are exposed to treatment.

This study design is coined “within-subjects” because conditions are compared within the same group of participants. A between-subjects design, on the other hand, is the opposite of a within-subjects design where the differences in conditions occur between the groups of subjects.

Using a within-subjects design

Within-subjects studies are typically used for longitudinal studies as researchers can assess changes within the same group of subjects over an extended period of time.

For example, assume a psychiatrist is looking for new medication to treat patients with Obsessive-Compulsive Disorder (OCD). She has four potential options of medications to help the patients with their OCD.

In order to determine which medication is going to be the most beneficial for her patients, she measures each child's performance four times, once after being on each of four drug doses for a week. Each subject’s performance is thus measured at each of the four levels of the factor, or dose.

Advantages

Does not require large subject pool

Within-subjects designs require smaller sample sizes as each participant provides repeated measures for each treatment condition. This also reduces the cost and resources necessary to conduct these studies.

A between subjects study, on the other hand, would require at least twice as many participants as a within-subject design. This also means twice the cost and resources.

No variation in individual differences

Since the same individuals participate in all conditions, there will be no effects from variations in individual differences between conditions.

Because individual variation is removed, this study design has little room for error, and researchers can easily detect any differences that exist among treatments.

Limitations

Time

Data collection can take a long time since each participant is given multiple treatments. In addition, it can be challenging to control the effects of time on the outcomes of the study. Between-subjects studies tend to have shorter sessions than within-subject ones.

Carryover effects

In within-subject designs, participants are exposed to several levels of the same independent variable. This prior exposure to a treatment condition could alter the outcomes of later treatment conditions.

For example, exposure to a reaction time test could make participants’ reactions times faster in a subsequent treatment due to familiarity with the study. Randomization and counterbalancing can help reduce these carryover effects.

Examples

  • Course of Cognitive Decline in Hematopoietic Stem Cell Transplantation: A Within-subjects Design (Friedman et al., 2009).
  • Beliefs, attitudes, and intentions toward nuclear energy before and after Chernobyl in a longitudinal within-subjects design (Verplanken, 1989).
  • A comparison of paper and online tests using a within-subjects design and propensity score matching study (Lottridge, Nicewander, & Mitzel, 2011).
  • A test of exercise analgesia using signal detection theory and a within-subjects design (Fuller and Robinson, 1993).
  • Reported jealousy differs as a function of menstrual cycle stage and contraceptive pill use: A within-subjects investigation (Cobey et al., 2012).
  • Behavioral effects of haloperidol in young autistic children: An objective analysis using a within-subjects reversal design (Cohen et al., 1980).
  • Tipping and service quality: A within-subjects analysis (Lynn and Sturman, 2010).

Frequently asked questions about within-subjects design

1. What's the difference between a Between-subjects versus within-subjects design?

Between-subjects and within-subjects designs are two different methods for researchers to assign test participants to different treatments.

In a between-subjects design, researchers will assign each subject to only one treatment condition; whereas in a within-subjects design, researchers will test the same participants repeatedly across all conditions.

Between-subjects and within-subjects designs can be used in place of each other, or in conjunction with each other.

Each of these types of experimental design has its own advantages and disadvantages, and it is usually up to the researchers to determine which method will be more beneficial for their study.

2. Can you use a between-subjects and within-subjects design in the same study?

Yes. Between-subjects and within-subjects designs can be combined in a single study when you have two or more independent variables (a factorial design).

Factorial designs are a type of experiment where multiple independent variables are tested. Each level of one independent variable (a factor) is combined with each level of every other independent variable to produce different conditions.

Each combination becomes a condition in the experiment. In a factorial experiment, the researcher has to decide for each independent variable whether to use a between-subjects design or a within-subjects design.

In a mixed factorial design, researchers will manipulate one independent variable between subjects and another within subjects.

About the Author

Julia Simkus is an undergraduate student at Princeton University, majoring in Psychology. She plans to pursue a PhD in Clinical Psychology upon graduation from Princeton in 2023. Julia has co-authored two journal articles, one titled “Substance Use Disorders and Behavioral Addictions During the COVID-19 Pandemic and COVID-19-Related Restrictions," which was published in Frontiers in Psychiatry in April 2021 and the other titled “Food Addiction: Latest Insights on the Clinical Implications," to be published in Handbook of Substance Misuse and Addictions: From Biology to Public Health in early 2022.

How to reference this article:

How to reference this article:

Simkus, J. (2022, Feb 15). Within-Subjects Design: Examples, Pros & Cons. Simply Psychology. www.simplypsychology.org/within-subjects-design.html

Sources

Allen, M. (2017). The sage encyclopedia of communication research methods (Vols. 1-4). Thousand Oaks, CA: SAGE Publications, Inc doi: 10.4135/9781483381411

Baeyens, F., Díaz, E., & Ruiz, G. (2005). Resistance to extinction of human evaluative conditioning using a between‐subjects design. Cognition & Emotion, 19(2), 245-268.

Birnbaum, M. H. (1999). How to show that 9> 221: Collect judgments in a between-subjects design. Psychological Methods, 4(3), 243.

Carey, A. A., Lester, T. G., & Valencia, R. M. (2016). The Effects of a Fatal Vision Goggles Intervention on Middle School Aged Children's Attitudes toward Drinking and Driving and Texting and Driving as Related to Impulsivity: A Between Subjects Design (Doctoral dissertation, Brenau University).

Chang, H. I., & Kang, W. C. (2018). The Impact of the 2018 North Korea-United States Summit on South Koreans’ Altruism Toward and Trust in North Korean Refugees: Between-Subjects Design Around the Summit. Available at SSRN 3270334.

Egele, V. S., Kiefer, L. H., & Stark, R. (2021). Faking self-reports of health behavior: a comparison between a within-and a between-subjects design. Health psychology and behavioral medicine, 9(1), 895-916.

Ehrlichman, H., Brown Kuhl, S., Zhu, J., & WRRENBURG, S. (1997). Startle reflex modulation by pleasant and unpleasant odors in a between‐subjects design. Psychophysiology, 34(6), 726-729.

Jhangiani, R. S., Chiang, I.-C. A., Cuttler, C., & Leighton, D. C. (2019, August 1). Experimental Design. Research Methods in Psychology. Retrieved from https://kpu.pressbooks.pub/psychmethods4e/

Home | About Us | Privacy Policy | Advertise | Contact Us

Simply Psychology's content is for informational and educational purposes only. Our website is not intended to be a substitute for professional medical advice, diagnosis, or treatment.

© Simply Scholar Ltd - All rights reserved

What methods can be used to counterbalance conditions when using a within subjects design?

How do you counterbalance a condition?

Counterbalancing is a technique used to deal with order effects when using a repeated measures design. With counterbalancing, the participant sample is divided in half, with one half completing the two conditions in one order and the other half completing the conditions in the reverse order.

Why is it appropriate to counterbalance when using a within groups design?

When comparing different treatments within subjects, you should randomize or counterbalance the order in which every condition is presented across the group of participants. This prevents the effects of earlier treatments from spilling over onto later ones.

What does counterbalancing protect against in within groups designs?

Counterbalancing removes confounding variables from an experiment by giving slightly different treatments to different participant groups.

What is subject subject counterbalancing?

Subject-by-subject counterbalancing- a technique for controlling progressive error for each individual subject by presenting all treatment conditions more than once.