Per Carlbring
  • Email
  • Facebook
  • Linkedin
  • Twitter
  • YouTube
  • RSS
  • News
  • Publications
  • MSc thesis
  • Questionnaires
  • CV
  • Contact
Search the site...
  • Swedish
  • English
  • Home
  • Nyheter @en
  • Consequences of ignoring therapist effects in trials with longitudinal data: A simulation study

Consequences of ignoring therapist effects in trials with longitudinal data: A simulation study

Posted on 2018-08-23 by Per Carlbring in Nyheter @en
0

Psychotherapy trials frequently generate multilevel longitudinal data with 3 levels. This type of hierarchy exists in all trials in which therapists deliver the treatment and patients are repeatedly measured. Unfortunately, researchers often ignore the possibility that therapists could differ in their performance and instead assume there is no difference between therapists in their average impact on patients’ rate of change. In this new article, just published in Journal of Consulting and Clinical Psychology, we focused on scenarios in which therapists are fully and partially nested within treatments and investigate the consequences of ignoring even small therapist effects in longitudinal data.

We first derived the factors leading to increased Type I errors for the Time × Treatment effect in a balanced study. Scenarios with an unbalanced allocation of patients to therapists and studies with missing data were then investigated in a comprehensive simulation study, in which the correct 3-level linear mixed-effects model, which modeled therapist effects using a random slope at the therapist level, was compared with a misspecified 2-level model.

Results: Type I errors were strongly influenced by several interacting factors. Estimates of the therapist-level random slope suffer from bias when there are very few therapists per treatment.

Conclusion: Researchers should account for therapist effects in the rate of change in longitudinal studies. To facilitate this, we developed an open source R package powerlmm, which makes it easy to investigate model misspecification and conduct power analysis for these designs.

The paper has public health significance since it shows that the prevalent statistical practice of ignoring therapist effects when analyzing psychotherapy trials with longitudinal measures is likely to substantially increase the risk of finding a treatment effect when none exists. We show the factors most likely to lead to spurious findings and provide software tools that make it easy to perform our calculations.

Read the full paper:
Magnusson, K., Andersson, G., & Carlbring, P. (2018). The consequences of ignoring therapist effects in trials with longitudinal data: A simulation study. Journal of Consulting and Clinical Psychology, 86(9), 711-725. doi:10.1037/ccp0000333

Just published, Randomized controlled trial, Simulation study, Statistics, Therapist effects, Treatment

Subscribe to my Newsletter!

Keep you up-to-date with what is happening. One mail per month.

News

  • Signing OFF once and signing ON twice!

    2022-06-30
  • The Future of Mental Health Treatment: Prescription Digital Therapeutics, Cyberpsychology, and Care Intelligence Solutions

    2022-04-11
  • Open PhD position in Psychology (with salary!)

    2022-03-09
  • Integrating virtual realities and psychotherapy

    2021-08-03
  • Internet-based cognitive behavior therapy for depression, social anxiety disorder, and panic disorder: Effectiveness and predictors of response in a teaching clinic

    2021-07-14
  • New impact factor for “my” journal

    2021-07-01
  • Dismantling, optimising, and personalising internet cognitive behavioural therapy for depression: a systematic review and component network meta-analysis

    2021-05-04
  • New meta-analysis on genes and psychotherapy outcome in anxiety disorders

    2021-02-25
  • The Prevalence and Clinical and Sociodemographic Factors of Problem Online Gambling: A Systematic Review

    2021-02-02
  • Online Consultations in Mental Healthcare During the Covid-19 Outbreak: An International Survey Study on Uptake and Experiences

    2020-12-17
  • NEW STUDY: How to succeed in keeping your New Year’s resolution

    2020-12-09
  • Virtual Reality exposure therapy for public speaking anxiety in routine care: a single-subject effectiveness trial

    2020-11-30
  • Sudden gains and large intersession improvements in internet-based psychodynamic treatment (IPDT) for depressed adolescents

    2020-11-30
  • Seeking neutral: A Virtual Reality-based person-identity-matching task for attentional bias modification

    2020-11-30
  • Measuring Alliance Toward Embodied Virtual Therapists in the Era of Automated Treatments

    2020-07-09
  • Measuring Alliance Toward Embodied Virtual Therapists in the Era of Automated Treatments

    2020-07-09
  • Internet Interventions for Adults with Anxiety and Mood Disorders: A Narrative Umbrella Review of Recent Meta-Analyses

    2020-05-19
  • In the Absence of Effects: An Individual Patient Data Meta-Analysis of Non-response and Its Predictors in Internet-Based Cognitive Behavior Therapy

    2020-05-18
  • Are physical activity and sedentary behavior related to depression?

    2020-05-13
  • Comparing internet-delivered cognitive therapy and behavior therapy with telephone support for insomnia disorder: a randomized controlled trial

    2020-04-27

Popular subjects:

Anxiety Attention bias training Cancer CBT Cognitive behavior therapy cognitive flexibility Conference content analysis Depression Effectiveness Exposure therapy fMRI Gambling group therapy ICBT Internet-based treatment Internetbehandling Internet Interventions internet treatment Just published meta-analysis Negative effects Ny artikel Online gambling open access Panic disorder Ph.D. Dissertation PhD Physical activity Problem gambling Procrastination Psychometric PTSD qualitative Randomized controlled trial responsible gambling Review Smartphone @en Social anxiety social anxiety disorder social phobia Stepped care Thesis Treatment Virtual reality
Copyleft (ɔ) 2020 Professor Per Carlbring