51
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      To transform or not to transform: using generalized linear mixed models to analyse reaction time data

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Linear mixed-effect models (LMMs) are being increasingly widely used in psychology to analyse multi-level research designs. This feature allows LMMs to address some of the problems identified by Speelman and McGann ( 2013) about the use of mean data, because they do not average across individual responses. However, recent guidelines for using LMM to analyse skewed reaction time (RT) data collected in many cognitive psychological studies recommend the application of non-linear transformations to satisfy assumptions of normality. Uncritical adoption of this recommendation has important theoretical implications which can yield misleading conclusions. For example, Balota et al. ( 2013) showed that analyses of raw RT produced additive effects of word frequency and stimulus quality on word identification, which conflicted with the interactive effects observed in analyses of transformed RT. Generalized linear mixed-effect models (GLMM) provide a solution to this problem by satisfying normality assumptions without the need for transformation. This allows differences between individuals to be properly assessed, using the metric most appropriate to the researcher's theoretical context. We outline the major theoretical decisions involved in specifying a GLMM, and illustrate them by reanalysing Balota et al.'s datasets. We then consider the broader benefits of using GLMM to investigate individual differences.

          Related collections

          Most cited references58

          • Record: found
          • Abstract: found
          • Article: not found

          Random effects structure for confirmatory hypothesis testing: Keep it maximal.

          Linear mixed-effects models (LMEMs) have become increasingly prominent in psycholinguistics and related areas. However, many researchers do not seem to appreciate how random effects structures affect the generalizability of an analysis. Here, we argue that researchers using LMEMs for confirmatory hypothesis testing should minimally adhere to the standards that have been in place for many decades. Through theoretical arguments and Monte Carlo simulation, we show that LMEMs generalize best when they include the maximal random effects structure justified by the design. The generalization performance of LMEMs including data-driven random effects structures strongly depends upon modeling criteria and sample size, yielding reasonable results on moderately-sized samples when conservative criteria are used, but with little or no power advantage over maximal models. Finally, random-intercepts-only LMEMs used on within-subjects and/or within-items data from populations where subjects and/or items vary in their sensitivity to experimental manipulations always generalize worse than separate F 1 and F 2 tests, and in many cases, even worse than F 1 alone. Maximal LMEMs should be the 'gold standard' for confirmatory hypothesis testing in psycholinguistics and beyond.
            Bookmark
            • Record: found
            • Abstract: not found
            • Article: not found

            Mixed-effects modeling with crossed random effects for subjects and items

              Bookmark
              • Record: found
              • Abstract: not found
              • Article: not found

              An interactive activation model of context effects in letter perception: I. An account of basic findings.

                Bookmark

                Author and article information

                Contributors
                Journal
                Front Psychol
                Front Psychol
                Front. Psychol.
                Frontiers in Psychology
                Frontiers Media S.A.
                1664-1078
                07 August 2015
                2015
                : 6
                : 1171
                Affiliations
                School of Psychology, University of Sydney Sydney, NSW, Australia
                Author notes

                Edited by: Craig Speelman, Edith Cowan University, Australia

                Reviewed by: Michael Smithson, Australian National University, Australia; Guillermo Campitelli, Edith Cowan University, Australia

                *Correspondence: Steson Lo, School of Psychology, University of Sydney, Griffith Taylor Building (A19), Sydney, NSW 2006, Australia steson.lo@ 123456sydney.edu.au

                This article was submitted to Quantitative Psychology and Measurement, a section of the journal Frontiers in Psychology

                Article
                10.3389/fpsyg.2015.01171
                4528092
                26300841
                ed97eddc-95ec-4f5a-ad76-35bdc0c30ea5
                Copyright © 2015 Lo and Andrews.

                This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

                History
                : 20 April 2015
                : 24 July 2015
                Page count
                Figures: 6, Tables: 1, Equations: 0, References: 68, Pages: 16, Words: 12700
                Funding
                Funded by: Australian Research Council Discovery Project
                Award ID: DP120101491
                Categories
                Psychology
                Original Research

                Clinical Psychology & Psychiatry
                rt transformations,generalized linear mixed-effect models,mental chronometry,interaction effects,additive factors

                Comments

                Comment on this article