Reading Time Analysis

Reading Time Analysis

Purpose

This skill encodes expert methodological knowledge for analyzing eye-tracking data from reading experiments. A competent programmer without psycholinguistics training would likely compute a single "reading time" per word, missing the critical insight that different eye-tracking measures tap different stages of language processing. Choosing the wrong measure for your research question -- or failing to account for spillover effects, skipping patterns, and the distinction between first-pass and second-pass reading -- leads to misattribution of cognitive processes.

When to Use

Use this skill when:

• Analyzing eye-movement data from reading experiments (sentence or passage reading)
• Selecting which eye-tracking measures to report for a given linguistic manipulation
• Defining regions of interest and handling spillover effects
• Setting up statistical models for eye-tracking reading data
• Cleaning and filtering fixation data for reading analyses

Do not use this skill when:

• Analyzing self-paced reading data (see self-paced-reading-designer for that paradigm)
• Analyzing eye movements in visual search or scene viewing (different fixation patterns)
• Working with eye-tracking data from non-reading tasks (e.g., visual world paradigm)

Research Planning Protocol

Before executing the domain-specific steps below, you MUST:

1. State the research question -- What specific question is this analysis/paradigm addressing?
2. Justify the method choice -- Why is this approach appropriate? What alternatives were considered?
3. Declare expected outcomes -- What results would support vs. refute the hypothesis?
4. Note assumptions and limitations -- What does this method assume? Where could it mislead?
5. Present the plan to the user and WAIT for confirmation before proceeding.

For detailed methodology guidance, see the research-literacy skill.

⚠️ Verification Notice

This skill was generated by AI from academic literature. All parameters, thresholds, and citations require independent verification before use in research. If you find errors, please open an issue.

Eye-Tracking Reading Measures Hierarchy

Measure Definitions and Cognitive Interpretations

The following measures are ordered from earliest to latest processing stages. This hierarchy reflects the temporal unfolding of language comprehension during reading (Rayner, 1998, 2009; Clifton et al., 2007).

First-Pass Measures (Before Leaving the Region)

Late Measures (After Leaving the Region)

Decision Tree: Which Measure for Which Question?

What stage of processing is your manipulation expected to affect?
|
+-- EARLY LEXICAL (word frequency, orthographic regularity, predictability)
| |
| +-- Use GAZE DURATION as primary measure (Rayner, 1998, 2009)
| +-- Report FIRST FIXATION DURATION as supplementary
| +-- Report SINGLE FIXATION DURATION if high proportion of
| single-fixation cases (Rayner, 2009)
|
+-- LATE LEXICAL / POST-LEXICAL (semantic plausibility, thematic fit)
| |
| +-- Use GAZE DURATION for early effects
| +-- Use GO-PAST TIME for integration effects (Clifton et al., 2007)
| +-- Use TOTAL READING TIME for overall effects
|
+-- SYNTACTIC (garden-path, structural ambiguity, reanalysis)
| |
| +-- Use GO-PAST TIME as primary measure (Clifton et al., 2007)
| +-- Use REGRESSION PROBABILITY as complementary binary measure
| +-- Effects often appear in the SPILLOVER REGION (1-2 words
| post-critical; Rayner & Pollatsek, 1989)
|
+-- DISCOURSE / PRAGMATIC (reference resolution, inference, coherence)
| |
| +-- Use GO-PAST TIME and TOTAL READING TIME
| +-- Effects are typically late and may span multiple words
| +-- Consider REGRESSION-IN probability for earlier regions
|
+-- EXPLORATORY / UNKNOWN TIMING
 |
 +-- Report ALL major measures: FFD, GD, GPT, TRT, Reg-out
 +-- Let the pattern across measures inform process interpretation

First-Pass vs. Second-Pass Distinction

Why this matters: First-pass measures reflect initial processing; second-pass measures reflect recovery from processing difficulty encountered downstream. Conflating them obscures when processing difficulty arose.

Region of Interest (ROI) Definition

Word-Level ROIs

• The most common unit of analysis is the single word (Rayner, 1998)
• For multi-word critical regions, report analyses at both word level and region level

Multi-Word ROIs

• Sometimes necessary for syntactic manipulations where the critical structure spans multiple words
• Define ROIs a priori based on linguistic structure, not post-hoc based on where effects appear
• Report the number of characters and words in each ROI

Spillover Effects

Spillover is the delayed manifestation of a processing effect on fixations one or more words downstream of the critical word (Rayner & Pollatsek, 1989).

• Typical spillover range: 1-2 words after the critical word (Rayner, 1998)
• Always analyze the spillover region (word n+1, sometimes n+2) in addition to the critical word
• Spillover is most common for first-pass measures (GD, FFD)
• Pre-target region (word n-1) should also be checked to verify no confounding baseline differences

Parafoveal Preview Effects

• Words are partially processed before they are directly fixated -- the parafoveal preview benefit (Rayner, 1975; Rayner, 2009)
• Parafoveal preview extends to approximately 7-8 characters to the right of fixation in English (McConkie & Rayner, 1975)
• This means effects of word n's properties can appear on the last fixation of word n-1 (parafoveal-on-foveal effects; Drieghe et al., 2008)

Data Cleaning

Fixation Duration Cutoffs

Note: Some researchers use 50 ms as the lower bound and 1000-1200 ms as the upper bound. The critical requirement is to report your exact cutoffs and the percentage of data excluded.

Trial-Level Exclusions

Skipping Rate Considerations

• Short, high-frequency, and predictable words are skipped 10-30% of the time (Rayner, 1998, 2009)
• Content words are skipped ~15% of the time; function words ~35% (Rayner, 2009)
• If skipping rates differ across conditions, this is informative -- report it
• For first-pass measures, words that are skipped contribute no data, not zero reading time
• Do not substitute zero for skipped words -- this conflates fast processing with no fixation

Statistical Modeling

Linear Mixed-Effects Models (LMMs)

Eye-tracking reading data should be analyzed with LMMs with crossed random effects for subjects and items (Baayen et al., 2008; Baayen, Davidson, & Bates, 2008):

# R formula (lme4 syntax):
gaze_duration ~ condition + (1 + condition | subject) + (1 + condition | item)

Why crossed random effects: Reading experiments use a Latin square design where every subject sees every item, but items rotate across conditions between subjects. Both subjects and items are random samples, and both contribute variance (Clark, 1973; Baayen et al., 2008).

Random Effects Structure

Convergence protocol (Barr et al., 2013; Bates et al., 2015):

1. Fit maximal model (all by-subject and by-item random slopes for within-unit factors)
2. If convergence fails: remove correlations between random effects (use || in lme4)
3. If still fails: remove the random slope with the smallest variance component
4. Report the final model structure and note any simplifications

Distributional Considerations

Reading times are right-skewed and bounded below by zero. Options:

Recommendation: Start with raw reading times in the LMM. Check residual plots. If residuals are non-normal, apply log-transformation or fit a GLMM with Gamma family and identity link (Lo & Andrews, 2015).