Week 9, Lecture 2:
Our results
Key paper
Jaswal, V. K., & Neely, L. A. (2006). Adults don’t always know best: preschoolers use past reliability over age when learning new words. Psychological Science, 17(9), 757–758. (JA)
What and when do children learn from their peers?
Vikram Jaswal (UVA) & Leslie Neely (UTSA)
Participants
58 children—any age of 3-year-old or 4-year-old
Between subjects design: Randomly divided into 4 groups of N = 14–15:
Our study:
59 children—any age of 3-year-old or 4-year-old�(5 excluded for failure to train/answer to test or given pre-set inclusion criteria)
Between subjects design: Randomly divided into 4 groups:
Trial structure (orig)
sneaker!
shoe!
Shoe. Sneaker.�What is this called?
Sneaker.
Could it be called something else?
Shoe.
Did anyone say anything wrong?
No.
Training trials only:
“Corrective feedback as necessary”
Trial structure (ours)
sneaker!
shoe!
What did E & M say? They said: “Shoe” and “Sneaker”.�What is this called?
???
Training trials only:
“Corrective feedback as necessary”
Sneaker.
(In case of non-choice; mas 2x):�Just choose one. Is it: “Shoe” or “Sneaker”?
Testing phase
Training phase
shoe
airplane
cup
telephone
sneaker
plane
glass
phone
wug
blicket
dax
zimmer
zup
chroma
fips
haiger
Both reliable condition (orig stims)
Testing phase
Training phase
coat
jeans
cup
sofa
jacket
pants
glass
couch
peyf
darill
hayg
kraums
wesmer
yem
swuk
trobes
Both reliable condition (our stims)
Analysis & Results (orig)
T-test of difference from chance in each condition
ANOVA of # of “adult” selections for differences across conditions +
Tukey’s test for pairwise differences in each condition
Age & sex dropped from analysis (FN1)
Results (orig)
Results (ours)
Choices greater than chance
Both reliable:
t(13) = 2.22, prep = .92 (p = 0.02), d = 0.59
Reliable adult:
t(13) = 5.09, prep = .99 (p < .001), d = 1.36
Reliable child:
t(14) = 4.68, prep = .99 (p < .001), d = 1.21
Both unreliable:
t(14) < 1
Choices not greater than chance
Both reliable:
t(14) = 0.69, p = .49, d = 0.18
Reliable adult:
t(14) = 1.85, p = .086, d = 0.48
Reliable child:
t(16) = -0.637, p = .53, d = 0.15
Both unreliable:
t(11) = -0.56, p = .59, d = 0.16
Significant effect of condition
F(3,54) = 13.31,�prep = .99, (p < .001)�η2 = .43
Tukey’s HSD, p < .05:
No significant effect of condition
F(3,55) = 1.30,�p = 0.28,�η2 = .07
Tukey’s HSD, ps ≥ .32
ANOVA: No significant effect of condition
t-tests: No selections above chance
*
ANOVA: No significant effect of condition
ANOVA: No significant effect of condition
*
*
*
*
ANOVA: No significant effect of condition
ANOVA: No significant effect of condition
Mixed-effects regression
What about a different statistical approach?
Adult choice (binary) ~� condition + age_group + * sibs + second_speaker + (1|participant)
Discussion
Is this a useful replication? How has your thinking on J&N changed/not changed?
What would you do differently if we did it all over again? What changes did we make to the original design that you feel are justified?
How has this experience changed your thinking about replication and open science practices?
What are the next steps?
Who got more right?