1 of 43

Evaluating Adaptive Functioning Deficits�Prong-2

Antonio E. Puente, PhD

University of North Carolina Wilmington

�(with assistance Juan A. Serrano, PsyD)

MCLAP Meeting

San Antonio, TX

May 16, 2024

2 of 43

Preamble

The information contained in this presentation does not reflect the policy of APA, any division of APA, APA Psychological Services, NAN, or any state psychological or specialty association. Further, this information is intended to be informative. It does not supersede APA or state provincial licensing boards, ethical guidelines, and/or local, state, provincial, or national regulations and/or laws. This is a living document that can and will be revised as additional information becomes available. The ultimate responsibility for the validity, utility, and application of the information contained herein lies with the individual and/or institution using this information and not with any supporting organization and/or the author of this presentation. Suggestions or changes should be addressed directly addressed to the author. Note that whenever possible, references are provided. The information provided serves as a source of education to the readers of the materials contained or attendees at this presentation and is not intended for public distribution. Thank you

3 of 43

OUTLINE

  1. BACKGROUND
  2. DEFINITION OF INTELLECTUAL DISABILITY (ID)
  3. ASSESSMENT OF ADAPTIVE BEHAVIOR– PRONG 2
  4. BEST PRACTICES
  5. CHALLENGES
  6. FUTURE DIRECTIONS

4 of 43

OUTLINE

  1. BACKGROUND
  2. DEFINITION OF INTELLECTUAL DISABILITY (ID)
  3. ASSESSMENT OF ADAPTIVE BEHAVIOR– PRONG 2
  4. BEST PRACTICES
  5. CHALLENGES
  6. FUTURE DIRECTIONS

5 of 43

6 of 43

ROGER W SPERRY�NEUROPSYCHOLOGY LABORATORY���

6

Status

Individuals

Post-doctoral Fellow & Visiting Scientists

Juan A. Serrano-Salcedo, PsyD,

Jessica Forde, PhD & Antonio N. Puente, PhD

Graduate Student

Kate E. Carlson

Post-Bachelor’s (College)

Marla Allen

Undergraduate Students

Andy Ontiveros, Nicole Aragon

7 of 43

Roger W. Sperry�(rogersperry.org)

8 of 43

Alexander Luria

9 of 43

OUTLINE

  1. BACKGROUND
  2. DEFINITION OF INTELLECTUAL DISABILITY (ID)
  3. ASSESSMENT OF ADAPTIVE BEHAVIOR– PRONG 2
  4. BEST PRACTICES
  5. CHALLENGES
  6. FUTURE DIRECTIONS

10 of 43

Definition of ID

Standards for ID diagnosis: �

    • American Association for Intellectual and Developmental Disability (AAIDD, 11th and 12th Editions)

    • Diagnostic and Statistical Manual of Mental Disorders by the American Psychiatric Association (DSM, 5th edition and 5-TR Editions)

    • International Classification of Diseases by the World Health Organization (ICD, 10th and 11th Editions)

11 of 43

Definition of ID

Three criteria or prongs: �

Prong 1- An intellectual ability that is two standard deviations or more below the population (70).

Prong 2- Significant impairments in adaptive functioning.

Prong 3- Both of these must be presented prior to the age of 22.

(AAIDD, 2021).

12 of 43

Adaptive Behavior

Critical:

  • Before age 22
  • Ecologically valid setting.
  • Collaterals: Knowledge of US cultural values and knew the person before age 22.

Additional:

  • How well a person meets community standards of personal independence and social responsibility in comparison to others of similar age and socio-cultural background (DSM-5 TR).
  • Is actual performance, not ability or potential.
  • Importance of a socio-historical-cultural context.

12

13 of 43

13

Conceptual Skills

Social Skills

Practical Skills

Domains of Adaptive Behavior

(AAIDD, 2021)

14 of 43

Areas of Adaptive Behavior

14

(AAIDD, 11 & 12th Edition)

(AAMR, 10th Edition)

15 of 43

OUTLINE

  1. BACKGROUND
  2. DEFINITION OF INTELLECTUAL DISABILITY (ID)
  3. ASSESSMENT OF ADAPTIVE BEHAVIOR– PRONG 2
  4. BEST PRACTICES
  5. CHALLENGES
  6. FUTURE DIRECTIONS

16 of 43

Assessment of Adaptive Behavior #1

  • Standardized adaptive behavior tests.
  • Individualized, culturally appropriate, and psychometrically sound.
  • Test that have been translated, adapted, and normed in Spanish (lack of).

16

17 of 43

Assessment of Adaptive Behavior #2

Other sources, such as: �

    • Direct observation.
    • Review of record:
      • School records.
      • Medical records.
      • Previous psychological evaluations.
      • Vocational record
    • Collaterals interviews.

17

(AAIDD, 11th Edition)

18 of 43

Assessment of Adaptive Behavior #3

  • Sensitive to language differences and culture (AAIDD, 11th Edition).

  • Difficulties in respondents to appreciate the cultural reference point.�
  • “Use clinical judgment to guide the evaluation of the reliability of information provided by respondents...” (AAIDD, 11th Edition, p. 48). �

18

19 of 43

Fairness in Testing

“Accessible testing situations are those that enable all test takers in the intended population, to the extent feasible, to show their status on the target construct(s) without being unduly advantaged or disadvantaged by individual characteristics (e.g., characteristics related to age, disability, race/ethnicity, gender, or language) that are irrelevant to the construct(s) the test is intended to measure.” (AERA, et al., 2014, p.52).

19

20 of 43

“Validity and reliability/precision considerations are paramount, but the demographic characteristics of the group(s) for which the test originally was constructed and for which initial and subsequent normative data are available also are important.” (AERA et al., 2014, p. 152)

Standard 10.5:

    • Tests selected for use in psychological testing should be suitable for the test taker's characteristics and background (AERA et al., 2014, p. 165).

20

Test Selection

21 of 43

Examples of Tests Used to Evaluate �Adaptive Behavior in English/Spanish

English/Spanish:

    • Adaptive Behavior Assessment System, Third Edition (ABAS™-3)
      • Ages: Birth to 89

    • Vineland Adaptive Behavior Scales (Vineland-3)
      • Ages: Birth to 90

22 of 43

OUTLINE

  1. BACKGROUND
  2. DEFINITION OF INTELLECTUAL DISABILITY (ID)
  3. ASSESSMENT OF ADAPTIVE BEHAVIOR– PRONG 2
  4. BEST PRACTICES
  5. CHALLENGES
  6. FUTURE DIRECTIONS

23 of 43

Best Practices

  • Individually administered scales normed on the general population (US

and other).

  • Respondents:
    • Adaptive behavior is typical behavior, not maximal behavior.
    • Rating based on direct observation.
    • Observed the behavior across multiple ecological valid contexts.

  • Considering Standard Error of Measurement – 95% Confidence Interval.

  • Comprehensive assessment: multiple sources, collaterals, and records.

  • Before age of 22 vs. after 22.

(AAIDD, 12th Edition)

24 of 43

Standard Error of Measurement (SEM)

  • SEM = an estimate of error or imprecision in IQ score.

  • Range IQ score using a 95% confidence interval.

  • Typical SEM is around 3-5 points (example next slide).

25 of 43

Normal Distribution Bell Curve

Score: 70

95% C.I: 67-73

26 of 43

OUTLINE

  1. BACKGROUND
  2. DEFINITION OF INTELLECTUAL DISABILITY (ID)
  3. ASSESSMENT OF ADAPTIVE BEHAVIOR– PRONG 2
  4. BEST PRACTICES
  5. CHALLENGES
  6. FUTURE DIRECTIONS

27 of 43

Test and Norm Selection

Efforts should be made to select tests and norms that:

    • Close to meeting recognized scientific standards of validation.
    • Representative of the population with whom they are being used.
    • Follow standards of translation and adaptation.

(Judd et al., 2009)

28 of 43

Using a Translator

  • Decrease errors by matching the examinee with evaluator's native language.�
  • Sources of error: rapport, validity of test results, adaptation, distractibility, norm interpretation, and construct equivalence.

  • Translators can affect rapport, communication, and validity (Tassé, 2009).

  • Inconsistent with testing environment being free from distractions (NAN, 2000).

  • 3rd party introduces an unknown variable and prevents valid comparisons (NAN, 2000).

29 of 43

Translating Tests

  • Does not produce scores that are equally reliable/precise and valid.

  • Lack of evidence:�
    • Validity
    • Reliability/precision
    • Comparability of scores
    • Construct equivalence

� (AERA, et al., 2014)

30 of 43

Adaptive Assessment Challenges

  • Ecological valid functioning.

  • Structured and non-ecological valid settings (e.g., prison.

  • Learning of the dominant culture.

  • Trusted sources.

  • Collateral’s knowledge of cultural values of the US and of the person before age 22.

31 of 43

Puente Practices

  • Rationale for Mitigation Information.
  • Approaches to Mitigation Gathering and Mitigation Specialists.
  • Methods of Mitigation Gathering.
    • Virtual vs. In-Person.
    • Selection of Collaterals.
    • Selection of Prong 2 Portions to Emphasize.
    • Location of Interviewing.
    • Clinical Interviewing Techniques.
    • Psychometric Data.
    • Presence of Third Party Observers.
  • Focus on the Socio-Historical-Cultural Context.
  • Integrating Records, History, Qualitative, and Quantitative Data.

.

32 of 43

Prosecutorial Challanges

  • Prong 1 vs Prong II.
  • Retrospective Analysis.
  • Lack of Tests.
  • Norms.
  • Comparison to Native vs. US References/Norms.
  • Limited, if any, Quantitative Data.
  • Reference Situations and Samples.
  • Misunderstanding or Disbelief of Socio-Historical-Cultural Context.
  • Dr. Death’s Assessment Approaches.
  • Dr. Death’s Interpretation of Variables Producing IQ.

33 of 43

OUTLINE

  1. BACKGROUND
  2. DEFINITION OF INTELLECTUAL DISABILITY (ID)
  3. ASSESSMENT OF ADAPTIVE BEHAVIOR– PRONG 2
  4. BEST PRACTICES
  5. CHALLENGES
  6. FUTURE DIRECTIONS

34 of 43

An Alternative Paradigm

Division 52, International Psychology,

American Psychological Association

Seeks to develop a science that is contextually informed, cultural

inclusive, serves the public interest, and promotes global perspectives

(within and outside of APA).

Antonio E. Puente

President, 2022-2023

35 of 43

Minnesota Neuropsychology Conference: Diversity, Equity, & Inclusion Aspirations

  • Demonstrate cultural humility and respect; understand culture’s impact on all professional activities; be aware of intersectional identities and associated inequities; be aware of historical and institutional inequities; and advocate for marginalized and/or minoritized individuals, populations, and perspectives, traditionally defined by differing ability levels, ethnicity, gender, sexual orientation, and other social and economic constructs.

36 of 43

Minnesota Assessment Definition

  • Conduct culturally-informed neuropsychological evaluations. Use tests and procedures, including measures developed with innovative methods and technologies, that are evidence-based, reliable, valid, and culturally and normatively appropriate. Develop diagnostic case conceptualizations and interpretations that consider ethnicity, language, education level and quality, literacy, gender, sexual orientation, disability status, and other identities and their intersectionality. Utilize tests and procedures, including measures developed with innovative methods and technologies, that are evidence-based, reliable, valid, and culturally and normatively appropriate...

37 of 43

Neuro/Psychological Methodology

  • Sperry
    • Upward/Downward Causation
    • Quantitative
  • Luria & Vygotsky
    • Socio-historical-cultural context
    • Qualitative
  • Hybrid
    • From bottom to top/From right to left
    • Scientific & Socio-historical-cultural integration
    • “Romantically scientific”

38 of 43

39 of 43

40 of 43

Information

    • Vita/ Academic: antonioepuente.com
    • Clinical: clinicalneuropsychology.us

antonioenriquepuente@gmail.com

clinicalneuropsychology@gmail.com

41 of 43

Resources

42 of 43

References

  • American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (Eds.). (2014). Standards for educational and psychological testing. American Educational Research Association.�
  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). https://doi.org/10.1176/appi.books.9780890425596
  • American Psychiatric Association. (2022). Diagnostic and statistical manual of mental disorders (5th ed., text rev.). https://doi.org/10.1176/appi.books.9780890425787
  • Axelrod, B., Barth, J., Faust, D., Fisher, J., Heilbronner, R., Larrabee, G., Pliskin, N., Silver, C., & Policy and Planning Committee, National Academy of Neuropsychology (2000). Presence of third party observers during neuropsychological testing: official statement of the National Academy of Neuropsychology.  Archives of Clinical Neuropsychology, 15(5), 379-380.

  • Judd, T., Capetillo, D., Carrión-Baralt, J., Mármol, L. M., Miguel-Montes, L. S., Navarrete, M. G., Puente, A. E., Romero, H. R., Valdés, J., & NAN Policy and Planning Committee (2009). Professional considerations for improving the neuropsychological evaluation of Hispanics: a National Academy of Neuropsychology education paper.,Archives of clinical neuropsychology. 24(2), 127–135.

  • Luckasson, R., Borthwick-Duffy, S., Buntinx, W. H. E., Coulter, D. L., Craig, E. M. (P.), Reeve, A., Schalock, R. L., Snell, M. E., Spitalnik, D. M., Spreat, S., Tassé, M. J., & The AAMR AD HOC Committee on Terminology and Classification. (2002). Mental retardation: Definition, classification, and systems of supports (10th ed.). American Association on Mental Retardation.

43 of 43

References (continued)

  • Schalock, R. L., Borthwick-Duffy, S. A., Bradley, V. J., Buntinx, W. H. E., Coulter, D. L., Craig, E. M., Gomez, S. C., Lachapelle, Y., Luckasson, R., Reeve, A., Shogren, K. A., Snell, M. E., Spreat. S., Tassé, M. J., Thompson, J. R., Verdugo-Alonso, M., Wehmeyer, M. L., & Yaeger, M. H. (2010). Intellectual Disability: Definition, classification, and systems of supports (11th ed.). American Association on Intellectual and Developmental Disabilities.

  • Schalock, R. L., Luckasson, R., & Tassé, M. J. (2021). Intellectual disability: Definition, diagnosis, classification, and systems of supports (12th ed.).American Association on Intellectual and Developmental Disabilities.

  • Tassé M. J. (2009). Adaptive behavior assessment and the diagnosis of mental retardation in capital cases. Applied neuropsychology16(2), 114–123. https://doi.org/10.1080/09084280902864451

  • World Health Organization. (2016). International statistical classification of diseases and related health problems (10th ed.). https://icd.who.int/browse10/2016/en

  • World Health Organization. (2019). International statistical classification of diseases and related health problems (11th ed.). https://icd.who.int/