How reliable are psychological tests used by practicing clinicians?

References

  • Adams, R., & Jenkins, R. (1981). Basic principles of the neuropsychological examination. In C. E. Walker (Ed.), Clinical practice of psychology: A guide for mental health professionals. New York: Pergamon Press.

    Google Scholar 

  • Allen, M..(1985). Review of Milton Behavioral Health Inventory. In J. V. Mitchell, Jr. (Ed.), The ninth mental measurements yearbook (Vol. 1). Lincoln, NE: University of Nebraska Press.

    Google Scholar 

  • American Psychiatric Association. (1987). Diagnostic and statistical manual (3rd ed. rev.). Washington, DC: Author.

    Google Scholar 

  • Anastasi, A. (1988). Psychological testing (6th ed.). New York: Macmillan.

    Google Scholar 

  • Barton, E., & Ascione, E. (1984). Direct observation. In T. Ollendick & M. Hersen (Eds.), Child behavioral assessment: Principals and procedures. New York: Pergamon Press.

    Google Scholar 

  • Belar, C., Deardorff, W., & Kelly, K. (1987). The practice of clinical health psychology. New York: Pergamon Press.

    Google Scholar 

  • Berg, R., Franzen, M., & Wedding, D. (1987), Screening for brain impairment: A manual for mental health practice. New York: Springer.

    Google Scholar 

  • Bruner, K. (1942). Of psychological writing: Being some valedictory remarks on style. Journal of Abnormal and Social Psychology, 37, 52–70.

    CrossRef  Google Scholar 

  • Campbell, D. & Hansen, J. (1981). Manual for the SVIB-SCII Strong-Campbell Interest Inventory (3rd ed.). Stanford, CA: Stanford University Press.

    Google Scholar 

  • Connolly, A. J., Nachtman, W., & Pritchett, E. M. (1976). KeyMath Diagnostic Arithmetic Test: Manual. Circle Pines, MN: American Guidance Service.

    Google Scholar 

  • Cronbach, L. (1984). Essentials of psychological testing (4th ed.). New York: Harper & Row.

    Google Scholar 

  • Dahlstrom, W (1985). The development of psychological testing. In G. Kimble & K. Schlesinger (Eds.), Topics in the history of psychology. Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • D’Amato, R., Dean, R., & Holloway, A. (1987). A decade of employment trends in neuropsychology. Professional Psychology: Research and Practice, 18, 653–655.

    CrossRef  Google Scholar 

  • Derogatis, L., Lipman, R., & Covi, L. (1973). The SCL-90: An outpatient psychiatric rating scale. Psychopharmacology Bulletin, 9, 13–28.

    PubMed  Google Scholar 

  • Dubois, P (1970). A history of psychological testings. Barton: Allyn and Bacon.

    Google Scholar 

  • Elbert, J., & Holden, E. (1987). Child diagnostic assessment: Current training practices in clinical psychology internships. Professional Psychology: Research and Practice, 18, 587–596.

    CrossRef  Google Scholar 

  • Exner, J. (1978). The Rorschach: A comprehensive system (Vol. 2). New York: Wiley.

    Google Scholar 

  • Exner, J. (1986). The Rorschach: A comprehensive system (Vol. 1) 2nd ed.). New York: Wiley.

    Google Scholar 

  • Exner, J., & Weiner, I. (1982) The Rorschach: A comprehensive system (Vol. 3). New York: Wiley.

    Google Scholar 

  • Feinstein, A. (1985). Clinical epidemiology: The architecture of clinical research. Philadelphia: Saunders.

    Google Scholar 

  • Frances, A. (1987). DSM-III personality disorders: Diagnosis and treatment. New York: Guilford Press.

    Google Scholar 

  • Friedman, M., a& Rosenman, R. (1974). Type A behavior and your heart. New York: Knopf.

    Google Scholar 

  • Gatchel, R., & Baum, A. (1983). An introduction to health psychology. Reading, MA: Addison-Wesley.

    Google Scholar 

  • Golden, C., Hammeke, T., & Purisch, A. (1978). Diagnostic validity of a standardized neuropsychological battery derived from Luria’s neuropsychological tests. Journal of Consulting and Clinical Psychology, 46, 1258–1265.

    CrossRef  PubMed  Google Scholar 

  • Golden, C., Kane, R., Sweet, J., Moses, J., Cardellino, J., Templeton, R., Vicente, P, Kennelly, D., & Graber, B. (1981). The relationship of the Halstead-Reitan Neuropsychological Battery to the Luria-Nebraska Neuropsychological Battery. Journal of Consulting Psychology, 49, 410–417.

    CrossRef  Google Scholar 

  • Goldstein, G., & Hersen, M. (1984). Historical perspectives. In G. Goldstein & M. Hersen (Eds.) Handbook of psychological assessment. New York: Pergamon Press.

    Google Scholar 

  • Goulet Fisher, D., Sweet, J., & Pfaelzer-Smith, E. (1986). Influence of depression on repeated neuropsychological testing. International Journal of Clinical Neuropsychology, 8, 14–18.

    Google Scholar 

  • Greene, R. (1980). The MMPI: An interpretive manual. Orlando, FL: Grune & Stratton.

    Google Scholar 

  • Hall, J. (1988). Records for psychologists. Register Report: Newsletter for Psychologist Health Service Providers, 14, 3–4.

    Google Scholar 

  • Holmes, T., & Rahe, R. (1967). The social readjustment rating scale. Journal of Psychosomatic Research, 11, 213–218.

    CrossRef  PubMed  Google Scholar 

  • Incagnoli, T., Goldstein, C., & Golden, C (1986). Clinical application of neuropsychological test batteries. New York: Plenum Press.

    CrossRef  Google Scholar 

  • Jackson, C., & Wohl, J. (1966). A survey of Rorschach teaching in the university. Journal of Projective Techniques and Personality Assessment, 30, 115–134.

    CrossRef  Google Scholar 

  • Jastak, S., & Jastak, G. (1984). The Wide Range Achievement Test-Revised: Administration Manual. Wilmington, DE: Jastak.

    Google Scholar 

  • Jenkins, C., Roseman, R., & Friedman, M. (1967). Development of an objective psychological test for the determination of the coronary-prone behavior pattern in employed men. Journal of Chronic Diseases, 20, 371–379.

    CrossRef  PubMed  Google Scholar 

  • Johannson, C. (1982). Manual for Career Assessment Inventory (2nd ed.). Minneapolis: National Computer Systems.

    Google Scholar 

  • Johnson, S., & Bolstad, O. (1973). Methodological issues in naturalistic observations: Some problems and solutions for field research. In L. Hammerlynck, L. Handy, & E. Mash (Eds.), Behavior change: Methodology, concepts, and practice. Champaign, IL: Research Press.

    Google Scholar 

  • Kane, R., Sweet, J., Golden, C., Parsons, O., & Moses, J. (1981). Comparative clinical diagnostic accuracy of the Halstead-Reitan and Standardized Luria-Nebraska Neuropsychological Batteries. Journal of Consulting and Clinical Psychology, 49, 484–485.

    CrossRef  PubMed  Google Scholar 

  • Kazdin, A. (1977). Artifact, bias, and complexity of assessment: The ABCs of reliability. Journal of Applied Behavior Analysis, 4, 7–14.

    Google Scholar 

  • Kellerman, H., & Burry, A. (1981). Handbook of psychodiagnostic testing: Personality analysis and report writing. New York: Grune & Stratton.

    Google Scholar 

  • Kirsch, I., & Winter, C. (1983). A history of clinical psychology. In C. E. Walker (Ed.), The Handbook of Clinical Psychology (Vol. 1). Homewood, IL: Dorsey.

    Google Scholar 

  • Klopfer, W. (1983). Writing psychological reports. In C. Walker (Ed.), The handbook of clinical psychology (Vol. 1). Homewood, IL: Dorsey.

    Google Scholar 

  • Lanyon, R. (1985). Review of Millon Behavioral Health Inventory. In J. V. Mitchell, Jr. (Ed.), The ninth mental measurements yearbook (Vol. 1). Lincoln, NE: University of Nebraska Press.

    Google Scholar 

  • Lee-Riordan, D., & Sweet, J. (1990). Evaluation of the Millon Behavioral Health Inventory and the MMPI in the assessment of back pain patients. Unpublished manuscript.

    Google Scholar 

  • Lezak, M. (1983). Neuropsychological assessment (2nd ed.). New York: Oxford University Press.

    Google Scholar 

  • Lubin, B., Larsen, R., & Matarazzo, J. (1984). Patterns of psychological test usage in the United States: 1935–1982. American Psychologist, 39, 451–454.

    CrossRef  Google Scholar 

  • Lubin, B., Larsen, R., Matarazzo, J., & Seever, M. (1986). Selected characteristics of psychologists and psychological assessment in five settings. Professional Psychology: Research and Practice, 17, 155–157.

    CrossRef  Google Scholar 

  • Markwardt, E (1989). Peabody Individual Achievement Test-Revised: Manual. Circle Pines, MN: American Guidance Service.

    Google Scholar 

  • Matarazzo, R., & Matarazzo, J. (1984). Assessment of adult intelligence in clinical practice. In P. McReynolds & G. Chelune (Eds.), Advance in psychological assessment (Vol. 6). San Francisco: Jossey-Bass.

    Google Scholar 

  • McReynolds, P. (1987). Lightner Witmer: Little-known founder of clinical psychology. American Psychologist, 42, 849–858.

    CrossRef  PubMed  Google Scholar 

  • Melton, G., Petrila, J., Poythress, N., & Slobogin, C. (1987). Psychological evaluations for the courts: A handbook for mental health professionals and lawyers. New York: Guilford Press.

    Google Scholar 

  • Millon, T., Green, C., & Meagler, R. (1979). The MBHI: A new inventory for the psychodiagnostician in medical settings. Professional Psychology, 10, 529–539.

    CrossRef  Google Scholar 

  • Newman, P, & Sweet, J. (1986). The effects of clinical depression on the Luria-Nebraska Neuropsychological Battery. International Journal of Clinical Neuropsychology, 8, 109–114.

    Google Scholar 

  • Parsons, O. (1986). Overview of the Halstead-Reitan Battery. In T. Incagnoli, G. Goldstein, & C. Golden (Eds.), Clinical applications of neuropsychological test batteries. New York: Plenum Press.

    Google Scholar 

  • Poon, L. (Ed.). (1986). Handbook for clinical memory assessment of older adults. Washington, DC: American Psychological Association.

    CrossRef  Google Scholar 

  • Puente, A., & McCaffrey, R. (1992). Handbook of neuropsychological assessment: A biopsychosocial perspective. New York: Plenum Press.

    Google Scholar 

  • Ritzler, B., & Alter, B. (1986). Rorschach teaching in APAapproved clinical graduate programs: Ten years later. Journal of Personality Assessment, 50, 44–49.

    CrossRef  PubMed  Google Scholar 

  • Rourke, B., Fisk, J., & Strang, J. (1986). Neuropsychological assessment of children. New York: Guilford Press.

    Google Scholar 

  • Sarason, I., Johnson, J., & Siegel, J. (1978). Assessing the impact of life changes: Development of the Life Experiences Survey. Journal of Consulting and Clinical Psychology, 467, 932–946.

    CrossRef  Google Scholar 

  • Schenkenberg, T, Peterson, D., Wood, D., & DaBell, R. (1981). Psychological consultation/liaison in a medical and neurological setting: Physician’s appraisal. Professional Psychology,12, 309–317.

    CrossRef  Google Scholar 

  • Seretny, M., Dean, R., & Seretny, S. (1985, October). Second survey of the National Academy of Neuropsychology. Paper presented at the annual meeting of the National Academy of Neuropsychology, Philadelphia, PA.

    Google Scholar 

  • Seretny, M., Dean, R., Gray, J., & Hartlage, L. (1986). The practice of clinical neuropsychology in the United States. Archives of Clinical Neuropsychology, 1, 5–12.

    PubMed  Google Scholar 

  • Shemberg, K., & Keeley, S. (1970). Psychodiagnostic training in the academic setting: Past and present. Journal of Consulting and Clinical Psychology, 34, 205–211.

    CrossRef  PubMed  Google Scholar 

  • Spitzer, R., & Endicott J. (1977). Schedule for affective disorders and schizophrenia. Technical Report. New York: New York State Psychiatric Institute.

    Google Scholar 

  • Strassberg, D. S., Reimherr, E, Ward, M., Russell, S., & Cole, A. (1981). The MMPI and chronic pain. Journal of Consulting and Clinical Psychology, 49, 220–226.

    CrossRef  PubMed  Google Scholar 

  • Sweeney, J., Clarkin, J., & Fitzgibbon, M. (1987). Current practice of psychological assessment. Professional Psychology: Research and Practice, 18, 377–380.

    CrossRef  Google Scholar 

  • Sweet, J. (1981). The MMPI in evaluation of response to treatment of chronic pain. American Journal of Clinical Biofeedback, 4, 121–130.

    Google Scholar 

  • Sweet, J. (1983). Confounding effects of depression on neuropsychological testing: Five illustrative cases. Clinical Neuropsychology,5, 103–109.

    Google Scholar 

  • Sweet, J., & Moberg, P (1990). A survey of practices and beliefs among ABPP and non-ABPP clinical neuropsychologists. The Clinical Neuropsychologist, 4, 101–120.

    CrossRef  Google Scholar 

  • Sweet, J., & Rozensky, R. (1991). Professional relations. In M. Hersen, A. Kazdin, & A. Bellack (Eds.), The clinical psychology handbook (2nd ed.). New York: Pergamon Press.

    Google Scholar 

  • Sweet, J., Breuer, S., Hazlewood, L., Toye, R., & Pawl, R. (1985). The Millon Behavioral Health Inventory: Concurrent and predictive validity in a pain treatment center. Journal of Behavioral Medicine, 8, 215–226.

    CrossRef  PubMed  Google Scholar 

  • Sweet, J., Tal, C., & Shain, M. (1985). A survey of practices and beliefs in clinical neuropsychology. Unpublished manuscript.

    Google Scholar 

  • Tallent, N. (1976). Psychological report writing. Englewood Cliffs, NJ: Prentice-Hall.

    Google Scholar 

  • Thorndike, R., Hagen, E., & Sattler, J. (1986). Stanford-Binet Intelligence Scale (Fourth Ed.). Chicago: Riverside.

    Google Scholar 

  • vanReken, M. (1981). Psychological assessment and report writing. In C. Walker (Ed.), Clinical practice of psychology. New York: Pergamon Press.

    Google Scholar 

  • Wade, T., & Baker, T. (1977). Opinions and use of psychological tests: A survey of clinical psychologists. American Psychologist, 32, 874–882.

    CrossRef  PubMed  Google Scholar 

  • Wade, T., Baker, T., Morton, T., & Baker, L. (1978). The status of psychological testing in clinical psychology: Relationships between test use and professional activities and orientations. Journal of Personality Assessment, 42, 3–10.

    CrossRef  PubMed  Google Scholar 

  • Wechsler, D. (1955). Manual for the Wechsler Adult Intelligence Scale. New York: Psychological Corp.

    Google Scholar 

  • Wechsler, D. (1974). Manual for the Wechsler Intelligence Scale for Children—Revised. New York: Psychological Corp.

    Google Scholar 

  • Wechsler, D. (1981). Manual for the Wechsler Adult Intelligence Scale—Revised. New York: Psychological Corp.

    Google Scholar 

  • Wedding, D., & Williams, M. (1983). Training options in behavioral medicine and clinical neuropsychology. Clinical Neuropsychology, 5, 100–102.

    Google Scholar 

  • Weiner, I., & Hess, A. (1987). Handbook of forensic psychology. New York: Wiley.

    Google Scholar 

  • Wilcoxson, M., Zook, A., & Zarski, J. (1988). Predicting behavioral outcomes with two psychological assessment methods in an outpatient pain management program. Psychology and Health, 2, 319–333.

    CrossRef  Google Scholar 

  • Woodcock, R. (1973). Manual for the Woodcock Reading Mastery Tests. Circle Pines, MN: American Guidance Service.

    Google Scholar 

  • Woodcock, R., & Johnson, B. (1977). Woodcock-Johnson Psycho-Educational Battery: Examiner’s Manual. Allen, TX: DLM Teaching Resources.

    Google Scholar 

  • Wysocki, J., & Sweet, J. (1985). Identification of schizophrenic, brain-damaged, and normal medical patients using a brief neuropsychological screening battery. International Journal of Clinical Neuropsychology, 7, 40–44.

    Google Scholar 

Download references

What makes a test reliable psychology?

Reliability in psychology is the consistency of the findings or results of a psychology research study. If findings or results remain the same or similar over multiple attempts, a researcher often considers it reliable.

What are three problems with psychological tests?

There are three major issues in psychological testing: reliability, validity and bias.

Can psychological tests be wrong?

Accuracy: False Negatives and False Positives Like all conscientiously constructed tests, psychological tests are designed to ensure accuracy and limit error. A test that cannot yield accurate results is not helpful and can even be harmful.

What are some major errors in the use of psychological tests?

10 Fallacies in Psychological Assessment.
Mismatched Validity. ... .
Confirmation Bias. ... .
Confusing Retrospective & Predictive Accuracy (Switching Conditional Probabilities) ... .
Unstandardizing Standardized Tests. ... .
Ignoring the Effects of Low Base Rates. ... .
Misinterpreting Dual High Base Rates. ... .
Perfect Conditions Fallacy. ... .
Financial Bias..