RE: What's in an Inkblot? Some Say, Not Much

From: Vincent Campbell (v.p.campbell@stir.ac.uk)
Date: Wed Feb 21 2001 - 10:39:42 GMT

  • Next message: Vincent Campbell: "RE: fitness and stability"

    Received: by alpheratz.cpm.aca.mmu.ac.uk id KAA18648 (8.6.9/5.3[ref pg@gmsl.co.uk] for cpm.aca.mmu.ac.uk from fmb-majordomo@mmu.ac.uk); Wed, 21 Feb 2001 10:40:27 GMT
    Message-ID: <2D1C159B783DD211808A006008062D3101745C9E@inchna.stir.ac.uk>
    From: Vincent Campbell <v.p.campbell@stir.ac.uk>
    To: "'memetics@mmu.ac.uk'" <memetics@mmu.ac.uk>
    Subject: RE: What's in an Inkblot? Some Say, Not Much
    Date: Wed, 21 Feb 2001 10:39:42 -0000
    X-Mailer: Internet Mail Service (5.5.2650.21)
    Content-Type: text/plain; charset="iso-8859-1"
    Sender: fmb-majordomo@mmu.ac.uk
    Precedence: bulk
    Reply-To: memetics@mmu.ac.uk
    

    All I ever see is nasty monsters or pretty butterflies...

    > ----------
    > From: Wade T.Smith
    > Reply To: memetics@mmu.ac.uk
    > Sent: Wednesday, February 21, 2001 4:37 am
    > To: SKEPTIC-L; Memetics Discussion List
    > Subject: Fwd: What's in an Inkblot? Some Say, Not Much
    >
    > What's in an Inkblot? Some Say, Not Much
    >
    > By ERICA GOODE
    >
    > Psychology has produced few more popular icons than the Rorschach inkblot
    > test.
    >
    > Devised 80 years ago by a young Swiss psychiatrist, the Rorschach has
    > entered the language as a synonym for anything ambiguous enough to invite
    > multiple interpretations. And beyond its pop culture status, it has
    > retained a central role in personality assessment, administered several
    > hundred thousand times a year, by conservative estimates, to both
    > children and adults.
    >
    > In custody disputes, for example, the test is used to help determine the
    > emotional fitness of warring parents. Judges and parole boards rely on it
    > for insight into a prisoner's criminal tendencies or potential for
    > violence. Clinicians use it in investigating accusations of sexual abuse,
    > and psychotherapists, as a guide in diagnosing and treating patients.
    >
    > Yet almost since its creation, the inkblot test has also been
    > controversial, with early critics calling it "cultish" and later ones
    > deeming it "scientifically useless."
    >
    > And in recent years, academic psychology departments have been divided
    > over the merits of the test, and some have stopped teaching it.
    >
    > The debate is likely to become even more heated with the publication of
    > an article provoking discussion and anger among clinicians who routinely
    > use the Rorschach. In the article, three psychologists conclude that the
    > inkblot test and two others commonly used < the Thematic Apperception
    > Test or T.A.T. and the Draw-a-Person test < are seriously flawed and
    > should not be used in court or the consulting room.
    >
    > "There has been a substantial gap between the clinical use of these tests
    > and what the research suggests about their validity," said Dr. Scott O.
    > Lilienfeld, an associate professor of psychology at Emory University and
    > the lead author of the article. "The research continues to suggest that
    > they are not as useful for most purposes as many clinicians believe."
    >
    > The review, by Dr. Lilienfeld and two colleagues, Dr. James M. Wood of
    > the University of Texas at El Paso and Dr. Howard Garb of the University
    > of Pittsburgh, appears in the current issue of the journal Psychological
    > Science in the Public Interest, a publication of the American
    > Psychological Society.
    >
    > The three tests are known as "projective" because they present people
    > with an ambiguous image or situation and ask them to interpret or make
    > sense of it. The test taker's responses are assumed to reflect underlying
    > personality traits and unconscious conflicts, motives and fantasies.
    >
    > In the T.A.T., test takers are shown a series of evocative pictures
    > depicting domestic scenes and are asked to tell a story about each one.
    > The figure-drawing test requires drawing a person on a blank sheet of
    > paper and then drawing a second person of the opposite sex.
    >
    > While the Rorschach and the other projective techniques may be valuable
    > in certain specific situations, the reviewers argue, the tests' ability
    > to diagnose mental illnesses, assess personality characteristics, predict
    > behavior or uncover sexual abuse or other trauma is very limited.
    >
    > The tests, which often take hours to score and interpret, add little
    > information beyond what can be gleaned from far less time-consuming
    > assessments, the psychologists say. They recommend that practitioners
    > refrain from administering the tests for purposes other than research "or
    > at least limit their interpretations to the very small number of indexes
    > derived from these techniques that are empirically supported."
    >
    > Dr. Lilienfeld said that the review was written to raise awareness of the
    > problems with the tests in the legal field and with "the hope that maybe
    > we can reach a small number of open-minded people, and in particular
    > students, who have yet to make up their minds on this issue."
    >
    > But he added, "I'm confident that many will take issue with our
    > conclusions."
    >
    > One of those is Dr. Irving B. Weiner, a clinical professor of psychiatry
    > and behavioral medicine at the University of South Florida and the
    > president of the International Rorschach Society, who said the authors of
    > the journal report took research findings out of context to bolster their
    > case.
    >
    > Dr. Lilienfeld and his colleagues do not really understand how clinicians
    > use the tests, Dr. Weiner said. They "have been used for a long time very
    > effectively, with very good results and a great deal of scientific
    > support," he said.
    >
    > Dr. Gregory J. Meyer, an associate professor of psychology at the
    > University of Alaska at Anchorage, who has studied the Rorschach, said
    > admonishing psychologists against using the tests was "not in the spirit
    > of advancing our science."
    >
    > He said the journal's decision to run the psychologists' article was like
    > asking "someone who believes in creationism to review evolutionary theory
    > and make recommendations about it."
    >
    > A History of Controversy
    >
    > Projective tests are no strangers to controversy. The Rorschach, in
    > particular, has inspired intense passion in defenders and critics over
    > the decades, leading two scientists to observe in a 1999 paper that the
    > test had "the dubious distinction of being, simultaneously, the most
    > cherished and the most reviled of psychological assessment instruments."
    >
    > Dr. Hermann Rorschach, a Swiss psychiatrist who worked with schizophrenic
    > patients, is believed to have gotten the idea for the test from a popular
    > European parlor game called Klexographie, which involves making inkblots
    > and telling stories about them. As a child, Dr. Rorschach was so good at
    > the game that he earned the nickname Klecks, or Blot. He died of
    > peritonitis a year after the test's publication in 1921. He was 37.
    >
    > The Rorschach's champions have often been almost worshipful in their
    > belief in its ability to pare back the layers of the psyche, and the test
    > is generally regarded as offering a richness of information about a
    > person's psychological world that cannot be gained from interviews or
    > from "self-report" tests like the Minnesota Multiphasic Personality
    > Inventory or M.M.P.I.
    >
    > The test has used the same 10 images since it was developed. Responses to
    > the inkblots can be scored using more than 100 criteria, including how
    > common or unusual the responses are, what areas of the blots are focused
    > on, whether movement is seen in the images, and so on.
    >
    > In an earlier era, clinicians who demonstrated special skill in
    > interpreting the test were dubbed Rorschach "wizards," and the technique
    > sometimes was referred to as "an X- ray of the mind."
    >
    > Over the years, the test's detractors have also been zealous, making at
    > times brutal attacks on its scientific validity, especially in the 1950's
    > and 1960's, when practitioners varied greatly in the ways they
    > administered and scored the tests.
    >
    > Some of the criticism abated in the mid-1970's, when Dr. John E. Exner,
    > then a professor of psychology at Long Island University, developed
    > systematic rules for giving and scoring the Rorschach and established
    > norms against which the responses of test takers could be compared.
    >
    > Dr. Exner's "comprehensive system" is used by a majority of psychologists
    > who administer the Rorschach. Dr. Exner says that Rorschach Workshops, a
    > North Carolina research foundation which he directs, trains an average of
    > 300 clinicians a year in the method in the United States and several
    > hundred more in Europe and Japan. The foundation charges $650 for five
    > days of intense training in the technique.
    >
    > With the comprehensive system, the test can yield a complex picture of
    > people's psychological strengths and weaknesses, the Rorschach's
    > proponents say, including their intelligence and overall mental
    > functioning, their ability to relate appropriately to other people, their
    > sexuality, and their fantasies, fears and preoccupations.
    >
    > Below the Surface
    >
    > The test is considered particularly powerful in situations in which
    > people may not be expected to volunteer negative information about
    > themselves.
    >
    > For example, Dr. Carl F. Hoppe, a clinical psychologist who does
    > psychological evaluations for the Los Angeles Superior Court's family law
    > division, said he administered the Rorschach about 130 times a year in
    > "high-conflict" custody disputes.
    >
    > In a custody evaluation, Dr. Hoppe said, parents are often motivated to
    > present themselves positively and to deny any sort of difficulties, and
    > the Rorschach is a way to look beyond the way people present themselves.
    >
    > "We take some of the familiar away," he said, "and look at patterns of
    > perceptions in a highly statistical manner."
    >
    > But even with Dr. Exner's scoring system, the embrace of the Rorschach,
    > and other projective tests, has been far from universal.
    >
    > "There is widespread criticism, there's no doubt about it," said Dr.
    > Wayne H. Holtzman, Hogg professor of psychology at the University of
    > Texas at Austin, who in 1956 developed his own inkblot test to correct
    > deficiencies he saw in the Rorschach.
    >
    > Dr. Lilienfeld and his colleagues argue, for example, that there is
    > "virtually no evidence" that the Rorschach can accurately diagnose
    > depression, anxiety, post-traumatic stress disorder or some other
    > emotional problems, calling into question the test's usefulness in
    > custody hearings or as a diagnostic tool in psychotherapy.
    >
    > (The Rorschach is such a common feature of custody disputes that Fathers'
    > Right to Custody, a nonprofit organization, includes advice on its Web
    > site on the best ways to respond to the inkblots. Describing one
    > Rorschach card, for example, the site counsels, "This blot is supposed to
    > reveal how you really feel about your mother." In another case it
    > advises, "Schizophrenics sometimes see moving people in this blot.")
    >
    > Equally scant, Dr. Lilienfeld and his colleagues conclude, are the data
    > supporting the test's use in parole and sentencing hearings to evaluate
    > whether prisoners are prone to violence or likely to commit future
    > crimes. Research suggesting a relationship between certain Rorschach
    > indicators and psychopathic tendencies and violent behavior has been
    > contradicted by later studies, the authors say.
    >
    > "It just doesn't work for most things that it's supposed to," Dr. Wood
    > said.
    >
    > And the psychologists argue that even when the Rorschach appears to have
    > greater validity < for example, in assessing intelligence, diagnosing
    > schizophrenia and predicting a patient's success in psychotherapy < it is
    > not clear how much additional knowledge is gained from the test.
    >
    > In some studies, they point out, the ability of clinicians to predict
    > behavior or diagnose mental disorders actually went down when data from
    > the Rorschach were added to information derived from other tests.
    >
    > "The critical question is what, if anything, does this measure buy you
    > above information that could be more easily collected," Dr. Lilienfeld
    > said.
    >
    > Detecting Abnormality
    >
    > Another problem with the Rorschach, the psychologists say in their
    > review, is that the test tends to "overpathologize," making even normal
    > people look maladjusted.
    >
    > In a study, which they reviewed, of 123 subjects with no psychiatric
    > history who were given the test, most at a California blood bank, 16
    > percent scored in the abnormal range on the test's schizophrenia index <
    > far higher than the 1 percent incidence of the illness in the general
    > population indicated in other surveys. Eighteen percent showed signs of
    > clinical depression on the test, and 29 percent had indicators of extreme
    > narcissism.
    >
    > Empirical backing for the validity of the other two projective measures,
    > the T.A.T. and the human figure drawing test, was sketchy at best, the
    > review's authors found, with the drawing test "the weakest" of the three
    > tests.
    >
    > Psychologists like Dr. Weiner, the author of "Principles of Rorschach
    > Interpretation" and another book on the test, strongly disputed the
    > conclusions drawn in the review.
    >
    > They said a diagnosis was never made on the basis of the test alone.
    >
    > "There are plenty of studies that show the Rorschach can help you
    > identify people who have schizophrenia or whether people are depressed,"
    > Dr. Weiner said, "but the test doesn't make the diagnosis. No single test
    > that a clinician uses makes the diagnosis. If you're going to use this
    > instrument effectively, you're going to take a lot of things into
    > consideration."
    >
    > He added: "Tests don't `overpathologize.' That's done by the person who
    > interprets them."
    >
    > Dr. Meyer, of the University of Alaska, said that while more research
    > needed to be done on some of the issues raised by Dr. Lilienfeld and his
    > colleagues, their views did not fairly reflect what is known about the
    > validity of the Rorschach and other tests.
    >
    > In an article to be published in the journal American Psychologist, Dr.
    > Meyer and other researchers conclude that the validity of psychological
    > tests, including the Rorschach and the T.A.T., is comparable to that of
    > medical tests, like ultrasounds and M.R.I.'s. The article is based on a
    > review of 125 meta-analyses of the validity of psychological and medical
    > tests.
    >
    > But even Dr. Exner, the developer of the comprehensive system, agreed
    > that the test "can be abused unwittingly by the ill-trained person," and
    > he said he was uncomfortable with the use of the test in "adversarial"
    > settings, like custody disputes, unless the psychologist was working for
    > the court, rather than for one parent or the other.
    >
    > "It takes a long time to learn the Rorschach and you've got to work at
    > it, it's not simple," said Dr. Exner, who is also the curator of the
    > Rorschach archives.
    >
    > The real question for clinicians in using the test, he said, is, "What do
    > you want to know about the individual?"
    >
    > "If you're interested only in some diagnostic labeling," Dr. Exner said,
    > "I don't know that the Rorschach is worth doing, not simply because of
    > time but because you're flooded with information that you're not going to
    > use. On the other hand, if you're going to treat someone, I think the
    > Rorschach is a pretty sturdy instrument.
    >
    > "The strength of the test," he continued, "is that it helps the really
    > capable interpreter to develop a picture of an individual."
    >
    > Copyright 2001 The New York Times Company
    >
    > ==============================================================This was
    > distributed via the memetics list associated with the
    > Journal of Memetics - Evolutionary Models of Information Transmission
    > For information about the journal and the list (e.g. unsubscribing)
    > see: http://www.cpm.mmu.ac.uk/jom-emit
    >

    ===============================================================
    This was distributed via the memetics list associated with the
    Journal of Memetics - Evolutionary Models of Information Transmission
    For information about the journal and the list (e.g. unsubscribing)
    see: http://www.cpm.mmu.ac.uk/jom-emit



    This archive was generated by hypermail 2b29 : Wed Feb 21 2001 - 10:42:45 GMT