Qualitative studies and the headline problem

Standard

If you want to know what a study does and does not say, you need to read the whole study – indeed, if you’re looking at a paper in an academic journal, and you really want to get to the bottom of it, you might even want to contact the authors to ask for a more detailed report.

But the truth is, you can’t read everything.  Sometimes you just read the abstract, or even the title.  If the title is particularly catchy, that’s the message that may stick in readers’ heads.  And that’s a bit of an issue because studies don’t always produce black and white answers that can be summarised in a nuanced way in ten or twenty words.

So I get really frustrated by the tendency, which is really quite common in qualitative research, of using a quotation from one of the study participants in the study title.  I’ve come across two in the last fortnight: “I wish I had AIDS’: A qualitative study on access to health care services for HIV/AIDS and diabetic patients in Cambodia“.  “These girls gave me AIDS. Why should I use condoms?’ Clients of Sex Workers in Kamathipura Express Their Attitudes About HIV“.  Both studies (if you read them in their entirety) are informative.  Both were conducted with very small and non-representative samples.  In both cases, authors chose to highlight the most shocking statements they heard from study participants in the titles of their articles.  The quote in the Cambodia article comes from a diabetes patient.  I have no doubt the person in question felt that way.  They may also have known nothing about what it is like to live with HIV treatment.  Whether any HIV patients would rather have diabetes, we do not know – it looks like the researchers didn’t ask.  Likewise, I’m sure the client quoted in the India study said what it says he said. I’d also wager that some of the other study participants said much more pleasant but much more dull things.  But the headline is what’s going to stick in peoples’ minds.

 

Advertisements

One thought on “Qualitative studies and the headline problem

  1. OK – yes I agree that the extent is important, I suppose I’m just really into outliers! I also wonder where the line is between qualitative methods as used in a formal study setting, and the use of those techniques as a matter of good practice, eg by a service – so, not to inform policies as such, but to inform what they do tomorrow. I recently supported some work in Namibia where the point was really about identifying specific, resolvable problems in specific locations. (write up here: epidreamiology.posterous.com/participatory-research-and-generalisability)The sponsors were really keen to draw conclusions that could inform national policy – which I understand, but I hope they also took away the message that even if you have a sense of what is going on, it is always worth checking for outliers and so on.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s