Evaluating Popular Science in the Media

News of the latest scientific breakthroughs, health, and nutritional information is pervasive in our news environments.  Local television coverage usually includes a daily segment devoted to health issues.  Newspapers include dedicated sections for science issues.  The Internet teams with information from every kind of source imaginable.

Sometimes it is difficult to tell what is good science and what is junk science.  The following suggestions¹ may help:

1.The ownership of a web site should be clear.
2.  The information provided should be based on sound scientific study.
3.  Evidence should be carefully weighed and limitations of the study should be acknowledged.
4.  Beware of junk science and suggestions of conspiracies.
5.  The individuals or group providing the information should be qualified to address the subject matter.
6.  Arguments should be based on fact, not conjecture.
7.  The motive of the information provider should be clear.
8.  The information should make sense - if it seems to be too good to be true, it probably isn't true.
9.  References should be included to recognized peer-reviewed publications.
10.  Enough information should be provided to make it easy to find additional information.

Red flags² of "Junk Science":
1.  Recommedations that promise a quick fix.
2.  Dire warnings of danger from a single product or regimen.
3.  Claims that sound too good to be true.
4.  Recommendations made to help sell a product.
5.  Dramatic statements that are refuted by reputable scientific organizations.
6.  Lists of "good" and "bad" things.
7.  Recommendations based on a single study.
8.  Simplistic conclusions drawn from a complex study.
9.  Recommendations based on studies published without peer review.
10.  Recommendations from studies that ignore differences among individuals, groups, or species.

Sources:
¹ "Tips for Evaluating Information on the Internet", Oregon Public Health Services <http://www.ohd.ht.state.or.us/mmm/opic/webevaltips.htm>, date accessed 10/18/02.

² Greene, Angela.  "Evaluating Food and Nutrition News", Michigan State University Extension, Van Buren County <http://www.msue.msu.edu/vanburen/redflag.htm>, date accessed 10/18/02.

Prepared by
Deborah Carter Peoples