You get it?- Deciphering the research
Twenty-five years ago it would have been a rare occurrence
to find a dietary health-related study in a scientific journal making
front-page news. Now, rarely a day goes by without the media reporting
on the findings from yet another breaking dietary study. Public interest
in the safety, quality and effectiveness of food and supplements has
increased dramatically. Consumers want to know the whats and whys
before buying.
Unfortunately more and more frequently the media coverage of these
individual studies result in consumer confusion not education. Almost
by definition, much of the information involved in these single studies
is preliminary, not conclusive and therefore not a strong basis for
change in public behavior. These studies, and the news coverage that
follows them, do however help raise public awareness of key nutrition,
health and food safety issues, if, and that is a big IF they
are written in enough context to enable the average person to assess
the information appropriately.
As a consumer being influenced by these studies it is important to
understand that new research studies published in scientific journals
should be viewed as discussions among scientists. In these discussions,
almost no one gets to have the final word, as it's rare that a study
provides a final, complete answer. Publishing research allows researchers
to obtain input on their work, which not only confirms or contradicts
their results, but also adds to the body of literature on a subject
and helps shape future research.
Keeping this in mind, a major step towards deciphering, interpreting
and making educated choices surrounding a study is to understand research
practices and methods.
There is a hierarchy of scientific evidence. From most reliable
to least it looks something like this:
· multicenter, randomized control clinical trials
· longitudinal prospective cohort studies
· case/control studies
· case studies
· anecdotal studies
Each type of these studies has its advantages and disadvantages.
Clinical trials are the 'gold standard' of research studies.
They are typically experiments conducted on human subjects to evaluate
the benefits and risks of a given treatment. In clinical trials, treatment
groups must be randomized, a control group is required and investigators
must be blinded; also the sample size needs to be large enough to
allow for differences to be detected.
Advantages:
· Study conditions are at least partially controlled.
· Because of the above, cause-and-effect relationship can be
observed.
Disadvantages:
· Challenges involved in maintaining an adequate number of
participants.
· The extraordinary costs of conducting such large-scale studies.
Example of a clinical trial- The ongoing Women's Health
Initiative, which recently reported its findings on the risks of taking
hormone replacement therapy that combines estrogen and progestin.
Cohort studies are observational examinations
that compare the outcome of one group that is exposed to a potential
hazard or disease with the outcome of another group that is not exposed.
Advantages:
· They focus on hazard exposure before a disease develops.
Disadvantages:
· They require a large number of subjects.
· The follow-up period must be lengthy in order to give time
for diseases to develop.
· They are expensive.
Example of a Cohort study- Nurses' Health Study, which
recently released a follow-up report on body mass index and its relationship
to stroke and heart disease.
Case/control studies are observational in nature.
They focus on the subjects who have already developed a certain disease.
Researchers then compare the afflicted participants' past exposure
to suspected risk factors with the exposure of controls who do not
have the disease.
Advantages:
· Useful for identifying rare exposures that may be important
causes of disease.
Disadvantages:
· The design is subject to many potential biases.
Case Studies are detailed analysis of persons
or groups and usually focus on social, psychological or medical phenomena.
Advantages:
· They serve as catalysts for critical thinking and quantitative
questioning.
Disadvantages:
· Not considered as scientifically rigorous as other forms
of research.
Anecdotal studies provide information from personal
experiences but are not based on fact or proper study design.
Advantages:
· Many similar anecdotal reports may spur on future research.
Disadvantages:
· The results of anecdotal studies are not reliable.
It is also important to remember that nutrition research
involves the unique component of recording of dietary intake. Researchers
use several methods to obtain this vital data: food records, food-frequency
questionnaires, 24-hour recall and diet histories. This component
of nutrition research is a challenge as it is common for subjects
to under-report their dietary intakes, so it is critical that researchers
diligently validate the intake methodologies of the study for the
most reliable results.
Questions to Ask.
The questions to ask when reviewing a scientific study or an article
reporting on one.
1) What are the inherent limitations (see disadvantages above) of
the study and is the type of study appropriate for what the researchers
are trying to find out?
2) Is the sample size appropriate for the study?
3) What is the real and statistical significance of the results and
to whom do they apply?
4) How do these results compare to those of other studies on the subject?
5) Are the conclusions supported by the data and are they related
to the purpose of the study?
6) How was the research funded? This does not always mean there will
be a bias; a good study should be able to stand on its own merit regardless
of who supported the research. It will more then not dictate what
is actually studied rather then the outcome.
With all of the above in mind, wading through all the
information that the public is currently being fed is still no easy
task; an open mind and diligence are key to finding the most recent
version of the truth possible. Always try to put what you read into
context, what may seem like a life-altering study today may turn out
to be just the opposite tomorrow. That is the nature of research and
what makes the journey so exciting.