Flexibility in Design, Outcomes and Analysis in “Evidence- Based” Drug Prevention Research: The Case of the Midwestern Prevention Project
Journal Title: Journal of Addiction & Prevention - Year 2014, Vol 2, Issue 1
Abstract
Flexibility in study designs, definitions, outcomes and analytic models increases the chance that the results reported in an empirical study are untrue. Such flexibility in methodological and analytic practices has been observed in evaluations of a number of drug prevention programs that appear on lists of evidenced-based programs. The current paper examines the evidence base pertaining to one of the most well-established drug prevention programs, namely the Midwestern Prevention Project (MPP; also known as Project STAR). Specifically, it examines the results reported from the quasiexperimental evaluation of the MPP that was conducted in Kansas City and the experimental replication conducted in Indianapolis, Indiana, and the data analysis practices used in producing these findings. It shows there is considerable analytical flexibility evident in the published accounts from these two evaluations studies, notably in the samples used in the data analyses and the manner in which outcome variables were measured. The implications of this for the MPP’s status as an evidenced-based drug prevention program are discussed, along with the means by which flexibility in analytic procedures in drug prevention research could be reduced. The seemingly widespread existence of such analytic flexibility within the field suggests that confirmation bias is part of the general culture of drug prevention research. This impedes the development of a sound scientific base within the discipline and might even lead it to degenerate into a pseudoscience.
Authors and Affiliations
Dennis M. Gorman
Keywords
Related Articles
- EP ID EP202548
- DOI 10.13188/2330-2178.1000009
- Views 140
- Downloads 0
Rodent Models of Adolescent Alcohol and Drug Self- Administration: Implications for Understanding Adult Substance Abuse
In humans, experimentation with drugs (including alcohol) typically begins in adolescence. Adolescent experimentation can escalate to abuse and dependence in adulthood. Converging evidence from molecular, cellular and sy...
Acquired Color Vision Defects in Chronic Heavy Smoking
Nicotine, a psychoactive compound of cigarette, is an alkaloid that binds and activates nicotinic acetylcholine receptors on the retina and lateral geniculate nucleus, being able to affect visual spatial processing. Loss...
Diagnostic Performance of the Rutgers Alcohol Problem Index (RAPI) in Detecting DSM-5 Alcohol Use Disorders among College Students
Background and objectives: The DSM-5 Alcohol Use Disorder criteria (AUD) have been modified to reflect a single diagnosis, which may alter how AUDs are detected within our screening measures. The Rutgers Alcohol Problem...
Chronic Methamphetamine Increases Alpha-Synuclein Protein Levels in the Striatum and Hippocampus but not in the Cortex of Juvenile Mice
Methamphetamine is the second most widely used illicit drug worldwide. More than 290 tons of methamphetamine was synthesized in the year 2005 alone, corresponding to approximately ~3 billion 100 mg doses of methamphetami...
Past Year Alcohol Consumption Patterns, Alcohol Problems and Alcohol-Related Diagnoses in the New Zealand Mental Health Survey
Background: Criteria for the diagnosis of alcohol abuse or dependence in DSM-IV or ICD-10 do not include measures of alcohol consumption. However the Alcohol Use Disorders Identification Test (AUDIT) contains three consu...