NRS 490 Week 3 Discussion Paper.
What is Scientifically Based Research?•Consistent and reliable evidence that the intervention (practice, program, curriculum, etc.) has been proven to be effective.NRS 490 Week 3 Discussion Paper.
Definitions•Rigorous – thorough, meticulous, precise•Systematic – methodical, orderly, regular, organized, logical•Empirical – experimental•Objective – impartial, neutral, unbiased, independent•Reliability – confidence of the tool to produce the same results for the same person/group if the tool was used again or by another person•Validity – extent to which the tool measures what it is supposed to measure
More Definitions•Involves the application of rigorous, systematic, and objective procedures to obtain reliable and valid knowledge•Includes research that:–Employs systematic, empirical methods–Involves rigorous data analysis–Relies on measurements that provide reliable and valid data–Uses experimental or quasi-experimental designs–Ensures that studies are clear and detailed to allow for replication–Has been reviewed or accepted by independent experts. NRS 490 Week 3 Discussion Paper.
Evaluating Evidence-Based Practices•Select criteria on which to evaluate the practices, treatment, or intervention before looking at the research•Studies published in peer reviewed journals–Research is scrutinized by panel of experts who look at the adequacy of the methodology, soundness of conclusions, and contributions to scientific knowledge.–The editor gives feedback to the authors of the article to make recommendations for or against publication of the article.–Peer review increases the likelihood that reports are reliable and useful sources of information.–Peer reviewed reports are much more trustworthy than reports in popular media.
Evaluating Research•Two types of research–Between groups studies–Single subject studies
Between Groups Approaches•Randomized Clinical Trials (RCT) – participants are randomly assigned to one of two or more groups. One group receives treatment, another does not. Results are then compared. This design yields strong evidence for the efficacy of the intervention.•Quasi-Experimental Designs – participants are matched on some characteristics and then randomly assigned to groups. This can yield important evidence of efficacy of an intervention. However, RCTs are still needed to confirm the results.
Single-Subject Design•Compares baseline phase in which no intervention is implemented to one or more intervention phases. Data are collected continuously on outcome measures (improvement of skills, decline in behavior of concern, etc.). NRS 490 Week 3 Discussion Paper.Consistent improvement on outcome measures during intervention compared to baseline indicate intervention was effective for that individual. Many replications of these outcomes over multiple individuals confirms that intervention is effective.–Multiple baseline across subjects, multiple baseline across behavior, multiple baseline across setting–AB designs are weaker research designs as another variable (not controlled for) may have made the changes observed
Data Analysis•Statistical analysis of data –used for data analysis for group research design•Linear graphical presentation –used for single subject design research
How to evaluate an intervention to determine if is supported by rigorous evidence•Is the intervention backed by “strong” evidence of effectiveness?•Quality + Quantity = “strong” evidence–Quality involves using well-designed studies–Quantity involves the number of trials or studies showing effectiveness (two or more settings, settings similar to yours)NRS 490 Week 3 Discussion Paper.