The California Evidence-Based Clearinghouse for Child Welfare
The California Evidence-Based Clearinghouse for Child Welfare

This document was printed from the website of the California Evidence-Based Clearinghouse for Child Welfare (CEBC), which you can access at http://www.cachildwelfareclearinghousetest.org/

Glossary of Terminology Frequently Used in Research

Anecdotal – Information based on casual observations or indications rather than rigorous or scientific analysis.

Case-control study – Compares people with a disease or condition ('cases') to another group of people from the same population who don't have that disease or condition ('controls'). A case-control study can identify risks and trends, and suggest some possible causes for disease, or for particular outcomes. For example, a study could compare 4th graders with ADHD to a group of 4th graders without ADHD.

Cohort study – A 'cohort' is a group of people clearly identified: a cohort study follows that group over time, and reports on what happens to them. A cohort study is an observational study, and it can be prospective (following people forward over time) or retrospective (looking at what happened in the past). For example, a cohort study of 4th graders could follow them forward as they age, or look back at their previous health and school histories.

Controlled settings – A control is a standard against which experimental observations may be evaluated. In a controlled group study, one group of participants is given an intervention, while another group (i.e., the control group) is given the standard treatment or a placebo. For example, one classroom of 4th graders may receive an interventional health curriculum while the classroom of 4th graders across the hall receives the standard health curriculum and serves as the control group.

Effectiveness trial – An effectiveness trial focuses on whether a treatment works when used in the real world. An effectiveness trial is done after the intervention has been shown to have a positive effect in an efficacy trial.

Efficacy – Power or capacity to produce a desired effect.

Efficacy trial – An efficacy trial focuses on whether an intervention can work under ideal circumstances and looks at whether the intervention has any effect at all.

Empirical research – Research conducted 'in the field', where data are gathered first-hand and/or through observation. Case studies and surveys are examples of empirical research.

Fidelity – In intervention research, fidelity commonly refers to the extent to which an intervention is implemented as intended by the designers of the intervention. Thus, fidelity refers not only to whether or not all the intervention components and activities were actually implemented, but whether they were implemented in the proper manner.

Matched comparison study – A study in which groups who will be compared are created by a non-random method, but where participants in each group are assigned so that they are similar in important characteristics such as ethnic or socioeconomic status, assessment scores, or other variables that might affect study outcomes.

Matched wait list study – In this type of study, subjects are matched based on certain characteristics, such as age, gender, or race/ethnicity, into pairs. One is then assigned to the intervention group, while the other half of each pair is assigned to a wait-list group, which will receive the intervention at a later time. The wait-list group serves as the control group.

Meta-analysis – A statistical technique which summarizes the results of several studies into a single estimate of their combined result. It is a key element of many systematic reviews.

Peer review – A refereeing process used to check the quality and importance of research studies. It aims to provide a wider check on the quality and interpretation of a report. For example, an article submitted for publication in a peer-reviewed journal is reviewed by other experts in the field.

Placebo group – A placebo is something that does not directly affect the behavior or symptoms under study in any specific way. A researcher must be able to separate placebo effects from the actual effects of the intervention being studied. For example, in a drug study, subjects in the experimental and placebo groups may receive identical-looking medication, but those in the experimental group are receiving the study drug while those in the placebo group are receiving a sugar pill. Typically, subjects are not aware whether they are receiving the study drug or a placebo.

Prevention (Primary) - This type of prevention consists of activities designed to impact families prior to any allegations of abuse and neglect, and include public education activities, such as parent education classes, family support programs, public awareness campaigns, etc.

Prevention (Secondary) - This type of prevention consists of activities targeted to families that have one or more risk factors, including families with substance abuse or domestic violence issues, teenaged parents, parents of special needs children, single parents and low-income families. These services include parent education classes for high-risk parents, respite care, home visiting programs, crisis nurseries, etc.

Prevention (Tertiary) - This type of prevention consists of activities targeted to families in which abuse has already occurred and include early intervention and targeted services, such as individual, group, and family counseling; parenting education - such as Parent-Child Interactive Therapy (PCIT); community and social services referrals for substance abuse treatment, domestic violence services, psychiatric evaluations, and mental health treatment; infant safe-haven programs; family reunification services (including follow-up care programs for families after a child has been returned); temporary child care; etc.

Randomization – A process that reduces the likelihood of bias by assigning people to specific groups (e.g., experimental and control groups) by chance alone (randomly). When groups are created by random assignment, individual characteristics are less likely to make the results inaccurate.

Randomized controlled trials (RCTs) – In a randomized controlled trial, participants are randomly assigned to receive either an intervention or control treatment (often usual care services). This allows the effect of the intervention can be studied in groups of people who are: (1) the same at the outset and (2) treated the same way, except for the intervention(s) being studied. Any differences seen in the groups at the end can be attributed to the difference in treatment alone, and not to bias or chance.

Reliability – The extent to which the same result will be achieved when repeating the same measure or study again. For example, someone completing the same assessment tool twice within a short period of time should get roughly the same result if the tool is reliable.

Single subject studies – These prospective observation designs focus on a single subject and typically involve reporting data individually over time.

Uncontrolled group study – A study that does not have another group to compare results objectively against. In this case, only the group that receives the intervention is examined, so you cannot be certain that any changes seen were caused by the intervention itself, as other factors may have been acting.

Untreated group – This group serves as a control group for comparison with the treatment or intervention group. This group receives no treatment at all during the study.

Validity – The degree to which a result is likely to be true and free of bias. There are two types of validity:

  • External validity – External validity is the extent to which the results of a study can apply to people other than the ones that were in the study. This is a measure of how generalizable the results are to others outside of the study.
  • Internal validity – Internal validity is the extent to which a study properly measures what it is meant to.