Office of Education

PURPOSE: Standards for reporting exist for many types of quantitative research, but currently none exist for the broad spectrum of qualitative research. The purpose of the present study was to formulate and define standards for reporting qualitative research while preserving the requisite flexibility to accommodate various paradigms, approaches, and methods. METHOD: The authors identified guidelines, reporting standards, and critical appraisal criteria for qualitative research by searching PubMed, Web of Science, and Google through July 2013; reviewing the reference lists of retrieved sources; and contacting experts. Specifically, two authors reviewed a sample of sources to generate an initial set of items that were potentially important in reporting qualitative research. Through an iterative process of reviewing sources, modifying the set of items, and coding all sources for items, the authors prepared a near-final list of items and descriptions and sent this list to five external reviewers for feedback. The final items and descriptions included in the reporting standards reflect this feedback. RESULTS: The Standards for Reporting Qualitative Research (SRQR) consists of 21 items. The authors define and explain key elements of each item and provide examples from recently published articles to illustrate ways in which the standards can be met. CONCLUSIONS: The SRQR aims to improve the transparency of all aspects of qualitative research by providing clear standards for reporting qualitative research. These standards will assist authors during manuscript preparation, editors and reviewers in evaluating a manuscript for potential publication, and readers when critically appraising, applying, and synthesizing study findings.

The increasingly popular term 'problem-based learning' does not refer to a specific educational method. It can have many different meanings depending on the design of the educational method employed and the skills of the teacher. The many variables possible can produce wide variations in quality and in the educational objectives that can be achieved. A taxonomy is proposed to facilitate an awareness of these differences and to help teachers choose a problem-based learning method most appropriate for their students.

CONTEXT: Although technology-enhanced simulation has widespread appeal, its effectiveness remains uncertain. A comprehensive synthesis of evidence may inform the use of simulation in health professions education. OBJECTIVE: To summarize the outcomes of technology-enhanced simulation training for health professions learners in comparison with no intervention. DATA SOURCE: Systematic search of MEDLINE, EMBASE, CINAHL, ERIC, PsychINFO, Scopus, key journals, and previous review bibliographies through May 2011. STUDY SELECTION: Original research in any language evaluating simulation compared with no intervention for training practicing and student physicians, nurses, dentists, and other health care professionals. DATA EXTRACTION: Reviewers working in duplicate evaluated quality and abstracted information on learners, instructional design (curricular integration, distributing training over multiple days, feedback, mastery learning, and repetitive practice), and outcomes. We coded skills (performance in a test setting) separately for time, process, and product measures, and similarly classified patient care behaviors. DATA SYNTHESIS: From a pool of 10,903 articles, we identified 609 eligible studies enrolling 35,226 trainees. Of these, 137 were randomized studies, 67 were nonrandomized studies with 2 or more groups, and 405 used a single-group pretest-posttest design. We pooled effect sizes using random effects. Heterogeneity was large (I(2)>50%) in all main analyses. In comparison with no intervention, pooled effect sizes were 1.20 (95% CI, 1.04-1.35) for knowledge outcomes (n = 118 studies), 1.14 (95% CI, 1.03-1.25) for time skills (n = 210), 1.09 (95% CI, 1.03-1.16) for process skills (n = 426), 1.18 (95% CI, 0.98-1.37) for product skills (n = 54), 0.79 (95% CI, 0.47-1.10) for time behaviors (n = 20), 0.81 (95% CI, 0.66-0.96) for other behaviors (n = 50), and 0.50 (95% CI, 0.34-0.66) for direct effects on patients (n = 32). Subgroup analyses revealed no consistent statistically significant interactions between simulation training and instructional design features or study quality. CONCLUSION: In comparison with no intervention, technology-enhanced simulation training in health professions education is consistently associated with large effects for outcomes of knowledge, skills, and behaviors and moderate effects for patient-related outcomes.

OBJECTIVES: This article reviews and critically evaluates historical and contemporary research on simulation-based medical education (SBME). It also presents and discusses 12 features and best practices of SBME that teachers should know in order to use medical simulation technology to maximum educational benefit. METHODS: This qualitative synthesis of SBME research and scholarship was carried out in two stages. Firstly, we summarised the results of three SBME research reviews covering the years 1969-2003. Secondly, we performed a selective, critical review of SBME research and scholarship published during 2003-2009. RESULTS: The historical and contemporary research synthesis is reported to inform the medical education community about 12 features and best practices of SBME: (i) feedback; (ii) deliberate practice; (iii) curriculum integration; (iv) outcome measurement; (v) simulation fidelity; (vi) skill acquisition and maintenance; (vii) mastery learning; (viii) transfer to practice; (ix) team training; (x) high-stakes testing; (xi) instructor training, and (xii) educational and professional context. Each of these is discussed in the light of available evidence. The scientific quality of contemporary SBME research is much improved compared with the historical record. CONCLUSIONS: Development of and research into SBME have grown and matured over the past 40 years on substantive and methodological grounds. We believe the impact and educational utility of SBME are likely to increase in the future. More thematic programmes of research are needed. Simulation-based medical education is a complex service intervention that needs to be planned and practised with attention to organisational contexts.

.Discipline practices in schools affect the social quality of each educational environment, and the ability of children to achieve the academic and social gains essential for success in a 21st century society. We review the documented patterns of office discipline referrals in 364 elementary and middle schools during the 2005–2006 academic year. Data were reported by school personnel through daily or weekly uploading of office discipline referrals using the Web-based School-wide Information System. Descriptive and logistic regression analyses indicate that students from African American families are 2.19 (elementary) to 3.78 (middle) times as likely to be referred to the office for problem behavior as their White peers. In addition, the results indicate that students from African American and Latino families are more likely than their White peers to receive expulsion or out of school suspension as consequences for the same or similar problem behavior. These results extend and are consistent with a long history of similar findings, and argue for direct efforts in policy, practice, and research to address ubiquitous racial and ethnic disparities in school discipline.

OBJECTIVE: The purpose of this study was to determine if participation in a patient empowerment program would result in improved psychosocial self-efficacy and attitudes toward diabetes, as well as a reduction in blood glucose levels. RESEARCH DESIGN AND METHODS: This study was conducted as a randomized, wait-listed control group trial. The intervention group received a six-session (one session per week) patient empowerment education program; the control group was assigned to a wait-list. At the end of 6 weeks, the control group completed the six-session empowerment program. Six weeks after the program, both groups provided follow-up data. RESULTS: The intervention group showed gains over the control group on four of the eight self-efficacy subscales and two of the five diabetes attitude subscales. Also, the intervention group showed a significant reduction in glycated hemoglobin levels. Within groups, analysis of data from all program participants showed sustained improvements in all of the self-efficacy areas and two of the five diabetes attitude subscales and a modest improvement in blood glucose levels. CONCLUSIONS: This study indicated that patient empowerment is an effective approach to developing educational interventions for addressing the psychosocial aspects of living with diabetes. Furthermore, patient empowerment is conducive to improving blood glucose control. In an ideal setting, patient education would address equally blood glucose management and the psychosocial challenges of living with diabetes.

For many patients, the time spent meeting with their physician-the clinical encounter-is the most opportune moment for them to become engaged in their own health through the process of shared decision making. In the United States shared decision making is being promoted for its potential to improve the health of populations and individual patients, while also helping control care costs. In this overview we describe the three essential elements of shared decision making: recognizing and acknowledging that a decision is required; knowing and understanding the best available evidence; and incorporating the patient's values and preferences into the decision. To achieve the promise of shared decision making, more physicians need training in the approach, and more practices need to be reorganized around the principles of patient engagement. Additional research is also needed to identify the interventions that are most effective.

ABSTRACTS Gaps in reading performance between Anglo and Latino children are associated with gaps in vocabulary knowledge. An intervention was designed to enhance fifth graders' academic vocabulary. The meanings of academically useful words were taught together with strategies for using information from context, from morphology, from knowledge about multiple meanings, and from cognates to infer word meaning. Among the principles underlying the intervention were that new words should be encountered in meaningful text, that native Spanish speakers should have access to the text's meaning through Spanish, that words should be encountered in varying contexts, and that word knowledge involves spelling, pronunciation, morphology, and syntax as well as depth of meaning. Fifth graders in the intervention group showed greater growth than the comparison group on knowledge of the words taught, on depth of vocabulary knowledge, on understanding multiple meanings, and on reading comprehension. The intervention effects were as large for the English‐language learners (ELLs) as for the English‐only speakers (EOs), though the ELLs scored lower on all pre‐ and posttest measures. The results show the feasibility of improving comprehension outcomes for students in mixed ELL‐EO classes, by teaching word analysis and vocabulary learning strategies.

OBJECTIVE: Feedback is important in clinical education. However, the medical education literature provides no consensual definition of feedback. The aim of this study is to propose a consensual, research-based, operational definition of feedback in clinical education. An operational definition is needed for educational practice and teacher training, and for research into the effectiveness of different types of feedback. METHODS: A literature search about definitions of feedback was performed in general sources, meta-analyses and literature reviews in the social sciences and other fields. Feedback definitions given from 1995 to 2006 in the medical education literature are also reviewed. RESULTS: Three underlying concepts were found, defining feedback as 'information'; as 'reaction', including information, and as a 'cycle', including both information and reaction. In most medical education and social science literature, feedback is usually conceptualised as information only. Comparison of feedback definitions in medical education reveals at least 9 different features. The following operational definition is proposed. Feedback is: 'Specific information about the comparison between a trainee's observed performance and a standard, given with the intent to improve the trainee's performance.' CONCLUSIONS: Different conceptual representations and the use of different key features might be a cause for inconsistent definitions of feedback. The characteristics, strengths and weaknesses of this research-based operational definition are discussed.

This Guide reviews theories of science that have influenced the development of common educational evaluation models. Educators can be more confident when choosing an appropriate evaluation model if they first consider the model's theoretical basis against their program's complexity and their own evaluation needs. Reductionism, system theory, and (most recently) complexity theory have inspired the development of models commonly applied in evaluation studies today. This Guide describes experimental and quasi-experimental models, Kirkpatrick's four-level model, the Logic Model, and the CIPP (Context/Input/Process/Product) model in the context of the theories that influenced their development and that limit or support their ability to do what educators need. The goal of this Guide is for educators to become more competent and confident in being able to design educational program evaluations that support intentional program improvement while adequately documenting or describing the changes and outcomes-intended and unintended-associated with their programs.

In this paper, we review and discuss ten common methodological mistakes found in retrospective chart reviews. The retrospective chart review is a widely applicable research methodology that can be used by healthcare disciplines as a means to direct subsequent prospective investigations. In many cases in this review, we have also provided suggestions or accessible resources that researchers can apply as a "best practices" guide when planning, conducting, or reviewing this investigative method.

PURPOSE: A recent systematic review (2008) described the effectiveness of Internet-based learning (IBL) in health professions education. A comprehensive synthesis of research investigating how to improve IBL is needed. This systematic review sought to provide such a synthesis. METHOD: The authors searched MEDLINE, CINAHL, EMBASE, Web of Science, Scopus, ERIC, TimeLit, and the University of Toronto Research and Development Resource Base for articles published from 1990 through November 2008. They included all studies quantifying the effect of IBL compared with another Internet-based or computer-assisted instructional intervention on practicing and student physicians, nurses, pharmacists, dentists, and other health professionals. Reviewers working independently and in duplicate abstracted information, coded study quality, and grouped studies according to inductively identified themes. RESULTS: From 2,705 articles, the authors identified 51 eligible studies, including 30 randomized trials. The pooled effect size (ES) for learning outcomes in 15 studies investigating high versus low interactivity was 0.27 (95% confidence interval, 0.08-0.46; P = .006). Also associated with higher learning were practice exercises (ES 0.40 [0.08-0.71; P = .01]; 10 studies), feedback (ES 0.68 [0.01-1.35; P = .047]; 2 studies), and repetition of study material (ES 0.19 [0.09-0.30; P < .001]; 2 studies). The ES was 0.26 (-0.62 to 1.13; P = .57) for three studies examining online discussion. Inconsistency was large (I(2) >or=89%) in most analyses. Meta-analyses for other themes generally yielded imprecise results. CONCLUSIONS: Interactivity, practice exercises, repetition, and feedback seem to be associated with improved learning outcomes, although inconsistency across studies tempers conclusions. Evidence for other instructional variations remains inconclusive.

BACKGROUND: Patients vary in their willingness and ability to actively participate in medical consultations. Because more active patient participation contributes to improved health outcomes and quality of care, it is important to understand factors affecting the way patients communicate with healthcare providers. OBJECTIVES: The objectives of this study were to examine the extent to which patient participation in medical interactions is influenced by 1) the patient's personal characteristics (age, gender, education, ethnicity); 2) the physician's communication style (eg, use of partnership-building and supportive talk); and 3) the clinical setting (eg, the health condition, medical specialty). RESEARCH DESIGN AND SUBJECTS: The authors conducted a post hoc cross-sectional analysis of 279 physician-patient interactions from 3 clinical sites: 1) primary care patients in Sacramento, California, 2) patients with systemic lupus erythematosus (SLE) from the San Francisco Bay area, and 3) patients with lung cancer from a VA hospital in Texas. MAIN OUTCOME MEASURES: The outcome measures included the degree to which patients asked questions, were assertive, and expressed concerns and the degree to which physicians used partnership-building and supportive talk (praise, reassurance, empathy) in their consultations. RESULTS: The majority of active participation behaviors were patient-initiated (84%) rather than prompted by physician partnership-building or supportive talk. Patients who were more active participants received more facilitative communication from physicians, were more educated, and were more likely to be white than of another ethnicity. Women more willingly expressed negative feelings and concerns. There was considerable variability in patient participation across the 3 clinical settings. Female physicians were more likely to use supportive talk than males, and physicians generally used less supportive talk with nonwhite compared with white patients. CONCLUSIONS: Patient participation in medical encounters depends on a complex interplay of personal, physician, and contextual factors. Although more educated and white patients tended to be more active participants than their counterparts, the strongest predictors of patient participation were situation-specific, namely the clinical setting and the physician's communicative style. Physicians could more effectively facilitate patient involvement by more frequently using partnership-building and supportive communication. Future research should investigate how the nuances of individual clinical settings (eg, the health condition, time allotted for the visit) impose constraints or opportunities for more effective patient involvement in care.

How and when the Americas were populated remains contentious. Using ancient and modern genome-wide data, we found that the ancestors of all present-day Native Americans, including Athabascans and Amerindians, entered the Americas as a single migration wave from Siberia no earlier than 23 thousand years ago (ka) and after no more than an 8000-year isolation period in Beringia. After their arrival to the Americas, ancestral Native Americans diversified into two basal genetic branches around 13 ka, one that is now dispersed across North and South America and the other restricted to North America. Subsequent gene flow resulted in some Native Americans sharing ancestry with present-day East Asians (including Siberians) and, more distantly, Australo-Melanesians. Putative "Paleoamerican" relict populations, including the historical Mexican Pericúes and South American Fuego-Patagonians, are not directly related to modern Australo-Melanesians as suggested by the Paleoamerican Model.

PURPOSE: To determine if medical students who demonstrate unprofessional behavior in medical school are more likely to have subsequent state board disciplinary action. METHOD: A case-control study was conducted of all University of California, San Francisco, School of Medicine graduates disciplined by the Medical Board of California from 1990-2000 (68). Control graduates (196) were matched by medical school graduation year and specialty choice. Predictor variables were male gender, undergraduate grade point average, Medical College Admission Test scores, medical school grades, National Board of Medical Examiner Part 1 scores, and negative excerpts describing unprofessional behavior from course evaluation forms, dean's letter of recommendation for residencies, and administrative correspondence. Negative excerpts were scored for severity (Good/Trace versus Concern/Problem/Extreme). The outcome variable was state board disciplinary action. RESULTS: The alumni graduated between 1943 and 1989. Ninety-five percent of the disciplinary actions were for deficiencies in professionalism. The prevalence of Concern/Problem/Extreme excerpts in the cases was 38% and 19% in controls. Logistic regression analysis showed that disciplined physicians were more likely to have Concern/Problem/Extreme excerpts in their medical school file (odds ratio, 2.15; 95% confidence interval, 1.15-4.02; p =.02). The remaining variables were not associated with disciplinary action. CONCLUSION: Problematic behavior in medical school is associated with subsequent disciplinary action by a state medical board. Professionalism is an essential competency that must be demonstrated for a student to graduate from medical school.

Abstract The Indo‐US Cross‐National Dementia Epidemiology Study seeks to compare two rural populations, in the US and India: the Monongahela Valley, a rural community of relatively low socioeconomic status in southwestern Pennsylvania (USA), and Ballabgarh, a rural community near New Delhi in North India. Of Particular interest is the fact that the Ballabgarh elderly population is exclusively Hindi‐speaking, has little or no education and is largely illiterate, rendering its cognitive screening a particular challenge. In this article we report methods and preliminary data on the development of a Hindi cognitive screening instrument suitable for the Ballabgarh elderly population. We use as an example our Hindi adaptation of the Mini‐Mental State Examination (MMSE), a widely used global cognitive screening scale. Systematic, item‐by‐item, empirically based test development has shown that effective modifications can be made to existing tests that require reading and writing; and that culturally sensitive modifications can be made to render the test meaningful and relevant while still tapping the appropriate cognitive domains. Certain cognitive functions, particularly orientation to time, remain difficult to test adequately in this type of population. In Ballabgarh, as in the Monongahela Valley, educated individuals obtain higher test scores. Implications for dementia screening are discussed, including those relevant to the hypothesis that low education predisposes to dementia.

The Massachusetts Institute of Technology's iLab project has developed a distributed software toolkit and middleware service infrastructure to support Internet-accessible laboratories and promote their sharing among schools and universities on a worldwide scale. The project starts with the assumption that the faculty teaching with online labs and the faculty or academic departments that provide those labs are acting in two roles with different goals and concerns. The iLab architecture focuses on fast platform-independent lab development, scalable access for students, and efficient management for lab providers while preserving the autonomy of the faculty actually teaching the students. Over the past two years, the iLab architecture has been adopted by an increasing number of partner universities in Europe, Australia, Africa, Asia, and the United States. The iLab project has demonstrated that online laboratory use can scale to thousands of students dispersed on several continents.

Allen C. Smith, III, Sherryl Kleinman, Managing Emotions in Medical School: Students' Contacts with the Living and the Dead, Social Psychology Quarterly, Vol. 52, No. 1, Special Issue: Sentiments, Affect and Emotion (Mar., 1989), pp. 56-69

CONTEXT: With the public's increasing use of complementary and alternative medicine, medical schools must consider the challenge of educating physicians about these therapies. OBJECTIVES: To document the prevalence, scope, and diversity of medical school education in complementary and alternative therapy topics and to obtain information about the organizational and academic features of these courses. DESIGN: Mail survey and follow-up letter and telephone survey conducted in 1997-1998. PARTICIPANTS: Academic or curriculum deans and faculty at each of the 125 US medical schools. MAIN OUTCOME MEASURES: Courses taught at US medical schools and administrative and educational characteristics of these courses. RESULTS: Replies were received from 117 (94%) of the 125 US medical schools. Of schools that replied, 75 (64%) reported offering elective courses in complementary or alternative medicine or including these topics in required courses. Of the 123 courses reported, 84 (68%) were stand-alone electives, 38 (31%) were part of required courses, and one (1%) was part of an elective. Thirty-eight courses (31%) were offered by departments of family practice and 14 (11%) by departments of medicine or internal medicine. Educational formats included lectures, practitioner lecture and/or demonstration, and patient presentations. Common topics included chiropractic, acupuncture, homeopathy, herbal therapies, and mind-body techniques. CONCLUSIONS: There is tremendous heterogeneity and diversity in content, format, and requirements among courses in complementary and alternative medicine at US medical schools.

The authors of this article reviewed the methodology of three common consensus methods: nominal group process, consensus development panels, and the Delphi technique. The authors set out to determine how a majority of researchers are conducting these studies, how they are analyzing results, and subsequently the manner in which they are reporting their findings. The authors conclude with a set of guidelines and suggestions designed to aid researchers who choose to use the consensus methodology in their work.Overall, researchers need to describe their inclusion criteria. In addition to this, on the basis of the current literature the authors found that a panel size of 5 to 11 members was most beneficial across all consensus methods described. Lastly, the authors agreed that the statistical analyses done in consensus method studies should be as rigorous as possible and that the predetermined definition of consensus must be included in the ultimate manuscript. More specific recommendations are given for each of the three consensus methods described in the article.