Triple Jump Examinations a Reliable Way to Assess Dental Students’ Reasoning
12 Dec 13
Triple jump examinations administered by the Herman Ostrow School of Dentistry of USC are reliable and consistent in the way they assess dental students’ reasoning and critical thinking skills, according to an article published in the Journal of Dental Education.
Lead author Mahvash Navazesh, professor and Ostrow School of Dentistry Associate Dean of Academic Affairs and Student Life, said while the triple jump examination (TJE) is noted by the American Dental Education Association for effectively testing students’ analysis and critical thinking skills, they are used by only one percent of all U.S. dental schools.
As Navazesh detailed in the article, there are three steps in a pre-clinical TJE administered at the Ostrow School of Dentistry. The initial step encompasses a one-hour, written analysis of the patient case scenario provided (in a clinical TJE, a live patient would be interviewed and examined).
The student’s analysis includes determining the patient’s presenting or chief complaint and its pertinent facts, formulating mechanistic-oriented hypotheses that may explain the patient’s problems, and listing learning topics to be investigated with regard to each hypothesis. As a second step, the student conducts an overnight gathering of information to contribute to his or her learning for an oral presentation the next day.
For the third step, two faculty members – one with clinical and one with biomedical expertise – assess the student’s performance in the oral presentation and provide feedback with interactive discussion and questioning in a 30-minute session. The students are expected to use their reasoning ability to explain whether they accept or reject their hypotheses from the previous day and how they will approach a continuance of learning for the case, formulate new and revised hypotheses, and address lingering questions or further gaps in their knowledge.
Faculty evaluators engage in discussion with the students and provide immediate verbal feedback on the student’s critical analysis and reasoning. On a written TJE assessment form, the student is graded independently by the two examiners on their performance level in each of three steps of the examination. Following the session, the student submits their anonymous evaluations of the participating faculty raters. Faculty members receive electronic copies of the evaluations and student feedback is used for further development of faculty.
The seemingly subjective nature of the faculty evaluations may give other dental schools pause when considering the use of the TJE for their student assessments, Navazesh said.
However, when examining the scores given by different faculty raters to the same student presentations, raters generally agreed on scores for each criterion over 99 percent of the time, with over 77 percent of the ratings in exact agreement, she said.
The study examined more than 19,000 ratings over a three-year period. Besides the high level of consistency and reliability between raters’ scores of the same student presentations, there appeared to be no significant difference in scoring consistency between raters who had different levels of experience with scoring the TJE, Navazesh added.
The results indicate that the triple jump examination format is a consistent, reliable tool for testing dental students’ critical thinking and higher-order thinking skills, she said.
“It’s very valuable for us to be able to assess not only a student’s memorization of facts but also their ability to analyze information, identify the important questions and think critically in order to solve problems and ultimately offer their patients the best available care.,” Navazesh said.
USC researchers look inside teeth to figure out how we might regenerate teeth in the future. TEETH ARE MARVELOUSLY COMPLICATED structures — and the way they develop is also complex. The majority of tooth tissue (except the enamel) comes from cranial neural crest cells — stem cells that eventually develop into craniofacial bones and cartilage. […]
Through the DIA JumpStart program, non-USC undergraduates interested in pursuing a PhD spend the summer in USC research labs. BY DANIEL P. SMITH The moment Angelita Araujo-Villalba heard about the USC Diversity, Inclusion, Access (DIA) JumpStart program at USC, she knew she had to apply. Then a sophomore at Cal Poly Pomona studying molecular and […]
Michael DeBourg II DDS ’22 overcomes personal loss, a chronic disease and the specter of low expectations to craft a fulfilling life. AFTER HIS FATHER PASSED AWAY in 2007 from pancreatic cancer, Michael DeBourg II went soul searching. The first in his immediate family to earn a high school degree, the then-21-year-old DeBourg had settled […]
First-generation college student Erika Correa DDS ’22 wants to use her career to help improve others’ lives. IT WAS A FABLED TRIP to the orthodontist to get braces that first sparked then-13-year-old Erika Correa’s interest in a dental career . “My new smile after my braces gave me confidence, which really changed my life for […]