Triple Jump Examinations a Reliable Way to Assess Dental Students’ Reasoning
12 Dec 13
Triple jump examinations administered by the Herman Ostrow School of Dentistry of USC are reliable and consistent in the way they assess dental students’ reasoning and critical thinking skills, according to an article published in the Journal of Dental Education.
Lead author Mahvash Navazesh, professor and Ostrow School of Dentistry Associate Dean of Academic Affairs and Student Life, said while the triple jump examination (TJE) is noted by the American Dental Education Association for effectively testing students’ analysis and critical thinking skills, they are used by only one percent of all U.S. dental schools.
As Navazesh detailed in the article, there are three steps in a pre-clinical TJE administered at the Ostrow School of Dentistry. The initial step encompasses a one-hour, written analysis of the patient case scenario provided (in a clinical TJE, a live patient would be interviewed and examined).
The student’s analysis includes determining the patient’s presenting or chief complaint and its pertinent facts, formulating mechanistic-oriented hypotheses that may explain the patient’s problems, and listing learning topics to be investigated with regard to each hypothesis. As a second step, the student conducts an overnight gathering of information to contribute to his or her learning for an oral presentation the next day.
For the third step, two faculty members – one with clinical and one with biomedical expertise – assess the student’s performance in the oral presentation and provide feedback with interactive discussion and questioning in a 30-minute session. The students are expected to use their reasoning ability to explain whether they accept or reject their hypotheses from the previous day and how they will approach a continuance of learning for the case, formulate new and revised hypotheses, and address lingering questions or further gaps in their knowledge.
Faculty evaluators engage in discussion with the students and provide immediate verbal feedback on the student’s critical analysis and reasoning. On a written TJE assessment form, the student is graded independently by the two examiners on their performance level in each of three steps of the examination. Following the session, the student submits their anonymous evaluations of the participating faculty raters. Faculty members receive electronic copies of the evaluations and student feedback is used for further development of faculty.
The seemingly subjective nature of the faculty evaluations may give other dental schools pause when considering the use of the TJE for their student assessments, Navazesh said.
However, when examining the scores given by different faculty raters to the same student presentations, raters generally agreed on scores for each criterion over 99 percent of the time, with over 77 percent of the ratings in exact agreement, she said.
The study examined more than 19,000 ratings over a three-year period. Besides the high level of consistency and reliability between raters’ scores of the same student presentations, there appeared to be no significant difference in scoring consistency between raters who had different levels of experience with scoring the TJE, Navazesh added.
The results indicate that the triple jump examination format is a consistent, reliable tool for testing dental students’ critical thinking and higher-order thinking skills, she said.
“It’s very valuable for us to be able to assess not only a student’s memorization of facts but also their ability to analyze information, identify the important questions and think critically in order to solve problems and ultimately offer their patients the best available care.,” Navazesh said.
A new grant will bring together multidisciplinary researchers to understand jaw joint degeneration and pain from the inside out. THE JAW JOINT IS A LITTLE LIKE THE KNEE: It has a disc in the middle and then two bony structures that articulate together to open and close the jaw. But, with all that talking and […]
A new Cell Stem Cell publication by Ostrow researcher Jianfu Chen shows how the lymphatic system and skull stem cells may help kids with a rare birth defect. CRANIOSYNOSTOSIS IS A BIRTH DEFECT in which the bones in a baby’s skull fuse too early — before the brain is fully formed. It happens in 1 […]
WE LOST AN ICON AND PILLAR in USC Orthodontics history. Donald L. Tuverson passed away peacefully in his home in Point Loma, San Diego, in January 2023. Dr. Tuverson was in the private practice of orthodontics in Pasadena, Calif., until he retired at the end of 1999. He was known for his attention to the fine […]
Amy Merrill-Brugger has been awarded a second grant to study bent bone syndrome — and help uncover some fundamental truths about joints in the skull. IF YOU’VE EVER HELD A BABY, you probably remember soft spots on their heads — space for the developing skulls to grow around the brain. When the system works correctly, […]
Chai joins a list of illustrious scientists in the award and hopes his research will impact patients’ lives. ASSOCIATE DEAN OF RESEARCH Yang Chai PhD ’91, DDS ’96 has been awarded the 2023 Paul Goldhaber Award by the Harvard School of Dental Medicine. The highest honor given by the school, the award goes to a […]