Our Research

Driving innovation through research initiatives

Our Research Commitment

We are dedicated to providing assessments that are consistent, reliable and valid. To achieve this, we rely on research-based evidence to foster innovation, make efficient use of our resources and uphold the highest standards in our field.

Recent Notable Publications

A comparison of psychometric properties of the American Board of Anesthesiology’s in-person and virtual Standardized Oral Examinations

Mark T. Keegan, M.B., B.Ch.; Ann E. Harman, Ph.D.; Stacie G. Deiner, M.D.; Huaping Sun Ph.D.

Academic Medicine, 2025

Healthcare business graph data and growth, Stethoscope with doctor's health report clipboard on table, Medical examination and doctor analyzing medical report on laptop screen.

Utilizing linear logistic test models to explore item characteristics of medical subspecialty certification examinations

Emily K. Toutkoushian, Ph.D.; Huaping Sun, Ph.D.; Mark T. Keegan, M.B., B.Ch.; Ann E. Harman, Ph.D.

Measurement: Interdisciplinary Research and Perspectives, 2024

Administration of the American Board of Anesthesiology’s virtual APPLIED Examination: successes, challenges and lessons learned

Mark T. Keegan, M.B., B.Ch.; Ann E. Harman, Ph.D.; Thomas M. McLoughlin Jr., M.D.; Alex Macario, M.D., MBA; Stacie G. Deiner, M.D., Robert R. Gaiser, M.D.; David O. Warner, M.D.; Santhanam Suresh, M.D.; Huaping Sun, Ph.D.

BMC Medical Education, 2024

Comparing characteristics and perspectives of U.S. anesthesiology fellows in training and anesthesiologists in their first year of practice

Emily Toutkoushian, Ph.D.; Dandan Chen, Ph.D.; Huaping Sun, Ph.D.; David O. Warner, M.D.; Alex Macario, M.D., MBA; Stacie G. Deiner, M.D.; Mark T. Keegan, M.B., B.Ch.

BMC Medical Education, 2023

Career decisions, training priorities and perceived challenges for anesthesiology residents in the United States

Dandan Chen, Ph.D.; Emily Toutkoushian, Ph.D.; Huaping Sun, Ph.D.; David O. Warner, M.D.; Alex Macario, M.D., MBA; Stacie G. Deiner, M.D.; Mark T. Keegan, M.B., B.Ch.

Journal of Clinical Anesthesiology, 2023

A comparison of the American Board of Anesthesiology’s in-person and virtual objective structured clinical examinations

Huaping Sun, Ph.D.; Stacie G. Deiner, M.D.; Ann E. Harman, Ph.D.; Robert S. Isaak, D.O.; Mark T. Keegan, M.B., B.Ch.

Journal of Clinical Anesthesiology, 2023

Putting her ideas forward. Cropped shot of a group of businesspeople meeting in the boardroom

A comparison of 3‑ and 4‑option multiple‑choice items for medical subspecialty in‑training examinations

Dandan Chen, Ph.D.; Ann E. Harman, Ph.D.; Huaping Sun, Ph.D.; Tianpeng Ye, Ph.D.; Robert R. Gaiser, M.D.

BMC Medical Education, 2023

Resident family and medical leave during the first year of the American Board of Anesthesiology’s extended leave policy

Huaping Sun, Ph.D.; Rupa J. Dainer, M.D.; David O. Warner, M.D.; Alex Macario, M.D., MBA

Academic Medicine, 2021

Residency program directors’ perceptions about the impact of the American Board of Anesthesiology’s Objective Structured Clinical Examination

Dandan Chen, Ph.D.; Huaping Sun, Ph.D.; David O. Warner, M.D.; Alex Macario, M.D., MBA

Journal of Clinical Anesthesia, 2021

Doctor Wearing White Coat Reading Notes In Office

Demographic trends from 2005 to 2015 among physicians with Accreditation Council for Graduate Medical Education–accredited anesthesiology training and active medical licenses

Yan Zhou, Ph.D.; Huaping Sun, Ph.D.; Ting Wang, Ph.D.; Ann E. Harman, Ph.D.; Mark T. Keegan, M.B., B.Ch.; Alex Macario, M.D., MBA; Mohammed M. Minhaj, M.D., MBA; Humayun J. Chaudhry, D.O., M.S.; Aaron Young, Ph.D.; David O. Warner, M.D.

Anesthesia & Analgesia, 2021

Construction validation of the American Board of Anesthesiology's APPLIED Examination for initial certification

Ting Wang, Ph.D.; Huaping Sun, Ph.D.; Yan Zhou, Ph.D.; Dandan Chen, Ph.D.; Ann E. Harman, Ph.D.; Robert S. Isaak, D.O.; Cathleen Peterson-Layne, Ph.D., M.D.; Alex Macario, M.D., MBA; Brenda G. Fahy, M.D., MCCM; David O. Warner, M.D.

Anesthesia & Analgesia, 2021

Anesthesiology residents' experiences and perspectives of residency training

Huaping Sun, Ph.D.; Dandan Chen, Ph.D.; David O. Warner, M.D.; Yan Zhou, Ph.D.; Edward C. Nemergut, M.D.; Alex Macario, M.D., MBA; Mark T. Keegan, M.B., B.Ch.

Anesthesia & Analgesia, 2021

Coronavirus with blue World Map Background - 3D illustration

A Coronavirus disease 2019 pandemic pivot: development of the American Board of Anesthesiology's virtual APPLIED Examination

Mark T. Keegan, M.B., B.Ch.; Thomas M. McLoughlin Jr., M.D.; Andrew J. Patterson, M.D., Ph.D.; John E. Fiadjoe, M.D.; Margaret M. Pisacano, BSN, J.D., CPHRM; David O. Warner, M.D.; Huaping Sun, Ph.D.; Ann E. Harman, Ph.D.

Anesthesia & Analgesia, 2021

Substance use disorder in physicians after completion of training in anesthesiology in the United States from 1977 to 2013

David O. Warner, M.D.; Keith Berge, M.D.; Huaping Sun, Ph.D.; Ann Harman, Ph.D.; Ting Wang, Ph.D.

Anesthesiology, 2020

Medical team performing surgical operation in modern operating room at hospital

First-year results of the American Board of Anesthesiology's Objective Structured Clinical Examination for initial certification

David O. Warner, M.D.; Cynthia A. Lien, M.D.; Ting Wang, Ph.D.; Yan Zhou, Ph.D.; Robert S. Isaak, D.O.; Cathleen Peterson-Layne, Ph.D., M.D.; Ann E. Harman, Ph.D.; Alex Macario, M.D., MBA; Robert R. Gaiser, M.D.; Santhanam Suresh, M.D., MBA; Deborah J. Culley, M.D.; James P. Rathmell, M.D.; Mark T. Keegan, M.B., B.Ch.; Daniel J. Cole, M.D.; Brenda G. Fahy, M.D., MCCM; Rupa J. Dainer, M.D.; Huaping Sun, Ph.D.

Anesthesia & Analgesia, 2020

Development of an Objective Structured Clinical Examination as a component of assessment for initial board certification in anesthesiology

David O. Warner, M.D.; Robert S. Isaak, D.O., FASA; Cathleen Peterson-Layne, Ph.D., M.D.; Cynthia A. Lien, M.D.; Huaping Sun, Ph.D.; Anna O. Menzies, B.A.; Daniel J. Cole, M.D.; Rupa J. Dainer, M.D.; Brenda G. Fahy, M.D., MCCM; Alex Macario, M.D., MBA; Santhanam Suresh, M.D., MBA; Ann E. Harman, Ph.D.

Anesthesia & Analgesia, 2020

Detection of learning in longitudinal assessment via score-based tests

Tina Wang, Ph.D.; Huaping Sun, Ph.D.; Yan Zhou, Ph.D.; Ann E. Harman, Ph.D.

Practical Assessment, Research and Evaluation, 2020

multicultural surgeons and patient during surgery in operating room

Clinical practice profiles of anesthesiologists certified in or after the year 2000 participating in maintenance of certification in the United States

Huaping Sun, Ph.D.; Thomas M. McLoughlin Jr., M.D.; Alex Macario M.D., MBA

Journal of Clinical Anesthesia, 2020

Interested in accessing our research data? Download the form below.

Data Request Form

Research Committee

Hoda Badr, Ph.D.

Committee Chair, Public Board Member

Heather Ballard, M.D., M.S.

Committee Member

Stacie G. Deiner, M.D., M.S.

Committee Member, Vice President

Richard Dutton, M.D., M.B.A

Committee Member

Jill Eckert, D.O.

Committee Member, Board Director

Rob Isaak, D.O., FASA

Committee Member, Board Director

Sachin Kheterpal, M.D., M.B.A

Committee Member

Mohammed M. Minhaj, M.D., MBA

Committee Member, Board Director

John D. Mitchell, M.D.

Committee Member, Physician Research Consultant

ABA Research Team

Closely collaborating with the Research Committee, the psychometric and research team ensures that the work remains grounded by leveraging their expertise in psychometrics. The team actively contributes to applying analytical methodologies, drafting and refining manuscripts, ensuring the work is accurately and effectively communicated.