干旱区生态环境知识资源中心(Arid): American College of Surgeons Objective Assessment of Skills in Surgery (ACS OASIS): A Formative Assessment of Junior Residents' Technical Skills

Arid

DOI	10.1016/j.jsurg.2022.07.007
	American College of Surgeons Objective Assessment of Skills in Surgery (ACS OASIS): A Formative Assessment of Junior Residents' Technical Skills
	Shabahang, Mohsen M.; Adetunji, Adegoke A.; Daley, Brian J.; Mpinga, Ebondo; Sudan, Ranjan; Tillou, Areti; Blair, Patrice G.; Park, Yoon Soo; Lipsett, Pamela A.; Jarman, Benjamin T.; Sachdeva, Ajit K.
通讯作者	Shabahang, MM
来源期刊	JOURNAL OF SURGICAL EDUCATION
ISSN	1931-7204
EISSN	1878-7452
出版年	2022
卷号	79 期号:6 页码:194-201
英文摘要	OBJECTIVE: The objective assessment of technical skills of junior residents is essential in implementing competency-based training and providing specific feedback regarding areas for improvement. An innovative assessment that can be easily implemented by training programs nationwide has been developed by expert surgeon educators under the aegis of the American College of Surgeons (ACS) Division of Education. This assessment, ACS Objective Assessment of Skills in Surgery (ACS OASIS) uses eight stations to address technical skills important for junior residents within the domains of laparoscopic appendectomy, excision of lipoma, central line placement, laparoscopic cholecystectomy, trocar placement, exploratory laparotomy, repair of enterotomy, and tube thoracostomy. The purpose of this study was to implement ACS OASIS at a number of sites to study its psychometric rigor. DESIGN: The ACS OASIS was pre-piloted at two programs to establish feasibility and to gather information regarding implementation. Each skills station was 12 minutes long, and the faculty completed a checklist with 5 to 15 items, and a global assessment scale. The study was then repeated at three pilot sites and included 29 junior residents who were assessed by a total of 44 faculty. Psychometric data for the stations and checklists were collected and analyzed. SETTING: The pre-pilot sites were Geisinger and University of Tennessee Knoxville.Data were gathered from pilot sites that included Wellspan Health, Duke University, and University of California Los Angeles. RESULTS: The mean checklist score for all learners was 76% (IQR of 66%-85%). The average global rating was 3.36 on a 5-point scale with a standard deviation of 0.56. The overall cut score derived using the borderline group method was at 68% with 34% of performances requiring remediation. Using this criterion, the average number of stations that were completed by each learner without need for remediation was five.The station discrimination index ranged from 0.27 to 0.65 (all above the threshold of 0.25), demonstrating solid psychometric characteristics at the station level. The internal-consistency reliability was 0.76 with SEM of 5.8%. The inter-rater reliability (intraclass correlation) was high at 0.73 with general agreement of 79% between the two raters. The station discrimination was at 0.45 (range of 0.27 to 0.65) indicating a high level of differentiation between high and low performers. Using the generalizability theory, the G-coefficient reliability was at 0.72 with the reliability projection flattening after 8 stations. Overall, 75% to 82% the faculty and learners rated ACS OASIS as realistic and beneficial. CONCLUSIONS: ACS OASIS is a psychometrically sound technical skills assessment tool that can provide useful information for feedback to junior residents and support efforts to remediate gaps in performance. (C) 2022 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.
英文关键词	Competency-based surgical education formative assessment of technical skills feedback junior residents
类型	Article ; Proceedings Paper
语种	英语
开放获取类型	Bronze
收录类别	SCI-E ; CPCI-S
WOS记录号	WOS:000916185400024
WOS关键词	STRUCTURED ASSESSMENT ; FEEDBACK ; EDUCATION ; VALIDITY ; OSATS
WOS类目	Education, Scientific Disciplines ; Surgery
WOS研究方向	Education & Educational Research ; Surgery
资源类型	期刊论文
条目标识符	http://119.78.100.177/qdio/handle/2XILL650/393602
推荐引用方式 GB/T 7714	Shabahang, Mohsen M.,Adetunji, Adegoke A.,Daley, Brian J.,et al. American College of Surgeons Objective Assessment of Skills in Surgery (ACS OASIS): A Formative Assessment of Junior Residents' Technical Skills[J],2022,79(6):194-201.
APA	Shabahang, Mohsen M..,Adetunji, Adegoke A..,Daley, Brian J..,Mpinga, Ebondo.,Sudan, Ranjan.,...&Sachdeva, Ajit K..(2022).American College of Surgeons Objective Assessment of Skills in Surgery (ACS OASIS): A Formative Assessment of Junior Residents' Technical Skills.JOURNAL OF SURGICAL EDUCATION,79(6),194-201.
MLA	Shabahang, Mohsen M.,et al."American College of Surgeons Objective Assessment of Skills in Surgery (ACS OASIS): A Formative Assessment of Junior Residents' Technical Skills".JOURNAL OF SURGICAL EDUCATION 79.6(2022):194-201.