Knowledge Resource Center for Ecological Environment in Arid Area
DOI | 10.1109/TSE.2019.2934409 |
An Empirical Validation of Oracle Improvement | |
Jahangirova, Gunel; Clark, David; Harman, Mark; Tonella, Paolo | |
通讯作者 | Jahangirova, G (corresponding author), Fdn Bruno Kessler, I-38122 Trento, Italy. ; Jahangirova, G (corresponding author), UCL, London WC1E 6BT, England. |
来源期刊 | IEEE TRANSACTIONS ON SOFTWARE ENGINEERING
![]() |
ISSN | 0098-5589 |
EISSN | 1939-3520 |
出版年 | 2021 |
卷号 | 47期号:8页码:1708-1728 |
英文摘要 | We propose a human-in-the-loop approach for oracle improvement and analyse whether the proposed oracle improvement process is helping developers to create better oracles. For this, we conducted two human studies with 68 participants overall: an oracle assessment study and an oracle improvement study. Our results show that developers exhibit poor performance (29 percent accuracy) when manually assessing whether an assertion oracle contains a false positive, a false negative or none of the two. This shows that automated detection of these oracle deficiencies is beneficial for the users. Our tool OASIs (Oracle ASsessment and Improvement) helps developers produce assertions with higher quality. Participants who used OASIs in the improvement study were able to achieve 33 percent of full and 67 percent of partial correctness as opposed to participants without the tool who achieved only 21 percent of full and 43 percent of partial correctness. |
英文关键词 | Tools Standards Generators Indexes Software testing Software Oracle problem test oracle oracle assessment oracle improvement human study test case generation mutation testing |
类型 | Article |
语种 | 英语 |
开放获取类型 | Green Submitted |
收录类别 | SCI-E |
WOS记录号 | WOS:000684687400011 |
WOS类目 | Computer Science, Software Engineering ; Engineering, Electrical & Electronic |
WOS研究方向 | Computer Science ; Engineering |
来源机构 | University of London |
资源类型 | 期刊论文 |
条目标识符 | http://119.78.100.177/qdio/handle/2XILL650/363571 |
作者单位 | [Jahangirova, Gunel] Fdn Bruno Kessler, I-38122 Trento, Italy; [Jahangirova, Gunel; Clark, David; Harman, Mark] UCL, London WC1E 6BT, England; [Harman, Mark] Facebook, Menlo Pk, CA USA; [Tonella, Paolo] Univ Svizzera Italiana USI, CH-6900 Lugano, Switzerland |
推荐引用方式 GB/T 7714 | Jahangirova, Gunel,Clark, David,Harman, Mark,et al. An Empirical Validation of Oracle Improvement[J]. University of London,2021,47(8):1708-1728. |
APA | Jahangirova, Gunel,Clark, David,Harman, Mark,&Tonella, Paolo.(2021).An Empirical Validation of Oracle Improvement.IEEE TRANSACTIONS ON SOFTWARE ENGINEERING,47(8),1708-1728. |
MLA | Jahangirova, Gunel,et al."An Empirical Validation of Oracle Improvement".IEEE TRANSACTIONS ON SOFTWARE ENGINEERING 47.8(2021):1708-1728. |
条目包含的文件 | 条目无相关文件。 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。