Arid
DOI10.1145/3568424
Oasis: Controlling Data Migration in Expansion of Object-based Storage Systems
Zhang, Yiming; Wang, Li; Gai, Shun; Ke, Qiwen; Li, Wenhao; Song, Zhenlong; Xue, Guangtao; Shu, Jiwu
通讯作者Zhang, YM
来源期刊ACM TRANSACTIONS ON STORAGE
ISSN1553-3077
EISSN1553-3093
出版年2023
卷号19期号:1
英文摘要Object-based storage systems have been widely used for various scenarios such as file storage, block storage, blob (e.g., large videos) storage, and so on, where the data is placed among a large number of object storage devices (OSDs). Data placement is critical for the scalability of decentralized object-based storage systems. The state-of-the-art CRUSH placement method is a decentralized algorithm that deterministically places object replicas onto storage devices without relying on a central directory. While enjoying the benefits of decentralization such as high scalability, robustness, and performance, CRUSH-based storage systems suffer from uncontrolled data migration when expanding the capacity of the storage clusters (i.e., adding new OSDs), which is determined by the nature of CRUSH and will cause significant performance degradation when the expansion is nontrivial. This article presents MapX, a novel extension to CRUSH that uses an extra time-dimension mapping (from object creation times to cluster expansion times) for controlling data migration after cluster expansions. Each expansion is viewed as a new layer of the CRUSH map represented by a virtual node beneath the CRUSH root. MapX controls the mapping from objects onto layers by manipulating the timestamps of the intermediate placement groups (PGs). MapX is applicable to a large variety of object-based storage scenarios where object timestamps can be maintained as higher-level metadata. We have applied MapX to the state-of-the-art Ceph-RBD (RADOS Block Device) to implement a migration-controllable, decentralized object-based block store (called Oasis). Oasis extends the RBD metadata structure to maintain and retrieve approximate object creation times (for migration control) at the granularity of expansion layers. Experimental results show that the MapX-based Oasis block store outperforms the CRUSH-based Ceph-RBD (which is busy in migrating objects after expansions) by 3.17x similar to 4.31x in tail latency, and 76.3% (respectively, 83.8%) in IOPS for reads (respectively, writes).
英文关键词Object storage cluster expansion datamigration data placement CRUSH block storage system
类型Article
语种英语
收录类别SCI-E
WOS记录号WOS:000939530200002
WOS关键词PERFORMANCE ; SERVICE ; OVERLAY ; CHORD
WOS类目Computer Science, Hardware & Architecture ; Computer Science, Software Engineering
WOS研究方向Computer Science
资源类型期刊论文
条目标识符http://119.78.100.177/qdio/handle/2XILL650/394930
推荐引用方式
GB/T 7714
Zhang, Yiming,Wang, Li,Gai, Shun,et al. Oasis: Controlling Data Migration in Expansion of Object-based Storage Systems[J],2023,19(1).
APA Zhang, Yiming.,Wang, Li.,Gai, Shun.,Ke, Qiwen.,Li, Wenhao.,...&Shu, Jiwu.(2023).Oasis: Controlling Data Migration in Expansion of Object-based Storage Systems.ACM TRANSACTIONS ON STORAGE,19(1).
MLA Zhang, Yiming,et al."Oasis: Controlling Data Migration in Expansion of Object-based Storage Systems".ACM TRANSACTIONS ON STORAGE 19.1(2023).
条目包含的文件
条目无相关文件。
个性服务
推荐该条目
保存到收藏夹
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Zhang, Yiming]的文章
[Wang, Li]的文章
[Gai, Shun]的文章
百度学术
百度学术中相似的文章
[Zhang, Yiming]的文章
[Wang, Li]的文章
[Gai, Shun]的文章
必应学术
必应学术中相似的文章
[Zhang, Yiming]的文章
[Wang, Li]的文章
[Gai, Shun]的文章
相关权益政策
暂无数据
收藏/分享

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。