干旱区生态环境知识资源中心(Arid): Multi-scale and multi-patch transformer for sandstorm image enhancement

Arid

DOI	10.1016/j.jvcir.2022.103662
	Multi-scale and multi-patch transformer for sandstorm image enhancement
	Liang, Pengwei; Ding, Wenyu; Fan, Lu; Wang, Haoyu; Li, Zihong; Yang, Fan; Wang, Bo; Li, Chongyi
通讯作者	Wang, B
来源期刊	JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION
ISSN	1047-3203
EISSN	1095-9076
出版年	2022
卷号	89
英文摘要	Sandstorm is a meteorological phenomenon common in arid and semi-arid regions. A sandstorm can carry large volumes of sand unexpectedly, which leads to severe color deviations and significantly degraded visibility when an image is taken in such a scenario. However, existing image enhancement methods cannot enhance sandstorm images well due to the challenging degradations and the scarcity of sandstorm training data. In this paper, we propose a Transformer with rotary position embedding to perform sandstorm image enhancement via building multi-scale and multi-patch dependencies. Our key insights in this work are 1) a multi-scale Transformer can globally eliminate the color deviations of sandstorm images via aggregating global information, 2) a multi-patch Transformer can recover local details well via learning the spatial variant degradations, and 3) a U-shape Transformer with rotary position embedding as the core unit of multi-scale and multi-patch Transformer can effectively build the long-range dependencies. We also contribute a real-world Sandstorm Image Enhancement (SIE) dataset including 1,400 sandstorm images with different degrees of degradations and various scenes. Ex-periments performed on synthetic images and real-world sandstorm images demonstrate that our proposed method not only obtains visually pleasing results but also outperforms state-of-the-art methods qualitatively and quantitatively.
英文关键词	Sandstorm image enhancement Transformer Two-stage network Dataset
类型	Article
语种	英语
收录类别	SCI-E
WOS记录号	WOS:000876919900001
WOS关键词	COLOR ; RETINEX
WOS类目	Computer Science, Information Systems ; Computer Science, Software Engineering
WOS研究方向	Computer Science
资源类型	期刊论文
条目标识符	http://119.78.100.177/qdio/handle/2XILL650/393633
推荐引用方式 GB/T 7714	Liang, Pengwei,Ding, Wenyu,Fan, Lu,et al. Multi-scale and multi-patch transformer for sandstorm image enhancement[J],2022,89.
APA	Liang, Pengwei.,Ding, Wenyu.,Fan, Lu.,Wang, Haoyu.,Li, Zihong.,...&Li, Chongyi.(2022).Multi-scale and multi-patch transformer for sandstorm image enhancement.JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION,89.
MLA	Liang, Pengwei,et al."Multi-scale and multi-patch transformer for sandstorm image enhancement".JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION 89(2022).