CostNet: A Concise Overpass Spatiotemporal Network for Predictive Learning

ISPRS International Journal of Geo-Information

Qingjun Liu¹  Shaojie Li²  Fengzhen Sun²  Shaohua Wang³  Lixin Zhou⁴ 

[1] 360 Security Technology Inc., Beijing 100015, China;Future GIS Laboratory, SuperMap Software Co., Ltd., Beijing 100015, China;Institute of Geographic Sciences and Natural Resources Research, China Academy of Science, Beijing 100101, China;School of Software and Microelectronics, Peking University, Beijing 102600, China;

关键词: spatiotemporal network;    predictive learning;    horizon LSTM;    vertical structure;    encoder-decoder architecture;   

DOI  :  10.3390/ijgi9040209

来源: DOAJ

【 摘 要 】

Predicting the futures from previous spatiotemporal data remains a challenging topic. There have been many previous works on predictive learning. However, mainstream models suffer from huge memory usage or the gradient vanishing problem. Enlightened by the idea from the resnet, we propose CostNet, a novel recursive neural network (RNN)-based network, which has a horizontal and vertical cross-connection. The core of this network is a concise unit, named Horizon LSTM with a fast gradient transmission channel, which can extract spatial and temporal representations effectively to alleviate the gradient propagation difficulty. In the vertical direction outside of the unit, we add overpass connections from unit output to the bottom layer, which can capture the short-term dynamics to generate precise predictions. Our model achieves better prediction results on moving-mnist and radar datasets than the state-of-the-art models.

【 授权许可】

Unknown