Fig. 1. Method for creating sequential image samples using affined transformation.
Fig. 2. Left: Difference images between real images, Right:Difference images between affine transformed images.
Fig. 3. Internal structure of Convolutional LSTM model.
Fig. 4. Convolutional LSTM-based regression model for transformation parameters.
Fig. 5. Regression results of transformed images using sub-pixel interpolation.
Table 1. Regression results of convolutional LSTM model according to the range of translation parameters
References
- Feipeng Zhu., Pengxiang Bai, Jingbin Zhang, Dong Lei, and Xiaoyuan He, "Measurement of true stress-strain curves and evolution of plastic zone of low carbon steel under uniaxial tension using digital image correlation" Optics and Lasers in Engineering, Vol. 65, pp. 81-88, Feb. 2015. https://doi.org/10.1016/j.optlaseng.2014.06.013
- H. G. Min, D. J. Kang, K. J. Kim, and J. H. Park, "New Non-Contact Measurement Method of Deformation at Tensile Test of Thin Film via Digital Image Correlation Technique", International Journal of Precision Engineering and Manufacturing, Vol. 18, no. 11, pp. 1509-1517, Jun. 2017. https://doi.org/10.1007/s12541-017-0179-0
- Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. of the IEEE, Vol. 86, pp. 2278-2324, Nov. 1998. https://doi.org/10.1109/5.726791
- S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural Computation, Vol. 9, no. 8, pp. 1735-1780, Mar. 1997. https://doi.org/10.1162/neco.1997.9.8.1735
- Xingjian Shi and Zhourong Chen, "Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting" Computer Vision and Pattern Recognition, 2015. Proceedings CVPR '15, Computer Society Conference on, Sep. 2015.
- Ji, S., Xu, W., Yang, M., Yu, K., "3D Convolutional Neural Networks for Human Action Recognition", IEEE transactions on pattern analysis and machine intelligence, Vol. 35, no. 1, pp. 221-231. Sep. 2013. https://doi.org/10.1109/TPAMI.2012.59
- Wenxin Hu, and Hong Miao. "Sub-pixel displacement algorithm in temporal sequence digital image correlation based on correlation coefficient weighted fitting", Optics and Lasers in Engineering, Vol. 110, pp. 410-414, Nov. 2018. https://doi.org/10.1016/j.optlaseng.2018.04.006
- Huafeng Li, Xinkun Liu, Zhengtao Yu, and Yafei Zhang, "Performance improvement scheme of multifocus image fusion derived by difference images", Signal Processing, Vol. 128, pp. 474-493, Nov. 2016. https://doi.org/10.1016/j.sigpro.2016.05.015
- S. Lambert-Lacroix and L. Zwald, "Robust regression through the Hubers criterion and adaptive lasso penalty", Electronic Journal of Statistics, Vol. 5, pp. 1015-1053, 2011. https://doi.org/10.1214/11-EJS635
- W. Yin, H. Schutze, "ABCNN: Attention-Based Convoluti onal Neural Network for Modeling Sentence Pairs", Computation and Language, Dec. 2015.
- F. Wang and M. Jiang, "Residual Attention Network for Image Classification", Computer Vision and Pattern Recognition, 2017. Proceedings CVPR '17, Computer Society Conference on, Sep. 2017.
- Jiasen Lu, Caiming Xiong, Devi Parikh and Richard Socher, "Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning", Computer Vision and Pattern Recognition, 2016. Proceedings CVPR '16, Computer Society Conference on, Dec. 2016.
- Ilya Sutskever, Oriol Vinyals and Quoc V. Le, "Sequence to Sequence Learning with Neural Networks", Computer Vision and Pattern Recognition, 2014. Proceedings CVPR '14, Computer Society Conference on, Sep. 2014.