Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Baseball Game Analysis Method Using Broadcast Video

중계 영상을 활용한 야구 경기 분석 방법

  • Son, Jong-Woong (Dept. of Electronics and Information Engineering, Korea Aerospace University) ;
  • Lee, Myeong-jin (Dept. of Electronics and Information Engineering, Korea Aerospace University)
  • 손종웅 (한국항공대학교 항공전자정보공학과) ;
  • 이명진 (한국항공대학교 항공전자정보공학과)
  • Received : 2020.04.02
  • Accepted : 2020.05.25
  • Published : 2020.07.30
Download PDF
⟨ Previous Next ⟩

Abstract

Analyzing baseball games using sensors such as radars or riders is expensive. In this paper, we propose an algorithm to detect pitch shots and hit shots using baseball video and to generate ball trajectories within hit shots using camera movement. After the pitch shot and the hit shot detection using object detection and optical flow, we generate the transformation relationship between frames and ball locations in the frame, and calculates the ball trajectory. The performance of the proposed method is evaluated for three KBO baseball video sequences, and the detection accuracy and detection rate of pitch shot and hit shot were within 89-95 [%], and the average error for shot range was 13.6[m], The direction error was 7.5° and foul classification accuracy was 98.6%.

레이더나 라이더 센서를 활용한 야구 경기 분석은 많은 비용이 요구된다. 본 논문에서는 중계 비디오에서 피치 샷과 타구 샷을 검출하고, 카메라의 움직임 기반 타구 궤적 생성 알고리즘을 제안한다. 제안하는 알고리즘은 객체 검출과 옵티컬 플로우 기반 피치 샷과 타구 샷 검출 이후, 프레임 간 변환 관계를 통해 프레임 내 타구 위치와 타구 궤적을 계산한다. 제안 방법은 KBO 중계 영상 시퀀스 3개에 대해 성능을 평가하였고 피치 샷과 타구 샷 검출 정확도와 검출률은 89-95[%] 이내의 성능을 보였으며, 평균 타구 위치 거리차이는 13.6[m], 방향 차이 7.5°, 파울 분류 정확도 98.6%의 성능을 보였다.

Keywords

References

  1. Major league baseball statcast leaderboard, http://m.mlb.com/statcast/leaderboard#exit-velo,r,2019 (accessed Feb. 11, 2020).
  2. H.-C. Shih, "A survey of content-aware video analysis for sports," IEEE Transactions on Circuits and Systems for Video Technology, Vol.28, No.5, pp. 1212-1231, 2017. https://doi.org/10.1109/tcsvt.2017.2655624
  3. C.-H. Liang, et al., "Baseball event detection using game-specific feature sets and rules," IEEE International Symposium on Circuits and Systems, pp. 3829-3832, 2005.
  4. Y.-F. Huang and L.-H. Tung, "Semantic scene detection system for baseball videos," International Journal of Digital Content Technology and Its Applications (JDCTA), Vol.5, No.9, 2011.
  5. S. Tippaya, et al., "Multi-modal visual features-based video shot boundary detection," IEEE Access, Vol.5, pp 12563-12575, 2017. https://doi.org/10.1109/ACCESS.2017.2717998
  6. Z. Rasheed, and M. Shah, "Scene detection in Hollywood movies and TV shows," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol.2, pp. 11-343, 2003.
  7. I. U. Haq, et al., "Movie scene segmentation using object detection and set theory," International Journal of Distributed Sensor Networks, Vol.15, No.6, 2019.
  8. Z.-M. Lu and Y. Shi, "Fast video shot boundary detection based on SVD pattern mathcing," IEEE Transactions on Image processing, Vol.22, No.12, pp 5136-5145, 2013. https://doi.org/10.1109/TIP.2013.2282081
  9. J. Sun and Y. Wan, "A novel metric for efficient video shot boundary detection," IEEE Visual Communications and Image Processing Conference, pp. 45-48, 2014.
  10. M.-H. Hung and C.-H. Hsieh, "Event detection of broadcast baseball videos," IEEE Transactions on Circuits and Systems for Video Technology, Vol.18, No.12, pp. 1713-1726, 2008. https://doi.org/10.1109/TCSVT.2008.2004934
  11. P. Chang, M. Han and Y. Gong, "Extract highlights from baseball game video with hidden Markov models," Proceedings. International Conference on Image Processing, Rochester, NY, USA, 2002.
  12. J. Redmon and A. Farhadi, "Yolov3: An incremental improvement," arXiv preprint arXiv:1804.02767, 2018.
  13. G. Farneback, "Two-frame motion estimation based on polynomial expansion," Scandinavian conference on Image anaysis, pp. 363-370, 2003.