DOI QR코드

DOI QR Code

Development of UAV Teleoperation Virtual Environment Based-on GSM Networks and Real Weather Effects

  • AbdElHamid, Amr (College of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics (NUAA)) ;
  • Zong, Peng (Astronautics College, NUAA)
  • Received : 2015.06.02
  • Accepted : 2015.08.05
  • Published : 2015.09.30

Abstract

Future Ground Control Stations (GCSs) for Unmanned Aerial Vehicles (UAVs) teleoperation targets better situational awareness by providing extra motion cues to stimulate the vestibular system. This paper proposes a new virtual environment for long range Unmanned Aerial Vehicle (UAV) control via Non-Line-of-Sight (NLoS) communications, which is based on motion platforms. It generates motion cues for the teleoperator for extra sensory stimulation to enhance the guidance performance. The proposed environment employs the distributed component simulation over GSM network as a simulation platform. GSM communications are utilized as a multi-hop communication network, which is similar to global satellite communications. It considers a UAV mathematical model and wind turbulence effects to simulate a realistic UAV dynamics. Moreover, the proposed virtual environment simulates a Multiple Axis Rotating Device (MARD) as Human Machine Interface (HMI) device to provide a complete delay analysis. The demonstrated measurements cover Graphical User Interface (GUI) capabilities, NLoS GSM communications delay, MARD performance, and different software workload. The proposed virtual environment succeeded to provide visual and vestibular feedbacks for teleoperators via GSM networks. The overall system performance is acceptable relative to other Line-of-Sight (LoS) systems, which promises a good potential for future long range, medium altitude UAV teleoperation researches.

Keywords

References

  1. A. AbdElHamid, and P. Zong, "A Novel Software Simulator Model Based on Active Hybrid Architecture", International Journal of Aerospace Engineering, Vol. 2015, 2015, pp. 19. DOI:10.1155/2015/107301
  2. R. Rodrigues, R. C. B. Sampaio, A. P. Aguiar, and M. Becker, "FVMS Software-in-the-Loop Flight Simulation Experiments: Guidance, Navigation and Control", Proceeding of 2014 Joint Conference on Robotics: SBR-LARS Robotics Symposium and Robocontrol (SBR LARS Robocontrol), San Carlos, Sao Paulo, 2014, pp. 223-228.
  3. S. Zheng, Q. Huang, J. Jin, and J. Han, "Flight Simulator Architecture Development and Implementation", Proceeding of 2009. ICMTMA '09. International Conference on Measuring Technology and Mechatronics Automation, Zhangjiajie, Hunan, 2009, pp. 230-233.
  4. P. Kemao, M. C. Ben, and L. Kai Yew, "Autonomous Flight Control Design for a Small-scale Unmanned Helicopter", in AIAA Guidance, Navigation, and Control Conference, American Institute of Aeronautics and Astronautics, 2011.
  5. S. Tang, X. Lu, and Z. Zheng, "Platform and State Estimation Design of a Small-Scale UAV Helicopter System", International Journal of Aerospace Engineering, Vol. 2013, 2013, pp. 13. DOI:10.1155/2013/524856
  6. Miaobo Dong, Ben M. Cheni, Guowei Cai, and K. Peng, "Development of a Real-time Onboard and Ground Station Software System for a UAV helicopter", Journal of Aerospace Computing, Information, and Communication, Vol. 4, No. 8, 2007, pp. 933-955. https://doi.org/10.2514/1.26408
  7. Y. Fan, Z. Zhang, M. Trinkle, A. D. Dimitrovski, J. B. Song, and H. Li, "A Cross-Layer Defense Mechanism Against GPS Spoofing Attacks on PMUs in Smart Grids", IEEE Transactions on Smart Grid, Vol. PP, No. 99, 2014, pp. 1-10. DOI:10.1109/tsg.2014.2346088
  8. G. Shuping, Z. Zhenghao, M. Trinkle, A. D. Dimitrovski, and L. Husheng, "GPS spoofing based time stamp attack on real time wide area monitoring in smart grid", Proceeding of 2012 IEEE Third International Conference on Smart Grid Communications (SmartGridComm), Tainan, Taiwan, 2012, pp. 300-305.
  9. L. Khoa Duy, N. Hung Duc, D. Ranthumugala, and A. Forrest, "Haptic driving system for surge motion control of underwater remotely operated vehicles", Proceeding of the 6th International Conference on Modelling, Identification & Control (ICMIC), 2014, Melbourne, Australia, pp. 207-212.
  10. F. Ryden, A. Stewart, and H. J. Chizeck, "Advanced telerobotic underwater manipulation using virtual fixtures and haptic rendering", Proceeding of Oceans - San Diego, 2013, pp. 1-8.
  11. A. M. Brandt, and M. B. Colton, "Haptic collision avoidance for a remotely operated quadrotor UAV in indoor environments", Proceeding of IEEE International Conference on Systems Man and Cybernetics (SMC), Istanbul, Turkey, 2010, pp. 2724-2731.
  12. L. Dongjun, A. Franchi, P. R. Giordano, S. Hyoung Il, and H. H. Bulthoff, "Haptic teleoperation of multiple unmanned aerial vehicles over the internet", Proceeding of 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 2011, pp. 1341-1347.
  13. T. M. Lam, M. Mulder, and M. M. van Paassen, "Collision avoidance in UAV tele-operation with time delay", Proceeding of 2007 IEEE International Conference on Systems, Man and Cybernetics, Montreal, QC, 2007, pp. 997-1002.
  14. J. Borenstein, and Y. Koren, "Real-time obstacle avoidance for fast mobile robots in cluttered environments", Proceeding of 1990 IEEE International Conference on Robotics and Automation, Cincinnati, Ohio, 1990, pp. 572-577.
  15. L. Sangyoon, G. Sukhatme, K. Jounghyun, and P. Chan-Mo, "Haptic control of a mobile robot: a user study", Proceeding of 2002. IEEE/RSJ International Conference on Intelligent Robots and Systems, EPFL Lausanne, Switzerland, 2002, pp. 2867-2874.
  16. T. Harald, N. Hans-Gunther, B. Karl, B. John, K. Michael, and B. Heinrich, "MPI Motion Simulator: Development and Analysis of a Novel Motion Simulator", in AIAA Modeling and Simulation Technologies Conference and Exhibit, American Institute of Aeronautics and Astronautics, 2007.
  17. J. Hing, and P. Oh, "Development of an Unmanned Aerial Vehicle Piloting System with Integrated Motion Cueing for Training and Pilot Evaluation", in Unmanned Aircraft Systems, Springer Netherlands, 2009, pp. 3-19.
  18. P. R. Giordano, H. Deusch, J. Lachele, and H. H. Bulthoff, "Visual-vestibular feedback for enhanced situational awareness in teleoperation of UAVs", Proceeding of AHS 66th Annual Forum and Technology Display, South Carolina, 2010.
  19. J. T. Hing and P. Y. Oh, "Mixed reality for unmanned aerial vehicle operations in near Earth environments", Proceeding of 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Taipei, Taiwan, 2010, pp. 2537-2538.
  20. J. M. Teixeira, R. Ferreira, M. Santos, and V. Teichrieb, "Teleoperation Using Google Glass and AR, Drone for Structural Inspection", Proceeding of 2014 XVI Symposium on Virtual and Augmented Reality (SVR), Salvador, Brazil, 2014, pp. 28-36.
  21. Frederick R Carrick, Guido Pagnacco, Elena Oggero, Stephanie Sullivan, Derek Barton, Susan Esposito, Gerry Leisman, and R. Melillo, "The Effects of Whole Body Rotations in the Pitch and Yaw Planes on Postural Stability", Functional Neurology, Rehabilitation, and Ergonomics, Vol. 1, No. 2, 2011, pp. 167-180.
  22. S. Ronald, F. Alia, K. John, and W. Christopher, "A Pilot Spatial Orientation Aiding System", in AIAA 5th ATIO and16th Lighter-Than-Air Sys Tech. and Balloon Systems Conferences, American Institute of Aeronautics and Astronautics, 2005.
  23. J. T. Hing, and P. Y. Oh, "A motion platform integrated uav pilot training and evaluation system for future civilian applications", Proceeding of ASME 2008 Dynamic Systems and Control Conference, Ann Arbor, Michigan, USA, 2008, pp. 447-454.
  24. M. Rauw, FDC 1.2 - A Simulink Toolbox for Flight Dynamics and Control Analysis, 2nd edition, 2001.
  25. L. Manmaker, MATLAB External Interfaces, The MathWorks, 2013.
  26. The MathWorks, Inc., Application Program Interface Guide, Version 5, The MathWorks, Inc., 1998,
  27. E. F. Hogge, B-737 linear autoland simulink model, NASA, Langley Research Center, Hampton, Virginia, USA, Tech. Rep. CR-2004-213021, 2004.
  28. S. Fortunati, A. Farina, F. Gini, A. Graziano, M. S. Greco, and S. Giompapa, "Impact of flight disturbances on airborne radar tracking", IEEE Transactions on Aerospace and Electronic Systems, Vol. 48, No. 3, 2012, pp. 2698-2710. https://doi.org/10.1109/TAES.2012.6237620
  29. D. Moorhouse, and R. Woodcock, US Military Specification MIL-F-8785C, Technical report, US Department of Defense,1980.
  30. The MathWorks, Inc., Dryden Wind Turbulence Model, MATLAB Reference Pages, 2010,
  31. F. Hargrave, Appendixes A: AT Fax/Modem Commands, Wiley-IEEE Press, 2001.
  32. J. Craighead, R. Murphy, J. Burke, and B. Goldiez, "A Survey of Commercial & Open Source Unmanned Vehicle Simulators", Proceeding of IEEE International Conference on Robotics and Automation, Roma, Italy, 2007, pp. 852-857.