• Title/Summary/Keyword: 3D autonomous system

Search Result 152, Processing Time 0.026 seconds

Unsupervised Monocular Depth Estimation Using Self-Attention for Autonomous Driving (자율주행을 위한 Self-Attention 기반 비지도 단안 카메라 영상 깊이 추정)

  • Seung-Jun Hwang;Sung-Jun Park;Joong-Hwan Baek
    • Journal of Advanced Navigation Technology
    • /
    • v.27 no.2
    • /
    • pp.182-189
    • /
    • 2023
  • Depth estimation is a key technology in 3D map generation for autonomous driving of vehicles, robots, and drones. The existing sensor-based method has high accuracy but is expensive and has low resolution, while the camera-based method is more affordable with higher resolution. In this study, we propose self-attention-based unsupervised monocular depth estimation for UAV camera system. Self-Attention operation is applied to the network to improve the global feature extraction performance. In addition, we reduce the weight size of the self-attention operation for a low computational amount. The estimated depth and camera pose are transformed into point cloud. The point cloud is mapped into 3D map using the occupancy grid of Octree structure. The proposed network is evaluated using synthesized images and depth sequences from the Mid-Air dataset. Our network demonstrates a 7.69% reduction in error compared to prior studies.

A study on the development of a ship-handling simulation system based on actual maritime traffic conditions (실제 해상교통상황 기반 선박조종 시뮬레이션 시스템 개발에 관한 연구)

  • Eunkyu Lee;Jae-Seok Han;Kwang-Hyun Ko;Eunbi Park;Seong-Phil Ann
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • 2022.06a
    • /
    • pp.306-307
    • /
    • 2022
  • Recently, in the process of developing, verifying, and upgrading the e-Navigation service and autonomous navigation system, there is an increasing demand for inter-working with a ship-handling simulator that can simulate actual maritime traffic conditions. In this paper, to develop a ship-handling simulation system based on actual maritime traffic conditions, a simulation server was built, received information on the actual maritime traffic conditions from the e-Navigation linkage system, and changed to information for operating the ship-handling simulator. In order to provide simulation images to users, 3D shape modeling for trade ports, coastal ports in Korea and major type of ship were performed. The developed system will be used for the advancement of e-Navigation service, development and verification of autonomous navigation systems, by enabling simultaneous processing of more than 10,000 ships and allowing users to simulate actual maritime traffic conditions in the desired area.

  • PDF

Mission Management Technique for Multi-sensor-based AUV Docking

  • Kang, Hyungjoo;Cho, Gun Rae;Kim, Min-Gyu;Lee, Mun-Jik;Li, Ji-Hong;Kim, Ho Sung;Lee, Hansol;Lee, Gwonsoo
    • Journal of Ocean Engineering and Technology
    • /
    • v.36 no.3
    • /
    • pp.181-193
    • /
    • 2022
  • This study presents a mission management technique that is a key component of underwater docking system used to expand the operating range of autonomous underwater vehicle (AUV). We analyzed the docking scenario and AUV operating environment, defining the feasible initial area (FIA) level, event level, and global path (GP) command to improve the rate of docking success and AUV safety. Non-holonomic constraints, mounted sensor characteristic, AUV and mission state, and AUV behavior were considered. Using AUV and docking station, we conducted experiments on land and at sea. The first test was conducted on land to prevent loss and damage of the AUV and verify stability and interconnection with other algorithms; it performed well in normal and abnormal situations. Subsequently, we attempted to dock under the sea and verified its performance; it also worked well in a sea environment. In this study, we presented the mission management technique and showed its performance. We demonstrated AUV docking with this algorithm and verified that the rate of docking success was higher compared to those obtained in other studies.

Particle Filter Based Robust Multi-Human 3D Pose Estimation for Vehicle Safety Control (차량 안전 제어를 위한 파티클 필터 기반의 강건한 다중 인체 3차원 자세 추정)

  • Park, Joonsang;Park, Hyungwook
    • Journal of Auto-vehicle Safety Association
    • /
    • v.14 no.3
    • /
    • pp.71-76
    • /
    • 2022
  • In autonomous driving cars, 3D pose estimation can be one of the effective methods to enhance safety control for OOP (Out of Position) passengers. There have been many studies on human pose estimation using a camera. Previous methods, however, have limitations in automotive applications. Due to unexplainable failures, CNN methods are unreliable, and other methods perform poorly. This paper proposes robust real-time multi-human 3D pose estimation architecture in vehicle using monocular RGB camera. Using particle filter, our approach integrates CNN 2D/3D pose measurements with available information in vehicle. Computer simulations were performed to confirm the accuracy and robustness of the proposed algorithm.

Uplink Resource Management Scheme for Multiple QoS Traffics in cdma2000 type Networks: Modified Weighted G-Fair Scheduler with RoT Filling (cdma2000-type 네트워크의 역방향 링크에서의 다중 QoS 서비스 보장을 위한 자원 관리 기술: Modified Weighted G-Fair 스케줄러)

  • 기영민;김은선;김동구
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.29 no.7A
    • /
    • pp.786-793
    • /
    • 2004
  • Autonomous data rate control scheme of current IxEV-DO uplink networks can not supper the various QoS requirements of heterogeneous traffics nor hold rise-over-thermal OtoT) constraints. In this paper, an uplink resource management scheme called the modified weighted g-fair (MWGF) scheduler with RoT filling is proposed and evaluated for heterogeneous traffics in cdma2000 type uplink networks. The proposed scheme belongs to a family of centralized resource management schemes and offers QoS guarantee by using priority metrics as well as lower system loading by holding RoT constraints using RoT filling method. With some case-study simulations, the proposed algorithms shows lower average delays of real time users compared to that of autonomous rate control by 29 - 40 %. It also shows the 1.0 - 1.3 dB lower received RoT level than autonomous rate control schemes, leading to lower network loading.

Implementation of Path Finding Method using 3D Mapping for Autonomous Robotic (3차원 공간 맵핑을 통한 로봇의 경로 구현)

  • Son, Eun-Ho;Kim, Young-Chul;Chong, Kil-To
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.14 no.2
    • /
    • pp.168-177
    • /
    • 2008
  • Path finding is a key element in the navigation of a mobile robot. To find a path, robot should know their position exactly, since the position error exposes a robot to many dangerous conditions. It could make a robot move to a wrong direction so that it may have damage by collision by the surrounding obstacles. We propose a method obtaining an accurate robot position. The localization of a mobile robot in its working environment performs by using a vision system and Virtual Reality Modeling Language(VRML). The robot identifies landmarks located in the environment. An image processing and neural network pattern matching techniques have been applied to find location of the robot. After the self-positioning procedure, the 2-D scene of the vision is overlaid onto a VRML scene. This paper describes how to realize the self-positioning, and shows the overlay between the 2-D and VRML scenes. The suggested method defines a robot's path successfully. An experiment using the suggested algorithm apply to a mobile robot has been performed and the result shows a good path tracking.

Current Status and Development Direction of Advanced Air Mobility ICTs (Advanced Air Mobility ICT 기술 현황 및 발전 방향)

  • B.J. Oh;M.S. Lee;B.K. Kim;Y.J. Jeong;Y.J. Lim;C.D. Lim
    • Electronics and Telecommunications Trends
    • /
    • v.38 no.3
    • /
    • pp.1-10
    • /
    • 2023
  • In this study, the status of global advanced air mobility (AAM) was investigated to derive information and communications technologies (ICTs) that should be prepared according to directions of domestic AAM development. AAM is an urban air traffic system for moving from city to city by electric vertical take-off and landing or personal aircraft. It is expected to establish a three-dimensional air traffic system that can solve ground traffic congestion caused by the rapid global urbanization. With the full-scale commercialization of AAM solutions, high-density air traffic is expected, and with the advent of the personal air vehicle (PAV), the flight space usage is expected to expand. Therefore, it is necessary to develop a safe AAM service through early research on core ICTs for autonomous flight.

3-D Hetero-Integration Technologies for Multifunctional Convergence Systems

  • Lee, Kang-Wook
    • Journal of the Microelectronics and Packaging Society
    • /
    • v.22 no.2
    • /
    • pp.11-19
    • /
    • 2015
  • Since CMOS device scaling has stalled, three-dimensional (3-D) integration allows extending Moore's law to ever high density, higher functionality, higher performance, and more diversed materials and devices to be integrated with lower cost. 3-D integration has many benefits such as increased multi-functionality, increased performance, increased data bandwidth, reduced power, small form factor, reduced packaging volume, because it vertically stacks multiple materials, technologies, and functional components such as processor, memory, sensors, logic, analog, and power ICs into one stacked chip. Anticipated applications start with memory, handheld devices, and high-performance computers and especially extend to multifunctional convengence systems such as cloud networking for internet of things, exascale computing for big data server, electrical vehicle system for future automotive, radioactivity safety system, energy harvesting system and, wireless implantable medical system by flexible heterogeneous integrations involving CMOS, MEMS, sensors and photonic circuits. However, heterogeneous integration of different functional devices has many technical challenges owing to various types of size, thickness, and substrate of different functional devices, because they were fabricated by different technologies. This paper describes new 3-D heterogeneous integration technologies of chip self-assembling stacking and 3-D heterogeneous opto-electronics integration, backside TSV fabrication developed by Tohoku University for multifunctional convergence systems. The paper introduce a high speed sensing, highly parallel processing image sensor system comprising a 3-D stacked image sensor with extremely fast signal sensing and processing speed and a 3-D stacked microprocessor with a self-test and self-repair function for autonomous driving assist fabricated by 3-D heterogeneous integration technologies.

3D LIDAR Based Vehicle Localization Using Synthetic Reflectivity Map for Road and Wall in Tunnel

  • Im, Jun-Hyuck;Im, Sung-Hyuck;Song, Jong-Hwa;Jee, Gyu-In
    • Journal of Positioning, Navigation, and Timing
    • /
    • v.6 no.4
    • /
    • pp.159-166
    • /
    • 2017
  • The position of autonomous driving vehicle is basically acquired through the global positioning system (GPS). However, GPS signals cannot be received in tunnels. Due to this limitation, localization of autonomous driving vehicles can be made through sensors mounted on them. In particular, a 3D Light Detection and Ranging (LIDAR) system is used for longitudinal position error correction. Few feature points and structures that can be used for localization of vehicles are available in tunnels. Since lanes in the road are normally marked by solid line, it cannot be used to recognize a longitudinal position. In addition, only a small number of structures that are separated from the tunnel walls such as sign boards or jet fans are available. Thus, it is necessary to extract usable information from tunnels to recognize a longitudinal position. In this paper, fire hydrants and evacuation guide lights attached at both sides of tunnel walls were used to recognize a longitudinal position. These structures have highly distinctive reflectivity from the surrounding walls, which can be distinguished using LIDAR reflectivity data. Furthermore, reflectivity information of tunnel walls was fused with the road surface reflectivity map to generate a synthetic reflectivity map. When the synthetic reflectivity map was used, localization of vehicles was able through correlation matching with the local maps generated from the current LIDAR data. The experiments were conducted at an expressway including Maseong Tunnel (approximately 1.5 km long). The experiment results showed that the root mean square (RMS) position errors in lateral and longitudinal directions were 0.19 m and 0.35 m, respectively, exhibiting precise localization accuracy.

A Study on the Development of 3D Virtual Reality Campus Tour System for the Adaptation of University Life to Freshmen in Non-face-to-face Situation - Autonomous Operation of Campus Surrounding Environment and University Information Guide Screen Design Using Visual Focus Movement - (비대면 상황에서 신입생 대학생활적응을 위한 3차원 가상현실 캠퍼스 투어시스템 개발연구 - 시야초점의 움직임을 활용한 캠퍼스주변 환경의 자유로운 이동과 대학정보안내화면 GUI설계 -)

  • Lim, Jang-Hoon
    • Journal of Information Technology Applications and Management
    • /
    • v.28 no.3
    • /
    • pp.59-75
    • /
    • 2021
  • This study aims to establish a foundation for autonomous driving on campus and communication of abundant university information in the HCI environment in a VR environment where college freshmen can freely travel around campus facilities. The purpose of this study is to develop a three-dimensional VR-style campus tour system to establish a media environment to provide abundant university information guidance services to freshmen in non-face-to-face situations. This study designed a three-dimensional virtual reality campus tour system to solve the problem of discontinuity in which VR360 filming space does not lead to space like reality, and to solve many problems of expertise in VR technology by constructing an integrated production environment of tour system. We aim to solve the problem of inefficiency, which requires a large amount of momentum in virtual space, by constructing a GUI that utilizes the motion of the field of view focus. The campus environment was designed as a three-dimensional virtual reality using a three-dimensional graphic design. In non-face-to-face situations, college freshmen freely transformed the HMD VR device, smartphone, FPS operation mode of the gyroscope sensor. The design elements of the three-dimensional virtual reality campus tour system were classified as ①Visualization of factual experiences, ②Continuity of space movement, ③Operation, automatic operation mode, ④Natural landscape animation, ⑤Animation according to wind direction, ⑥Actual space movement mode, ⑦Informatization of spatial understanding, ⑧GUI by experience environment, ⑨Text GUI by building, ⑩VR360, 3D360 Studio Environment, ⑪Three-dimensional virtual space coupling block module, ⑫3D360-3D Virtual Space Transmedia Zone, ⑬Transformable GUI(VR Device Dual Viewer-Gyro Sensor Full Viewer-FPS Operation Viewer) and an integrated production environment was established with each element. It is launched online (http://vautu.com/u1) by constructing a GUI for free driving mode and college information screens to adapt to college life for freshmen, and designing an environment that can be used simultaneously by current media such as PCs, Android, and iPads. Therefore, it conducted user research, held a development presentation, a forum on excellence in university innovation support projects, and applied it as a system on the website of a particular university. College freshmen will be able to experience university information directly from the web and app to the virtual reality campus environment.