• Title/Summary/Keyword: Unity engine

Search Result 150, Processing Time 0.022 seconds

A Study on Training System for Fire Prevention based on Virtual Reality (가상현실 기반 화재대응 훈련 시스템에 관한 연구)

  • Song, Eun-Jee
    • Journal of Digital Contents Society
    • /
    • v.17 no.3
    • /
    • pp.189-195
    • /
    • 2016
  • According to the National Statistical Office, the number of fires was the 42,135 items in 2014, it has increased reviews 1203 compare with 2013. In addition, the sum of the property damage 2,560 billion, injured number 1,599 people, it was announced in deaths number 263 people. Although Korea government have announced many fire manuals for fire prevention, the reason that many of the wounded and the dead occurred is because people have recognized fire riskiness in just only head simply from manual. In this paper, the simulation system for prevention of fire based virtual reality is proposed to solve this problems. The people who trained by proposed system can recognize and realize fire riskiness more than fire writing manuals.

Autonomous-Driving Vehicle Learning Environments using Unity Real-time Engine and End-to-End CNN Approach (유니티 실시간 엔진과 End-to-End CNN 접근법을 이용한 자율주행차 학습환경)

  • Hossain, Sabir;Lee, Deok-Jin
    • The Journal of Korea Robotics Society
    • /
    • v.14 no.2
    • /
    • pp.122-130
    • /
    • 2019
  • Collecting a rich but meaningful training data plays a key role in machine learning and deep learning researches for a self-driving vehicle. This paper introduces a detailed overview of existing open-source simulators which could be used for training self-driving vehicles. After reviewing the simulators, we propose a new effective approach to make a synthetic autonomous vehicle simulation platform suitable for learning and training artificial intelligence algorithms. Specially, we develop a synthetic simulator with various realistic situations and weather conditions which make the autonomous shuttle to learn more realistic situations and handle some unexpected events. The virtual environment is the mimics of the activity of a genuine shuttle vehicle on a physical world. Instead of doing the whole experiment of training in the real physical world, scenarios in 3D virtual worlds are made to calculate the parameters and training the model. From the simulator, the user can obtain data for the various situation and utilize it for the training purpose. Flexible options are available to choose sensors, monitor the output and implement any autonomous driving algorithm. Finally, we verify the effectiveness of the developed simulator by implementing an end-to-end CNN algorithm for training a self-driving shuttle.

Metaverse Based Virtual Reality Space Consulting Service Platform Research and Development (메타버스 기반의 가상 현실 공간 상담 서비스 플랫폼 연구 및 개발)

  • Kim, Jehyun;Oh, Seok-hee
    • Journal of the Semiconductor & Display Technology
    • /
    • v.20 no.4
    • /
    • pp.130-133
    • /
    • 2021
  • Recently, as the expansion of the metaverse accelerated due to the spread of the non-face-to-face trend after the COVID-19 pandemic, various metaverse platforms using it have appeared. In this study, we propose research and development of a virtual reality spatial psychological counseling service platform utilizing the advantages of metaverse. A counseling service platform was developed through virtual reality hardware including Unity 3D game engine and Head Mounted Display. Counseling participants create and participate in their own avatars, and counseling facilitators respond to the situation and environment of the counseling target in various virtual environments. It was attempted to improve the efficiency of the counseling service by allowing the space and counselor avatar to be selected. Furthermore, various interactions were implemented, and development was carried out so that it could be extended and utilized for social activities such as group counseling and general meetings and presentations. In the future, through additional research and development, we will prove the practical effectiveness of the psychological counseling service platform developed by conducting clinical trials under the support of psychological counseling experts and participation in actual counseling.

Development of Head Mounted Display Interface System for Controlling Wireless Capsule Endoscope (무선 캡슐내시경 조종을 위한 머리부착형 디스플레이 인터페이스 시스템의 개발)

  • Young-Eun, Hwang;Young-Don, Son
    • Journal of Biomedical Engineering Research
    • /
    • v.43 no.6
    • /
    • pp.417-423
    • /
    • 2022
  • The present study proposed a new interface system for capsule endoscopy by using head mounted display (HMD) device, which can control the orientation of the capsule endoscope with electromagnetic actuator (EMA) system. The orientation information of the HMD user was detected by the gyroscope sensor built into the device and then calculated to as an angle increment using Unity Engine compiler. The measured angle changes from the HMD were converted to the current values of the corresponding coils to be changed in the EMA system. Two experiments were designed to measure the accuracy and the intuitiveness of the HMD interface system. In the angle accuracy measurement, the capsule endoscope driven by HMD interface system showed the averaged errors of 0.68 degrees horizontally and 1.001 degrees vertically for given test angles. In the intuitiveness measurement, HMD interface system showed 1.33 times faster manipulation speed rather than the joystick interface system. In this respect, the HMD interface system for capsule endoscopy was expected to improve the overall diagnostic environment while maintaining comfort of patients and clinicians.

Development of Plug-n-Play Automation System for Machine Tending through Digital Twin (디지털 트윈을 활용한 Plug-n-Play 머신텐딩 자동화 시스템 개발)

  • Park, Yong-Keun;Kim, Sujong;Um, Jumyung
    • The Journal of Society for e-Business Studies
    • /
    • v.25 no.4
    • /
    • pp.143-154
    • /
    • 2020
  • With the increasing trend of making manufacturing system intelligent and autonomous, the introduction of robot-assist automation, like machine tending system for automated operation of CNC machine tools, is being actively carried out at many industrial sites. Most important part of this intelligent system to install machine tending system, is interface programming between the CNC machine tools and the industrial robot. Despite this importance, however, the machine tending system has many setup problems. it is necessary for difficult re-program of both controllers whenever a new CNC machine tool or robot is introduced. And, the helps of external engineers is required even though trivial changes due to the complex structure of the machine tending system. Authors of this paper introduces the integrated system of the interface between heterogeneous CNC machine tools and industrial robots. In addition, the digital twin implemented inside the machine tool controller enable shop-floor operators to change the interface programming easily. To implement this system, an integrated development environment for 1) an intelligent HMI platform that provide standardized interfaces to heterogeneous CNC machine tools and 2) a robot platform developing application software of various robots, was established. For easy un-tact environment, this paper explain the development of 3) a game-engine based web program of controlling and monitoring machine tending system remotely.

The Development of VR based Application for Realistic Disaster Prevention Training (현실감 있는 재난재해 예방 교육을 위한 VR 기반 앱 개발)

  • Kim, Taehoon;Youn, Junhee
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.19 no.12
    • /
    • pp.287-293
    • /
    • 2018
  • The Korean peninsula has been known as an area that is free of volcanic disasters. However, recent observations and research results of volcanoes in Far East Asia, including Baedu Mountain and Japanese volcanoes, show that the Korean peninsula is no longer a safe area from volcanic disasters. Since 2012, the Korean government has been developing an IT-based construction technology, VDRS (Volcanic Disaster Response System), for effective volcanic disaster response system. The main users of VDRS are public officers in central or local governments. However, most of them have little experience and knowledge about volcanic disasters. Therefore, it is essential to develop education contents and implement training on volcanic disaster response for effective response in a real disaster situation. In this paper, we deal with the development of a mobile application based on virtual reality (VR) for realistic volcanic disaster response training. The objectives of training are the delivery of knowledge and experience for volcanic disasters. First, VR contents were generated based on spatial information. A 3D model was constructed based on a Digital Elevation Model (DEM), and visualization models for meterological effects and various volcanic disaster diffusion effects were implemented for the VR contents. Second, the mobile application for the volcanic disaster response training was implemented. A 12-step story board is proposed for volcanic disaster experience. The application was developed with the Unity3D engine based on the proposed story board to deliver knowledge of various volcanic disasters (volcanic ash, pyroclastic flows, volcanic mudflow etc.). The results of this paper will be used for volcanic disaster response and prevention training and for more realistic training linked with augmented reality technology in the future.

A Study on Virtual Environment Platform for Autonomous Tower Crane (타워크레인 자율화를 위한 가상환경 플랫폼 개발에 관한 연구)

  • Kim, Myeongjun;Yoon, Inseok;Kim, Namkyoun;Park, Moonseo;Ahn, Changbum;Jung, Minhyuk
    • Korean Journal of Construction Engineering and Management
    • /
    • v.23 no.4
    • /
    • pp.3-14
    • /
    • 2022
  • Autonomous equipment requires a large amount of data from various environments. However, it takes a lot of time and cost for an experiment in a real construction sites, which are difficulties in data collection and processing. Therefore, this study aims to develop a virtual environment for autonomous tower cranes technology development and validation. The authors defined automation functions and operation conditions of tower cranes with three performance criteria: operational design domain, object and event detection and response, and minimum functional conditions. Afterward, this study developed a virtual environment for learning and validation for autonomous functions such as recognition, decision making, and control using the Unity game engine. Validation was conducted by construction industry experts with a fidelity which is the representative matrix for virtual environment assessment. Through the virtual environment platform developed in this study, it will be possible to reduce the cost and time for data collection and technology development. Also, it is also expected to contribute to autonomous driving for not only tower cranes but also other construction equipment.

Study on Development of Digital Ocean Information Contents for Climate Change and Environmental Education : Focusing on the 3D Simulator Experiencing Sea Level Rise (기후변화 환경교육을 위한 디지털 해양정보 콘텐츠 개발 방안 연구 - 해수면 상승 체험 3D 시뮬레이터를 중심으로 -)

  • Jin-Hwa Doo;Hong-Joo Yoon;Cheol-Young Lee
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.18 no.5
    • /
    • pp.953-964
    • /
    • 2023
  • Climate change is undeniably the most urgent challenge that humanity faces today. Despite this, the level of public awareness and understanding of climate change remains insufficient, indicating a need for more proactive education and the development of supportive content. In particular, it is crucial to intensify climate change education during elementary and secondary schooling when values and ethical consciousness begin to form. However, there is a significant lack of age-appropriate, experiential educational content. To address this, our study has developed an innovative 3D simulator, enabling learners to indirectly experience the effects of climate change, specifically sea-level rise. This simulator considers not only sea-level rise caused by climate change but also storm surges, which is a design based on the analysis of long-term wave observation big data. To make the simulator accessible and engaging for students, we utilized the 'Unity' game engine. We further propose using this simulator as a part of a comprehensive educational program on climate change.

Interface Application of a Virtual Assistant Agent in an Immersive Virtual Environment (몰입형 가상환경에서 가상 보조 에이전트의 인터페이스 응용)

  • Giri Na;Jinmo Kim
    • Journal of the Korea Computer Graphics Society
    • /
    • v.30 no.1
    • /
    • pp.1-10
    • /
    • 2024
  • In immersive virtual environments including mixed reality (MR) and virtual reality (VR), avatars or agents, which are virtual humans, are being studied and applied in various ways as factors that increase users' social presence. Recently, studies are being conducted to apply generative AI as an agent to improve user learning effects or suggest a collaborative environment in an immersive virtual environment. This study proposes a novel method for interface application of a virtual assistant agent (VAA) using OpenAI's ChatGPT in an immersive virtual environment including VR and MR. The proposed method consists of an information agent that responds to user queries and a control agent that controls virtual objects and environments according to user needs. We set up a development environment that integrates the Unity 3D engine, OpenAI, and packages and development tools for user participation in MR and VR. Additionally, we set up a workflow that leads from voice input to the creation of a question query to an answer query, or a control request query to a control script. Based on this, MR and VR experience environments were produced, and experiments to confirm the performance of VAA were divided into response time of information agent and accuracy of control agent. It was confirmed that the interface application of the proposed VAA can increase efficiency in simple and repetitive tasks along with user-friendly features. We present a novel direction for the interface application of an immersive virtual environment through the proposed VAA and clarify the discovered problems and limitations so far.

Optimal deployment of sonobuoy for unmanned aerial vehicles using reinforcement learning considering the target movement (표적의 이동을 고려한 강화학습 기반 무인항공기의 소노부이 최적 배치)

  • Geunyoung Bae;Juhwan Kang;Jungpyo Hong
    • The Journal of the Acoustical Society of Korea
    • /
    • v.43 no.2
    • /
    • pp.214-224
    • /
    • 2024
  • Sonobuoys are disposable devices that utilize sound waves for information gathering, detecting engine noises, and capturing various acoustic characteristics. They play a crucial role in accurately detecting underwater targets, making them effective detection systems in anti-submarine warfare. Existing sonobuoy deployment methods in multistatic systems often rely on fixed patterns or heuristic-based rules, lacking efficiency in terms of the number of sonobuoys deployed and operational time due to the unpredictable mobility of the underwater targets. Thus, this paper proposes an optimal sonobuoy placement strategy for Unmanned Aerial Vehicles (UAVs) to overcome the limitations of conventional sonobuoy deployment methods. The proposed approach utilizes reinforcement learning in a simulation-based experimental environment that considers the movements of the underwater targets. The Unity ML-Agents framework is employed, and the Proximal Policy Optimization (PPO) algorithm is utilized for UAV learning in a virtual operational environment with real-time interactions. The reward function is designed to consider the number of sonobuoys deployed and the cost associated with sound sources and receivers, enabling effective learning. The proposed reinforcement learning-based deployment strategy compared to the conventional sonobuoy deployment methods in the same experimental environment demonstrates superior performance in terms of detection success rate, deployed sonobuoy count, and operational time.