• Title/Summary/Keyword: 2020 vision

Search Result 343, Processing Time 0.024 seconds

Aerial Object Detection and Tracking based on Fusion of Vision and Lidar Sensors using Kalman Filter for UAV

  • Park, Cheonman;Lee, Seongbong;Kim, Hyeji;Lee, Dongjin
    • International journal of advanced smart convergence
    • /
    • v.9 no.3
    • /
    • pp.232-238
    • /
    • 2020
  • In this paper, we study on aerial objects detection and position estimation algorithm for the safety of UAV that flight in BVLOS. We use the vision sensor and LiDAR to detect objects. We use YOLOv2 architecture based on CNN to detect objects on a 2D image. Additionally we use a clustering method to detect objects on point cloud data acquired from LiDAR. When a single sensor used, detection rate can be degraded in a specific situation depending on the characteristics of sensor. If the result of the detection algorithm using a single sensor is absent or false, we need to complement the detection accuracy. In order to complement the accuracy of detection algorithm based on a single sensor, we use the Kalman filter. And we fused the results of a single sensor to improve detection accuracy. We estimate the 3D position of the object using the pixel position of the object and distance measured to LiDAR. We verified the performance of proposed fusion algorithm by performing the simulation using the Gazebo simulator.

Vision Sensor and Deep Learning-based Around View Monitoring System for Ship Berthing (비전 센서 및 딥러닝 기반 선박 접안을 위한 어라운드뷰 모니터링 시스템)

  • Kim, Hanguen;Kim, Donghoon;Park, Byeolteo;Lee, Seung-Mok
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.15 no.2
    • /
    • pp.71-78
    • /
    • 2020
  • This paper proposes vision sensors and deep learning-based around view monitoring system for ship berthing. Ship berthing to the port requires precise relative position and relative speed information between the mooring facility and the ship. For ships of Handysize or higher, the vesselships must be docked with the help of pilots and tugboats. In the case of ships handling dangerous cargo, tug boats push the ship and dock it in the port, using the distance and velocity information receiving from the berthing aid system (BAS). However, the existing BAS is very expensive and there is a limit on the size of the vessel that can be measured. Also, there is a limitation that it is difficult to measure distance and speed when there are obstacles near the port. This paper proposes a relative distance and speed estimation system that can be used as a ship berthing assist system. The proposed system is verified by comparing the performance with the existing laser-based distance and speed measurement system through the field tests at the actual port.

Autonomous vision-based damage chronology for spatiotemporal condition assessment of civil infrastructure using unmanned aerial vehicle

  • Mondal, Tarutal Ghosh;Jahanshahi, Mohammad R.
    • Smart Structures and Systems
    • /
    • v.25 no.6
    • /
    • pp.733-749
    • /
    • 2020
  • This study presents a computer vision-based approach for representing time evolution of structural damages leveraging a database of inspection images. Spatially incoherent but temporally sorted archival images captured by robotic cameras are exploited to represent the damage evolution over a long period of time. An access to a sequence of time-stamped inspection data recording the damage growth dynamics is premised to this end. Identification of a structural defect in the most recent inspection data set triggers an exhaustive search into the images collected during the previous inspections looking for correspondences based on spatial proximity. This is followed by a view synthesis from multiple candidate images resulting in a single reconstruction for each inspection round. Cracks on concrete surface are used as a case study to demonstrate the feasibility of this approach. Once the chronology is established, the damage severity is quantified at various levels of time scale documenting its progression through time. The proposed scheme enables the prediction of damage severity at a future point in time providing a scope for preemptive measures against imminent structural failure. On the whole, it is believed that the present study will immensely benefit the structural inspectors by introducing the time dimension into the autonomous condition assessment pipeline.

Effects of Balance Training through Visual Control on Balance Ability, Postural Control, and Balance Confidence in Chronic Stroke Patients (시각 통제를 이용한 균형훈련이 만성 뇌졸중 환자의 균형능력과 자세조절, 균형자신감에 미치는 영향)

  • Jeong, Seong-Hwa;Koo, Hyun-Mo
    • PNF and Movement
    • /
    • v.18 no.1
    • /
    • pp.133-141
    • /
    • 2020
  • Purpose: The purpose of this study was to conduct balance training through vision control to improve the balance, postural control, and balance confidence and to decrease the visual and sensory dependence of stroke patients. Methods: Twenty-eight chronic stroke patients volunteered to participate in the study. They were randomly assigned to the eyes-closed and the eyes-open training groups. Three times a week for four weeks each group performed an unstable-support session and a balance training session for thirty minutes per set. Their balance, postural control, and balance confidence were assessed using BIO Rescue (BR), the postural assessment scale for stroke (PASS), and the Korean activity-specific balance confidence scale (K-ABC), respectively. All data were analyzed using SPSS version 22.0. Statistical methods before and after working around the average value of each dataset were independent T-test. The significance level for statistical analyses was set at 0.05. Results: Comparison between the groups showed statistically significant effects on all variables before and after the intervention (p < 0.05). Conclusion: This study reflected that balance-training programs involving vision control improve the balance, postural control, and balance confidence of chronic stroke patients. Thus, stroke patients should undergo training programs that increase the use of their other senses with vision control in clinical practice.

Interface Modeling for Digital Device Control According to Disability Type in Web

  • Park, Joo Hyun;Lee, Jongwoo;Lim, Soon-Bum
    • Journal of Multimedia Information System
    • /
    • v.7 no.4
    • /
    • pp.249-256
    • /
    • 2020
  • Learning methods using various assistive and smart devices have been developed to enable independent learning of the disabled. Pointer control is the most important consideration for the disabled when controlling a device and the contents of an existing graphical user interface (GUI) environment; however, difficulties can be encountered when using a pointer, depending on the disability type; Although there are individual differences depending on the blind, low vision, and upper limb disability, problems arise in the accuracy of object selection and execution in common. A multimodal interface pilot solution is presented that enables people with various disability types to control web interactions more easily. First, we classify web interaction types using digital devices and derive essential web interactions among them. Second, to solve problems that occur when performing web interactions considering the disability type, the necessary technology according to the characteristics of each disability type is presented. Finally, a pilot solution for the multimodal interface for each disability type is proposed. We identified three disability types and developed solutions for each type. We developed a remote-control operation voice interface for blind people and a voice output interface applying the selective focusing technique for low-vision people. Finally, we developed a gaze-tracking and voice-command interface for GUI operations for people with upper-limb disability.

Preparation and Properties of Silicone Hydrogel Material Containing Silane Group with Cobalt Oxide Nanoparticles through Thermal Polymerization

  • Lee, Min-Jae;Kong, Ki-Oh;Sung, A-Young
    • Korean Journal of Materials Research
    • /
    • v.30 no.6
    • /
    • pp.273-278
    • /
    • 2020
  • This research is conducted to analyze the compatibility of used monomers and produce the high functional hydrogel ophthalmic polymer containing silane and nanoparticles. VTMS (vinyltrimethoxysilane), TAVS [Triacetoxy(vinyl)silane] and cobalt oxide nanoparticles are used as additives for the basic combination of SilM (silicone monomer), MMA (methyl methacrylate) and MA (methyl acrylate). Also, the materials are copolymerized with EGDMA (ethylene glycol dimethacrylate) as cross-linking agent, AIBN (thermal polymerization initiator) as the initiator. It is judged that the lenses of all combinations are optically excellent and thus have good compatibility. Measurement of the optical and physical characteristics of the manufactured hydrophilic ophthalmic polymer are different in each case. Especially for TAVS, the addition of cobalt oxide nanoparticles increases the oxygen permeability. These materials are considered to create synergy, so they can be used in functional hydrogel ophthalmic lenses.

Preparation and Analysis of Functional Hydrogel Lenses Using Cerium Iron Hydroxide Nanoparticles

  • Shin, Su-Mi;Sung, A-Young
    • Journal of Integrative Natural Science
    • /
    • v.13 no.1
    • /
    • pp.13-18
    • /
    • 2020
  • This study used cerium iron hydroxide nanoparticle with HEMA (2-hydroxyethyl methacrylate), the cross-linker EGDMA (ethylene glycol dimethacrylate), NVP (N-vinyl-2-pyrrolidone) and the initiator AIBN (azobisisobutyronitrile) for copolymerization. Also, the physical properties of the prepared lenses were compared, and their applicability as polymers for ophthalmic materials was experimented. The results of the measurement showed that the UV blocking rate and the wettability increased with the cerium iron hydroxide nanoparticles addition ratio, and the refractive index and water content were not affected. Thus, the produced copolymer is expected to be useful as a functional contact lens material while satisfying the basic physical properties of the hydrogel contact lens.

Object detection technology trend and development direction using deep learning

  • Kwak, NaeJoung;Kim, DongJu
    • International Journal of Advanced Culture Technology
    • /
    • v.8 no.4
    • /
    • pp.119-128
    • /
    • 2020
  • Object detection is an important field of computer vision and is applied to applications such as security, autonomous driving, and face recognition. Recently, as the application of artificial intelligence technology including deep learning has been applied in various fields, it has become a more powerful tool that can learn meaningful high-level, deeper features, solving difficult problems that have not been solved. Therefore, deep learning techniques are also being studied in the field of object detection, and algorithms with excellent performance are being introduced. In this paper, a deep learning-based object detection algorithm used to detect multiple objects in an image is investigated, and future development directions are presented.

Augmented Reality Framework for Efficient Access to Schedule Information on Construction Sites (증강현실 기술을 통한 건설 현장에서의 공정 정보 활용도 제고 방안)

  • Lee, Yong-Ju;Kim, Jin-Young;Pham, Hung;Park, Man-Woo
    • Journal of KIBIM
    • /
    • v.10 no.4
    • /
    • pp.60-69
    • /
    • 2020
  • Allowing on-site workers to access information of the construction process can enable task control, data integration, material and resource control. However, in the current practice of the construction industry, the existing methods and scope is quite limited, leading to inefficient management during the construction process. In this research, by adopting cutting edge technologies such as Augmented Reality(AR), digital twins, deep learning and computer vision with wearable AR devices, the authors proposed an AR visualization framework made of virtual components to help on-site workers to obtain information of the construction process with ease of use. Also, this paper investigates wearable AR devices and object detection algorithms, which are critical factors in the proposed framework, to test their suitability.

3D Printed Flexible Cathode Based on Cu-EDTA that Prepared by Molecular Precursor Method and Microwave Processing for Electrochemical Machining

  • Yan, Binggong;Song, Xuan;Tian, Zhao;Huang, Xiaodi;Jiang, Kaiyong
    • Journal of Electrochemical Science and Technology
    • /
    • v.11 no.2
    • /
    • pp.180-186
    • /
    • 2020
  • In this work, a metal-ligand solution (Cu-EDTA) was prepared based on the molecular precursor method and the solution was spin-coated onto 3D printed flexible photosensitive resin sheets. After being processed by microwave, a laser with a wavelength of 355 nm was utilized to scan the spin-coated sheets and then the sheets were immersed in an electroless copper plating solution to deposit copper wires. With the help of microwave processing, the adhesion between copper wires and substrate was improved which should result from the increase of roughness, decrease of contact angle and the consistent orientation of coated film according to the results of 3D profilometer and SEM. XPS results showed that copper seeds formed after laser scanning. Using the 3D printed flexible sheets as cathode and galvanized iron as anode, electrochemical machining was conducted.