• Title/Summary/Keyword: Real Time Object Detection

Search Result 520, Processing Time 0.024 seconds

Development of a Tactile Sensor Array with Flexible Structure Using Piezoelectric Film

  • Yu, Kee-Ho;Kwon, Tae-Gyu;Yun, Myung-Jong;Lee, Seong-Cheol
    • Journal of Mechanical Science and Technology
    • /
    • v.16 no.10
    • /
    • pp.1222-1228
    • /
    • 2002
  • This research is the development of a flexible tactile sensor array for service robots using PVDF (polyvinylidene fluoride) film for the detection of a contact state in real time. The prototype of the tactile sensor which has 8${\times}$8 array using PVDF film was fabricated. In the fabrication procedure, the electrode patterns and the common electrode of the thin conductive tape were attached to both sides of the 281$\mu\textrm{m}$ thickness PVDF film using conductive adhesive. The sensor was covered with polyester film for insulation and attached to the rubber base for a stable structure. The proposed fabrication method is simple and easy to make the sensor. The sensor has the advantages in the implementing for practical applications because its structure is flexible and the shape of the each tactile element can be designed arbitrarily. The signals of a contact force to the tactile sensor were sensed and processed in the DSP system in which the signals are digitized and filtered. Finally, the signals were integrated for taking the force profile. The processed signals of the output of the sensor were visualized in a personal computer, and the shape and force distribution of the contact object were obtained. The reasonable performance for the detection of the contact state was verified through the sensing examples.

RHT-Based Ellipse Detection for Estimating the Position of Parts on an Automobile Cowl Cross Bar Assembly (RHT 기법을 이용한 카울크로스바의 조립위치 결정에 관한 연구)

  • Shin, Ik-Sang;Kang, Dong-Hyeon;Hong, Young-Gi;Min, Young-Bong
    • Journal of Biosystems Engineering
    • /
    • v.36 no.5
    • /
    • pp.377-383
    • /
    • 2011
  • This study proposed the new method of discerning the assembled parts and presuming the position of central point in a Cowl Cross Bar (CCB) using a Charge-Couple Device (CCD) camera attached to a robot in the auto assembly line. Three control points of an ellipse were decided by three reference points, which were equally distanced. The radii of these reference points were determined by the size of the object, and the repeated presumption secured the precise determination. The comparison of the central point of ellipse presumed by Randomized Hough Transform (RHT) with the part information stored in a database was used for determining the faulty part in an assembly. The method proposed in this study was applied for the real-time inspection of elliptical parts, such as bolt, nut hole and so on, connected to a CCB using a CCD camera. The findings of this study showed that the precise decision on whether the parts are inferior or not can be made irrespective of the lighting condition of industrial site and the noises of the surface of the part. In addition, the defect decision on the individual elliptic parts assembled in a CCB showed more than 98% accuracy within a 500-millisecond period at most.

A New Efficient Detection Method in Lane Road Environment (도로 환경에 효율적인 새로운 차선 검출 방법)

  • Lee, Kyung-Min;Lin, Chi-Ho
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.17 no.1
    • /
    • pp.129-136
    • /
    • 2018
  • In this paper, we propose a new real-time lane detection method that is efficient for road environment. Existing methods have a problem of low reliability under environmental changes. In order to overcome this problem, we emphasize the lane candidate area by using gray level division. And Extracts a straight line component near the lane by using the Hough transform, and generates an ROI for each straight line based on the extracted coordinates. And integrates the generated ROI images. Then, the lane is determined by dividing the object using the dual queue in the ROI image. The proposed method is able to detect lanes even in the environmental change unlike the conventional method. And It is possible to obtain an advantage that the area corresponding to the background such as sky, mountain, etc. is efficiently removed and high reliability is obtained.

Video Digital Doorlock System for Recognition and Transmission of Approaching Objects (접근객체 인식 및 전송을 위한 영상 디지털 도어락 시스템 설계)

  • Lee, Sang-Rack;Park, Jin-Tae;Woo, Byoung-Hyoun;Choi, Han-Go
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.3 no.6
    • /
    • pp.237-242
    • /
    • 2014
  • Current digital door lock systems are mainly designed for users' convenience, so they have weakness in security. Thus, this paper suggests a video digital doorlock system grouped with a relay device, a server, and a digital doorlock with a camera, sensors, and communication modules, which is detecting or recognizing objects approaching to the front of the door lock system and sending images and door-opening information to users' smart devices. Experiments showed that the suggested system has 96~98% recognition rate of approaching objects and requires 17.1~23.9 seconds for transmission on average, depending on network systems. Therefore, the system is thought to have enough capability for real time security response by monitoring the front area of the doorlock system.

A Study on Automatic Detection of Speed Bump by using Mathematical Morphology Image Filters while Driving (수학적 형태학 처리를 통한 주행 중 과속 방지턱 자동 탐지 방안)

  • Joo, Yong Jin;Hahm, Chang Hahk
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.21 no.3
    • /
    • pp.55-62
    • /
    • 2013
  • This paper aims to detect Speed Bump by using Omni-directional Camera and to suggest Real-time update scheme of Speed Bump through Vision Based Approach. In order to detect Speed Bump from sequence of camera images, noise should be removed as well as spot estimated as shape and pattern for speed bump should be detected first. Now that speed bump has a regular form of white and yellow area, we extracted speed bump on the road by applying erosion and dilation morphological operations and by using the HSV color model. By collecting huge panoramic images from the camera, we are able to detect the target object and to calculate the distance through GPS log data. Last but not least, we evaluated accuracy of obtained result and detection algorithm by implementing SLAMS (Simultaneous Localization and Mapping system).

Defect Detection of the Wall Thinning Pipe of the Nuclear Power Plant Using Infrared Thermography (적외선열화상을 이용한 원자력발전소 감육 배관의 결함 검출)

  • Kim, Kyeong-Suk;Chang, Ho-Sub;Hong, Dong-Pyo;Park, Chan-Joo;Na, Sung-Won;Kim, Kyung-Su;Jung, Hyun-Chul
    • Journal of the Korean Society for Nondestructive Testing
    • /
    • v.30 no.2
    • /
    • pp.85-90
    • /
    • 2010
  • The infrared energy is emitted in the infrared wavelength range that corresponds to the surface temperature of a object which has temperature that is over the absolute the temperature(OK). The infrared thermography (IRT) is a non-destrnctive testing method that provides thermal video for the user in real-time by converting the infrared quantity that is detected by the infrared detector into temperature. The pipes of nuclear power plant(NPP) could be thinned by the corrosion and fatigue and the defect could lead to a big accident. For this reason, the effective non-destructive testing method is necessary. In this study, the relationship between the measured temperature and the defect depth or size of NPP pipes were recognized and that was applied to detect the wall thinning defects of NPP pipes.

Abnormal behaviour in rock bream (Oplegnathus fasciatus) detected using deep learning-based image analysis

  • Jang, Jun-Chul;Kim, Yeo-Reum;Bak, SuHo;Jang, Seon-Woong;Kim, Jong-Myoung
    • Fisheries and Aquatic Sciences
    • /
    • v.25 no.3
    • /
    • pp.151-157
    • /
    • 2022
  • Various approaches have been applied to transform aquaculture from a manual, labour-intensive industry to one dependent on automation technologies in the era of the fourth industrial revolution. Technologies associated with the monitoring of physical condition have successfully been applied in most aquafarm facilities; however, real-time biological monitoring systems that can observe fish condition and behaviour are still required. In this study, we used a video recorder placed on top of a fish tank to observe the swimming patterns of rock bream (Oplegnathus fasciatus), first one fish alone and then a group of five fish. Rock bream in the video samples were successfully identified using the you-only-look-once v3 algorithm, which is based on the Darknet-53 convolutional neural network. In addition to recordings of swimming behaviour under normal conditions, the swimming patterns of fish under abnormal conditions were recorded on adding an anaesthetic or lowering the salinity. The abnormal conditions led to changes in the velocity of movement (3.8 ± 0.6 cm/s) involving an initial rapid increase in speed (up to 16.5 ± 3.0 cm/s, upon 2-phenoxyethanol treatment) before the fish stopped moving, as well as changing from swimming upright to dying lying on their sides. Machine learning was applied to datasets consisting of normal or abnormal behaviour patterns, to evaluate the fish behaviour. The proposed algorithm showed a high accuracy (98.1%) in discriminating normal and abnormal rock bream behaviour. We conclude that artificial intelligence-based detection of abnormal behaviour can be applied to develop an automatic bio-management system for use in the aquaculture industry.

A Study on the Land Change Detection and Monitoring Using High-Resolution Satellite Images and Artificial Intelligence: A Case Study of Jeongeup City (고해상도 위성영상과 인공지능을 활용한 국토 변화탐지 및 모니터링 연구: 실증대상 지역인 정읍시를 중심으로)

  • Cho, Nahye;Lee, Jungjoo;Kim, Hyundeok
    • Journal of Cadastre & Land InformatiX
    • /
    • v.53 no.1
    • /
    • pp.107-121
    • /
    • 2023
  • In order to acquire a wide range of land that changes in real time and quickly and accurately grasp it, we plan to utilize the recently released high-resolution S.Korea's satellite image data and artificial intelligence (AI). Compared to existing satellite images, the spectral and periodic resolutions of S.Korea's satellite are higher, making them a more suitable data source for periodically monitoring changes in land. Therefore, this study aims to acquire S.Korea's satellite, select 8 types of objects to detect land changes, construct data sets for them, and apply AI models to analyze them. In order to confirm the optimal model and variable conditions for detecting 8 types of objects of various types, several experiments are performed and AI-based image analysis is technically reviewed.

Filtering-Based Method and Hardware Architecture for Drivable Area Detection in Road Environment Including Vegetation (초목을 포함한 도로 환경에서 주행 가능 영역 검출을 위한 필터링 기반 방법 및 하드웨어 구조)

  • Kim, Younghyeon;Ha, Jiseok;Choi, Cheol-Ho;Moon, Byungin
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.11 no.1
    • /
    • pp.51-58
    • /
    • 2022
  • Drivable area detection, one of the main functions of advanced driver assistance systems, means detecting an area where a vehicle can safely drive. The drivable area detection is closely related to the safety of the driver and it requires high accuracy with real-time operation. To satisfy these conditions, V-disparity-based method is widely used to detect a drivable area by calculating the road disparity value in each row of an image. However, the V-disparity-based method can falsely detect a non-road area as a road when the disparity value is not accurate or the disparity value of the object is equal to the disparity value of the road. In a road environment including vegetation, such as a highway and a country road, the vegetation area may be falsely detected as the drivable area because the disparity characteristics of the vegetation are similar to those of the road. Therefore, this paper proposes a drivable area detection method and hardware architecture with a high accuracy in road environments including vegetation areas by reducing the number of false detections caused by V-disparity characteristic. When 289 images provided by KITTI road dataset are used to evaluate the road detection performance of the proposed method, it shows an accuracy of 90.12% and a recall of 97.96%. In addition, when the proposed hardware architecture is implemented on the FPGA platform, it uses 8925 slice registers and 7066 slice LUTs.

A Study on People Counting in Public Metro Service using Hybrid CNN-LSTM Algorithm (Hybrid CNN-LSTM 알고리즘을 활용한 도시철도 내 피플 카운팅 연구)

  • Choi, Ji-Hye;Kim, Min-Seung;Lee, Chan-Ho;Choi, Jung-Hwan;Lee, Jeong-Hee;Sung, Tae-Eung
    • Journal of Intelligence and Information Systems
    • /
    • v.26 no.2
    • /
    • pp.131-145
    • /
    • 2020
  • In line with the trend of industrial innovation, IoT technology utilized in a variety of fields is emerging as a key element in creation of new business models and the provision of user-friendly services through the combination of big data. The accumulated data from devices with the Internet-of-Things (IoT) is being used in many ways to build a convenience-based smart system as it can provide customized intelligent systems through user environment and pattern analysis. Recently, it has been applied to innovation in the public domain and has been using it for smart city and smart transportation, such as solving traffic and crime problems using CCTV. In particular, it is necessary to comprehensively consider the easiness of securing real-time service data and the stability of security when planning underground services or establishing movement amount control information system to enhance citizens' or commuters' convenience in circumstances with the congestion of public transportation such as subways, urban railways, etc. However, previous studies that utilize image data have limitations in reducing the performance of object detection under private issue and abnormal conditions. The IoT device-based sensor data used in this study is free from private issue because it does not require identification for individuals, and can be effectively utilized to build intelligent public services for unspecified people. Especially, sensor data stored by the IoT device need not be identified to an individual, and can be effectively utilized for constructing intelligent public services for many and unspecified people as data free form private issue. We utilize the IoT-based infrared sensor devices for an intelligent pedestrian tracking system in metro service which many people use on a daily basis and temperature data measured by sensors are therein transmitted in real time. The experimental environment for collecting data detected in real time from sensors was established for the equally-spaced midpoints of 4×4 upper parts in the ceiling of subway entrances where the actual movement amount of passengers is high, and it measured the temperature change for objects entering and leaving the detection spots. The measured data have gone through a preprocessing in which the reference values for 16 different areas are set and the difference values between the temperatures in 16 distinct areas and their reference values per unit of time are calculated. This corresponds to the methodology that maximizes movement within the detection area. In addition, the size of the data was increased by 10 times in order to more sensitively reflect the difference in temperature by area. For example, if the temperature data collected from the sensor at a given time were 28.5℃, the data analysis was conducted by changing the value to 285. As above, the data collected from sensors have the characteristics of time series data and image data with 4×4 resolution. Reflecting the characteristics of the measured, preprocessed data, we finally propose a hybrid algorithm that combines CNN in superior performance for image classification and LSTM, especially suitable for analyzing time series data, as referred to CNN-LSTM (Convolutional Neural Network-Long Short Term Memory). In the study, the CNN-LSTM algorithm is used to predict the number of passing persons in one of 4×4 detection areas. We verified the validation of the proposed model by taking performance comparison with other artificial intelligence algorithms such as Multi-Layer Perceptron (MLP), Long Short Term Memory (LSTM) and RNN-LSTM (Recurrent Neural Network-Long Short Term Memory). As a result of the experiment, proposed CNN-LSTM hybrid model compared to MLP, LSTM and RNN-LSTM has the best predictive performance. By utilizing the proposed devices and models, it is expected various metro services will be provided with no illegal issue about the personal information such as real-time monitoring of public transport facilities and emergency situation response services on the basis of congestion. However, the data have been collected by selecting one side of the entrances as the subject of analysis, and the data collected for a short period of time have been applied to the prediction. There exists the limitation that the verification of application in other environments needs to be carried out. In the future, it is expected that more reliability will be provided for the proposed model if experimental data is sufficiently collected in various environments or if learning data is further configured by measuring data in other sensors.