• Journal of Intelligence and Information Systems
• /
• v.26 no.2
• /
• pp.131-145
• /
• 2020

In line with the trend of industrial innovation, IoT technology utilized in a variety of fields is emerging as a key element in creation of new business models and the provision of user-friendly services through the combination of big data. The accumulated data from devices with the Internet-of-Things (IoT) is being used in many ways to build a convenience-based smart system as it can provide customized intelligent systems through user environment and pattern analysis. Recently, it has been applied to innovation in the public domain and has been using it for smart city and smart transportation, such as solving traffic and crime problems using CCTV. In particular, it is necessary to comprehensively consider the easiness of securing real-time service data and the stability of security when planning underground services or establishing movement amount control information system to enhance citizens' or commuters' convenience in circumstances with the congestion of public transportation such as subways, urban railways, etc. However, previous studies that utilize image data have limitations in reducing the performance of object detection under private issue and abnormal conditions. The IoT device-based sensor data used in this study is free from private issue because it does not require identification for individuals, and can be effectively utilized to build intelligent public services for unspecified people. Especially, sensor data stored by the IoT device need not be identified to an individual, and can be effectively utilized for constructing intelligent public services for many and unspecified people as data free form private issue. We utilize the IoT-based infrared sensor devices for an intelligent pedestrian tracking system in metro service which many people use on a daily basis and temperature data measured by sensors are therein transmitted in real time. The experimental environment for collecting data detected in real time from sensors was established for the equally-spaced midpoints of 4×4 upper parts in the ceiling of subway entrances where the actual movement amount of passengers is high, and it measured the temperature change for objects entering and leaving the detection spots. The measured data have gone through a preprocessing in which the reference values for 16 different areas are set and the difference values between the temperatures in 16 distinct areas and their reference values per unit of time are calculated. This corresponds to the methodology that maximizes movement within the detection area. In addition, the size of the data was increased by 10 times in order to more sensitively reflect the difference in temperature by area. For example, if the temperature data collected from the sensor at a given time were 28.5℃, the data analysis was conducted by changing the value to 285. As above, the data collected from sensors have the characteristics of time series data and image data with 4×4 resolution. Reflecting the characteristics of the measured, preprocessed data, we finally propose a hybrid algorithm that combines CNN in superior performance for image classification and LSTM, especially suitable for analyzing time series data, as referred to CNN-LSTM (Convolutional Neural Network-Long Short Term Memory). In the study, the CNN-LSTM algorithm is used to predict the number of passing persons in one of 4×4 detection areas. We verified the validation of the proposed model by taking performance comparison with other artificial intelligence algorithms such as Multi-Layer Perceptron (MLP), Long Short Term Memory (LSTM) and RNN-LSTM (Recurrent Neural Network-Long Short Term Memory). As a result of the experiment, proposed CNN-LSTM hybrid model compared to MLP, LSTM and RNN-LSTM has the best predictive performance. By utilizing the proposed devices and models, it is expected various metro services will be provided with no illegal issue about the personal information such as real-time monitoring of public transport facilities and emergency situation response services on the basis of congestion. However, the data have been collected by selecting one side of the entrances as the subject of analysis, and the data collected for a short period of time have been applied to the prediction. There exists the limitation that the verification of application in other environments needs to be carried out. In the future, it is expected that more reliability will be provided for the proposed model if experimental data is sufficiently collected in various environments or if learning data is further configured by measuring data in other sensors.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.54 no.4
• /
• pp.50-58
• /
• 2017

Recently, some methods of converging heterogeneous fire sensor data have been proposed for effective fire detection, but the rule-based methods have low adaptability and accuracy, and the fuzzy inference methods suffer from detection speed and accuracy by lack of consideration for images. In addition, a few image-based deep learning methods were researched, but it was too difficult to rapidly recognize the fire event in absence of cameras or out of scope of a camera in practical situations. In this paper, we propose a novel fire detection system combining a deep learning algorithm based on CNN and fuzzy inference engine based on heterogeneous fire sensor data including temperature, humidity, gas, and smoke density. we show it is possible for the proposed system to rapidly detect fire by utilizing images and to decide fire in a reliable way by utilizing multi-sensor data. Also, we apply distributed computing architecture to fire detection algorithm in order to avoid concentration of computing power on a server and to enhance scalability as a result. Finally, we prove the performance of the system through two experiments by means of NIST's fire dynamics simulator in both cases of an explosively spreading fire and a gradually growing fire.

• Smart Media Journal
• /
• v.13 no.4
• /
• pp.23-32
• /
• 2024

Large-scale fires and their consequential damages are becoming increasingly common, but confidence in fire detection systems is waning. Recently, widely-used chemical fire detectors frequently generate lots of false alarms, while video-based deep learning fire detection is hampered by its time-consuming and expensive nature. To tackle these issues, this study proposes a fire detection model utilizing an autoencoder approach. The objective is to minimize false alarms while achieving swift and precise fire detection. The proposed model, employing an autoencoder methodology, can exclusively learn from normal data without the need for fire-related data, thus enhancing its adaptability to diverse environments. By amalgamating data from five distinct sensors, it facilitates rapid and accurate fire detection. Through experiments with various hyperparameter combinations, the proposed model demonstrated that out of 14 scenarios, only one encountered false alarm issues. Experimental results underscore its potential to curtail fire-related losses and bolster the reliability of fire detection systems.

• Journal of the Computational Structural Engineering Institute of Korea
• /
• v.34 no.5
• /
• pp.301-308
• /
• 2021

It is important to develop a digital SOC (Social Overhead Capital) maintenance system for preemptive maintenance in response to the rapid aging of social infrastructures. Abnormal signals induced from structures can be detected quickly and optimal decisions can be made promptly using IoT sensors deployed on the structures. In this study, a digital SOC monitoring system incorporating a multimetric IoT sensor was developed for long-term monitoring, for use in cloud-computing server for automated and powerful data analysis, and for establishing databases to perform : (1) multimetric sensing, (2) long-term operation, and (3) LTE-based direct communication. The developed sensor had three axes of acceleration, and five axes of strain sensing channels for multimetric sensing, and had an event-driven power management system that activated the sensors only when vibration exceeded a predetermined limit, or the timer was triggered. The power management system could reduce power consumption, and an additional solar panel charging could enable long-term operation. Data from the sensors were transmitted to the server in real-time via low-power LTE-CAT M1 communication, which does not require an additional gateway device. Furthermore, the cloud server was developed to receive multi-variable data from the sensor, and perform a displacement fusion algorithm to obtain reference-free structural displacement for ambient structural assessment. The proposed digital SOC system was experimentally validated on a steel railroad and concrete girder bridge.

• Smart Structures and Systems
• /
• v.3 no.3
• /
• pp.373-384
• /
• 2007

For structural health monitoring (SHM) of civil infrastructures, displacement is a good descriptor of the structural behavior under all the potential disturbances. However, it is not easy to measure displacement of civil infrastructures, since the conventional sensors need a reference point, and inaccessibility to the reference point is sometimes caused by the geographic conditions, such as a highway or river under a bridge, which makes installation of measuring devices time-consuming and costly, if not impossible. To resolve this issue, a visionbased real-time displacement measurement system using digital image processing techniques is developed. The effectiveness of the proposed system was verified by comparing the load carrying capacities of a steel-plate girder bridge obtained from the conventional sensor and the present system. Further, to simultaneously measure multiple points, a synchronized vision-based system is developed using master/slave system with wireless data communication. For the purpose of verification, the measured displacement by a synchronized vision-based system was compared with the data measured by conventional contact-type sensors, linear variable differential transformers (LVDT) from a laboratory test.

• Journal of Digital Contents Society
• /
• v.6 no.2
• /
• pp.131-135
• /
• 2005

Nowadays, the demand for the wireless technology has gradually increased to support the services of high speed wired internet and also the interest of a mobile terminal convergence has increased. In the next generation, the mobile terminal could merge with the celluar phone, wireless LAN, portable internet, digital multimedia brodcasting, mobile game and sensor(smart-tag and biometrics) through the unified single user interface. Moreover, the system is supported to multi-mode at difference networks, which have variable functions and high performance for available service. Inthis paper, we investigate the minimum requirements and the core technologies of the next generation mobile terminals.

• Smart Structures and Systems
• /
• v.5 no.4
• /
• pp.317-328
• /
• 2009

Current maintenance operations and integrity checks on a wide array of structures require personnel entry into normally-inaccessible or hazardous areas to perform necessary nondestructive inspections. To gain access for these inspections, structure must be disassembled and removed or personnel must be transported to remote locations. The use of in-situ sensors, coupled with remote interrogation, can be employed to overcome a myriad of inspection impediments stemming from accessibility limitations, complex geometries, the location and depth of hidden damage, and the isolated location of the structure. Furthermore, prevention of unexpected flaw growth and structural failure could be improved if on-board health monitoring systems were used to more regularly assess structural integrity. A research program has been completed to develop and validate Comparative Vacuum Monitoring (CVM) Sensors for surface crack detection. Statistical methods using one-sided tolerance intervals were employed to derive Probability of Detection (POD) levels for a wide array of application scenarios. Multi-year field tests were also conducted to study the deployment and long-term operation of CVM sensors on aircraft. This paper presents the quantitative crack detection capabilities of the CVM sensor, its performance in actual flight environments, and the prospects for structural health monitoring applications on aircraft and other civil structures.

• Smart Structures and Systems
• /
• v.12 no.2
• /
• pp.209-233
• /
• 2013

With an annual growth rate of about 30%, wind energy systems, such as wind turbines, represent one of the fastest growing renewable energy technologies. Continuous structural health monitoring of wind turbines can help improving structural reliability and facilitating optimal decisions with respect to maintenance and operation at minimum associated life-cycle costs. This paper presents an integrated monitoring system that is designed to support structural assessment and life-cycle management of wind turbines. The monitoring system systematically integrates a wide variety of hardware and software modules, including sensors and computer systems for automated data acquisition, data analysis and data archival, a multiagent-based system for self-diagnosis of sensor malfunctions, a model updating and damage detection framework for structural assessment, and a management module for monitoring the structural condition and the operational efficiency of the wind turbine. The monitoring system has been installed on a 500 kW wind turbine located in Germany. Since its initial deployment in 2009, the system automatically collects and processes structural, environmental, and operational wind turbine data. The results demonstrate the potential of the proposed approach not only to ensure continuous safety of the structures, but also to enable cost-efficient maintenance and operation of wind turbines.

• Smart Structures and Systems
• /
• v.23 no.1
• /
• pp.61-69
• /
• 2019

Offshore structures are generally exposed to harsh environments such as strong tidal currents and wind loadings. Monitoring the structural soundness and integrity of offshore structures is crucial to prevent catastrophic collapses and to prolong their lifetime; however, it is intrinsically challenging because of the difficulties in accessing the critical structural members that are located under water for installing and repairing sensors and data acquisition systems. Virtual sensing technologies have the potential to alleviate such difficulties by estimating the unmeasured structural responses at the desired locations using other measured responses. Despite the usefulness of virtual sensing, its performance and applicability to the structural health monitoring of offshore structures have not been fully studied to date. This study investigates the use of virtual sensing of offshore structures. A Kalman filter based virtual sensing algorithm is developed to estimate responses at the location of interest. Further, this algorithm performs a multi-sensor data fusion to improve the estimation accuracy under non-stationary tidal loading. Numerical analysis and laboratory experiments are conducted to verify the performance of the virtual sensing strategy using a bottom-fixed offshore structural model. Numerical and experimental results show that the unmeasured responses can be reasonably recovered from the measured responses.

• Journal of Positioning, Navigation, and Timing
• /
• v.11 no.4
• /
• pp.279-286
• /
• 2022

In this paper, we designed a software library that produces integrated Global Navigation Satellite System (GNSS) / Inertial Navigation System (INS) navigation information using the raw measurements provided by the GNSS chipset, gyroscope, accelerometer and magnetometer embedded in android smartphone. Loosely coupled integration method was used to derive information of GNSS /INS integrated navigation. An application built in the designed library was developed and installed on the android smartphone. And we conducted field experiments. GNSS navigation messages were collected in the Radio Technical Commission for Maritime Service (RTCM 3.0) format by the Network Transport of RTCM via Internet Protocol (NTRIP). As a result of experiments, it was confirmed that design requirements were satisfied by deriving navigation such as three-dimensional position and speed, course over ground (COG), speed over ground (SOG), heading and protection level (PL) using the designed library. In addition, the results of this experiment are expected to be applicable to maritime navigation applications using smart device.