• 한국컴퓨터정보학회논문지
• /
• 제27권2호
• /
• pp.61-69
• /
• 2022

배달산업이 COVID-19 상황과 함께 요식업을 중심으로 크게 성장함에 따라 배달업 종사자가 크게 증가했다. 그와 함께 개인형 모빌리티(Personal Mobility: PM)를 활용한 새로운 배달 형태가 등장했으며, 이륜차 혹은 PM 관련 사고는 꾸준히 증가하고 있다. 본 연구는 안전 배달 모니터링 환경을 구축하기 위해 PM의 주행 분석 장치의 제작한다. 이를 위해 주행 분석 장치와 장치에서 수집된 데이터를 클라우드 서버를 통해 처리하는 시스템을 구성했으며, 이 시스템을 통해 PM의 운전상황에서 운전 중 발생할 수 있는 특수한 상황(가/감속, 과속방지턱 통과)을 인식하고 기록하고자 한다. 그 결과 장치 내 측정 센서(IMU)에서 수집한 각속도, 가속도, 지자기 값을 통해 운행 여부 및 인도 주행 여부, 경사로 주행 여부를 판단해 낼 수 있었다. 이 기술은 기존의 영상기반 기록장치보다 약 1600배 이상의 주행 정보 저장 효율을 달성할 수 있었다.

• Smart Structures and Systems
• /
• 제29권1호
• /
• pp.181-193
• /
• 2022

Data-driven structural health monitoring (SHM) of civil infrastructure can be used to continuously assess the state of a structure, allowing preemptive safety measures to be carried out. Long-term monitoring of large-scale civil infrastructure often involves data-collection using a network of numerous sensors of various types. Malfunctioning sensors in the network are common, which can disrupt the condition assessment and even lead to false-negative indications of damage. The overwhelming size of the data collected renders manual approaches to ensure data quality intractable. The task of detecting and classifying an anomaly in the raw data is non-trivial. We propose an approach to automate this task, improving upon the previously developed technique of image-based pre-processing on one-dimensional (1D) data by enriching the features of the neural network input data with multiple channels. In particular, feature engineering is employed to convert the measured time histories into a 3-channel image comprised of (i) the time history, (ii) the spectrogram, and (iii) the probability density function representation of the signal. To demonstrate this approach, a CNN model is designed and trained on a dataset consisting of acceleration records of sensors installed on a long-span bridge, with the goal of fault detection and classification. The effect of imbalance in anomaly patterns observed is studied to better account for unseen test cases. The proposed framework achieves high overall accuracy and recall even when tested on an unseen dataset that is much larger than the samples used for training, offering a viable solution for implementation on full-scale structures where limited labeled-training data is available.

• Smart Structures and Systems
• /
• 제29권1호
• /
• pp.251-266
• /
• 2022

Structural Health Monitoring (SHM) of critical infrastructure comprises a major pillar of maintenance management, shielding public safety and economic sustainability. Although SHM is usually associated with data-driven metrics and thresholds, expert judgement is essential, especially in cases where erroneous predictions can bear casualties or substantial economic loss. Considering that visual inspections are time consuming and potentially subjective, artificial-intelligence tools may be leveraged in order to minimize the inspection effort and provide objective outcomes. In this context, timely detection of sensor malfunctioning is crucial in preventing inaccurate assessment and false alarms. The present work introduces a sensor-fault detection and interpretation framework, based on the well-established support-vector machine scheme for anomaly detection, combined with a coalitional game-theory approach. The proposed framework is implemented in two datasets, provided along the 1st International Project Competition for Structural Health Monitoring (IPC-SHM 2020), comprising acceleration and cable-load measurements from two real cable-stayed bridges. The results demonstrate good predictive performance and highlight the potential for seamless adaption of the algorithm to intrinsically different data domains. For the first time, the term "decision trajectories", originating from the field of cognitive sciences, is introduced and applied in the context of SHM. This provides an intuitive and comprehensive illustration of the impact of individual features, along with an elaboration on feature dependencies that drive individual model predictions. Overall, the proposed framework provides an easy-to-train, application-agnostic and interpretable anomaly detector, which can be integrated into the preprocessing part of various SHM and condition-monitoring applications, offering a first screening of the sensor health prior to further analysis.

• Smart Structures and Systems
• /
• 제29권1호
• /
• pp.237-250
• /
• 2022

Structural health monitoring (SHM) plays an important role in ensuring the safety and functionality of critical civil infrastructure. In recent years, numerous researchers have conducted studies to develop computer vision and machine learning techniques for SHM purposes, offering the potential to reduce the laborious nature and improve the effectiveness of field inspections. However, high-quality vision data from various types of damaged structures is relatively difficult to obtain, because of the rare occurrence of damaged structures. The lack of data is particularly acute for fatigue crack in steel bridge girder. As a result, the lack of data for training purposes is one of the main issues that hinders wider application of these powerful techniques for SHM. To address this problem, the use of synthetic data is proposed in this article to augment real-world datasets used for training neural networks that can identify fatigue cracks in steel structures. First, random textures representing the surface of steel structures with fatigue cracks are created and mapped onto a 3D graphics model. Subsequently, this model is used to generate synthetic images for various lighting conditions and camera angles. A fully convolutional network is then trained for two cases: (1) using only real-word data, and (2) using both synthetic and real-word data. By employing synthetic data augmentation in the training process, the crack identification performance of the neural network for the test dataset is seen to improve from 35% to 40% and 49% to 62% for intersection over union (IoU) and precision, respectively, demonstrating the efficacy of the proposed approach.

• Smart Structures and Systems
• /
• 제29권1호
• /
• pp.77-91
• /
• 2022

Various monitoring systems have been implemented in civil infrastructure to ensure structural safety and integrity. In long-term monitoring, these systems generate a large amount of data, where anomalies are not unusual and can pose unique challenges for structural health monitoring applications, such as system identification and damage detection. Therefore, developing efficient techniques is quite essential to recognize the anomalies in monitoring data. In this study, several machine learning techniques are explored and implemented to detect and classify various types of data anomalies. A field dataset, which consists of one month long acceleration data obtained from a long-span cable-stayed bridge in China, is employed to examine the machine learning techniques for automated data anomaly detection. These techniques include the statistic-based pattern recognition network, spectrogram-based convolutional neural network, image-based time history convolutional neural network, image-based time-frequency hybrid convolution neural network (GoogLeNet), and proposed ensemble neural network model. The ensemble model deliberately combines different machine learning models to enhance anomaly classification performance. The results show that all these techniques can successfully detect and classify six types of data anomalies (i.e., missing, minor, outlier, square, trend, drift). Moreover, both image-based time history convolutional neural network and GoogLeNet are further investigated for the capability of autonomous online anomaly classification and found to effectively classify anomalies with decent performance. As seen in comparison with accuracy, the proposed ensemble neural network model outperforms the other three machine learning techniques. This study also evaluates the proposed ensemble neural network model to a blind test dataset. As found in the results, this ensemble model is effective for data anomaly detection and applicable for the signal characteristics changing over time.

• Geomechanics and Engineering
• /
• 제28권6호
• /
• pp.599-611
• /
• 2022

Tendon reinforced cemented soil is applied extensively in foundation stabilisation and improvement, especially in areas with soft clay. To solve the deterioration problem led by steel corrosion, the glass fiber-reinforced polymer (GFRP) tendon is introduced to substitute the traditional steel tendon. The interface bond strength between the cemented soil matrix and GFRP tendon demonstrates the outstanding mechanical property of this composite. However, the lack of research between the influence factors and bond strength hinders the application. To evaluate these factors, back propagation neural network (BPNN) is applied to predict the relationship between them and bond strength. Since adjusting BPNN parameters is time-consuming and laborious, the particle swarm optimisation (PSO) algorithm is proposed. This study evaluated the influence of water content, cement content, curing time, and slip distance on the bond performance of GFRP tendon-reinforced cemented soils (GTRCS). The results showed that the ultimate and residual bond strengths were both in positive proportion to cement content and negative to water content. The sample cured for 28 days with 30% water content and 50% cement content had the largest ultimate strength (3879.40 kPa). The PSO-BPNN model was tuned with 3 neurons in the input layer, 10 in the hidden layer, and 1 in the output layer. It showed outstanding performance on a large database comprising 405 testing results. Its higher correlation coefficient (0.908) and lower root-mean-square error (239.11 kPa) were obtained compared to multiple linear regression (MLR) and logistic regression (LR). In addition, a sensitivity analysis was applied to acquire the ranking of the input variables. The results illustrated that the cement content performed the strongest influence on bond strength, followed by the water content and slip displacement.

• 한국컴퓨터정보학회논문지
• /
• 제27권12호
• /
• pp.141-149
• /
• 2022

본 연구에서는 공공 CCTV 함체 관리를 위한 블록체인 기반 함체기록 관리 시스템을 설계하였다. CCTV 영상 기록은 함체를 거쳐 관제센터까지 전송되기 때문에 영상기록의 변조 및 훼손 방지를 위한 함체 관리가 매우 중요하다. 최근 CCTV 함체 관리를 위해 실시간 원격 모니터링 및 개폐 상태 관리 기능을 갖춘 스마트 함체 모니터링 시스템을 사용하고 있으나 CCTV 영상기록의 안전성 확보에는 한계가 있다. 우리가 제안한 시스템은 함체기록을 블록체인에 분산 저장하여 해시값 비교를 통해 위조를 탐지하고 위조된 함체기록을 복구할 수 있다. 또한 관리서버가 수신하는 함체기록의 무결성을 확인할 수 있도록 무결성 검증 API를 제공하여 함체기록의 무결성을 보장한다. 제안 시스템의 효용성을 검증하기 위해 실험을 통해 무결성 검증 정확도와 소요시간을 측정하였다. 실험 결과 함체기록의 무결성(정확도: 100%)을 확인하였고, 검증 소요시간(평균: 73ms)이 모니터링에 영향을 미치지 않을 것으로 확인하였다.

• 정보처리학회논문지:컴퓨터 및 통신 시스템
• /
• 제11권2호
• /
• pp.51-58
• /
• 2022

블록체인 기술은 블록체인 네트워크에 참여하는 사용자의 데이터가 분산 처리되어 저장되는 시스템이다. 비트코인과 이더리움을 필두로 세계적으로 관심을 받고 있으며, 블록체인의 활용성은 무궁무진한 것으로 예측되고 있다. 하지만 블록체인의 모든 데이터를 네트워크 참여자에게 공개하는 투명성으로 인해 블록체인 데이터 프라이버시 보호에 대한 필요성이 개인정보를 처리하는 각종 금융, 의료, 부동산 분야에서 떠오르고 있다. 기존 블록체인 데이터 프라이버시 보호를 위해서 스마트 컨트랙트, 동형암호화, 암호학 키 방식을 사용하는 연구들이 주를 이루었으나, 본 논문에서는 기존의 논문들과 차별화된 매트릭스 문자 재배치 기법을 사용한 데이터 프라이버시 보호를 제안한다. 본 논문에서 제안하는 접근방안은 원본 데이터를 매트릭스 문자 재배치 하는 방법, 배치된 데이터를 다시 원본으로 되돌리는 방법, 크게 두 가지로 구성이 되어있다. 정성적인 실험을 통해 본 논문에서 제안하는 접근방안의 안전성을 평가하였으며, 매트릭스 문자 재배치가 적용된 데이터를 원본 데이터로 되돌릴 때 걸리는 시간을 측정하여 프라이빗 블록체인 환경에서도 충분히 적용이 가능할 것이라는 것을 증명하였다.

• International Journal of Computer Science & Network Security
• /
• 제22권5호
• /
• pp.103-114
• /
• 2022

The Internet of Things (IoT) is one of the fastest technologies that are used in various applications and fields. The concept of IoT will not only be limited to the fields of scientific and technical life but will also gradually spread to become an essential part of our daily life and routine. Before, IoT was a complex term unknown to many, but soon it will become something common. IoT is a natural and indispensable routine in which smart devices and sensors are connected wirelessly or wired over the Internet to exchange and process data. With all the benefits and advantages offered by the IoT, it does not face many security and privacy challenges because the current traditional security protocols are not suitable for IoT technologies. In this paper, we presented a comprehensive survey of the latest studies from 2018 to 2021 related to the security of the IoT and the use of machine learning (ML) and deep learning and their applications in addressing security and privacy in the IoT. A description was initially presented, followed by a comprehensive overview of the IoT and its applications and the basic important safety requirements of confidentiality, integrity, and availability and its application in the IoT. Then we reviewed the attacks and challenges facing the IoT. We also focused on ML and its applications in addressing the security problem on the IoT.

• 한국해양공학회지
• /
• 제36권3호
• /
• pp.153-160
• /
• 2022

Moored floating platforms have great potential in ocean engineering applications because a mooring system is necessary to keep the platform in station, which is directly related to the operational efficiency and safety of the platform. This paper briefly introduces the technical and operational details of an optical sensor for measuring the tension of mooring lines of a moored platform in waves. In order to check the performance of optical sensors, an experiment with a moored floating platform in waves is carried out in the wave tank at Changwon National University. The experiment is performed in regular waves and irregular waves with a semi-submersible and triangle platform. The performance of the optical sensor is confirmed by comparing the results of the tension of the mooring lines by the optical sensor and tension gauges. The maximum tension of the mooring lines is estimated to investigate the mooring dynamics due to the effect of the wave direction and wavelength in the regular waves. The significant value of the tension of mooring lines in various wave directions is estimated in the case of irregular waves. The results show that the optical sensor is effective in measuring the tension of the mooring lines.