• Journal of Creative Information Culture
• /
• v.7 no.4
• /
• pp.235-242
• /
• 2021

Recently, many human activity recognition(HAR) researches using smartphone sensor data have been studied. HAR can be utilized in various fields, such as life pattern analysis, exercise measurement, and dangerous situation detection. However researches have been focused on recognition of basic human behaviors or efficient battery use. In this paper, exercising activities performed indoors and outdoors were defined and recognized. Data collection and pre-processing is performed to recognize the defined activities by SVM, random forest and gradient boosting model. In addition, the recognition result is determined based on voting class approach for accuracy and stable performance. As a result, the proposed activities were recognized with high accuracy and in particular, similar types of indoor and outdoor exercising activities were correctly classified.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2018.10a
• /
• pp.360-363
• /
• 2018

Human activity is influenced by various factors, from individual physical features such as vertebral flexion and pelvic distortion to feelings such as joy, anger, and sadness. However, the nature of these behaviors changes over time, and behavioral characteristics do not change much in the short term. The activity data of a person has a time series characteristic that changes with time and a certain regularity for each action. In this study, we applied LSTM, a kind of cyclic neural network to deal with time - series characteristics, to the technique of recognizing activity type and improved recognition rate of activity type by measuring time and parameter optimization of components of LSTM model.

• Animal cells and systems
• /
• v.8 no.2
• /
• pp.125-133
• /
• 2004

We have extended our previous work that cross-linking CD4 molecules using specific MAb induced antigen nonspecific, MHC unrestricted killing of virally infected target cells by CD$4^+$We have extended our previous work that cross-linking CD$4^+$ molecules using specific MAb induced antigen nonspecific, MHC unrestricted killing of virally infected target cells by CD$4^+$ T cells. The killing activity of antibody activated CD$4^+$T cells was completely blocked by herbimycin A, a protein tyrosine kinase (PTK) inhibitor, but not by bisindolylamaleimide, a protein kinase C (PKC) inhibitor. Herbimycin A treated human or bovine peripheral blood CD$4^+$T cells lacked PTK activity and failed to kill virally infected target cells even after cross-linking of CD4 molecules. The CD$4^+$cross-linking failed to induce effector cell proliferation or the transcription of TNF${\beta}$ Upregulation of TNF${\beta}$ was induced by incubating the antibody activated effector cells with BHV-1 infected D17 target cells for 10 h. Anti-TNF${\beta}$ antibody partially abolished (13-44%) the direct effector cell-mediated antiviral cytotoxicity. However, this antibody neutralized 70 to 100% of antiviral activity of effector and target cell culture supernatants against BHV-1 infected D17 cells. The inhibition level of the antiviral activity by the antibody was dependent on the effector and target cell ratio. These results support the hypothesis that increased p$56^ICK enzyme activity in effector cells transduces a signal critical for effector cell recognition of viral glycoproteins expressed on the target cells. Following target cell recognition, lytic cytokines known to participate in target cell killing were produced. A better understanding of the killing activity displayed by CD$4^+$T lymphocytes following surface receptor cross-linking will provide insight into the mechanisms of cytotoxic activity directed toward virally-infected cells.T cells. The killing activity of antibody activated CD$4^+$T cells was completely blocked by herbimycin A, a protein tyrosine kinase (PTK) inhibitor, but not by bisindolylamaleimide, a protein kinase C (PKC) inhibitor. Herbimycin A treated human or bovine peripheral blood CD4T cells lacked PTK activity and failed to kill virally infected target cells even after cross-linking of CD4molecules. The CD4 cross-linking failed to induce effector cell proliferation or the transcription of TNF$\beta$. Upregulation of TNF$\beta$ was induced by incubating the antibody activated effector cells with BHV-1 infected D17 target cells for 10 h. Anti-TNF$\beta$ antibody partially abolished (13-44%) the direct effector cell-mediated antiviral cytotoxicity. However, this antibody neutralized 70 to 100% of antiviral activity of effector and target cell culture supernatants against BHV-1 infected D17 cells. The inhibition level of the antiviral activity by the antibody was dependent on the effector and target cell ratio. These results support the hypothesis that increased $56^ICK enzyme activity in effector cells transduces a signal critical for effector cell recognition of viral glycoproteins expressed on the target cells. Following target cell recognition, lytic cytokines known to participate in target cell killing were produced. A better understanding of the killing activity displayed by CD$4^+$T lymphocytes following surface receptor cross-linking will provide insight into the mechanisms of cytotoxic activity directed toward virally-infected cells.

• 한국HCI학회:학술대회논문집
• /
• 2007.02a
• /
• pp.750-754
• /
• 2007

본 논문은 실내의 로비나 복도에 설치된 방범 카메라로부터 얻어진 일련의 영상으로부터 '걷기', '뛰기', '앉기', '일어서기', '넘어짐'의 비교적 짧은 시간에 일어나는 인간 행동들을 실시간으로 인식하는 시스템의 구현에 관해 다룬다. 먼저 입력으로 받은 영상을 계층적 색인 구조를 갖는 다중 가우시안 기반의 배경 모델을 이용하여 윤곽을 추출하고 객체를 인식하여 시간차에 의한 가중치로 누적하여 시간 템플릿을 만든다. 만들어진 시간 템플릿으로부터 특징을 추출하여 신경망 모델에 적용하여 5가지 인간행동을 구분한다. 구현된 시스템으로 인간행동 인식 실험을 수행하였는데, 실험 참가자들의 행동 방식이 약간씩 달랐음에도 불구하고 높은 인식률을 보여주었다.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.2
• /
• pp.800-816
• /
• 2018

In recent years, video surveillance research has been able to recognize various behaviors of pedestrians and analyze the overall situation of objects by combining image analysis technology and deep learning method. Human Activity Recognition (HAR), which is important issue in video surveillance research, is a field to detect abnormal behavior of pedestrians in CCTV environment. In order to recognize human behavior, it is necessary to detect the human in the image and to estimate the pose from the detected human. In this paper, we propose a novel approach for 2D Human Pose Estimation based on object detection using RGB-D information. By adding depth information to the RGB information that has some limitation in detecting object due to lack of topological information, we can improve the detecting accuracy. Subsequently, the rescaled region of the detected object is applied to ConVol.utional Pose Machines (CPM) which is a sequential prediction structure based on ConVol.utional Neural Network. We utilize CPM to generate belief maps to predict the positions of keypoint representing human body parts and to estimate human pose by detecting 14 key body points. From the experimental results, we can prove that the proposed method detects target objects robustly in occlusion. It is also possible to perform 2D human pose estimation by providing an accurately detected region as an input of the CPM. As for the future work, we will estimate the 3D human pose by mapping the 2D coordinate information on the body part onto the 3D space. Consequently, we can provide useful human behavior information in the research of HAR.

• Journal of the Korea Society of Computer and Information
• /
• v.14 no.5
• /
• pp.157-165
• /
• 2009

In this paper, we propose a distributed model that recognize ADLs of human can be occurred in daily living places. We collect and analyze user's environmental, location or activity information by simple sensor attached home devices or utensils. Based on these information, we provide a lifecare services by inferring the user's life pattern and health condition. But in order to provide a lifecare services well-refined activity recognition data are required and without enough inferred information it is very hard to build an ADL activity recognition model for high-level situation awareness. The sequence that generated by sensors are very helpful to infer the activities so we utilize the sequence to analyze an activity pattern and propose a distributed linear time inference algorithm. This algorithm is appropriate to recognize activities in small area like home, office or hospital. For performance evaluation, we test with an open data from MIT Media Lab and the recognition result shows over 75% accuracy.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.5
• /
• pp.2327-2347
• /
• 2018

Human actions can be recognized from depth sequences. In the proposed algorithm, we initially construct depth, motion maps (DMM) by projecting each depth frame onto three orthogonal Cartesian planes and add the motion energy for each view. The body part of the action (BPoA) is calculated by using bounding box with an optimal window size based on maximum spatial and temporal changes for each DMM. Furthermore, feature vector is constructed by using BPoA for each human action view. In this paper, we employed an ensemble based learning approach called Rotation Forest to recognize different actions Experimental results show that proposed method has significantly outperforms the state-of-the-art methods on Microsoft Research (MSR) Action 3D and MSR DailyActivity3D dataset.

• Journal of the Ergonomics Society of Korea
• /
• v.31 no.2
• /
• pp.271-279
• /
• 2012

Objective: This study classified three different emotional states(boredom, pain, and surprise) using physiological signals. Background: Emotion recognition studies have tried to recognize human emotion by using physiological signals. It is important for emotion recognition to apply on human-computer interaction system for emotion detection. Method: 122 college students participated in this experiment. Three different emotional stimuli were presented to participants and physiological signals, i.e., EDA(Electrodermal Activity), SKT(Skin Temperature), PPG(Photoplethysmogram), and ECG (Electrocardiogram) were measured for 1 minute as baseline and for 1~1.5 minutes during emotional state. The obtained signals were analyzed for 30 seconds from the baseline and the emotional state and 27 features were extracted from these signals. Statistical analysis for emotion classification were done by DFA(discriminant function analysis) (SPSS 15.0) by using the difference values subtracting baseline values from the emotional state. Results: The result showed that physiological responses during emotional states were significantly differed as compared to during baseline. Also, an accuracy rate of emotion classification was 84.7%. Conclusion: Our study have identified that emotions were classified by various physiological signals. However, future study is needed to obtain additional signals from other modalities such as facial expression, face temperature, or voice to improve classification rate and to examine the stability and reliability of this result compare with accuracy of emotion classification using other algorithms. Application: This could help emotion recognition studies lead to better chance to recognize various human emotions by using physiological signals as well as is able to be applied on human-computer interaction system for emotion recognition. Also, it can be useful in developing an emotion theory, or profiling emotion-specific physiological responses as well as establishing the basis for emotion recognition system in human-computer interaction.

• Journal of Korea Multimedia Society
• /
• v.25 no.6
• /
• pp.807-818
• /
• 2022

In order to further improve the accuracy and time efficiency of behavior recognition in intelligent monitoring scenarios, a human behavior recognition algorithm based on YOLO combined with LSTM and CNN is proposed. Using the real-time nature of YOLO target detection, firstly, the specific behavior in the surveillance video is detected in real time, and the depth feature extraction is performed after obtaining the target size, location and other information; Then, remove noise data from irrelevant areas in the image; Finally, combined with LSTM modeling and processing time series, the final behavior discrimination is made for the behavior action sequence in the surveillance video. Experiments in the MSR and KTH datasets show that the average recognition rate of each behavior reaches 98.42% and 96.6%, and the average recognition speed reaches 210ms and 220ms. The method in this paper has a good effect on the intelligence behavior recognition.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.18 no.6
• /
• pp.319-325
• /
• 2023

In this study, we proposed a method for hyperparameter optimization in the building and training of a deep learning model designed to process point cloud data collected by a millimeter-wave radar system. The primary aim of this study is to facilitate the deployment of a baseline model in resource-constrained IoT devices. We evaluated a RadHAR baseline deep learning model trained on a public dataset composed of point clouds representing five distinct human activities. Additionally, we introduced a coarse-to-fine hyperparameter optimization procedure, showing substantial potential to enhance model efficiency without compromising predictive performance. Experimental results show the feasibility of significantly reducing model size without adversely impacting performance. Specifically, the optimized model demonstrated a 3.3% improvement in classification accuracy despite a 16.8% reduction in number of parameters compared th the baseline model. In conclusion, this research offers valuable insights for the development of deep learning models for resource-constrained IoT devices, underscoring the potential of hyperparameter optimization and model size reduction strategies. This work contributes to enhancing the practicality and usability of deep learning models in real-world environments, where high levels of accuracy and efficiency in data processing and classification tasks are required.