• Title/Summary/Keyword: 주생활

Search Result 3,684, Processing Time 0.031 seconds

Evaluation of the Perception and Satisfaction of Working and Internship Abroad -By Undergraduates Studying in Culinary and Foodservice Departments- (해외 취업 및 인턴쉽에 대한 인식과 만족도에 관한 연구 -조리 및 외식관련 전공자를 대상으로-)

  • Choi, Young-Hee;Kim, Il-Soon;Kim, Soo-Yeun
    • Journal of the East Asian Society of Dietary Life
    • /
    • v.19 no.2
    • /
    • pp.287-294
    • /
    • 2009
  • This study was conducted to evaluate the perception and satisfaction of undergraduates majoring in culinary arts and food service with working and internship abroad. The responses of the participants to 10 questions regarding perception and 13 questions regarding the importance and satisfaction with working and internship abroad were measured on a 5 point Likert scale. The primary results were as follows : 1) The subjects were composed of 50.9% male and 49.1% female students, of which 42.1% were employed and 57.9% experienced an internship abroad. 2) Most students went abroad to gain experience with respect to various foreign cultures in response to recommendations by the western cuisine department. 3) The items "I wish to conduct my affairs continuously"(M=4.21) and "I have good relationships with my colleagues at work"(M=4.11) received the highest points from male and female respondents, respectively. 4) Male students considered "cooperation among divisions"(M=4.11), "language skills"(M=4.38), and "kitchen environment"(M=4.34) to be very important. However, female students believed that "language skills"(M=4.36),"social relationships"(M=4.21), and "wage income"(M=4.18) were most important. Furthermore, male students were most satisfied with "company size" (M=4.28), "kitchen environment"(M=4.21), and "business hours"(M=4.10), while female students were most satisfied with "kitchen environment","incentive"(M=4.14) and "social relationships"(M=4.11).

  • PDF

The Spatio-temporal Distribution of Organic Matter on the Surface Sediment and Its Origin in Gamak Bay, Korea (가막만 표층퇴적물중 유기물량의 시.공간적 분포 특성)

  • Noh Il-Hyeon;Yoon Yang-Ho;Kim Dae-Il;Park Jong-Sick
    • Journal of the Korean Society for Marine Environment & Energy
    • /
    • v.9 no.1
    • /
    • pp.1-13
    • /
    • 2006
  • A field survey on the spatio-temporal distribution characteristics and origins of organic matter in surface sediments was carried out monthly at six stations in Gamak Bay, South Korea from April 2000 to March 2002. The range of ignition loss(IL) was $4.6{\sim}11.6%(7.1{\pm}1.6%)$, while chemical oxygen demand(CODs) ranged from $12.25{\sim}99.26mgO_2/g-dry(30.98{\pm}19.09mgO_2/g-dry)$, acid volatile sulfide(AVS) went from no detection(ND)${\sim}10.29mgS/g-dry(1.02{\pm}0.58mgS/g-dry)$, and phaeopigment was $6.84{\sim}116.18{\mu}g/g-dry(23.72{\pm}21.16{\mu}g/g-dry)$. The ranges of particulate organic carbon(POC) and particulate organic nitrogen(PON) were $5.45{\sim}23.24 mgC/g-dty(10.34{\pm}4.40C\;mgC/g-dry)$ and $0.71{\sim}2.99mgN/g-dry(1.37{\pm}0.58mgN/g-dry)$, respectively. Water content was in the range of $43.1{\sim}77.6%(55.8{\pm}5.6%)$, and mud content(silt+clay) was higher than 95% at all stations. The spatial distribution of organic matter in surface sediments was greatly divided between the northwestern, central and eastern areas, southern entrance area from the distribution characteristic of their organic matters. The concentrations of almost all items were greater at the northwestern and southern entrance area than at the other areas in Gamak Bay. In particular, sedimentary pollution was very serious at the northwestern area, because the area had an excessive supply of organic matter due to aquaculture activity and the inflow of sewage from the land. These materials stayed longer because of the topographical characteristics of such as basin and the anoxic conditions in the bottom seawater environment caused by thermocline in the summer. The tendency of temporal change was most prominently in the period of high-water temperatures than low-water ones at the northwestern and southern entrance areas. On the other hand, the central and eastern areas did not show a regular trend for changing the concentrations of each item but mainly showed a higher tendency during the low-water temperatures. This was observed for all but AVS concentrations which were higher during the period of high-water temperature at all stations. Especially, the central and eastern areas showed a large temporal increase of AVS concentration during those periods of high-water temperature where the concentration of CODs was in excess of $20mgO_2/g-dry$. The results show that the organic matters in surface sediments in Gamak Bay actually originated from autochthonous organic matters with eight or less in average C/N ratio including the organic matters generated by the use of ocean, rather than terrigenous organic matters. However, the formation of autochthonous organic matter was mainly derived from detritus than living phytoplankton, indicated the results of the POC/phaeopigment ratio. In addition, the CODs/IL ratio results demonstrate that the detritus was the product of artificial activities such as dregs feeding and fecal pellets of farm organisms caused by aquaculture activities rather than the dynamic of natural ocean activities.

  • PDF

Environmental Pollution in Korea and Its Control (우리나라의 환경오염 현황과 그 대책)

  • 윤명조
    • Proceedings of the KOR-BRONCHOESO Conference
    • /
    • 1972.03a
    • /
    • pp.5-6
    • /
    • 1972
  • Noise and air pollution, which accompany the development of industry and the increase of population, contribute to the deterioration of urban environment. The air pollution level of Seoul has gradually increased and the city residents are suffering from a high pollution of noise. If no measures were taken against pollution, the amount of emission of pollutant into air would be 36.7 thousand tons per year per square kilometer in 1975, three times more than that of 1970, and it would be the same level as that of United States in 1968. The main sources of air pollution in Seoul are the exhaust has from vehicles and the combustion of bunker-C oil for heating purpose. Thus, it is urgent that an exhaust gas cleaner should be instaled to every car and the fuel substituted by less sulfur-contained-oil to prevent the pollution. Transportation noise (vehicular noise and train noise) is the main component of urban noise problem. The average noise level in downtown area is about 75㏈ with maximum of 85㏈ and the vehicular homing was checked 100㏈ up and down. Therefore, the reduction of the number of bus-stop the strict regulation of homing in downtown area and a better maintenance of car should be an effective measures against noise pollution in urban areas. Within the distance of 200 metres from railroad, the train noise exceeds the limit specified by the pollution control law in Korea. Especially, the level of noise and steam-whistle of train as measured by the ISO evaluation can adversely affect the community activities of residents. To prevent environmental destruction, many developed countries have taken more positive action against worsening pollution and such an action is now urgently required in this country.

  • PDF

Clinical Study of Pulmonary Tuberculosis for Admitted Patients at National Masan Tuberculosis Hospital (국립마산결핵병원에 입원한 환자에 대한 폐결핵의 임상적 동태에 관한 연구)

  • Park, Seung-Kyu;Choi, In-Hwan;Kim, Chul-Min;Kim, Cheon-Tae;Song, Sun-Dae
    • Tuberculosis and Respiratory Diseases
    • /
    • v.44 no.2
    • /
    • pp.241-250
    • /
    • 1997
  • Objective : Although the prevalence of pulmonary tuberculosis has decreased progressively after the national control program for tuberculosis began, nowadays the number of MDRTB is increasing seriously. MDRTB tends to be poor responsive to current antituberculosis regimens. It is mainly due to poor compliance, high rate of side reaction of secondary drugs, and limitation in number of available drugs. The purpose of present study is to evaluate the clinical features of pulmonary tuberculosis patients admitted in one national tuberculosis hospital and to expose the problems pertaining to current remedies, to increase the treatment efficacy for pulmonary tuberculosis including MDRTB in the end. Method : Retrospective analysis of 336 pulmonary tuberculosis patients admitted in National Masan Tuberculosis Hospital was done. Contents of analysis were patients profile, the first diagnosed time and medical institutes, family history, residence, previous treatment history, chief complaints at the time of admission, lesion site on chest X -ray film, combined deseases, side reaction to antibuberculosis drugs, used drugs before admission and the results of drug sensitivity test. Results : The ratio between male and female was 4 : 1. Age showed relatively even distribution from 3rd to 6 th decades. 64.6% of the patients was diagnosed at public health center. Weight loss was the most common complaint at admission. Bilateral lesions on chest X-ray films were 59.8%. 130patients had combined desease, of which DM was the most common(37.7%). 95patients had family history, of which parents were the most common(41.7%). According to the time of first diagnosis, 31 patients were diagnosed before 1980, and after then the number of patients was increased by degrees. Residence overwhelmed in pusan and gyung-nam province. 258 patients got previous treatment history, of which 112 patients(43.4%) had more than 3 times and only 133 patients(51.6%)got regular medication. 97 patients used more than other 3 drugs in addition to INH, EMB, RFP and PZA before admission. 154 patients were informed with the results of drug sensitivity test. of which 77 patients had resistance to more than 5 drugs. Gastrointestinal problem was the most common in side reaction to drugs. Conclusion : In the case of weight loss of unknown cause, tuberculosis should be suspected. In first treatment, sufficient and satisfactory explanation for tuberculosis is necessary and treatment period should not be stict to 6 month-short term therapy. In retreatment, new drugs should not be added to used drugs even though drug sensitivity results show sensitivity to some of them. Proper time for surgical intervention should not be delayed.

  • PDF

A study on the factors to affect the career success among workers with disabilities (지체장애근로자의 직업성공 요인에 관한 연구)

  • Lee, Dal-Yob
    • 한국사회복지학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.185-216
    • /
    • 2003
  • This study was aimed at investigating important factors influencing career success among regular workers. The current researcher scrutinized the degree to which variables and factors affect the career success and occupational turnover rates of the research participants. At the same tune, two hypothetical path models established by the researcher were examined using linear multiple regression methods and the LISREL. After examining the differences among the factors of career success, a comparison was made between the disabled worker group and the non-disabled worker group. A questionnaire using the 5-point Likert scale was distributed to a group of 374 workers with disabilities and 463 workers without disabilities. For the data analysis purpose, the structural equation model, factor analysis, correlation analysis, and multiple regression analysis were carried out. The results of this study ran be summarized as follows. First, the results of factor analysis showed important categories of conceptual themes of career success. The initial conceptual factor model did not accord with the empirical one. A three-factorial model revealed categories of personal, family, and organizational factor respectively. The personal factor was composed of the self-esteem and self-efficiency. The family factor was consisted of the multi-roles stress and the number of children. Finally, the organizational factor was composed of the capacity for utilizing resources, networking, and the frequency of mentoring. In addition, the total 10 sub areas of career success were divided by two important aspects; the subjective career success and the objective career success. Second, both research participant groups seemed to be influenced by their occupational types. However, all predictive variables excluding the wage rate and the average length of work years had significant impact on job success for the disabled work group, while all the variables excluding the frequency of advice and length of working years had significant impact on job success for the non-disabled worker group. Third, the turnover rate was significantly influenced by the age and the experience of turnover of the research participants. However, the number of co-workers was the strongest predictive variable for the worker group with disabilities, but the occupation choice variable for the worker group without disabilities. For the disabled worker group, the turnover rate was differently influenced by the type of occupation, the length of working years, while multi-role stress and the average working years at the time of turnover for the worker group without disabilities. Fifth, as a result of verifying the hypothetical path model, it showed that the first model was somewhat proper and could predict the career success on both research participant groups. In the second model, the Chi-square, the degree of freedom (($x^2=64.950$, df=61, P=0.341), and the adjusted Goodness of Fit Index (AGFI) were .964, and the Comparative Fit Index (CFI) were .997, and the Root Mean Squared Residual (RMR) was respectively. .038. The model was best fitted and could predict the career success more highly because the goodness of fit index in the whole models was within the allowed range. In conclusion, the following research implications can be suggested. First, the occupational type of research participants was one of the most important variables to predict the career success for both research participant groups. It means that people with disabilities require human development services including education. They need to improve themselves in this knowledge-based society. Furthermore, for maintaining the career success, people with disabilities should be approached by considering the subjective career success aspects including wages and the promotion opportunities than the objective career success aspects.

  • PDF

A Study on the Relationship between Health Food and Health-Related Factors by Residence and Sex in Tong-Yeong Area (거주지역 및 성에 따른 통영지역주민의 건강식품 이용실태 및 건강관련 제요인과의 관련성)

  • Lee, Bog-Ri;Jeong, Bo-Young;Kim, In-Soo;Moon, Soo-Kyung
    • Journal of the Korean Society of Food Science and Nutrition
    • /
    • v.34 no.6
    • /
    • pp.840-849
    • /
    • 2005
  • In order to investigate the relationship between intake conditions of health food and health-related factors by residence and sex in Tong-Young area, a survey was carried out from 1,303 adults. Health foods were classified 3 groups including vitamin and mineral supplements, toner foods and manufactured health food supplements. Health-related factors were stress, fatigue, smoking and drinking. The $29.5\%$ of the subjects had taken some health food for health. Especially the male took more toner foods habitually than the female did. In take of vitamin and mineral supplements by residence, there was a significant difference $(p\leq0.01)$ as follows. The subjects in island $(20.0\%)$ who took vitamin/mineral supplements were about two times as compared with the subjects in Dong $(10.8\%)$, or Eub-Myeon $(10.0\%)$. The subjects taking supplementary food replied over fair $(82.8\%)$, the subjects taking toner food replied over fair (90.3$\%$) scored higher than who replied bad or very bad in self-perceived health status. Therefore, the better the subjects felt self-perceived health status, the more they took health foods for health themselves. In self-perceived stress status, the subjects who replied a little $(50.0\%,\;45.3\%)$ or little $(19.9\%,\;26.4\%)$, took vitamin and mineral supplements or manufactured health foods a lot. In toner food there was a significant correlation $(p\leq0.05)$ as follows. The less the subjects felt stress, the more they took dietry supplement. No smoker $(12.9\%)$intake rate of vitamin and mineral supplements was higher than smoker $(8.8\%)$. Smokers $(6.5\%)$ intake rate of toner food was higher than no smoker $(4.0\%)$. It was not significant the relationship between intake condition of health food and drinking. The main motivation for taking health food were by self-decision and invitation of friends or neighbors.

Application of OECD Agricultural Water Use Indicator in Korea (우리나라에 적합한 OECD 농업용수 사용지표의 설정)

  • Hur, Seung-Oh;Jung, Kang-Ho;Ha, Sang-Keun;Song, Kwan-Cheol;Eom, Ki-Cheol
    • Korean Journal of Soil Science and Fertilizer
    • /
    • v.39 no.5
    • /
    • pp.321-327
    • /
    • 2006
  • In Korea, there is a growing competitive for water resources between industrial, domestic and agricultural consumer, and the environment as many other OECD countries. The demand on water use is also affecting aquatic ecosystems particularly where withdrawals are in excess of minimum environmental needs for rivers, lakes and wetland habits. OECD developed three indicators related to water use by the agriculture in above contexts : the first is a water use intensity indicator, which is expressed as the quantity or share of agricultural water use in total national water utilization; the second is a water stress indicator, which is expressed as the proportion of rivers (in length) subject to diversion or regulation for irrigation without reserving a minimum of limiting reference flow; and the third is a water use efficiency indicator designated as the technical and the economic efficiency. These indicators have different meanings in the aspect of water resource conservation and sustainable water use. So, it will be more significant that the indicators should reflect the intrinsic meanings of them. The problem is that the aspect of an overall water flow in the agro-ecosystem and recycling of water use not considered in the assessment of agricultural water use needed for calculation of these water use indicators. Namely, regional or meteorological characteristics and site-specific farming practices were not considered in the calculation of these indicators. In this paper, we tried to calculate water use indicators suggested in OECD and to modify some other indicators considering our situation because water use pattern and water cycling in Korea where paddy rice farming is dominant in the monsoon region are quite different from those of semi-arid regions. In the calculation of water use intensity, we excluded the amount of water restored through the ground from the total agricultural water use because a large amount of water supplied to the farm was discharged into the stream or the ground water. The resultant water use intensity was 22.9% in 2001. As for water stress indicator, Korea has not defined nor monitored reference levels of minimum flow rate for rivers subject to diversion of water for irrigation. So, we calculated the water stress indicator in a different way from OECD method. The water stress indicator was calculated using data on the degree of water storage in agricultural water reservoirs because 87% of water for irrigation was taken from the agricultural water reservoirs. Water use technical efficiency was calculated as the reverse of the ratio of irrigation water to a standard water requirement of the paddy rice. The efficiency in 2001 was better than in 1990 and 1998. As for the economic efficiency for water use, we think that there are a lot of things to be taken into considerations to make a useful indicator to reflect socio-economic values of agricultural products resulted from the water use. Conclusively, site-specific, regional or meteorogical characteristics as in Korea were not considered in the calculation of water use indicators by methods suggested in OECD(Volume 3, 2001). So, it is needed to develop a new indicators for the indicators to be more widely applicable in the world.

Corporate Default Prediction Model Using Deep Learning Time Series Algorithm, RNN and LSTM (딥러닝 시계열 알고리즘 적용한 기업부도예측모형 유용성 검증)

  • Cha, Sungjae;Kang, Jungseok
    • Journal of Intelligence and Information Systems
    • /
    • v.24 no.4
    • /
    • pp.1-32
    • /
    • 2018
  • In addition to stakeholders including managers, employees, creditors, and investors of bankrupt companies, corporate defaults have a ripple effect on the local and national economy. Before the Asian financial crisis, the Korean government only analyzed SMEs and tried to improve the forecasting power of a default prediction model, rather than developing various corporate default models. As a result, even large corporations called 'chaebol enterprises' become bankrupt. Even after that, the analysis of past corporate defaults has been focused on specific variables, and when the government restructured immediately after the global financial crisis, they only focused on certain main variables such as 'debt ratio'. A multifaceted study of corporate default prediction models is essential to ensure diverse interests, to avoid situations like the 'Lehman Brothers Case' of the global financial crisis, to avoid total collapse in a single moment. The key variables used in corporate defaults vary over time. This is confirmed by Beaver (1967, 1968) and Altman's (1968) analysis that Deakins'(1972) study shows that the major factors affecting corporate failure have changed. In Grice's (2001) study, the importance of predictive variables was also found through Zmijewski's (1984) and Ohlson's (1980) models. However, the studies that have been carried out in the past use static models. Most of them do not consider the changes that occur in the course of time. Therefore, in order to construct consistent prediction models, it is necessary to compensate the time-dependent bias by means of a time series analysis algorithm reflecting dynamic change. Based on the global financial crisis, which has had a significant impact on Korea, this study is conducted using 10 years of annual corporate data from 2000 to 2009. Data are divided into training data, validation data, and test data respectively, and are divided into 7, 2, and 1 years respectively. In order to construct a consistent bankruptcy model in the flow of time change, we first train a time series deep learning algorithm model using the data before the financial crisis (2000~2006). The parameter tuning of the existing model and the deep learning time series algorithm is conducted with validation data including the financial crisis period (2007~2008). As a result, we construct a model that shows similar pattern to the results of the learning data and shows excellent prediction power. After that, each bankruptcy prediction model is restructured by integrating the learning data and validation data again (2000 ~ 2008), applying the optimal parameters as in the previous validation. Finally, each corporate default prediction model is evaluated and compared using test data (2009) based on the trained models over nine years. Then, the usefulness of the corporate default prediction model based on the deep learning time series algorithm is proved. In addition, by adding the Lasso regression analysis to the existing methods (multiple discriminant analysis, logit model) which select the variables, it is proved that the deep learning time series algorithm model based on the three bundles of variables is useful for robust corporate default prediction. The definition of bankruptcy used is the same as that of Lee (2015). Independent variables include financial information such as financial ratios used in previous studies. Multivariate discriminant analysis, logit model, and Lasso regression model are used to select the optimal variable group. The influence of the Multivariate discriminant analysis model proposed by Altman (1968), the Logit model proposed by Ohlson (1980), the non-time series machine learning algorithms, and the deep learning time series algorithms are compared. In the case of corporate data, there are limitations of 'nonlinear variables', 'multi-collinearity' of variables, and 'lack of data'. While the logit model is nonlinear, the Lasso regression model solves the multi-collinearity problem, and the deep learning time series algorithm using the variable data generation method complements the lack of data. Big Data Technology, a leading technology in the future, is moving from simple human analysis, to automated AI analysis, and finally towards future intertwined AI applications. Although the study of the corporate default prediction model using the time series algorithm is still in its early stages, deep learning algorithm is much faster than regression analysis at corporate default prediction modeling. Also, it is more effective on prediction power. Through the Fourth Industrial Revolution, the current government and other overseas governments are working hard to integrate the system in everyday life of their nation and society. Yet the field of deep learning time series research for the financial industry is still insufficient. This is an initial study on deep learning time series algorithm analysis of corporate defaults. Therefore it is hoped that it will be used as a comparative analysis data for non-specialists who start a study combining financial data and deep learning time series algorithm.

A Study on the Traditional House Landscape Styles Recorded in 'Jipkyungjaeyoungsi(集景題詠詩, Series of Poems on Gardens Poetry)' ('집경제영시(集景題詠詩)'를 통해 본 전통주택의 조경문화 향유양상)

  • Shin, Sang Sup
    • Korean Journal of Heritage: History & Science
    • /
    • v.49 no.3
    • /
    • pp.32-51
    • /
    • 2016
  • This study examines, based on the database of the Institute for the Translation of Korean Classics(ITKC), the garden plants and their symbolism, and the landscape culture recorded in 'Jipkyungjaeyoungsi(the Series of Poems on Gardens Poetry)' in relevance to traditional houses. First, Jipkyungjaeyoungsi had been continuously written since mid-Goryeo dynasty, when it was first brought in, until the late Joseon dynasty. It was mainly enjoyed by the upper class who chose the path of civil servants. 33 pieces of Jaeyoungsi(題詠詩) in 25 books out of a total of 165 books are related to residential gardens. The first person who wrote a poem in relation to this is believed to be Lee GyuBo(1168~1241) in the late Goryeo dynasty. He is believed to be the first person to contribute to the expansion of natural materials and the variation of entertainment in landscape culture with such books as 'Toesikjaepalyoung(退食齋八詠)', 'Gabeunjeungyukyoung(家盆中六詠)'and 'Gapoyukyoung(家圃六詠)'. Second, most of the poems used the names of the guesthouses. Out of the 33 sections, 19(57.5%) used 8 yeong(詠), then it was in the sequence of 4 yeong(詠), 6 yeong, 10 yeong, 14 yeong, 15 yeong, 16 yeong, 36 yeong(詠) and so on. In the poem writing, it appears to break the patterns of Sosangpalkyung(瀟湘八景) type of writings and is differentiated by (1) focusing on the independent title of the scenery, (2) combining the names of the place and landscape, (3) focusing on the name of the landscape. Third, the subtitles were derived from (1) mostly natural landscape focused on nature and garden plants(22 sections, 66.7%), (2) cultural landscape focused on landscape facilities such as guesthouses, ponds and pavilions(3 sections), (3) complex cultural scenery focused on the activities of people in nature(8 sections). Residents enjoy not only their aesthetic preferences and actual view, but the ideation of the scenery. Especially, they display attachment to and preference for vegetables and herbs, which had been neglected. Fourth, the percentage of deciduous tree population(17 species) rated higher(80.9%) compared to the evergreens(4 species). These aspects are similar results with the listed rate in 'Imwonkyungjaeji(林園經濟志)' by Seo YuGu [evergreen 18 species(21.2%) and deciduous trees 67 species(78.8%)] and precedent researches [Byun WooHyuk(1976), Jung DongOh(1977), Lee Sun(2006)]. Fifth, the frequency of the occurrence of garden plants were plum blossoms(14 times), bamboos(14 times), pine trees(11 times), lotus(11 times), chrysanthemum(10 times), willows(5 times), pomegranates(4 times), maple trees(14 times), royal foxglove trees, common crapemyrtle, chestnut trees, peony, plantains, reeds and a cockscombs(2 times). Thus, the frequency were higher with symbolic plants in relations to (1) Confucian norms(pine trees, oriental arbor vitae, plum blossoms, chrysanthemums, bamboos and lotus), (2) living philosophy of sustain-ability(chrysanthemum, willow), (3) the ideology of seclusion and seeking peace of mind(royal foxglove ree, bamboo). Sixth, it was possible to trace plants in the courtyard and outer garden, vegetable and herb garden. Many symbolic plants were introduced in the courtyard, and it became cultural landscape beyond aesthetic taste. In the vegetable and herb garden, vegetables, fruits and medicinal plants are apparently introduced for epigenetic use. The plants that were displayed to be observed and enjoyed were the sweet flag, pomegranate, daphne odora, chrysanthemum, bamboo, lotus and plum blossom. Seventh, it was possible to understand garden culture related to landscaping materials through poetic words such as pavilions, ponds, stream, flower pot, oddly shaped stones, backyard, orchard, herb garden, flower bed, chrysanthemum fence, boating, fishing, passing the glass around, feet bathing, flower blossom, forest of apricot trees, peach blossoms, stroking the pine tree, plum flower blossoming through the snow and frosted chrysanthemum.

A Deep Learning Based Approach to Recognizing Accompanying Status of Smartphone Users Using Multimodal Data (스마트폰 다종 데이터를 활용한 딥러닝 기반의 사용자 동행 상태 인식)

  • Kim, Kilho;Choi, Sangwoo;Chae, Moon-jung;Park, Heewoong;Lee, Jaehong;Park, Jonghun
    • Journal of Intelligence and Information Systems
    • /
    • v.25 no.1
    • /
    • pp.163-177
    • /
    • 2019
  • As smartphones are getting widely used, human activity recognition (HAR) tasks for recognizing personal activities of smartphone users with multimodal data have been actively studied recently. The research area is expanding from the recognition of the simple body movement of an individual user to the recognition of low-level behavior and high-level behavior. However, HAR tasks for recognizing interaction behavior with other people, such as whether the user is accompanying or communicating with someone else, have gotten less attention so far. And previous research for recognizing interaction behavior has usually depended on audio, Bluetooth, and Wi-Fi sensors, which are vulnerable to privacy issues and require much time to collect enough data. Whereas physical sensors including accelerometer, magnetic field and gyroscope sensors are less vulnerable to privacy issues and can collect a large amount of data within a short time. In this paper, a method for detecting accompanying status based on deep learning model by only using multimodal physical sensor data, such as an accelerometer, magnetic field and gyroscope, was proposed. The accompanying status was defined as a redefinition of a part of the user interaction behavior, including whether the user is accompanying with an acquaintance at a close distance and the user is actively communicating with the acquaintance. A framework based on convolutional neural networks (CNN) and long short-term memory (LSTM) recurrent networks for classifying accompanying and conversation was proposed. First, a data preprocessing method which consists of time synchronization of multimodal data from different physical sensors, data normalization and sequence data generation was introduced. We applied the nearest interpolation to synchronize the time of collected data from different sensors. Normalization was performed for each x, y, z axis value of the sensor data, and the sequence data was generated according to the sliding window method. Then, the sequence data became the input for CNN, where feature maps representing local dependencies of the original sequence are extracted. The CNN consisted of 3 convolutional layers and did not have a pooling layer to maintain the temporal information of the sequence data. Next, LSTM recurrent networks received the feature maps, learned long-term dependencies from them and extracted features. The LSTM recurrent networks consisted of two layers, each with 128 cells. Finally, the extracted features were used for classification by softmax classifier. The loss function of the model was cross entropy function and the weights of the model were randomly initialized on a normal distribution with an average of 0 and a standard deviation of 0.1. The model was trained using adaptive moment estimation (ADAM) optimization algorithm and the mini batch size was set to 128. We applied dropout to input values of the LSTM recurrent networks to prevent overfitting. The initial learning rate was set to 0.001, and it decreased exponentially by 0.99 at the end of each epoch training. An Android smartphone application was developed and released to collect data. We collected smartphone data for a total of 18 subjects. Using the data, the model classified accompanying and conversation by 98.74% and 98.83% accuracy each. Both the F1 score and accuracy of the model were higher than the F1 score and accuracy of the majority vote classifier, support vector machine, and deep recurrent neural network. In the future research, we will focus on more rigorous multimodal sensor data synchronization methods that minimize the time stamp differences. In addition, we will further study transfer learning method that enables transfer of trained models tailored to the training data to the evaluation data that follows a different distribution. It is expected that a model capable of exhibiting robust recognition performance against changes in data that is not considered in the model learning stage will be obtained.