A Deep Learning Based Approach to Recognizing Accompanying Status of Smartphone Users Using Multimodal Data (스마트폰 다종 데이터를 활용한 딥러닝 기반의 사용자 동행 상태 인식)
-
- Journal of Intelligence and Information Systems
- /
- v.25 no.1
- /
- pp.163-177
- /
- 2019
As smartphones are getting widely used, human activity recognition (HAR) tasks for recognizing personal activities of smartphone users with multimodal data have been actively studied recently. The research area is expanding from the recognition of the simple body movement of an individual user to the recognition of low-level behavior and high-level behavior. However, HAR tasks for recognizing interaction behavior with other people, such as whether the user is accompanying or communicating with someone else, have gotten less attention so far. And previous research for recognizing interaction behavior has usually depended on audio, Bluetooth, and Wi-Fi sensors, which are vulnerable to privacy issues and require much time to collect enough data. Whereas physical sensors including accelerometer, magnetic field and gyroscope sensors are less vulnerable to privacy issues and can collect a large amount of data within a short time. In this paper, a method for detecting accompanying status based on deep learning model by only using multimodal physical sensor data, such as an accelerometer, magnetic field and gyroscope, was proposed. The accompanying status was defined as a redefinition of a part of the user interaction behavior, including whether the user is accompanying with an acquaintance at a close distance and the user is actively communicating with the acquaintance. A framework based on convolutional neural networks (CNN) and long short-term memory (LSTM) recurrent networks for classifying accompanying and conversation was proposed. First, a data preprocessing method which consists of time synchronization of multimodal data from different physical sensors, data normalization and sequence data generation was introduced. We applied the nearest interpolation to synchronize the time of collected data from different sensors. Normalization was performed for each x, y, z axis value of the sensor data, and the sequence data was generated according to the sliding window method. Then, the sequence data became the input for CNN, where feature maps representing local dependencies of the original sequence are extracted. The CNN consisted of 3 convolutional layers and did not have a pooling layer to maintain the temporal information of the sequence data. Next, LSTM recurrent networks received the feature maps, learned long-term dependencies from them and extracted features. The LSTM recurrent networks consisted of two layers, each with 128 cells. Finally, the extracted features were used for classification by softmax classifier. The loss function of the model was cross entropy function and the weights of the model were randomly initialized on a normal distribution with an average of 0 and a standard deviation of 0.1. The model was trained using adaptive moment estimation (ADAM) optimization algorithm and the mini batch size was set to 128. We applied dropout to input values of the LSTM recurrent networks to prevent overfitting. The initial learning rate was set to 0.001, and it decreased exponentially by 0.99 at the end of each epoch training. An Android smartphone application was developed and released to collect data. We collected smartphone data for a total of 18 subjects. Using the data, the model classified accompanying and conversation by 98.74% and 98.83% accuracy each. Both the F1 score and accuracy of the model were higher than the F1 score and accuracy of the majority vote classifier, support vector machine, and deep recurrent neural network. In the future research, we will focus on more rigorous multimodal sensor data synchronization methods that minimize the time stamp differences. In addition, we will further study transfer learning method that enables transfer of trained models tailored to the training data to the evaluation data that follows a different distribution. It is expected that a model capable of exhibiting robust recognition performance against changes in data that is not considered in the model learning stage will be obtained.
First, The spatial distribution characteristics of old big trees were analyzed using ArcGIS figures by combining basic information such as species and ages of old big trees in Handan City, which were compiled by the local bureau of landscaping. The types of species, distribution by ages of trees, ownership status, growth status, and diversity status were comprehensively analyzed. Statistically, Styphnolobium, Acacia, Gleditsia, and Albizia of Fabaceae accounted for the majority, of which Sophora japonica accounted for the highest proportion. Sophora japonica is widely and intensively distributed to each prefecture and district in Handan city. According to the age and distribution, the old big trees over 1000 years old were mainly Sophora japonica, Zelkova serrata, Juniperus chinensis, Morus australis Koidz., Dalbergia hupeana Hance, Ceratonia siliqua L., and Pistacia chinensis, and Platycladus orientalis. Second, as found in each type of old big tree status, various types of old big tree status were investigated, the protection management system, protection management process, and protection management benefits were studied, and the protection of old big tree was closely related to the growth environment. Currently, the main driving force behind the protection of old big trees is the worship of old big trees. By depositing its sacredness to the old big tree and sublimating the natural character that nature gave to the old big tree into a guiding consciousness of social activities, nature's "beauty" and personality's "goodness" are well combined. The protection state of the old big tree is closely related to the degree of interaction with the surrounding environment and the participation of various cultures and subjects. In the process of continuously interacting with the surrounding environment during the long-term growth of old big trees, it seems that a natural sanctuary was formed around old big trees in the process of voluntarily establishing a "natural-cultural-scape" system involving bottom-up and top-down cross-regions, multicultural and multi-subjects. Third, China focused on protecting and recovering old big trees, but the protection management system is poor due to a lack of comprehensive consideration of historical and cultural values, plant diversity significance, and social values of old big trees in the management process. Three indicators of space's regional characteristics, property and protection characteristics, and value characteristics can be found in the evaluation of the natural characteristics of old giant trees, which are highly valuable in terms of traditional consciousness management, resource protection practice, faith system construction, and realization of life community values. A systematic management system should be supported as to whether they can be protected and developed for a long time. Fourth, as the perception of protected areas is not yet mature in China, "natural sanctuary" should be treated as an important research content in the process of establishing a nature reserve system. The form of natural sanctuary management, which focuses on bottom-up community participation, is a strong supplement to the current type of top-down nature reserve management in China. Based on this, the protection of old giant trees should be included in the form of a nature reserve called a natural monument in the nature reserve system. In addition, residents of the area around the nature reserve should be one of the main agents of biodiversity conservation.
It is not new that today's business organizations are expected to exhibit ethical and moral management and to carry out social responsibility as a good corporate citizen. Since South Korea emerged as a newly industrialized country during the 1980s, Korean corporations have become active in carrying out their social responsibility as a good corporate citizen to society. In spite of the short history of corporate social responsibility, Korean companies have actively participated in corporate philanthropy. Corporations' significant donations to various social causes, no-lay-off policies, corporate volunteerism and green marketing are evidences of their commitment to corporate citizenship. Corporate social responsibility is now an essential management practice whereby corporation can strengthen its sustainable value creation processes by enhancing the trust assets underlying the relationships between the business and the stakeholders. Much of the conceptual work in the area of corporate social responsibility(CSR) has originated from researches conducted in the management field. Carroll(1979) proposed that corporations have four types of social responsibilities: economic, legal, ethical and philanthropic responsibility. Most past research has investigated CSR and its impact on consumers' attitudes toward the corporations and corporate performances. Although there exists a large body of literature on how consumers perceive and respond to CSR, the majority of past studies were conducted in the United States. The stability and applicability of past findings need to be tested across different national/cultural settings, especially since corporate social responsibility is a reflection of implicit conformation with the expectations and criticism that society may have toward a corporation(Matten and Moon, 2004). In this study, we explored whether people in Korea perceive CSR of Korean corporations in the same four dimensions as done in the United States and what were the measurement items tapping each of these four dimensions. In order to investigate the dimensions of CSR and the measurement items for CSR perceived by Korean people, nine focus group interviews were conducted with several stakeholder groups(two with undergraduate students, two with graduate students, three with general consumers, and two with NGO groups). Scripts from the interviews revealed that the Korean stakeholders perceived four types of CSR which are the same as those proposed by Carroll(1979). However we found CSR issues unique to Korean corporations. For example for the economic responsibility, Korean people mentioned that the corporation needed to contribute to the economic development of the country by generating corporate profits. For the legal responsibility, Koreans included the "corporation need to follow the consumer protection law." For the ethical responsibility, they considered that the corporation needed to not promote false advertisement. In addition, Koreans thought that an ethical company should do transparent management. For the philanthropic responsibility, people in Korea thought that a corporation needed to return parts of its profits to the society for the betterment of society. The 28 items were developed based on the results of the nine focus group interviews, while considering the scale developed by Maignan and Ferrell(2001). Following the procedure proposed by Churchill(1979), we started by developing an item poll consisting of 28 items and purified the initial pool of items through exploratory, confirmatory factor analyses. 176 samples were sued for this analysis. Confirmatory factor analysis was performed on the 28 items in order to verify the underlying four factor structure. Study 1 provided new measurement items for tapping the Korean CSR dimensions, which can be useful for the future studies exploring the effects of CSR on Korean consumers' attitudes toward the corporations and corporate performances. And we found the CSR scale(17 items) has good reliability, discriminant validity and nomological validity. Economic Responsibility: "XYZ company continuously improves the quality of our products", "XYZ company has a procedure in place to respond to customer complaint", "XYZ company contributes to the economic development of our country by generating profits", "XYZ company is eager to hire people". Legal Responsibility: "XYZ company's products meet legal standards", "XYZ company seeks to comply with all laws regulating hiring and employee benefits", "XYZ company honors contractual obligations to its suppliers", "XYZ company's managers try to comply with the law related to the business operation". Ethical Responsibility: "XYZ company has a comprehensive code of conduct", "XYZ company does not promote a false or misleading advertisement", "XYZ company seems to conduct a transparent business", "XYZ company does a fair business with its suppliers or sub-contractors". Philanthropic Responsibility: "XYZ company encourages partnerships with local businesses and schools", "XYZ company supports sports and cultural activities", "XYZ company gives adequate contributions to charities considering its business size", "XYZ company encourages employees to support our community". Study 2 was condusted for comprehensive validity. 655 samples were used for this anlysis. Collected samples were tested by factor analysis and Crnbach's Alpha coefficiednts and were found to be satisfactory in terms of validity and reliability. Furthermore, fitness of the measurement model was tested by using conformatory factor analysis. χ2=880.73(df=160), GFI=0.891, AGFI=0.854, NFI=0.908, NNFI=0.913, RMR=0.059, RMESA=0.070. We hope that CSR scale could greatly facilitate research on Corporate social resposibility, it is by no means the final answer.
Seongjusa Temple was founded in Boryeong in Chungcheongnam-do Province by Monk Muyeom (800-888), better known as Nanghye Hwasang. After returning from studying in China, Muyeom stayed in the Silla capital city of Gyeongju for a period. He later settled in a temple that was managed by the descendants of Kim In-mun (629-694). He then restored a burned-out temple and opened it in 847 as a Seon (Zen) temple named Seongjusa. It prospered and grew to become a large-scale temple with several halls within its domains. The influence of Seongjusa in the region can be seen in the Historical Record of Seongjusa Temple on Sungamsan Mountain, which relates that there were seventy-three rooms within the domains of the temple. What is most notable in the record is that the temple is referred to as "栴檀林九間," which means either "a structure with nine rooms built with Chinese juniper wood" or "a place that houses Chinese juniper wood and has nine rooms." Regardless of the interpretation, Seongjusa Temple had a large amount of juniper wood. Around this time, the term "juniper" referred to the olibanum tree (Boswellia sacra) native to the islands of Java and Sumatra in Southeast Asia. It is presumed that at some point after the death of Jang Bogo, the maritime forces that controlled the southwestern coast of Korea may have acquired a large amount of Southeast Asian olibanum wood and offered it to Seongjusa Temple. During the reign of King Munseong, Kim Yang (808-857) patronized Seongjusa Temple and its head monk Muyeom, who enjoyed a lofty reputation in the region. He sought to strengthen his own position as a member of the royal lineage of King Muyeol and create a bridge between the royal family and Seongjusan Buddhist sect. The court of King Wonseong designated Seongjusa Temple as a regional base for the support of royal authority in an area where anti-royal sentiment remained strong. Monk Muyeom is believed to have created an iron Buddha to protect the temple, enlighten the people, and promote regional stability. Given that the Seongjusa community had expanded to include more than 2,000 followers, the iron Buddha at Seongjusa Temple would have been perceived as an image that rallied the local residents. It is assumed that there were two iron Buddhas at Seongjusa Temple. The surviving parts of these Buddhas and the size of their pedestals suggest that they were respectively enshrined in the Geumdang Main Hall and the Samcheonbuljeon Hall of Three Thousand Buddhas. It is presumed that the first iron Buddha in Geumdang was a large statue over two meters in height and the second one was medium-sized with the height over one meter. The Historical Record of Seongjusa Temple on Sungamsan Mountain contains the phrase "改創選法堂五層重閣" which indicates that a multistoried Geumdang was newly built to enshrine a large Buddha sculpture like the first iron Buddha when Seongjusa Temple was founded. Also, according to the Stele of Seongjusa Temple and the surviving finger fragments, the first Buddha was making the fear-not and wish-granting (abhayavarada) mudras. The main Buddha of Seongjusa Temple is possibly Nosana Buddha, just like the main Buddhas at the contemporaneous temples Silsangsa, Borimsa, and Samhwasa. Given that Monk Muyeom studied Hwaeom teachings in his early years and received royal patronage upon his return, it is believed that the retro tendencies of the Hwaeom school, centered on the royal family of the Silla Dynasty, were reflected in Seongjusa temple.
Just before the Korean War, the total number of the North Korean troops was 198,380, while that of the ROK(Republic of Korea) army troops 105,752. That is, the total number of the ROK army troops at that time was 53.3% of the total number of the North Korean army. As of December 2008, the total number of the North Korean troops is estimated to be 1,190,000, while that of the ROK troops is 655,000, so the ROK army maintains 55.04% of the total number of the North Korean troops. If the ROK army continues to reduce its troops according to [Military Reform Plan 2020], the total number of its troops will be 517,000 m 2020. If North Korea maintains the current status(l,190,000 troops), the number of the ROK troops will be 43.4% of the North Korean army. In terms of units, just before the Korean War, the number of the ROK army divisions and regiments was 80% and 44.8% of North Korean army. As of December 2008, North Korea maintains 86 divisions and 69 regiments. Compared to the North Korean army, the ROK army maintains 46 Divisions (53.4% of North Korean army) and 15 regiments (21.3% of North Korean army). If the ROK army continue to reduce the military units according to [Military Reform Plan 2020], the number of ROK army divisions will be 28(13 Active Division, 4 Mobilization Divisions and 11 Local Reserve Divisions), while that of the North Korean army will be 86 in 2020. In that case, the number of divisions of the ROK army will be 32.5% of North Korean army. During the Korean war, North Korea suddenly invaded the Republic of Korea and occupied its capital 3 days after the war began. At that time, the ROK army maintained 80% of army divisions, compared to the North Korean army. The lesson to be learned from this is that, if the ROK army is forced to disperse its divisions because of the simultaneous invasion of North Korea and attack of guerrillas in home front areas, the Republic of Korea can be in a serious military danger, even though it maintains 80% of military divisions of North Korea. If the ROK army promotes the plans in [Military Reform Plan 2020], the number of military units of the ROK army will be 32.5% of that of the North Korean army. This ratio is 2.4 times lower than that of the time when the Korean war began, and in this case, 90% of total military power should be placed in the DMZ area. If 90% of military power is placed in the DMZ area, few troops will be left for the defense of home front. In addition, if the ROK army continues to reduce the troops, it can allow North Korea to have asymmetrical superiority in military force and it will eventually exert negative influence on the stability and peace of the Korean peninsular. On the other hand, it should be reminded that, during the Korean War, the Republic of Korea was attacked by North Korea, though it kept 53.3% of troops, compared to North Korea. It should also be reminded that, as of 2008, the ROK army is defending its territory with the troops 55.04% of North Korea. Moreover, the national defense is assisted by 25,120 troops of the US Forces in Korea. In case the total number of the ROK troops falls below 43.4% of the North Korean army, it may cause social unrest about the national security and may lead North Korea's misjudgement. Besides, according to Lanchester strategy, the party with weaker military power (60% compared to the party with stronger military power) has the 4.1% of winning possibility. Therefore, if we consider the fact that the total number of the ROK army troops is 55.04% of that of the North Korean army, the winning possibility of the ROK army is not higher than 4.1%. If the total number of ROK troops is reduced to 43.4% of that of North Korea, the winning possibility will be lower and the military operations will be in critically difficult situation. [Military Reform Plan 2020] rums at the reduction of troops and units of the ground forces under the policy of 'select few'. However, the problem is that the financial support to achieve this goal is not secured. Therefore, the promotion of [Military Reform Plan 2020] may cause the weakening of military defence power in 2020. Some advanced countries such as Japan, UK, Germany, and France have promoted the policy of 'select few'. However, what is to be noted is that the national security situation of those countries is much different from that of Korea. With the collapse of the Soviet Unions and European communist countries, the military threat of those European advanced countries has almost disappeared. In addition, the threats those advanced countries are facing are not wars in national level, but terrorism in international level. To cope with the threats like terrorism, large scaled army trops would not be necessary. So those advanced European countries can promote the policy of 'select few'. In line with this, those European countries put their focuses on the development of military sections that deal with non-military operations and protection from unspecified enemies. That is, those countries are promoting the policy of 'select few', because they found that the policy is suitable for their national security environment. Moreover, since they are pursuing common interest under the European Union(EU) and they can form an allied force under NATO, it is natural that they are pursing the 'select few' policy. At present, NATO maintains the larger number of troops(2,446,000) than Russia(l,027,000) to prepare for the potential threat of Russia. The situation of japan is also much different from that of Korea. As a country composed of islands, its prime military focus is put on the maritime defense. Accordingly, the development of ground force is given secondary focus. The japanese government promotes the policy to develop technology-concentrated small size navy and air-forces, instead of maintaining large-scaled ground force. In addition, because of the 'Peace Constitution' that was enacted just after the end of World War II, japan cannot maintain troops more than 240,000. With the limited number of troops (240,000), japan has no choice but to promote the policy of 'select few'. However, the situation of Korea is much different from the situations of those countries. The Republic of Korea is facing the threat of the North Korean Army that aims at keeping a large-scale military force. In addition, the countries surrounding Korea are also super powers containing strong military forces. Therefore, to cope with the actual threat of present and unspecified threat of future, the importance of maintaining a carefully calculated large-scale military force cannot be denied. Furthermore, when considering the fact that Korea is in a peninsular, the Republic of Korea must take it into consideration the tradition of continental countries' to maintain large-scale military powers. Since the Korean War, the ROK army has developed the technology-force combined military system, maintaining proper number of troops and units and pursuing 'select few' policy at the same time. This has been promoted with the consideration of military situation in the Koran peninsular and the cooperation of ROK-US combined forces. This kind of unique military system that cannot be found in other countries can be said to be an insightful one for the preparation for the actual threat of North Korea and the conflicts between continental countries and maritime countries. In addition, this kind of technology-force combined military system has enabled us to keep peace in Korea. Therefore, it would be desirable to maintain this technology-force combined military system until the reunification of the Korean peninsular. Furthermore, it is to be pointed out that blindly following the 'select few' policy of advanced countries is not a good option, because it is ignoring the military strategic situation of the Korean peninsular. If the Republic of Korea pursues the reduction of troops and units radically without consideration of the threat of North Korea and surrounding countries, it could be a significant strategic mistake. In addition, the ROK army should keep an eye on the fact the European advanced countries and Japan that are not facing direct military threats are spending more defense expenditures than Korea. If the ROK army reduces military power without proper alternatives, it would exert a negative effect on the stable economic development of Korea and peaceful reunification of the Korean peninsular. Therefore, the desirable option would be to focus on the development of quality of forces, maintaining proper size and number of troops and units under the technology-force combined military system. The tableau above shows that the advanced countries like the UK, Germany, Italy, and Austria spend more defense expenditure per person than the Republic of Korea, although they do not face actual military threats, and that they keep achieving better economic progress than the countries that spend less defense expenditure. Therefore, it would be necessary to adopt the merits of the defense systems of those advanced countries. As we have examined, it would be desirable to maintain the current size and number of troops and units, to promote 'select few' policy with increased defense expenditure, and to strengthen the technology-force combined military system. On the basis of firm national security, the Republic of Korea can develop efficient policies for reunification and prosperity, and jump into the status of advanced countries. Therefore, the plans to reduce troops and units in [Military Reform Plan 2020] should be reexamined. If it is difficult for the ROK army to maintain its size of 655,000 troops because of low birth rate, the plans to establish the prompt mobilization force or to adopt drafting system should be considered for the maintenance of proper number of troops and units. From now on, the Republic of Korean government should develop plans to keep peace as well as to prepare unexpected changes in the Korean peninsular. For the achievement of these missions, some options can be considered. The first one is to maintain the same size of military troops and units as North Korea. The second one is to maintain the same level of military power as North Korea in terms of military force index. The third one is to maintain the same level of military power as North Korea, with the combination of the prompt mobilization force and the troops in active service under the system of technology-force combined military system. At present, it would be not possible for the ROK army to maintain such a large-size military force as North Korea (1,190,000 troops and 86 units). So it would be rational to maintain almost the same level of military force as North Korea with the combination of the troops on the active list and the prompt mobilization forces. In other words, with the combination of the troops in active service (60%) and the prompt mobilization force (40%), the ROK army should develop the strategies to harmonize technology and forces. The Korean government should also be prepared for the strategic flexibility of USFK, the possibility of American policy change about the location of foreign army, radical unexpected changes in North Korea, the emergence of potential threat, surrounding countries' demand for Korean force for the maintenance of regional stability, and demand for international cooperation against terrorism. For this, it is necessary to develop new approaches toward the proper number and size of troops and units. For instance, to prepare for radical unexpected political or military changes in North Korea, the Republic of Korea should have plans to protect a large number of refugees, to control arms and people, to maintain social security, and to keep orders in North Korea. From the experiences of other countries, it is estimated that 115,000 to 230,000 troops, plus ten thousands of police are required to stabilize the North Korean society, in the case radical unexpected military or political change happens in North Korea. In addition, if the Republic of Korea should perform the release of hostages, control of mass destruction weapons, and suppress the internal wars in North Korea, it should send 460,000 troops to North Korea. Moreover, if the Republic of Korea wants to stop the attack of North Korea and flow of refugees in DMZ area, at least 600,000 troops would be required. In sum, even if the ROK army maintains 600,000 troops, it may need additional 460,000 troops to prepare for unexpected radical changes in North Korea. For this, it is necessary to establish the prompt mobilization force whose size and number are almost the same as the troops in active service. In case the ROK army keeps 650,000 troops, the proper number of the prompt mobilization force would be 460,000 to 500,000.
Needless to say, the management of national forest in all countries is very important in view of the national mission and management purposes. Korean national forest is also in particular significant in promoting national economy for the continuous increasing of the demand for wood, conservation of the land and social welfare. But there's no denying the fact that the leading aim of the Korean forest policy has been based upon the conservation of forest resources and recovery of land conservation function instead of improvement of the forest productive capacity. Therefore, the management of national forest should be aimed as an industry in the chain of the Korean national economy. And the increment of the forest productive capacity based on rationalized forest management is also urgently needed. Not only the increment of the timber production but also the establishment of the good forest in quality and quantity are to bring naturally many functions of conservation and other public benefits. In 1908 Korean national forest was historically established for the first time as a result of the notification for ownership, and was divided into two kinds in 1911-1924, such as indisposable national forest for land conservation, forest management, scientific research and public welfare, and the other national forest to be disposed. Indisposable forest is mostly under the jurisdiction of national forest stations (Chungbu, Tongbu, Nambu), and the tother national forests are under custody of respective cities and provinces, and under custody of the other government authorities. As of the end of 1971, national forest land is 19.5% (1,297,708 ha) of the total forest land area, but growing stock is 50.1% (