A Study on Market Size Estimation Method by Product Group Using Word2Vec Algorithm (Word2Vec을 활용한 제품군별 시장규모 추정 방법에 관한 연구)
-
- Journal of Intelligence and Information Systems
- /
- v.26 no.1
- /
- pp.1-21
- /
- 2020
With the rapid development of artificial intelligence technology, various techniques have been developed to extract meaningful information from unstructured text data which constitutes a large portion of big data. Over the past decades, text mining technologies have been utilized in various industries for practical applications. In the field of business intelligence, it has been employed to discover new market and/or technology opportunities and support rational decision making of business participants. The market information such as market size, market growth rate, and market share is essential for setting companies' business strategies. There has been a continuous demand in various fields for specific product level-market information. However, the information has been generally provided at industry level or broad categories based on classification standards, making it difficult to obtain specific and proper information. In this regard, we propose a new methodology that can estimate the market sizes of product groups at more detailed levels than that of previously offered. We applied Word2Vec algorithm, a neural network based semantic word embedding model, to enable automatic market size estimation from individual companies' product information in a bottom-up manner. The overall process is as follows: First, the data related to product information is collected, refined, and restructured into suitable form for applying Word2Vec model. Next, the preprocessed data is embedded into vector space by Word2Vec and then the product groups are derived by extracting similar products names based on cosine similarity calculation. Finally, the sales data on the extracted products is summated to estimate the market size of the product groups. As an experimental data, text data of product names from Statistics Korea's microdata (345,103 cases) were mapped in multidimensional vector space by Word2Vec training. We performed parameters optimization for training and then applied vector dimension of 300 and window size of 15 as optimized parameters for further experiments. We employed index words of Korean Standard Industry Classification (KSIC) as a product name dataset to more efficiently cluster product groups. The product names which are similar to KSIC indexes were extracted based on cosine similarity. The market size of extracted products as one product category was calculated from individual companies' sales data. The market sizes of 11,654 specific product lines were automatically estimated by the proposed model. For the performance verification, the results were compared with actual market size of some items. The Pearson's correlation coefficient was 0.513. Our approach has several advantages differing from the previous studies. First, text mining and machine learning techniques were applied for the first time on market size estimation, overcoming the limitations of traditional sampling based- or multiple assumption required-methods. In addition, the level of market category can be easily and efficiently adjusted according to the purpose of information use by changing cosine similarity threshold. Furthermore, it has a high potential of practical applications since it can resolve unmet needs for detailed market size information in public and private sectors. Specifically, it can be utilized in technology evaluation and technology commercialization support program conducted by governmental institutions, as well as business strategies consulting and market analysis report publishing by private firms. The limitation of our study is that the presented model needs to be improved in terms of accuracy and reliability. The semantic-based word embedding module can be advanced by giving a proper order in the preprocessed dataset or by combining another algorithm such as Jaccard similarity with Word2Vec. Also, the methods of product group clustering can be changed to other types of unsupervised machine learning algorithm. Our group is currently working on subsequent studies and we expect that it can further improve the performance of the conceptually proposed basic model in this study.
A survey on nutrient recovery by rice plant was carried out countrywide in 1967 and 1968. The relationships between percent recovery of fertilizer nutrient and climatic zone or deposition mode, drainage grade, and texture of paddy soil profile, or chemical characteristics of surface soil were as follows. 1. The percent recovery of fertilizer nitrogen was highest in south and least in north, and that of potassium was highest in south and least in middle climatic zone. 2. Since the percent recovery of Phosphorus variates yearly with climatic zone, mode of deposition drainage grade or soil texture, it seemed to depend greatly on soil-weather interaction. 3. Nitrogen recovery was highest in alluvial colluvial (AC) and it was followed by alluvial (A), fluvomarine (FM) and old alluvial in decreasing order while potassium recovery was OA>AC>A>FM. 4. The greater the drainage was, the higher the nitrogen recovery. The recovery of potassium and phosphorus tended to show high in moderately well drain, and low in poorly and well drain. 5. Nitrogen recovery was highest in fine silty and gradually decreased with coarseness. That of potassium or phosphorus was greater in those below fine loamy than in those above coarse silty. 6. Nitrogen recovery was high in Jisan, Geugrag, and Sindab series, and low in Hwadong, Gyuam, Yongji and Hwabong series. 7. Nitrogen recovery showed significant positive correlation with the content of organic matter (OM), Ca, CEC of surface soil and only in the year of high phosphorus recovery it had significant negative correlation with soil phosphorus. Phosphorus recovery had significant posititive correlation with CEC, Mg or Ca. 8. Potassium recovery showed negative correlation with K/(Ca+Mg), P, OM or K while positive correlation with Ca, Mg, CEC but significant only with K/(Ca+Mg) in the year of low potassium recovery. In the year of high K recovery it showed positive correlation with P, OM, K/(Ca+Mg) or K while negative with CEC, Mg or Ca but significant only with P, OM or CEC. Soil potassium has significant positive correlation with soil OM and P only in the year of low potassium recovery. 9. The percent recovery of N, P or K showed negative correlation coefficient with pH without significant. 10. There was significant positive correlation between OM and P, K or K/(Ca+Mg), P and K or K/(Ca+Mg), K and K/(Ca+Mg), Mg or CEC, Ca and K/(Ca+Mg), Mg, CEC or pH, Mg and CEC while significant negative correlation between Mg and OM, P or K/(Ca+Mg), P and CEC, Ca and K/(Ca+Mg). 11. From the percent rcovery of fertilizer and soil chemical characteristics it was known that soil organic matter increase nitrogen uptake, that K uptake has closer relation to K/(Ca+Mg) than K, that Mg affects P ugtake, and that the annual difference of P and K recovery was partly explainable.
For the purpose of establishing the systematized technical scheme of the cooperative rice cultivation which has most significant impact to improve rice productivity and the farm management, the author have studied the cultivation practices, and the variation of rice growth and yield between the cooperative rice cultivation and the individual rice cultivation at random selected 18 paddy fields. The author also have investigated through comparative method on the cultivation practices, management, organization and operation scheme of the two different rice cultivation methods at 460 paddy fields. The economic feasibility has been ana lysed and added in this report. The results obtained from this study are summarized as follows; 1. In the nursery, the average amount of fertilizer application, especially, phosphate and potassium, and the frequency of chemicals spray for the disease, insect and pest control at the cooperative rice cultivation are significantly higher than those of the individual rice cultivation. 2. The cultivation techniques of the cooperative rice farming after the transplanting can be characterized by a) the earlier transplanting of rice, b) the denser hills per unit area and the lesser number of seedlings per hill, c) the application of larger quantities of fertilizer including nitrogen, phosphate and potassium, d) more divided application of fertilizers, split doses of the nitrogen and potassium, e) the increased frequencies of the chemicals spray for the prevention of disease, insect and pest damages. 3. The rate of lodging in the cooperative rice cultivation was slightly higher than that of the individual rice cultivation, however, the losses of rice yield owing to the occurrence of rice stem borer and grass leaf roller in the cooperative rice cultivation were lower than that of the individual rice cultivation. 4. The culm length, panicle length, straw weight and grain-straw ratio are respectively higher at the cooperative rice cultivation, moreover, the higher variation of the above factors due to different localities of the paddy fields found at the individual rice cultivation. 5. The number of panicles, number of flowers per panicle and the weight of 1, 000 grains, those contributing components to the rice yield were significantly greater in the cooperative rice cultivation, however, not clear difference in the maturing rate was observed. The variation coefficient of the yield component in the cooperative cultivation showed lower than that or the individual rice cultivation. 6. The average yield of brown rice per 10 are in the cooperative rice cultivation obtained 459.0 kilograms while that of the individual rice cultivation brought 374.8 kilograms. The yield of brown rice in the cooperative rice cultivation increased 84.2 kilogram per 10 are over the individual rice cultivation. With lower variation coefficient of the brown rice yield in the cooperative rice cultivation, it can be said that uniformed higher yield could be obtained through the cooperative rice cultivation. 7. Highly significant positive correlations shown between the seeding date and the number of flowers per panicle, the chemical spray and the number of flowers per panicle, the transplanting date and the number of flowers per panicle, phosphate application and yield, potassium application and maturing rate, the split application of fertilizers and yield. Whilst the significant negative correlation was shown between the transplanting date and the maturing rate 8. The results of investigation from 480 paddy fields obtained through comparative method on the following items are identical in general with those obtained at 18 paddy fields: Application of fertilizers, chemical spray for the control of disease, insects and pests both in the nursery and the paddy field, transplanting date, transplanting density, split application of fertilizers and yield n the paddy fields. a) The number of rice varieties used in the cooperative rice cultivation were 13 varieties while the individual rice cultivation used 47 varieties. b) The cooperative rice cultivation has more successfully adopted improved cultivation techniques such as the practice of seed disinfection, adoption of recommended seeding amount, fall ploughing, application of red soil, introduction of power tillers, the rectangular-type transplanting, midsummer drainage and the periodical irrigation. 9. The following results were also obtained from the same investigation and they are: a) In the cooperative rice cultivation, the greater part of the important practices have been carried out through cooperative operation including seed disinfection, ploughing, application of red soil and compost, the control of disease, insects and pests, harvest, threshing and transportation of the products. b) The labor input to the nursery bed and water control in the cooperative rice cultivation was less than that of the individual rice cultivation while the higher rate of labor input was resulted in the red soil and compost application. 10. From the investigation on the organization and operation scheme of the cooperative rice cultivation, the following results were obtained: a) The size of cooperative rice cultivation farm was varied from. 3 ha to 7 ha and 5 ha farm. occupied 55.9 percent of the total farms. And a single cooperative farm was consisted of 10 to 20 plots of paddies. b) The educational back ground of the staff members involved in the cooperative rice cultivation was superior than that of the individual rice cultivation. c) All of the farmers who participated to the questionaires have responded that the cooperative rice cultivation could promise the increased rice yield mainly through the introduction of the improved method of fertilizer application and the effective control of diseases, insects and pests damages. And the majority of farmers were also in the opinion that preparation of the materials and labor input can be timely carried out and the labor requirement for the rice cultivation possibly be saved through the cooperative rice cultivation. d) The farmers who have expressed their wishes to continue and to make further development of the cooperative rice cultivation was 74.5 percent of total farmers participated to the questionaires. 11. From the analysis of economical feasibility on the two different methods of cultivation, the following results were obtained: a) The value of operation cost for the compost, chemical fertilizers, agricultural chemicals and labor input in the cooperative rice cultivation was respectively higher by 335 won, 199 won, 288 won and 303 won over the individual rice cultivation. However, the other production costs showed no distinct differences between the two cultivation methods. b) Although the total value of expenses for the fertilizers, agricultural chemicals, labor input and etc. in the cooperative rice cultivation were approximately doubled to the amount of the individual rice cultivation, the net income, substracted operation costs from the gross income, was obtained 24, 302 won in the cooperative rice cultivation and 20, 168 won was obtained from the individual rice cultivation. Thereby, it can be said that net income from the cooperative rice cultivation increased 4, 134 won over the individual rice cultivation. It was revealed in this study that the cooperative rice cultivation has not only contributed to increment of the farm income through higher yield but also showed as an effective means to introduce highly improved cultivation techniques to the farmers. It may also be concluded, therefore, the cooperative rice cultivation shall continuously renovate the rice production process of the farmers.
The levels of health knowledge, attitude and practice of housewives considerably effect to the health of households, communities and the nation. This study was designed to grasp the levels of health knowledge, attitude and practice of houswives and analyse the various factors effecting to health in order to provide health education services as well as materials for effective formulation and implementation of health policy to improve the health of the nation. This study has been conducted through interviews by trained surveyers for 4,281 housewives selected from 4,500 households throughout the country for 40 days during July 11-August 20, 1983. The results of survey were analysed by stepwise multiple regression and path analysis are summarized as follows; 1. Based on the measurement instrument applied to this study, the levels of health knowledge, attitude and practice of housewives were extremely low with 54.5 points out of 100 points in full. Higher level with 72 points and above was approximately 21 percent and lower level with 39 points and below was approx. 24 percent. The middle level was approx. 55 percent. In order to implement health programs successively, health education should be more strengthened and to improve the level of health knowledge, attitude and practice (KAP) of the nation, political consideration as a part of spiritual reformation must be concentrated on health. 2. The level of health knowledge indicated the highest points with 57.3 the level of attitude was the second with 55.0 points and the practice level was the lowest with 50.0 point. Therefore, planning and implementation of health education program must be based on the persuasion and motivation that health knowledge turn into practice. 3. Housewives who had higher level of health knowledge, showed their practice level was relatively lower and those who had middle or low level of it practice level was the reverse. 4. Correlations among health knowledge, attitude and practice (KAP) were generally higher and statistically significant at 0.1 percent level. Correlation between total health KAP level and health knowledge was the highest with r=.8092. 5. Health KAP levels showed significant differences according to the age, number of children, marital status, self-assessed health status and concern on health of the housewives interviewed (p<0.001) 6. Health KAP levels also showed significant differences according to the education level, economic status, employment before marriage and grown-up area of the housewives interviewed. (p<0.001) 7. Heath KAP levels showed significant differences according to health insurance benificiary and the existence of patients in the family. (p<0.001). 8. Health KAP levels showed significant differences according to distance to government organizations, schools, distance to health facilities, telephone possession rate, television possession rate, newspaper reading rate and activities of Ban meeting and Women's club. (p<0.001) 9. Health KAP levels showed significant differences according to electric mass communication media such as television, radio and village broadcasting etc. and printed media such as newspaper, magazine and booklets etc., IEC variables such as individual consultation and husband-wife communication, however, there was no significance with group training. 10. Health KAP of the housewives showed close correlation with personal characteristics variables, i.e., education level (r=.5302), age (r=-.3694) grown-up area (r=.3357) and employment before marriage. In general, correlation of health knowledge level was higher than the levels of attitude or practice. In case of health concern and health insurance, correlation of practice level was higher than health knowledge level. 11. Health KAP levels showed higher correlation with community environmental characteristics, Ban meeting and activity of Women's club, however, no correlation with New-village movement. 12. Among IEC variables, husband-wife communication showed the highest correlation with health KAP levels and printed media, electric mas communication media and health consultation in order. Therefore, encouragement of husband-wife communication and development of training program for men should be included in health education program. 13. Mass media such as electric mass com. and printed media were effective for knowledge transmission and husband-wife communication and individual consultation were effective for health practice. Group training was significant for knowledge transmission, however, but not significant for attitude formation or turning to health practice. To improve health KAP levels, health knowledge should be transmitted via mass media and health consultation with health professionals and field health workers should be strengthened. 14. Correlation of health KAP levels showed that knowledge level was generally higher than that of practice and recognized that knowledge was not linked with attitude or practice. 15. The twenty-five variables effecting health KAP levels of housewives had 41 per cent explanation variances among which education level had great contribution (β=.2309) and electric mass com. media (β=.1778), husband-wife communication (β=.1482), printed media, grown-up area, and distance to government organizations in order. Variances explained (R²) of health KAP were 31%, 15%, and 30% respectively. 16. Principal variables contributed to health KAP were education level (β=.12320, β=.1465), electric mass comm. media (β=.1762, β=.1839), printed media, (β=.1383, β=.1420) husband-wife communication (β=.1004, β=.1067), grown-up area and distance to government organizations, in order. Since education level contributes greatly to health KAP of the housewives, health education including curriculum development in primary, middle and high schools must be emphasized and health science must be selected as one of the basic liberal arts subject in universities. 17. Variences explained of IEC variables to health KAP were 19% in total, 14% in knowledge, 9% in attitude, and 10% in health practice. Contributions of IEC variables to health KAP levels were printed media (β=.3882), electric mass comm media (β=.3165), husb-band wife com. (β=.2095,) and consultation on health (β=.0841) in order, however, group training showed negative effect (β=-.0402). National fund must be invested for the development of Health Program through mass media such as TV and radio etc. and for printed materials such as newspaper, magazines, phamplet etc. needed for transmission of health knowledge. 18. Variables contributed to health KAP levels through IEC variables with indirect effects were education level (Ind E=0.0410), health concern (Ind E=.0161), newspaper reading rate (Ind E=.0137), TV possession rate and activity of Ban meeting in order, however, health facility showed negative effect (Ind E=-.0232) and other variables showed direct effect but not indirect effect. 19. Among the variables effecting health KAP level, education level showed the highest in total effect (TE=.2693) then IEC (TE=.1972), grown-up city (TE=.1237), newspaper reading rate (TE=.1020), distance to government organization (TE=.095) in order. 20. Variables indicating indirect effects to health KAP levels were; at knowledge level with R²=30%, education level (Ind E=.0344), newspaper reading rate (Ind E=.0112), TV possession rate (Ind E=.0689), activity of Ban meeting (Ind E=.0079) in order and at attitude level with R²=13%, education level (Ind E=. 0338), activity of Ban meeting (Ind E=.0079), and at practice level with R²=29%. education level (Ind E=.0268), health facility (Ind E=.0830) and concern on health (Ind E=.0105). 21. Total effect to health KAP levels and IEC by variable characteristics, personal characteristics variables indicated larger than community characteristics variables. 22. Multiple Correlation Coefficient (MCC) expressed by the Personal Characteristic Variable was .5049 and explained approximately 25% of variances. MCC expressed by total Community environment variable was .4283 and explained approx. 18% of variances. MCC expressed by IEC Variables was .4380 and explained approx. 19% of variances. The most important variable effected to health KAP levels was personal characteristic and then IEC variable, Community Environment variable in order. When the IEC effected with personal characteristic or community characteristic, the MCC or the variances were relatively higher than effecting alone. Therefore it was identified that the IEC was one of the important intermediate variable.
The genetic diagnosis methods by RT-PCR and Virion capture (VC)/RT-PCR against Rice stripe virus (RSV) were developed. Three diagnosis methods of seedling test, ELISA and RT-PCR were compared in virus detection sensitivity (VDS) for RSV. The VDS of ELISA for RSV viruliferous small brown plant hopper (SBPH) was higher with 40.5% than that of seedling test. The VDS of RT-PCR was higher with 21% than that of ELISA. The VDS of ELISA and VC/RT-PCR was same with 9.2% in average on the SBPH collected from fields at the areas of Gimpo, Pyungtaeg and Sihueng, Gyeonggi province in 2009. The specific primers of RSV for SBPH and rice plant were developed for the diagnosis by Real time PCR. The RQ value of Real time PCR for the viruliferous and non viruliferous SBPH was 1 for 50 heads of non viruliferous SBPH, 96.5 for 50 heads of viruliferous SBPH, 23.1 for 10 heads of viruliferous SBPH + 40 heads of non viruliferous SBPH, and 75.6 for 30 heads of viruliferous SBPH + 20 heads of non viruliferous SBPH. The RQ value was increased positively by the ratio of viruliferous SBPH. Full sequences of 4 genomes of RSV RNA1, RNA2, RNA3 and RNA4 were analysed for the 13 RSV isolates from rice plants collected from different areas. Genetic relationships among the RSV isolates of Korea, Japan and China were classified as China + Korea, and China + Korea + Japan by phylogenetic analysis for RSV RNA1 and RNA2. In case of RNA3 involved in pathogenicity, genetic relationship of RSV among the three countries was grouped into 3 as China, China + Korea, and Korea + Japan. According to the genetic relationships in RSV RNA4, RSV isolates were grouped into 4 as China, Korea, China + Korea + Japan, and Korea + Japan. Viruliferous insect rate (VIR) of RSV in average increased in each year from 2008 to 2010, and the rates were 4.3%, 6.1%, and 7.2%, respectively, at the 28 major rice production areas in 7 provinces including Gyeonggido. The highest VIR in each year was 11.3% of Gyeonggido in 2008, 20.1% of Jellanamdo in 2009 and 14.2% of Chungcheongbukdo in 2010. The highest VIR depending upon the investigated areas was 22.1% at Buan of Jellabukdo in 2008, 36% at Wando and Jindo of Jellanamdo in 2009, and 30.0% at Boeun of Chungcheongbukdo in 2010. Average population density (APD) of overwintered SBPH was 13.1 heads in 2008, 13.9 heads in 2009 and 5.6 heads in 2010. The highest APD was 39.1 and 60.4 heads at Buan of Jellabukdo in 2008 and 2009, respectively, and 14.0 heads at Pyungtaeg of Gyeonggido. The acreage of RSV occurred fields was 869 ha in the western and southern parts, mainly at Jindo and Wando areas, of Jellanamdo in 2008. In 2009, RSV occurred in the acreage of 21,541 ha covered whole country, especially, partial and whole plant death were occurred with infection rate of 55.2% at 3,025 plots in 53 Li, 39 Eup/Myun, 19 Si/Gun of Gyeonggido, Incheonsi, Chungcheongnamdo, Jeollabukdo and Jeollanamdo. Seasonal development of overwintered SBPH was investigated at Buan, Jeollabukdo, and Jindo, Jeollanamdo for 3 years from 2008. Most SBPH developed to the 3rd and 4th instar on the periods of May 20 to June 10, and they developed to the adult stage for the 1st generation on Mid and Late June. In 2009, all SBPH trapped by sky net trap were adult on May 31 to June 1 at Mid-western aeas of Taean, Seosan and Buan, and South-western areas of Sinan and Jindo. The population density of adult SBPH was 963 heads at Taean, 919 at Seocheon and 819 at Sinan area. The origin of these higher population of adult SBPH were verified from the population of non-overwintered SBPH but immigrant SBPH. From Mid May to Mid June in 2010, adult SBPH could not be counted as immigrant insects by sky net trap. The variation of RSV VIR was high with 2.1% to 9.5% for immigrant adult SBPH trapped by sky net trap at Hongsung of Chungcheongbukdo, Buan of Jeollabukdo and so forth in 2009. The highest VIR for the immigrant adult SBPH was 9.5% at Boryung of Chungcheongnamdo, followed by 7.9% at Hongsung of Chungcheongnamdo, 6.5% at Younggwang of Jeollanamdo, and 6.4% at Taean of Cheongcheongnamdo. The infection rate of RSV on rice plants induced by the immigrant adult SBPH cultivated near sky net trap after about 10 days from immigration on June 12 in 2009 was 84.6% at Taean, 65.4% at Buan and 92.9% at Jindo, and 81% in average through genetic diagnosis of RT-PCR. Barley known as a overwintering host plant of RSV had very low infection rate of 0.2% from 530 specimens collected at 10 areas covering whole country including Pyungtaeg of Gyeonggido. Twenty nine plant species were newly recorded as natural hosts of RSV. In winter annual plant species, 11 plants including Vulpia myuros showed RSV infection rate of 24.9%. The plant species in summer annual ecotype were 13 including Digitaria ciliaris with 44.9%, Echinochloa crusgalli var. echinata with 95.2% and Setaria faberi with 65.5% in infection rate of RSV. Five perennial plants including Miscanths sacchariflorus with infection rate of 33.3% were recorded as hosts of RSV. Rice cultivars, 8 susceptible cultivars including Donggin1 and 17 resistant ones including Samgwang, were screened in field conditions at 3 different areas of Buan, Iksan and Ginje in 2009. All the susceptible cultivars were showed typical symptom of mosaic and wilt. In 17 genetic resistant cultivar, 12 cultivars were susceptible, however, 5 cultivars were field-resistant plus genetic resistant to RSV as non symptom expression. When RSV was artificially inoculated at seedling stage to 4 cultivars known as genetic resistant and 3 cultivars known as genetic susceptible, the symptom expression in resistant cultivars was lower as 19.3% in average than that of 53.3% in susceptible ones. In comparison of symptom expression rate and viral infection rate using resistant Nampyung and susceptible Heugnam cultivars by artificial inoculation of RSV at seedling stage, the symptom expression of Heugnam was higher as 28% than 12% of Nampyung. However, virion infection of resistant Nampyung cultivar was higher as 12% reversely than 85% of susceptible Heugnam. Yield loss of rice was investigated by the artificial inoculation of RSV at the seedling stage of resistant cultivars of Nampyung and Onnuri, and susceptible cultivars of Donggin1 and Ungwang for 3 years from 2008. The average yield per plant was 7.8 g, 8.5 g and 13.8 g on rice plants inoculated at seedling stage, tillering stage and maximum tillering stage, respectively. The yield loss rate was increased by earlier infection of RSV with 51% at seedling stage, 46% at tillering stage and 13% at maximum tillering stage. In resistant rice cultivars, there was no statistically significant relation between infection time and yield loss. In natural fields on susceptible rice cultivar of Ungwang at Taean and Jindo areas in 2009, the yield loss rate was increased with same tendency to the infection hill rate having the corelation coefficient of 0.94 when the viral infection was over 23.4%.
To grasp canonical correlations, their related backgrounds in various growth factors of stem, the characteristics of stem by synthetical dispersion analysis, principal component analysis and canonical correlation analysis as optimum method were applied to Larix leptolepis. The results are as follows; 1) There were high or low correlation among all factors (height (