• Title/Summary/Keyword: benchmark model

Search Result 722, Processing Time 0.028 seconds

Development of Information Extraction System from Multi Source Unstructured Documents for Knowledge Base Expansion (지식베이스 확장을 위한 멀티소스 비정형 문서에서의 정보 추출 시스템의 개발)

  • Choi, Hyunseung;Kim, Mintae;Kim, Wooju;Shin, Dongwook;Lee, Yong Hun
    • Journal of Intelligence and Information Systems
    • /
    • v.24 no.4
    • /
    • pp.111-136
    • /
    • 2018
  • In this paper, we propose a methodology to extract answer information about queries from various types of unstructured documents collected from multi-sources existing on web in order to expand knowledge base. The proposed methodology is divided into the following steps. 1) Collect relevant documents from Wikipedia, Naver encyclopedia, and Naver news sources for "subject-predicate" separated queries and classify the proper documents. 2) Determine whether the sentence is suitable for extracting information and derive the confidence. 3) Based on the predicate feature, extract the information in the proper sentence and derive the overall confidence of the information extraction result. In order to evaluate the performance of the information extraction system, we selected 400 queries from the artificial intelligence speaker of SK-Telecom. Compared with the baseline model, it is confirmed that it shows higher performance index than the existing model. The contribution of this study is that we develop a sequence tagging model based on bi-directional LSTM-CRF using the predicate feature of the query, with this we developed a robust model that can maintain high recall performance even in various types of unstructured documents collected from multiple sources. The problem of information extraction for knowledge base extension should take into account heterogeneous characteristics of source-specific document types. The proposed methodology proved to extract information effectively from various types of unstructured documents compared to the baseline model. There is a limitation in previous research that the performance is poor when extracting information about the document type that is different from the training data. In addition, this study can prevent unnecessary information extraction attempts from the documents that do not include the answer information through the process for predicting the suitability of information extraction of documents and sentences before the information extraction step. It is meaningful that we provided a method that precision performance can be maintained even in actual web environment. The information extraction problem for the knowledge base expansion has the characteristic that it can not guarantee whether the document includes the correct answer because it is aimed at the unstructured document existing in the real web. When the question answering is performed on a real web, previous machine reading comprehension studies has a limitation that it shows a low level of precision because it frequently attempts to extract an answer even in a document in which there is no correct answer. The policy that predicts the suitability of document and sentence information extraction is meaningful in that it contributes to maintaining the performance of information extraction even in real web environment. The limitations of this study and future research directions are as follows. First, it is a problem related to data preprocessing. In this study, the unit of knowledge extraction is classified through the morphological analysis based on the open source Konlpy python package, and the information extraction result can be improperly performed because morphological analysis is not performed properly. To enhance the performance of information extraction results, it is necessary to develop an advanced morpheme analyzer. Second, it is a problem of entity ambiguity. The information extraction system of this study can not distinguish the same name that has different intention. If several people with the same name appear in the news, the system may not extract information about the intended query. In future research, it is necessary to take measures to identify the person with the same name. Third, it is a problem of evaluation query data. In this study, we selected 400 of user queries collected from SK Telecom 's interactive artificial intelligent speaker to evaluate the performance of the information extraction system. n this study, we developed evaluation data set using 800 documents (400 questions * 7 articles per question (1 Wikipedia, 3 Naver encyclopedia, 3 Naver news) by judging whether a correct answer is included or not. To ensure the external validity of the study, it is desirable to use more queries to determine the performance of the system. This is a costly activity that must be done manually. Future research needs to evaluate the system for more queries. It is also necessary to develop a Korean benchmark data set of information extraction system for queries from multi-source web documents to build an environment that can evaluate the results more objectively.

Hydro-Mechanical Modelling of Fault Slip Induced by Water Injection: DECOVALEX-2019 TASK B (Step 1) (유체 주입에 의한 단층의 수리역학적 거동 해석: 국제공동연구 DECOVALEX-2019 Task B 연구 현황(Step 1))

  • Park, Jung-Wook;Park, Eui-Seob;Kim, Taehyun;Lee, Changsoo;Lee, Jaewon
    • Tunnel and Underground Space
    • /
    • v.28 no.5
    • /
    • pp.400-425
    • /
    • 2018
  • This study presents the research results and current status of the DECOVALEX-2019 project Task B. Task B named 'Fault slip modelling' is aiming at developing a numerical method to simulate the coupled hydro-mechanical behavior of fault, including slip or reactivation, induced by water injection. The first research step of Task B is a benchmark simulation which is designed for the modelling teams to familiarize themselves with the problem and to set up their own codes to reproduce the hydro-mechanical coupling between the fault hydraulic transmissivity and the mechanically-induced displacement. We reproduced the coupled hydro-mechanical process of fault slip using TOUGH-FLAC simulator. The fluid flow along a fault was modelled with solid elements and governed by Darcy's law with the cubic law in TOUGH2, whereas the mechanical behavior of a single fault was represented by creating interface elements between two separating rock blocks in FLAC3D. A methodology to formulate the hydro-mechanical coupling relations of two different hydraulic aperture models and link the solid element of TOUGH2 and the interface element of FLAC3D was suggested. In addition, we developed a coupling module to update the changes in geometric features (mesh) and hydrological properties of fault caused by water injection at every calculation step for TOUGH-FLAC simulator. Then, the transient responses of the fault, including elastic deformation, reactivation, progressive evolutions of pathway, pressure distribution and water injection rate, to stepwise pressurization were examined during the simulations. The results of the simulations suggest that the developed model can provide a reasonable prediction of the hydro-mechanical behavior related to fault reactivation. The numerical model will be enhanced by continuing collaboration and interaction with other research teams of DECOLVAEX-2019 Task B and validated using the field data from fault activation experiments in a further study.

Economic Impact of the Tariff Reform : A General Equilibrium Approach (관세율(關稅率) 조정(調整) 경제적(經濟的) 효과분석(效果分析) : 일반균형적(一般均衡的) 접근(接近))

  • Lee, Won-yong
    • KDI Journal of Economic Policy
    • /
    • v.12 no.1
    • /
    • pp.69-91
    • /
    • 1990
  • A major change in tariff rates was made in January 1989 in Korea. The benchmark tariff rate, which applies to about two thirds of all commodity items, was lowered to 15 percent from 20 percent. In addition, the variation in tariff rates among different types of commodities was reduced. This paper examines the economic impact of the tariff reform using a multisectoral general equilibrium model of the Korean economy which was introduced by Lee and Chang(1988), and by Lee(1988). More specifically, this paper attempts to find the changes in imports, exports, domestic production, consumption, prices, and employment in 31 different sectors of the economy induced by the reform in tariff rates. The policy simulations are made according to three different methods. First, tariff changes in industries are calculated strictly according to the change in legal tariff rates, which tend to over-estimate the size of the tariff reduction given the tariff-drawback system and tariff exemption applied to various import items. Second, tariff changes in industries are obtained by dividing the estimated tariff revenues of each industry by the estimated imports for that industry, which are often called actual tariff rates. According to the first method, the import-weighted average tariff rate is lowered from 15.2% to 10.2%, while the second method changes the average tariff rate from 6.2% to 4.2%. In the third method, the tariff-drawback system is internalized in the model. This paper reports the results of the policy simulation according to all three methods, comparing them with one another. It is argued that the second method yields the most realistic estimate of the changes in macro-economic variables, while the third method is useful in delineating the differences in impact across industries. The findings, according to the second method, show that the tariff reform induces more imports in most sectors. Garments, leather products, and wood products are those industries in which imports increase by more than 5 percent. On the other hand, imports in agricultural, mining and service sectors are least affected. Domestic production increases in all sectors except the following: leather products, non-metalic products, chemicals, paper and paper products, and wood-product industries. The increase in production and employment is largest in export industries, followed by service industries. An impact on macroeconomic variables is also simulated. The tariff reform increases nominal GNP by 0.26 percent, lowers the consumer price index by 0.49 percent, increases employment by 0.24 percent, and worsens the trade balance by 480 million US dollars, through a rise in exports of 540 million US dollars and a rise in imports of 1.02 billion US dollars.

  • PDF

Performance Optimization of Numerical Ocean Modeling on Cloud Systems (클라우드 시스템에서 해양수치모델 성능 최적화)

  • JUNG, KWANGWOOG;CHO, YANG-KI;TAK, YONG-JIN
    • The Sea:JOURNAL OF THE KOREAN SOCIETY OF OCEANOGRAPHY
    • /
    • v.27 no.3
    • /
    • pp.127-143
    • /
    • 2022
  • Recently, many attempts to run numerical ocean models in cloud computing environments have been tried actively. A cloud computing environment can be an effective means to implement numerical ocean models requiring a large-scale resource or quickly preparing modeling environment for global or large-scale grids. Many commercial and private cloud computing systems provide technologies such as virtualization, high-performance CPUs and instances, ether-net based high-performance-networking, and remote direct memory access for High Performance Computing (HPC). These new features facilitate ocean modeling experimentation on commercial cloud computing systems. Many scientists and engineers expect cloud computing to become mainstream in the near future. Analysis of the performance and features of commercial cloud services for numerical modeling is essential in order to select appropriate systems as this can help to minimize execution time and the amount of resources utilized. The effect of cache memory is large in the processing structure of the ocean numerical model, which processes input/output of data in a multidimensional array structure, and the speed of the network is important due to the communication characteristics through which a large amount of data moves. In this study, the performance of the Regional Ocean Modeling System (ROMS), the High Performance Linpack (HPL) benchmarking software package, and STREAM, the memory benchmark were evaluated and compared on commercial cloud systems to provide information for the transition of other ocean models into cloud computing. Through analysis of actual performance data and configuration settings obtained from virtualization-based commercial clouds, we evaluated the efficiency of the computer resources for the various model grid sizes in the virtualization-based cloud systems. We found that cache hierarchy and capacity are crucial in the performance of ROMS using huge memory. The memory latency time is also important in the performance. Increasing the number of cores to reduce the running time for numerical modeling is more effective with large grid sizes than with small grid sizes. Our analysis results will be helpful as a reference for constructing the best computing system in the cloud to minimize time and cost for numerical ocean modeling.

A Data-based Sales Forecasting Support System for New Businesses (데이터기반의 신규 사업 매출추정방법 연구: 지능형 사업평가 시스템을 중심으로)

  • Jun, Seung-Pyo;Sung, Tae-Eung;Choi, San
    • Journal of Intelligence and Information Systems
    • /
    • v.23 no.1
    • /
    • pp.1-22
    • /
    • 2017
  • Analysis of future business or investment opportunities, such as business feasibility analysis and company or technology valuation, necessitate objective estimation on the relevant market and expected sales. While there are various ways to classify the estimation methods of these new sales or market size, they can be broadly divided into top-down and bottom-up approaches by benchmark references. Both methods, however, require a lot of resources and time. Therefore, we propose a data-based intelligent demand forecasting system to support evaluation of new business. This study focuses on analogical forecasting, one of the traditional quantitative forecasting methods, to develop sales forecasting intelligence systems for new businesses. Instead of simply estimating sales for a few years, we hereby propose a method of estimating the sales of new businesses by using the initial sales and the sales growth rate of similar companies. To demonstrate the appropriateness of this method, it is examined whether the sales performance of recently established companies in the same industry category in Korea can be utilized as a reference variable for the analogical forecasting. In this study, we examined whether the phenomenon of "mean reversion" was observed in the sales of start-up companies in order to identify errors in estimating sales of new businesses based on industry sales growth rate and whether the differences in business environment resulting from the different timing of business launch affects growth rate. We also conducted analyses of variance (ANOVA) and latent growth model (LGM) to identify differences in sales growth rates by industry category. Based on the results, we proposed industry-specific range and linear forecasting models. This study analyzed the sales of only 150,000 start-up companies in Korea in the last 10 years, and identified that the average growth rate of start-ups in Korea is higher than the industry average in the first few years, but it shortly shows the phenomenon of mean-reversion. In addition, although the start-up founding juncture affects the sales growth rate, it is not high significantly and the sales growth rate can be different according to the industry classification. Utilizing both this phenomenon and the performance of start-up companies in relevant industries, we have proposed two models of new business sales based on the sales growth rate. The method proposed in this study makes it possible to objectively and quickly estimate the sales of new business by industry, and it is expected to provide reference information to judge whether sales estimated by other methods (top-down/bottom-up approach) pass the bounds from ordinary cases in relevant industry. In particular, the results of this study can be practically used as useful reference information for business feasibility analysis or technical valuation for entering new business. When using the existing top-down method, it can be used to set the range of market size or market share. As well, when using the bottom-up method, the estimation period may be set in accordance of the mean reverting period information for the growth rate. The two models proposed in this study will enable rapid and objective sales estimation of new businesses, and are expected to improve the efficiency of business feasibility analysis and technology valuation process by developing intelligent information system. In academic perspectives, it is a very important discovery that the phenomenon of 'mean reversion' is found among start-up companies out of general small-and-medium enterprises (SMEs) as well as stable companies such as listed companies. In particular, there exists the significance of this study in that over the large-scale data the mean reverting phenomenon of the start-up firms' sales growth rate is different from that of the listed companies, and that there is a difference in each industry. If a linear model, which is useful for estimating the sales of a specific company, is highly likely to be utilized in practical aspects, it can be explained that the range model, which can be used for the estimation method of the sales of the unspecified firms, is highly likely to be used in political aspects. It implies that when analyzing the business activities and performance of a specific industry group or enterprise group there is political usability in that the range model enables to provide references and compare them by data based start-up sales forecasting system.

Intercomparison of Shortwave Radiative Transfer Models for Aerosol-laden Atmospheres (에어러솔 대기에서 단파 영역에서의 복사전달모델들의 상호비교)

  • Yoo, Jung-Moon;Jeong, Myeong-Jae;Lee, Kyu-Tae;Kim, Jhoon;Rhee, Ju-Eun;Hur, Young-Min;Kim, Bo-Mi;Lee, Yun-Gon;Lee, Jae-Hwa;Yoon, Jong-Min;Lee, Won-Hak
    • Journal of the Korean earth science society
    • /
    • v.29 no.2
    • /
    • pp.128-139
    • /
    • 2008
  • Intercomparison among the three radiative transfer models (RTMs) which have been used in the studies for COMS, was carried out on the condition of aerosol-laden atmospheres. Also the role of aerosols in the atmospheric radiation budget was analyzed. The results (hereafter referred to as H15) from Halthore et al.'s study (2005) were used as a benchmark to examine the models. Aerosol Radiative Forcing (ARF) values from the three RTMs, calculated under two conditions of Aerosol Optical Thickness (AOT=0.08, 0.24), were systematically underestimated in comparison to H15 in the following shortwave components; 1) direct and diffuse irradiance at the surface, 2) diffuse upward fluxes at the surface and the top of the atmosphere, and 3) atmospheric absorbance. The ARF values for the direct and diffuse fluxes at the surface was $-10{\sim}-40Wm^{-2}$. The diffuse upward values became larger with increasing both AOT and Solar Zenith Angle (SZA). Diffuse upward/downward fluxes at the surface were more sensitive to the SZA than to the atmospheric type. The diffuse downward values increased with increasing AOT and decreasing SZA. The larger AOT led to surface cooling by exceeding the reduction of direct irradiance over the enhancement of diffuse one at the surface. The extinction of direct solar irradiance was due mainly to water vapor in tropical atmospheres, and to both ozone and water vapor in subarctic atmospheres. The effect of water vapor in the tropics was $3{\sim}4$ times larger than that of the ozone. The absorbance values from the three RTMs agree with those from H15 within ${\pm}10%$.

A study on the CRM strategy for medium and small industry of distribution (중소유통업체의 CRM 도입방안에 관한 연구)

  • Kim, Gi-Pyoung
    • Journal of Distribution Science
    • /
    • v.8 no.3
    • /
    • pp.37-47
    • /
    • 2010
  • CRM refers to the operating activities that always maintain and promote good relationship with customers to ultimately maximize the company's profits by understanding the value of customers to meet their demands, establishing a strategy which may maximize the Life Time Value and successfully operating the business by integrating the customer management processes. In our country, many big businesses are introducing CRM initiatively to use it in marketing strategy however, most medium and small sized companies do not understand CRM clearly or they feel difficult to introduce it due to huge investment needed. This study is intended to present CRM promotion strategy and activities plan fit for the medium and small sized companies by analyzing the success factors of the leading companies those have already executed CRM by surveying the precedents to make the distributors out of the industries have close relation with consumers to overcome their weakness in scale and strengthen their competitiveness in such a rapidly changing and fiercely competing market. There are 5 stages to build CRM such as the recognition of the needs of CRM establishment, the establishment of CRM integrated database, the establishment of customer analysis and marketing strategy through data mining, the practical use of customer analysis through data mining and the implementation of response analysis and close loop process. Through the case study of leading companies, CRM is needed in types of businesses where the companies constantly contact their customers. To meet their needs, they assertively analyze their customer information. Through this, they develop their own CRM programs personalized for their customers to provide high quality service products. For customers helping them make profits, the VIP marketing strategy is conducted to keep the customers from breaking their relationships with the companies. Through continuous management, CRM should be executed. In other words, through customer segmentation, the profitability for the customers should be maximized. The maximization of the profitability for the customers is the key to CRM. These are the success factors of the CRM of the distributors in Korea. Firstly, the top management's will power for CS management is needed. Secondly, the culture across the company should be made to respect the customers. Thirdly, specialized customer management and CRM workers should be trained. Fourthly, CRM behaviors should be developed for the whole staff members. Fifthly, CRM should be carried out through systematic cooperation between related departments. To make use of the case study for CRM, the company should understand the customer and establish customer management programs to set the optimal CRM strategy and continuously pursue it according to a long-term plan. For this, according to collected information and customer data, customers should be segmented and the responsive customer system should be designed according to the differentiated strategy according to the class of the customers. In terms of the future CRM, integrated CRM is essential where the customer information gathers together in one place. As the degree of customers' expectation increases a lot, the effective way to meet the customers' expectation should be pursued. As the IT technology improved rapidly, RFID (Radio Frequency Identification) appears. On a real-time basis, information about products and customers is obtained massively in a very short time. A strategy for successful CRM promotion should be improving the organizations in charge of contacting customers, re-planning the customer management processes and establishing the integrated system with the marketing strategy to keep good relation with the customers according to a long-term plan and a proper method suitable to the market conditions and run a company-wide program. In addition, a CRM program should be continuously improved and complemented to meet the company's characteristics. Especially, a strategy for successful CRM for the medium and small sized distributors should be as follows. First, they should change their existing recognition in CRM and keep in-depth care for the customers. Second, they should benchmark the techniques of CRM from the leading companies and find out success points to use. Third, they should seek some methods best suited for their particular conditions by achieving the ideas combining their own strong points with marketing. Fourth, a CRM model should be developed that will promote relationship with individual customers just like the precedents of small sized businesses in Switzerland through small but noticeable events.

  • PDF

Agency Costs of Clothing Companies with Famous Brand (유명 의류 상호 기업의 대리인 비용에 관한 연구)

  • Gong, Kyung-Tae
    • Management & Information Systems Review
    • /
    • v.36 no.4
    • /
    • pp.21-32
    • /
    • 2017
  • Motivated by the recent cases of negligent social responsibility as manifested by foreign luxury fashion brands in Korea, this study investigates whether agency costs depend on the sustainability of different types of corporate governance. Agency costs refer either to vertical costs arising from the relationship between stockholders and managers, or to horizontal costs associated with the potential conflicts between majority and minority stockholders. The firms with luxury fashion brand could spend large sums of money on maintenance of magnificent brand image, thereby increasing the agency cost. On the contrary, the firms may hold down wasteful spending to report a gaudily financial achievement. This results in mitigation of the agency cost. Agency costs are measured by the value of the principal component. First, three ratios are constructed: asset turnover, operating expense to sales, and earnings before interest, tax, and depreciation. Then, the scores of each of these ratios for individual firms in the sample are differenced from the ratios for the benchmark firm of S-OIL. S-OIL was designated as the best superior governance model firm for 2013 by CGS. We perform regression analysis of each agency cost index, luxury fashion brand dummy and a set of control variables. The regression results indicate that the agency costs of the firms with luxury fashion brand exceed those of control group in the fashion industry in the part of operating expenses, but the agency cost falls short of those of control group in the part of EBITD, thus the aggregate agency costs are not differential of those of the control group. In sensitivity test, the results are same that the agency cost of the firms are higher than those of the matching control group with PSM(propensity matching method). These results are corroborated by an additional analysis comparing the group of the companies with the best brands with the control group. The results raise doubts about the effectiveness of management of the firms with luxury fashion brand. This study has a limitation that the research has performed only for 2013 and this paper suggests that there is room for improvement in the current research methodology.

  • PDF

A Topic Modeling-based Recommender System Considering Changes in User Preferences (고객 선호 변화를 고려한 토픽 모델링 기반 추천 시스템)

  • Kang, So Young;Kim, Jae Kyeong;Choi, Il Young;Kang, Chang Dong
    • Journal of Intelligence and Information Systems
    • /
    • v.26 no.2
    • /
    • pp.43-56
    • /
    • 2020
  • Recommender systems help users make the best choice among various options. Especially, recommender systems play important roles in internet sites as digital information is generated innumerable every second. Many studies on recommender systems have focused on an accurate recommendation. However, there are some problems to overcome in order for the recommendation system to be commercially successful. First, there is a lack of transparency in the recommender system. That is, users cannot know why products are recommended. Second, the recommender system cannot immediately reflect changes in user preferences. That is, although the preference of the user's product changes over time, the recommender system must rebuild the model to reflect the user's preference. Therefore, in this study, we proposed a recommendation methodology using topic modeling and sequential association rule mining to solve these problems from review data. Product reviews provide useful information for recommendations because product reviews include not only rating of the product but also various contents such as user experiences and emotional state. So, reviews imply user preference for the product. So, topic modeling is useful for explaining why items are recommended to users. In addition, sequential association rule mining is useful for identifying changes in user preferences. The proposed methodology is largely divided into two phases. The first phase is to create user profile based on topic modeling. After extracting topics from user reviews on products, user profile on topics is created. The second phase is to recommend products using sequential rules that appear in buying behaviors of users as time passes. The buying behaviors are derived from a change in the topic of each user. A collaborative filtering-based recommendation system was developed as a benchmark system, and we compared the performance of the proposed methodology with that of the collaborative filtering-based recommendation system using Amazon's review dataset. As evaluation metrics, accuracy, recall, precision, and F1 were used. For topic modeling, collapsed Gibbs sampling was conducted. And we extracted 15 topics. Looking at the main topics, topic 1, top 3, topic 4, topic 7, topic 9, topic 13, topic 14 are related to "comedy shows", "high-teen drama series", "crime investigation drama", "horror theme", "British drama", "medical drama", "science fiction drama", respectively. As a result of comparative analysis, the proposed methodology outperformed the collaborative filtering-based recommendation system. From the results, we found that the time just prior to the recommendation was very important for inferring changes in user preference. Therefore, the proposed methodology not only can secure the transparency of the recommender system but also can reflect the user's preferences that change over time. However, the proposed methodology has some limitations. The proposed methodology cannot recommend product elaborately if the number of products included in the topic is large. In addition, the number of sequential patterns is small because the number of topics is too small. Therefore, future research needs to consider these limitations.

Assessing Impacts of Global Warming on Rice Growth and Production in Korea (지구온난화에 따른 벼 생육 및 생산성 변화 예측)

  • Shim, Kyo-Moon;Roh, Kee-An;So, Kyu-Ho;Kim, Gun-Yeob;Jeong, Hyun-Cheol;Lee, Deog-Bae
    • Journal of Climate Change Research
    • /
    • v.1 no.2
    • /
    • pp.121-131
    • /
    • 2010
  • This study was carried out to evaluate spatial variations in rice production areas by simulating rice growth and yield with CERES-Rice growth model under GCM $2{\times}CO_2$ climate change scenarios. A modified window version(v4.0) of CERES-Rice was used to simulate the growth and development of three varieties, representing early, medium, and late maturity classes. Simulated growth and yield data of the three cultivars under the climate for 1971 to 2000 was set as a reference. Compared with the current normal(1971 to 2000), heading period from transplanting to heading date decreased by 7~8 days for the climate in $2^{\circ}C$ increase over normal, and 16~18 days for the climate in UKMO with all maturity classes, while change of ripening period from heading to harvesting date was different with maturity classes. That is, physical maturity was shortened by 1~3 days for early maturity class and 14~18 days for late maturity class under different climate change scenarios. Rice yield was in general reduced by 4.5%, 8.2%, 9.9%, and 14.9% under the climate in $2^{\circ}C$, $3^{\circ}C$, $4^{\circ}C$, and about $5^{\circ}C$ increase, respectively. The yield reduction was due to increased high temperature-induced spikelet sterility and decreased growth period. The results show that predicted climate changes are expected to bring negative effects in rice production in Korea. So, it is required for introduction of new agricultural technologies to adapt to climate change, which are, for example, developing new cultivars, alternations of planting dates and management practices, and introducing irrigation systems, etc.