1. Introduction
The issue of journal globalization, which is of interest in this study, also cannot be free from this phenomenon. For example, Times Higher Education (THE), a British university evaluation agency, has been evaluating the overall competitiveness of world universities since 2004 and has been announcing them every year. According to the announcement on September 1, 2021 it considers the 5 areas which consist of 13 indicators namely, education/learning conditions (30%), research productivity (30%), research influence (30%), level of globalization (7.5%), and technology transfer (2.5%) (KESS, 2021). For the area of research productivity, the number of papers published by full-time researcher (6%) was evaluated, for the area of research influence the citation index (30%) was evaluated, and for the area of globalization the ratio of international collaborative researches was evaluated. This means that 38.5% of evaluation areas and indicators are related toconditions (30%), research productivity (30%), research influence (30%), level of globalization (7.5%), and technology transfer (2.5%) (KESS, 2021). For the area of research productivity, the number of papers published by full-time researcher (6%) was evaluated, for the area of research influence the citation index (30%) was evaluated, and for the area of globalization the ratio of international collaborative researches was evaluated. This means that 38.5% of evaluation areas and indicators are related to publication of journal articles (KESS, 2021). Therefore, the reality is that full-time researchers at domestic and foreign universities not only have to strive to increase their research productivity and globalization level of their study, but are also under pressure to publish in reputable journals in order to increase the citation index to meet the standard of Research Influence area.
Academic journals are not only a mirror that reflects the theoretical and practical interests of various academic fields, but also a beacon that provides the direction of theoretical systems and research methods, and is a historical record of changes in various theoretical and social phenomena (Yang, 2019; Yang & Yang, 2021). Therefore, researchers are making ceaseless efforts for the purpose of publishing not only in academic journals but also in renowned journals (Yang & Yang, 2021). In addition, from the standpoint of the academic society that operates the journal, good quality papers are selected through strict evaluation and strengthening of ethical standards (Hwang, Lee, Lee, Kim, Yang, Youn, & Lim, 2015; Hwang & Youn, 2016; Hwang, Lee, Kim, Shin, Kim, Kim, Lee, Kim, & Youn, 2017) and efforts are made to actively promote the journal and improve the impact factor (Kim & Youn, 2012; Yang & Yang, 2021).
It is confirmed that there is various academic research conducted, in numerous fields, on globalization of academic journals. For example, Ames (2011) found that the 6 criteria for measuring the success of a journal are the achievement of the journal's publication purpose, influence in academia, cost-effectiveness, continuous quality maintenance, validity and responsiveness to global changes, and duration (Ames, 2011). Moreover, Kim (2012) analyzed, in his study on the globalization of SCI journals publishing in Korea, the change in the number of publications in domestic SCI journals by foreign researchers, along with the increasing trend of international collaborative research between domestic and foreign authors and interest in domestic and international collaborative research network. In addition, Chun (2010)’s study on the globalization of Korean studies suggested enhancement of the exchange value of Korean studies, Park (2007) suggested globalization through liberal arts education that integrates knowledge and values, and Chang (2017) argued that Korea-related design research should communicate with the world to revitalize discourse on Korean design identity in order to achieve the globalization of Korean design researches.
Examining previous studies, the direction of globalization should aim to develop, as shown in
Figure 1: Criteria for Globalization of domestic academic journals
This study analyzed the standardization, the degree of collaboration and achievement of the publication goal of the all journals published by JDS which can be searched from Science On from 2011 and 2021, in order to check the level of globalization accomplishment.
According to Yang and Yang (2022), among papers on research ethics, published in Korea from 2000 to 2021, the largest number of publications was on bioethics of the Korean Society for Bioethics, and the second largest number was on research ethics, published in Journal of Research and Publication Ethics and JDS, both by KODISA. Such achievements already exhibit the contribution of KODISA in research ethics. So, we will exclude further analysis of this topic in this study.
In addition, JDS has implemented the Open Access System since 2013, and after participating in the National Research Foundation (NRF)’s online thesis submission and review system project (JAMS) in 2014, it implemented ACOMS, the online submission and review management system developed by the Korea Institute of Science and Technology Information (KISTI) from July 2021 in order to preemptively promote the efficiency and convenience of paper submission and review. Therefore, the openness criterion of globalization was deemed to be sufficient, so it is excluded from the analysis.
In order to check the globalization performance of JDS, the analysis was conducted by dividing the analysis period into 4 periods: the period using the internal submission system, period using JAMS, period using JAMS & ACOMS together, and period using ACOMS only. For each period, the ratio of English-written papers was analyzed to see the standardization, frequency analysis and crosstab-analysis was conducted to find out the degree of international collaboration. The degree of achievement of the publication purpose was analyzed by comparing the topic of actual published papers with the monthly research topics presented by JDS, by using the keyword analysis and weighted trend analysis and LDA topic modeling for the abstracts published in each period.
The results of this study are expected to be able to evaluate the direction of globalization (or internationalization) of JDS, a top academic journal in the field of social science in Korea. It is also expected to provide numerous implications that can contribute to the globalization of many other academic societies and journals.
2. About KODISA & JDS
The Korea Association for Distribution Science (KODISA) has succeeded in the quantitative and qualitative growth of its academic journals since 2010. It publishes more than 300 papers per year among other social science journals, and publishes the largest number of copies of more than 12, 000 copies per year (Yang & Yang, 2021). The sub associations of KODISA, according to its website, includes the International Convergence Management Association, Korea Artificial Intelligence Association, Korea Sports Science Association, East Asian Economics and Business Association, Korea Research Ethics Association, Korea 4th Industry Association, and Korea Food and Health Convergence Association. Directly managed journals include Journal of Distribution Science (JDS), The Journal of Asian Finance, Economics, and Business (JAFEB), The Journal of Industrial Distribution & Business (JIDB), and Asian Journal of Business (AJBE), East Asian Journal of Table 1: KODISA Journal List Business Economics (EAJBE), The Journal of Economics, Marketing and Management (JEMM), The Korean Journal of Franchise Management (KJFM), Korean Journal of Artificial Intelligence (KJAI), The Journal of Sport and Applied Science (JSAS), The Journal of Wellbeing Management and Applied Psychology (JWMAP), The Korean Journal of Food & Health Convergence (KJFHC), The Journal of Research and Publication Ethics (JRPE), Fourth Industrial Review (FIR), and KODISA ICBE Proceedings: KODISA International Conference on Business and Economics (ICBE).
Youn, Kim, Lee, Hwang, and Lee (2014) stated in their Editorial Review that since 2013 the website of JDS, JIDB, EAJBM (renamed to AJBE), and JAFEB are English-based and are adopting the Open Access System. Moreover, as of December 2013, more than 60% of contributors and editors/reviewers for JDS, more than 90% for JIDB, AJBE, and JAFEB are from overseas (Youn et al., 2014). In addition, all Korean-language articles provide English abstracts and English references to help foreign researchers, and JEL Classifiaction Code is used to ensure the professionalism. KODISA is establishing an international cooperative research system by providing a basis for international diversity of editors and authors and the publication of a vast amount of papers (Youn et al., 2014). As such, it is certain that KODISA is putting enormous effort to globalize not only academic journals under their direct management, but also academic journals of its affiliated societies.
A summary list of information on each journal registered in the Korea Citation Index (KCI) is presented in .
Table 1: KODISA Journal List
JDS, the analysis target of this study, is the main journal of KODISA and has published an average of 123.9 papers annually since 2014 (Yang & Yang, 2021). JDS, a journal directly managed by KODISA, is one of the first participants for the National Research Foundation (NRF)'s online journal submission and review system project (JAMS) on June 20, 2014 and used JAMS for 6 years. The online submission review management system (ACOMS) developed by the Institute of Science and Technology Information (KISTI) was introduced and used together with JAMS, and from July 1, 2021, JDS has completely converted to ACOMS. The purpose of conversion to ACOMS was to promote the efficiency and convenience of review by the foreign researchers. At the same time, JDS is putting effort to achieve the purpose of the journal by suggesting monthly research topics to researchers so that research in various distribution fields can be represented.
Table 2: JDS's Monthly Suggested Study Topics
3. Research Methodology
3.1. Analysis Methods
To carry out this study, JDS papers loaded in science ON of Korea Institute of Science and Technology Information were searched. For analysis, frequency analysis and crosstab-analysis were performed using SPSS 24.0, and topic modeling using LDA (Latent Dirichlet Allocation) algorithm, and keyword frequency analysis for the journal abstracts and word-clouding were performed using R 4.1.1 package. For data visualization, LDAvis, a web-based topic modeling visualization tool that can easily identify major topics and words by ranking each topic and words within the document according to their importance (Sievert & Shirley, 2014), was used.
3.2. Data Collection
A total of 863 papers were searched for 11 years from 2011 to December 2021. In order to check the performance of using the online submission system, the period of using the self-submission system (January 2011 to May 2014), the period of using the JAMS (June 2014 - May of 2020), the period of using the JAMS & ACOMS concurrently (June 2020 to June 2021) and the period of ACOMS (July 2021 to December 2021) were divided and analyzed as shown in the Table 3.
Table 3: Number of papers per period
Figure 2: Analysis of languages used and authors by period
4. Analysis Results
4.1. Keywords and Author Analysis by Periods
To analyze the degree of standardization the ratio of English-written papers was calculated. As shown in (a) of
Table 4: Top 20 words through keyword analysis
Figure 3: Results of Word clouding
4.3. Weighted Trend Analysis for Keywords
As mentioned in the data collection, frequency of journal publication during each submission system's period is different, and hence it is difficult to directly compare each other. Therefore, weight was given to each period based on the period of using JAMS which has the highest number of paper published, and then, analyzed the changes in keywords by each period. As shown in
Figure 4: Keyword trend analysis result with weight applied
The result of the analysis showed that among the top 20 words, the words whose frequency increased until the final period were ‘distribution’, ‘online’, ‘performance’, ‘social’, and ‘strategy’, and the words that appeared only during the ACOMS period were ‘behavior’, ‘channel’, ‘shopping’, ‘supply’, ‘Covid’, ‘enterpreneurial’, ‘overnment’, etc. These results indicate that when JDS used JAMS in the past, it published papers on wide-ranging research topics in the marketing field, some not directly related to the distribution. But recently, research topics of JDS are being more in agreement to the distribution science field. Also, the number of foreign authors has increased.
4.4. LDA Topic Modelling
The research of Yang (2021) and Yang and Yang (2022) LDA topic modeling was conducted with the expectation that analysis of research topics for each period can demonstrate the changes in JDS's publication purpose, although some of the changes can already be seen by examining
Topic names were set based on the monthly research topic suggested by JDS in
As shown in
Table 5: Topic Name & Token Ratio by Period
Figure 5: LDAvis Visualization Results by Period
The results of LDAvis in
5. Summary and Discussions
In order to examine the globalization performance of JDS, the main journal of KODISA, this study examined the standardization, openness, collaboration, achievement of publication goal which are the given criteria when assessing the level of globalization. Further, standardization, collaboration, and achievement of publication goal in terms of the publication ethics were examined. The analysis was conducted by dividing JDS publication period by four periods based on its operating submission and review system, namely, internal submission system period, JAMS period, JAMS & ACOMS period, and ACOMS period. The results of analysis are as follow;
First, the proportion of English-written papers were identified to check the degree of standardization for each period. It was confirmed that the percentage of English written papers increased as the periods elapsed, and that 100% of the papers were published in English during the period of using ACOMS. Moreover, the results of crosstab-analysis on the proportion of publication of English papers by period showed that the Pearson χ2 value was 93.805 (d.f=3, p=.000). This means that it is statistically significant to expect the increase in the number of English papers in the future. Therefore, it can be concluded that JDS is meeting the criteria of standardization, which considers the use of the English language.
Second, the ratios of Korean and overseas authors were analyzed to confirm collaborations. It was found that the ratio of overseas authors increased considerably from the period of using JAMS and ACOMS, and increased to 62.2% during the period of using ACOMS. The result of crosstabanalysis of the period and author showed the Pearson χ2 value was 101.742 (d.f=6, p=.000), which indicate that the continuous increase in the proportion of foreign authors in the future. However, the analysis indicated that there is lack of domestic and foreign collaborative researches, which is another criterion for the collaboration, indicating that a supporting strategy is needed.
Third, the result of weighted keyword analysis showed that the words which increased in frequency by period were ‘distribution’, ‘online’, ‘performance’, ‘social’, and ‘strategy’, and words that appeared only during the ACOMS period were ‘behavior’, ‘channel’, ‘shopping’, ‘supply’, ‘Covid’, ‘enterpreneurial’, ‘government’, etc. This result can be said that JDS is being refined into research topics that fit its publication purpose, which is focusing on distribution science, compared to the past when various research topics of marketing were published, including distribution science.
Fourth, as a result of LDA topic modeling by period, the number of topics during the internal submission system period was 13 and 12 during the JAMS period, 5 during the JAMS & ACOMS period, and 6 during the ACOMS period. As a result of comparing these by naming them based on the monthly research topic proposed by JDS, there were some topics that could not be classified as the monthly topics during internal submission system period and JAMS period, but the topics of the JAMS & ACOMS period and ACOMS period were relevant to the monthly research topic proposed by JDS. This result also suggests that even though the number of published papers is fewer compared to other periods, the monthly research topic proposed by JDS is likely to be settled, and it means that researches related to major issues in the distribution field are being published. It can be interpreted that the JDS is achieving its publication goal to some extent.
Based on the analysis of globalization performance of JDS, the following implications and points for improvements in the globalization process for other journals can be stated,
First, the results related to publication ethics and openness that JDS is aiming for can be used as benchmarks for other academic journals aiming for globalization. JDS is the main journal published by KODISA and has published various papers related to research ethics (eg, Hwang et al., 2014; Hwang et al., 2015; Hwang et al., 2017; Hwang & Youn, 2016). The research ethics of the Korean Research Ethics Society (JRPE) was founded as a branch journal and continue to put emphasis on the strict publication ethics. Regarding openness, the Open Access System has already been implemented since 2013. JDS was also the first participant of the National Research Foundation (NRF) Online Journal Submission Review System Project (JAMS) in 2014. From July 1, 2021, it implemented the online submission review management system (ACOMS) of the Korea Institute of Science and Technology Information (KISTI), which made it easier for both domestic and overseas researchers to search and submit their paper, in an environment similar to that of leading overseas academic journals. Therefore, other academic journals aiming for globalization will be able to benchmark JDS’s strategic approach or lay the groundwork for globalization through consulting. In particular, it is important to note that the proportion of overseas contributors has increased since the introduction of ACOMS, and this should be further strengthened.
Second, JDS policy to only accept English-language articles has contributed to its globalization. Even if this policy cannot be wholly implemented, English-language abstracts and English-language references should be provided for Korean-language articles. The use of the JEL Classification Code strengthened the diversity of editors and authors, and it is an effective operating strategy to become an international academic journal. These results suggest that other academic journals aiming for globalization need to examine their publication policies and consider the possibility of converting them to English papers. Lastly, there should be a strategy for increasing the citation of articles in Korea-based journals, including JDS.
Third, the proportion of publications by overseas authors in JDS is expected to increase continuously, so the ratio of overseas authors to meet the criteria of collaboration is expected to be satisfactory. However, the result of analysis showed that the cooperation between the Korean authors and foreign authors is insufficient and there should be measures to promote more collaborative research. The For example, collaboration between Korean and foreign authors can be promoted by holding international conferences, etc. However, such effort is uncertain in the COVID-19 pandemic situation, and other measures should be taken.
Fourth, as a result of LDA topic modeling, it was found that the monthly research topics of the JDS were relatively adequate, but it was found that more sophisticated research topics should be given and applied. JDS, the main academic journal of KODISA, launched in 1999 as a society pursuing complex and convergence studies related to the overall field of distribution. It proposed to publish original research on distribution economics and distribution management issues. Therefore, in order to deal with various topics in the distribution field, it is necessary to present the definition of the research topic more clearly and to refine the classification of sub-topics. This is because, in the distribution field, sub-themes are expected to change according to the rapidly changing environment such as the 4th industrial revolution. This reconstruction will provide great help to other academic journals in setting and presenting the publication purpose for globalization.
Although this study confirmed various evidences on globalization performance, there are some limitations, so future studies need to supplement this. First, although it is clear that the classification into the four periods could assess the openness of journal and compare the online submission systems, the limitation is that the frequency of submissions during the JAMS & ACOMS period and, in particular, the ACOMS period is relatively small. Therefore, continuous monitoring of published papers during the ACOMS period is needed, not only for the purpose of JDS to become the best journal through continuous globalization, but also for analysis of the effectiveness of the submission system. Second, based on previous studies, this study presented the criteria for globalization as five factors: standardization, openness, collaboration, publication purpose, and publication ethics, but there may be additional factors. Therefore, in future research, it will be necessary to analyze the top foreign academic journals from various viewpoints to identify additional standards.
References
- Ames,R. T. (2011). What makes a prestigious-journal?: Conditions for a world-class humanities journal. Proceeding of KOREA JOURNAL 50th Anniversary Academic Symposium (September 22, 2011). Seoul UNESCO Hall, Korea.
- Arun,R., Suresh, V., Veni Madhavan. C. E., & Narasimha Myrthy, M. N. (2010). On finding the natural number of topics with latent dirichlet allocation: Some observations. In: Zaki.
- M.J., Yu J.X., Ravindran B., Pudi V. (eds) Advances in knowledge discovery and data mining. PAKDD 2010. Lecture notes in computer science, vol 6118. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13657-3_43
- Cao, J., Xia, T., Li, J., Zhang, Y., & Tang, S. (2009). A density-based method for adaptive LDA model selection. Neurocomputing, 72(7-9), 1775-1781. https://doi.org/10.1016/j.neucom.2008.06.011
- Chang, J. Y. (2017). A study on the Korea related design research as a regional study which published in the major design academic journals and media in US & European countries. Journal of Korea Society of Design Forum, 55(0), 119-130. https://doi.org/10.21326/ksdt.2017..55.010
- Chun, S. W. (2010). The conception of Korean study and its ways of globalization. The Journal of Korean Studies, 32(3), 317-337. https://doi.org/10.17790/kors.2010.32..317
- Deveaud, R., SanJuan, E., & Bellot, P. (2014). Accurate and effective latent concept modeling for ad hoc information retrieval. Document numerique, 17, 61-84. https://doi.org/10.3166/dn.17.1.61-84
- Gills, B. K., & Thompson, W. (2012). Globalization and global history. London: Routledge.
- Griffiths, T., & Steyvers, M. (2004). Finding scientific topics. PNAS, 1(101), 5228-5235. https://doi.org/10.1073/pnas.0307752101
- Guttal, S. (2007). Globalisation. Development in Practice, 17(4/5), 523-531. https://doi.org/10.1080/09614520701469492
- Hwang, H. J., Kim, D. H., Yoon, M. K., Lee, J. W., & Lee, J. H. (2014). The standard of judgement on plagiarism in research ethics and the guideline of global journals for KODISA. Journal of Distribution Science, 12(6), 15-20. https://doi.org/10.15722/jds.12.6.201406.15
- Hwang, H.J., Lee,J. H., Lee,J.W., Kim, Y. E., Yang, H.C., Youn, M. K., & Lim, D. H. (2015). Strengthening publication ethics for KODISA journals: Learning from the cases of plagiarism. Journal of Distribution Science, 13(4), 5-8. https://doi.org/10.15722/jds.13.4.201504.5
- Hwang, H.J., Lee,J. W., Kim, D. H., Shin, D.J., Kim, B. G., Kim, T. J., Lee, Y. K., Kim, W. K., & Youn, M. K. (2017). Cases of ethical violation in research publications: Through editorial decision making process. Journal of Distribution Science, 15(5), 49-52. https://doi.org/10.15722/JDS.15.5.201705.49
- Hwang, H.J., & Youn, M. K. (2016). Based on proven practices in violation of research ethics for the KODISA journals. International Journal of Industrial Distribution & Business, 7(1), 5-10. https://doi.org/10.13106/ijidb.2016.vol7.no1.5.
- Kim, D. H., & Youn, M. K. (2012). Present and future of the journal of distribution science. Journal of Distribution Science, 10(5), 9-17. https://doi.org/10.15722/jds.10.5.201205.9
- Kim, Y.J. (2012). An analysis of globalization trends in the korean scientific knowledge: Investigating the factors of the scientific collaboration structure in the science citation Indexed Journals published in Korea. Journal of Science & Technology Studies, 12(2), 1-31.
- KODISAJAMS (2022). JDS Special Edition. retrieved January14, 2022 from Plan https://kodisa.jams.or.kr/po/community/notice/noticeView.kci
- O'Rourke, K. H., & Williamson, J. G. (2002). When did globalisation begin? Eurpoean Review of Economic History, 6(1), 23-50. https://doi.org/10.1017/S1361491602000023
- Park, S. U. (2007). Glogalization and general education. Korean Journal of General Education, 1(1), 91-106.
- Sievert, C., & Shirley, K. E. (2014). LDAvis: A method for visualizing and interpreting topics. proceedings of workshop on interactive language learning, visualization, and interfaces. Baltimore: Maryland.
- Yang, H.C., & Yang,W. R. (2021).Comparison of research trends in KODISA directly managed journals using keyword analysis. Journal of Research and Publication Ethics, 2(1), 19-24. https://doi.org/10.15722/JRPE.2.1.202103.19
- Yang, W. R. (2019). Exploration of research trends in the journal of distribution science using keyword analysis. International Journal of Industrial Distribution & Business, 10(8), 17-24. https://doi.org/10.13106/ijidb.2019.vol10.no8.17
- Yang, W. R., & Yang, H. C. (2022). Overseas Research Trends Related to Research Ethics Using LDA Topic Modeling. Proceeding of 2022 International Forum on Business Convergence(IFBC2022). Yangyang, Korea(p.42).
- Youn, M. K., Kim, D. H., Lee, J. H., Hwang, H. J., & Lee, J. W. (2014). Strategic approaches to solid ranking international journals: KODISA Journals. Journal of Distribution Science, 12(6), 5-13. https://doi.org/10.15722/jds.12.6.201406.5
- KESS (2021). 2021 THE World university rankings 2022:Ranking, Evaluation criteria. Retrieved December 22, 2021 from http://www.timeshighereducation.com