• The KIPS Transactions:PartD
• /
• v.16D no.3
• /
• pp.417-422
• /
• 2009

It is important to verify the validity of indicators assessing PMIS(Public Management Information System) effectiveness in academic research as well as practical affairs. As people invest in the field of Information Technology(IT) or IT system, private corporations are interested in investment in IT and it's business value. Moreover, the need of evaluating effectiveness on the investment in IT with the limited national budget are on the increase in public sector. Therefore, it is necessary to define the construct of PMIS(Public Management Information System) effectiveness so that we systematically compare and measure performance of public informatization project processed by each public organizations. It needs to develop indicators and verify the construct validity of them. we verified the construct validity of indicators assessing PMIS(Public Management Information System) effectiveness on the Administration DB Construction Projects.

• Journal of Korean Academy of Nursing Administration
• /
• v.10 no.1
• /
• pp.25-36
• /
• 2004

Purpose: Nursing puts much weight en the organization of hospital. Therefore it is necessity to improve nursing care. One of the most important things is to secure confident nurses and to develop nurse' potentiality. It directs nurse evaluation system. The concept of "performance appraisal tools" is extremely important in evaluation system. Therefore, the purpose of this study aims to define performance appraisal process. Method: In order to do this, two main study has been observed interviewing appraisers and employees in-depth and analyzing performance appraisal tools of seven hospitals and analysed validity, reliability, acceptability and practicability. Result: The result of this study can be summarized as follows; Firstly, the result of analysis of performance appraisal tools. Regard to validity, Hospitals had a typical goal, but had not put to practice use. Regard to reliability, 1) Appraisal rule had been focused on appraiser's error, how to avoid. 2) 5 hospitals accessed nurses with relative rating and 2 hospitals with absolute rating both in practice. 3) 3 hospitals informed nurses the result of performance appraisal but 4 hospitals did not. 4) All hospitals in this study had conducted superiors rating. Regard to acceptability, 1)Rating scale method had been implemented by 6 hospitals and among those conducted beth ranking method and descriptive method. 2) Most hospitals had focused on personal traits in performance appraisal factors. Regard to practicality, The term of appraisal took $10{\sim}14$ days; performance appraisal happened 1 or 2 times per year; appraisal factors were based on 10 different items. Secondly, the result of in-depth interview with head nurses and staff nurses Regard to validity, head nurses and nurses wared that the goal of performance appraisal is to develop nurse's ability. Regard to reliability, head nurses pointed out that they were doubt of the justice of performance appraisal and they should have got training. Nurses insisted that raters should have been trained due to lack of qualification of appraiser; Head nurses and nurse proposed to convert form relative rating to absolute rating; to inform the result of appraisal; to implement peers rating. Regard to acceptability, One of the critical problems of performance appraisal tools was abstract of appraisal factors ; Lack of job analysis. Regard to practicality, Head nurses used to take overtime for appraisal. There was only a little respond despite of their efforts. Nurses questioned that appraisal tools exist for only appraisal; there was less cost-effectiveness. Conclusion: Based en these findings, it could be suggested to improve the performance appraisal tools for nurses evaluation. Firstly, it is necessary to describe goal of performance appraisal clearly set up, so that nurses could improve their positive word performance and develop their potentiality. Secondly, it is necessary to obtain various training on raters, implement absolute rating and inform the result of appraisal to nurses and use peers rating. Thirdly, it is necessary to convert from rating scale method to management by objectives or behaviorally anchored rating scale and take measurable appraisal factors based en job analysis. Finally, it is necessary to reduce the appraisal cost but increase effectiveness of performance appraisal.

• Asia-Pacific Journal of Business Venturing and Entrepreneurship
• /
• v.12 no.4
• /
• pp.47-60
• /
• 2017

As the recent cultural contents area start-ups are creating remarkable outcomes such as investment attraction together with the reinforced institutional supports from the government, this study aimed to reverify the significance of researches related to correlation analysis between service of Business Incubating Center of Small & Medium Business Administration operated with no separation of business type, and corporate performance, in the aspect of Business Incubating Center in cultural contents area, and also to suggest the importance of establishing the business incubating system in the systematic and rational cultural contents area through the differentiated business incubating service by verifying the significant effects of the business validity of items on corporate performance, and then discovering services suitable for business incubating in cultural contents area, targeting Gyeonggi-do cultural contents area Business Incubating Center recently showing the biggest growth. Especially, contrary to the existing researches, in order to verify the characteristics of Gyeonggi-do Cultural Contents Business Incubating Center, the personal support service and marketing support service were included. It also aimed to understand the effects of the business validity of start-up items on corporate performance. Summarizing the results of this study, contrary to the results of the existing researches saying that spatial & additional support service, management support service, technical support service, personal support service, and marketing support service had significant effects on corporate performance, among the support service of Gyeonggi-do cultural contents area Business Incubating Center, the spatial & additional support service, personal support service, and marketing support service had significantly positive(+) effects on corporate performance while the management support service and technical support service had no significant effects on it. Comparing with the results of the researches on the support service of Business Incubating Center(BI) of Small & Medium Business Administration, the effects of the management support service and technical support service of Gyeonggi-do cultural contents area Business Incubating Center on corporate financial/non-financial performance were not huge. Also, in the results of analyzing the business validity of star-up items, the spatial & additional support service, management support service, and technical support service did not have significant effects on the business validity of start-up items while the personal support service and marketing support service had significantly positive(+) effects on it. In case when selecting companies, Gyeonggi-do Business Incubating Center emphasized the business validity of start-up items. However, the support service provided after the selection did not have huge effects on the business validity of start-up items. Lastly, in the results of analyzing the effects of the business validity of start-up items in Gyeonggi-do cultural contents area on corporate performance, among the success factors of business start-up, the business validity of start-up items was an important element having effects on corporate performance(financial/non-financial) in the cultural contents area.

• THE INTERNATIONAL COMMERCE & LAW REVIEW
• /
• v.30
• /
• pp.3-26
• /
• 2006

Supply chain is viewed as a number of organizations(at least three) working cooperatively with at least some shared objectives. The concept of supply chain management represents the most advanced state in the evolutionary development of purchasing, procurement and other supply chain activities. This study aims to analyze and develop a measurement instrument for supply chain performance in international logistics. A measurement instrument for supply chain performance in international logistics are developed by Lai et al(2002). Supply chain reliability, customer service and cost are constructed reflecting service effectiveness and operations efficiency between shipper, forwarder and liner. The results of this study are as follow. We firstly tested the measurement properties of the sub-dimension of the supply chain performance construct using reliability test and confirmatory factor analysis follow by exploratory factor analysis. For each of the factor, reliability and validity are achieved because of the significant loading of the measurement items on their latent factors. Further research perform the analysis of variance by multi respondents within each firm and across partner firms in the supply chain. The result of analysis present the difference with shipper, forwarder and liner in statistics.

• Asia pacific journal of information systems
• /
• v.33 no.4
• /
• pp.1118-1134
• /
• 2023

Previous research has shown that employees tend to react more positively to corrective feedback from supervisors to the extent they perceive that they were treated with empathy, respect, and concern towards fair interpersonal treatment in receiving the feedback information. Then, to facilitate effective supervisory feedback and coaching, it would be useful for organizations to monitor the contents of feedback exchanges between supervisors and employees to make sure that supervisors are providing performance feedback using languages that are more likely to be perceived as interpersonally fair. Computer-aided text analysis holds potential as a useful tool that organizations can use to efficiently monitor the quality of the feedback messages that supervisors provide to their employees. In the current study, we applied computer-aided text analysis (using closed-vocabulary text analysis) and machine learning to examine the validity of language-based algorithms trained on supervisor language in performance feedback situations for predicting human ratings of feedback interpersonal fairness. Results showed that language-based algorithms predicted feedback interpersonal fairness with reasonable level of accuracy. Our findings provide supportive evidence for the promise of using employee language data for managing (and improving) performance management in organizations.

• Journal of Distribution Science
• /
• v.13 no.4
• /
• pp.65-76
• /
• 2015

Purpose - This article aims to present and test a model regarding franchisors' supporting activities that may positively influence franchisees' attitude toward the franchising headquarter and their own business performance. Moreover, the authors examine the moderating effect of competitive intensity between franchisee attitude and business performance. Most previous research focused on behavioral performance measurements such as satisfaction, trust, and commitment. There are few empirical studies that focus on financial performance data because it is difficult to determine a relational mechanism between behavioral and financial performance. Moreover, financial data is confidential and difficult to collect in many cases. However, this study measures financial performance (e.g., sales revenue per square meter) differently than most previous research, which is mostly focused on the behavioral performance measurements. Research design, data, and methodology - To test our hypotheses, we selected 137 franchisee managers who are running chains of one of the foremost bakery franchise brands in South Korea. This study carefully investigated the reliability, content validity, convergent validity, and discriminant validity of the proposed instrument by analyzing the data obtained from the samples. The data was analyzed using the AMOS structural equation modeling program. Results - The results indicated that: non-financial support activities (e.g., information exchange and communication) had a positive impact on the franchisee attitude toward the franchising headquarter. The franchisee attitude in turn had a positive effect on the headquarters' business performance. Furthermore, competitive intensity could enhance the relationship between franchisee attitude toward franchising headquarter and business performance in a local franchise market. However, financial support activities (e.g., rewards and promotional support) and training had no relationship with either franchisee attitude or business performance. Conclusions - This study provides some practical implications to franchisors in terms of franchise operation and store opening strategies. With respect to the franchise operation strategy, franchisors need to focus on non-financial rather than financial support. Most franchisees consider the necessity of financial support activities and not their sufficiency because these activities are specified in their franchise contract. In addition, it is important for franchisees to maintain a positive attitude for the franchise headquarters. The franchisees with a positive attitude for the franchisor can show a high degree of solidarity for various support activities, and it consequently determines franchisees' sales performance. In terms of franchise store opening strategy, this study suggests an additional criterion that can be considered in determining the location of direct and non-direct management stores (e.g., franchisees' stores). In this research, franchise stores located within high level of competitive intensity are shown to have a high relationship between franchisee attitudes of franchisor support activities and business performance compared to the franchisees located within low competitive intensity level. This result shows that opening non-direct franchise stores is more effective than direct stores in higher competitive market situations. Research contribution, implications, and further research directions are discussed at the end of the paper.

• Therapeutic Science for Rehabilitation
• /
• v.8 no.4
• /
• pp.65-76
• /
• 2019

Objective : This study aimed to verify the validity and reliability of the Upper Extremity Performance Test for the Elderly (TEMPA) by modifying its items to exhibit cultural differences. Methods : This study included 171 healthy adults and older adults and 41 individuals with impaired upper extremity function. Content validity, discriminant validity, test-retest reliability, and inter-rater reliability were analyzed. Results : The following items, exhibiting cultural differences, were modified: "open a lock and take the top off a pillbox" and "write and affix a postage stamp." The discriminant validity results indicated that participants with normal upper extremity function performed better than those with impaired in the upper extremity function (p<.001). The test-retest reliability of the execution speed (intraclass correlation coefficient; ICC) was .71-.94, functional rating (kappa) was 1.0, and task analysis (ICC) was 1.0. The inter-rater reliability of the speed of execution was 1.0, functional rating was .79-1.0, and task analysis was .94-1.0. Conclusion : TEMPA has moderate to high level of reliability and is an assessment tool that can clearly distinguish individuals with upper extremity impairment from those without impairment.

• Therapeutic Science for Rehabilitation
• /
• v.8 no.3
• /
• pp.43-55
• /
• 2019

Objective: The purpose of this study is to conduct a preliminary research for the development of a Performance-Based Cognitive Function Test (PCFT) to screen the elderly for cognitive function impairment, and examine the reliability and validity of the test. Methods: A draft version of the Performance-Based Cognitive Function Test (PCFT) was developed and utilized in nine healthy elderly individuals. In order to verify its reliability, we analyzed the internal consistency of the PCFT. In order to verify the concurrent validity of the PCFT, this study analyzed the correlation between motor-cognitive dual task assessments and the Korean version of the Mini-Mental State Examination (MMSE-K). Results: The internal consistency of the PCFT for motor and cognitive tasks was 0.871 and 0.959 (Cronbach's ${\alpha}$), respectively. Concurrent validity of the PCFT, which was performed through motor-cognitive dual task assessments, ranged from 0.755 to 0.964 (Spearman's rho statistic, p < 0.05). In addition, correlation between the cognitive assessment tool and the MMSE-K ranged from 0.849 to 0.943 (p < 0.01). Conclusion: This study verified, and established the reliability and validity of the PCFT. Further studies are required to examine other psychometric properties in a modified PCFT, for screening cognitive function impairments in the elderly.

• The Korean Journal of Health Service Management
• /
• v.11 no.3
• /
• pp.91-104
• /
• 2017

Objectives : This study was a methodological study to verify the validity and reliability of the translated and modified Older Patients in Acute Care Survey-US (OPACS) tool, which was originally developed by Dikken and his colleagues. Methods : The OPACS was translated into Korean, and the content validity, composition validity, and reliability were verified using 348 nurses working for hospitals with over 200 beds and located in C city, B city, and K province. Results : The analysis showed that the Korean version of the OPACS had of eleven questions in the practice experience section and twelve in the general opinion section for older patients in the acute phase. Cronbach's ${\alpha}s$ were 0.84 for practice experience and 0.81 for general opinion. Conclusions : The study showed that the OPACS could measure the practice and opinion of Korean nurses who cared for elderly patients in the acute phase. The significance of the study was that it provided baseline data information regarding the performance and opinion of these nurses for nursing managers to improve the nursing environment.

• Journal of Korean Public Health Nursing
• /
• v.26 no.2
• /
• pp.258-267
• /
• 2012

Purpose: The purpose of this study was to examine the validity and reliability of injury risk perception in preschool children. Method: Employing a methodological research design, data were collected using questionnaires from a sample of 178 child day care center preschooler selected by convenient sampling located at Kwangwon-Do. Descriptive statistics, content analysis, and Pearson correlation coefficient were used in performance of data analysis. Results: Through conduct of validity testing, 27 items were finally selected. The internal consistency was acceptable with a Cronbach's alpha of .66 and a Guttman Split-half coefficient of .70. Conclusion: The injury risk perception scale showed adequate validity and reliability in preschool children. It can be used for assessment of injury risk and for development of injury prevention programs for preschool children.