• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.12 no.2
• /
• pp.181-186
• /
• 2012

This paper proposes a method for evaluating web pages by considering implicit user reaction on web pages. Usually users spend more time and make more reactions, such as clicking, dragging and scrolling, while reading interesting pages. Based on this observation, a web page evaluation method by observing implicit user reaction is proposed. The system is designed with Ajax for observing user reactions, and neural networks for learning correlation between user reactions and usefulness of pages. The amounts of each type of user reactions are inputted to neural networks. Also the numbers of characters and images of pages are used as inputs because the amount of users' behaviors has a tendency to increase as the length of pages increase. The experiment is conducted with 113 people and 74 pages. Each page is ranked by users with a questionnaire. The proposed method shows more close ranking results to the user ranks than Google. That is, our system evaluates web pages more closely to users' viewpoint than Google. Although our experiment is limited, our result shows powerful potential of new element for web page evaluation. Some approaches evaluate web pages with their contents and some evaluate web pages with structural attributes, particularly links, of pages. Web page evaluation is for users, so the best evaluation can be done by users themselves. So, user feedback is one of the most important factors for web page evaluation. This paper proposes a new method which reflects user feedbacks on web pages.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.28 no.4
• /
• pp.155-189
• /
• 2003

In this research, the comprehensive evaluation model of IS(information systems) for public sectors is theoretically constructed through reviewing and integrating previous IS evaluation-related research. This model is hypothesized to consist of five sectors(System Sector, User Sector, Organization and Management Sector, Resource Management Sector and Strategic Contribution Sector), ten evaluation items belonging to these five evaluation sectors, and sixty two evaluation indices for these ten evaluation items. The results of empirical analyses to test the validity of the research model show that the evaluation sectors turn out to be the same ones as proposed in the hypothetical model. The evaluation items(System Quality, Information Quality, Service Quality) in System Sector proves to be consistent with the hypothetical model. However, in case of User Sector, two evaluation items(Perceived Usefulness and User Satisfaction) which are included in the hypothetical model are found to be merged into one item(User Satisfaction). And, it is shown that four evaluation items such as the Efficiency of Internal Process, Customer Satisfaction, Organizational Innovation, and the Degree of Informatization competence improvement are included in Organization and Management Sector, differently from the research model in which the items, Organizational innovation and the Degree of Informatization competence improvement, are not divided. As a final result, sixty two evaluation indices that comprise all the evaluation items belonging to five sectors are found to be reduced to fifty seven ones through factor analyses, criterion-related validity tests and reliability analyses.

• 한국경영정보학회:학술대회논문집
• /
• 2007.06a
• /
• pp.357-362
• /
• 2007

This study presents a methodology that efficiently evaluates and interprets the end-user computing capability in a total perspective in a computing environment. The evaluation system has an evaluation tool, evaluation method and process, and an interpretation system. The validity and reliability of the developed tool construct was verified by factor and reliability analysis with the application of SPSS software. The application and utilization of the developed system was confirmed by applying it to evaluating the computing competency of 316 workers in an enterprise and presenting its evaluation results. This will contribute to developing a methodology for totally evaluating and interpreting the end-user computing capability and improving their computing capability in industrial fields.

• MALSORI
• /
• no.67
• /
• pp.103-120
• /
• 2008

Basic components for multimodal interface, such as speech recognition, speech synthesis, gesture recognition, and multimodal fusion, have their own technological limitations. For example, the accuracy of speech recognition decreases for large vocabulary and in noisy environments. In spite of those technological limitations, there are lots of applications in which speech-oriented multimodal user interfaces are very helpful to users. However, in order to expand application areas for speech-oriented multimodal interfaces, we have to develop the interfaces focused on usability. In this paper, we introduce usability and user-centered design methodology in general. There has been much work for evaluating spoken dialogue systems. We give a summary for PARADISE (PARAdigm for Dialogue System Evaluation) and PROMISE (PROcedure for Multimodal Interactive System Evaluation) that are the generalized evaluation frameworks for voice and multimodal user interfaces. Then, we present usability components for speech-oriented multimodal user interfaces and usability testing guidelines that can be used in a user-centered multimodal interface design process.

• Journal of the Ergonomics Society of Korea
• /
• v.22 no.2
• /
• pp.45-56
• /
• 2003

The purpose of this study is to develop the model including multiple causal relationship between factors to evaluate overall user satisfaction and develop an objective method to quantify the impacts and scores of each qualitative factors on overall user satisfaction using Structural Equation Model(SEM) and also test the feasibility to construct a comprehensive website evaluation model including qualitative and quantitative factors. The SEM model used 2 qualitative factors of usability and esthetic factors for the evaluation factors of user satisfaction and select 4 attributes of each factors using factor analysis. 3 shopping mall sites were evaluated to construct the SEM model, and 155 subjects participated the website evaluation using the walk-through and face-to-face survey method. Analysis results showed that the SEM model was statistically significant for all the 3 websites evaluated. Both the usability and esthetic factors showed significant effects to user satisfaction of websites and have positive correlation. The user satisfaction was more effected by the usability factor than esthetic factors, and the simplification and harmonization were the most critical attributes of the usability and esthetic factors.

• 한국HCI학회:학술대회논문집
• /
• 2008.02a
• /
• pp.528-533
• /
• 2008

Web page evaluation is important issue in the Internet. Web pages are increasing extremely fast. The web page evaluation based on frequency, like the count of the page view (PV), is not sufficient way even it is used variously. Because users never use the unnecessary or irrelevant web pages for a long time. We concentrated on user's visiting duration time for the evaluation web pages. And we can collect user actions. Users do some action when users using the web page in the web browser. The movements of mouse pointer, mouse button click, page scrolling and so on are produced in the web browser. JavaScript can collect user action and Ajax can send collected data to server when user using the web browser without no user notification.

• Proceedings of the ESK Conference
• /
• 1997.10a
• /
• pp.313-319
• /
• 1997

There is currently a focus on usability of interactive computer software. Previous research in software ergonomics has indicated the importance of evaluating the usability of software user interfaces. Software developers, interface designers or human foctors engineers often confront the task of comparative evaluation among systems, versions or interface designs. This study presents a structured model for comparative evaluation of user interface designs using usability criteria and measures. The proposed model consists of twomain phases : the prescreening phase ad the evaluation phase. The first phase involves expert judgment-based approach with qualitative criteria. The prescreening phase uses absolute measurement analytic hierarchy process to filter possible altermative interfaces to a reasonable subset. The second phase involves user-based approach such as usability testing, with quantitative criteria. The objective of the evaluation phase is to evaluate a subset of altermatives using objective measures. A set of criteria and measures for evaluating the usability of computer software designs is presented. The proposed model provides practitioners with a structured approach to select the best interface based on usability criteria and measures.

• The Journal of Society for e-Business Studies
• /
• v.24 no.1
• /
• pp.29-48
• /
• 2019

Recently, product design innovation to improve user experience has been perceived as a core element of enterprise competitiveness due to the fierce market competition and decrease of the technological gap between companies, but there is insufficient services to support the product experience evaluation of small and medium-sized companies (SMCs). The aim of this study is to develop a web-based product user experience evaluation and certification system supporting product design practices for SMCs. For system interface design, we conducted systematic functional requirement elicitation methods such as user survey, workflow analysis, user task definition, and function definition. Then main functions, information structure, navigation method, and detailed graphic user interfaces were developed with consideration of user interactions and requirements. In particular, it provides the databases for evaluation efficiency to support the evaluation process above a certain level of performance and efficiency, and knowledge databases to utilize in the evaluation and product design improvement. With help of the developed service platform, It is expected that the service platform would enhance SMCs' product development capability with regard to the user experience evaluation by connecting the consulting firms with SMCs.

• Nuclear Engineering and Technology
• /
• v.51 no.2
• /
• pp.453-462
• /
• 2019

Mental workload (MWL) is a major consideration for the user interface design in nuclear power plants (NPPs). However, each MWL evaluation method has its advantages and limitations, thus the evaluation and control methods based on multi-index methods are needed. In this study, fuzzy comprehensive evaluation (FCE) theory was adopted for assessment of interface designs in NPP based on operators' MWL. An evaluation index system and membership functions were established, and the weights were given using the combination of the variation coefficient and the entropy method. The results showed that multi-index methods such as performance measures (speed of task and error rate), subjective rating (NASA-TLX) and physiological measure (eye response) can be successfully integrated in FCE for user interface design assessment. The FCE method has a correlation coefficient compared with most of the original evaluation indices. Thus, this method might be applied for developing the tool to quickly and accurately assess the different display interfaces when considering the aspect of the operators' MWL.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.10 no.4
• /
• pp.127-132
• /
• 2014

Some laws and regulations may require internet service providers to provide services based on the age of users. Age verification in the online environment should be used as a tool to provide service that is appropriate to child based on age. Using the minimum attribute information, processes on age verification provides the proper guidance to the internet services. However, there is a lack of a globally accepted trust framework for age verification process including evaluation factors for age verification information. In this paper the federation model of user attributes were described and evaluation factors for the age verification information were suggested. Also using the suggested evaluation factors, performance evaluation of federation model of user evaluation was performed. To meet the requirements of evaluation factors, framework of federation model should consider the unlinkability pseudonym support, eavesdropping protection and cloning protection.