• Title/Summary/Keyword: Evaluation of recognition

Search Result 1,270, Processing Time 0.035 seconds

The Design and Implementation of a Performance Evaluation Tool for the Face Recognition System (얼굴인식시스템 성능평가 도구의 설계 및 구현)

  • Shin, Woo-Chang
    • Journal of Information Technology Services
    • /
    • v.6 no.2
    • /
    • pp.161-175
    • /
    • 2007
  • Face recognition technology has lately attracted considerable attention because of its non-intrusiveness, usability and applicability. Related companies insist that their commercial products show the recognition rates more than 95% according to their self-testing. But, the rates cannot be admitted as official recognition rates. So, performance evaluation methods and tools are necessary to objectively measure the accuracy and performance of face recognition systems. In this paper, I propose a reference model for biometrics recognition evaluation tools, and implement an evaluation tool for the face recognition system based on the proposed reference model.

A Usability Evaluation Method for Speech Recognition Interfaces (음성인식용 인터페이스의 사용편의성 평가 방법론)

  • Han, Seong-Ho;Kim, Beom-Su
    • Journal of the Ergonomics Society of Korea
    • /
    • v.18 no.3
    • /
    • pp.105-125
    • /
    • 1999
  • As speech is the human being's most natural communication medium, using it gives many advantages. Currently, most user interfaces of a computer are using a mouse/keyboard type but the interface using speech recognition is expected to replace them or at least be used as a tool for supporting it. Despite the advantages, the speech recognition interface is not that popular because of technical difficulties such as recognition accuracy and slow response time to name a few. Nevertheless, it is important to optimize the human-computer system performance by improving the usability. This paper presents a set of guidelines for designing speech recognition interfaces and provides a method for evaluating the usability. A total of 113 guidelines are suggested to improve the usability of speech-recognition interfaces. The evaluation method consists of four major procedures: user interface evaluation; function evaluation; vocabulary estimation; and recognition speed/accuracy evaluation. Each procedure is described along with proper techniques for efficient evaluation.

  • PDF

Quality Evaluation Model about Efficiency for Fingerprint Recognition System (지문인식 시스템의 효율성에 관한 품질평가 모델)

  • Lee, Ha-Young;Kim, Jung-Gyu
    • Journal of Digital Convergence
    • /
    • v.12 no.6
    • /
    • pp.215-221
    • /
    • 2014
  • The Fingerprint recognition system is a system which identify the user's identify by verifying user's fingerprint and prepared data. The performance of fingerprint recognition system is dependent on 'fingerprint recognition time' and 'fingerprint recognition accuracy' and so on. In this paper, we developed a evaluation model about efficiency based on ISO quality evaluation standard for evaluating of quality level of fingerprint recognition system. We expect to contribute to construct and use of evaluation criteria based on quality evaluation standard by this study.

Evaluation of Face Recognition System based on Scenarios (얼굴인식 시스템의 시나리오 기반 평가 방법론)

  • Maeng, Doo-Lyel;Hong, Byung-Woo;Kim, Sung-Jo
    • Journal of Korea Multimedia Society
    • /
    • v.13 no.4
    • /
    • pp.487-495
    • /
    • 2010
  • It has been required to develop an accurate and reliable evaluation method for the performance of biometric systems as their use is getting popular. Among a number of biometric systems, face recognition is one of the most widely used techniques and this leads to develop a stable evaluation method for face recognition systems in order to standardize the performance of face recognition systems. However, it is considered as a difficult task to evaluation such systems due to a large number of factors that affect their performance. Thus, it may be infeasible to take into account all the environmental factors that are related to the performance of face recognition systems and this naturally suggests an evaluation method for the overall performance based on scenarios. In this paper, we have analyzed environmental factors that are related to the performance of general face recognition systems and proposed their evaluation method taking into account those factors. We have proposed an evaluation method based on scenario that considers the combination of individual environment factors instead of evaluating the performance of face recognition systems regarding each factor. Indeed, we have presented examples on the evaluation of face recognition systems based on scenario that takes into account overall environmental factors.

The Study on the Quality Assessment Model of Aircraft Voice Recognition Software (항공기 음성인식 소프트웨어 품질 평가 모델 연구)

  • Lee, Seung-Mok
    • Journal of Software Assessment and Valuation
    • /
    • v.15 no.2
    • /
    • pp.73-83
    • /
    • 2019
  • Voice Recognition has recently been improved with AI(Artificial Intelligence) and has greatly improved the false recognition rate and provides an effective and efficient Human Machine Interface (HMI). This trend has also been applied in the defense industry, particularly in the aviation, F-35. However, for the quality evaluation of Voice Recognition, the defense industry, especially the aircraft, requires measurable quantitative models. In this paper, the quantitative evaluation model is proposed for applying Voice Recognition to aircraft. For the proposal, the evaluation items are identified from the Voice Recognition technology and ISO/IEC 25000(SQuaRE) quality attributes. Using these two perspectives, the quantitative evaluation model is proposed under aircraft operation condition and confirms the evaluation results.

Learning Element Recognition and Academic Achievement of Nursing Student Receiving PBL with Simulation Education (시뮬레이션 실습이 접목된 문제중심학습에 대한 간호학생의 PBL 학습요소별 인식과 학업성취도)

  • Kim, Ji-Yun;Choi, Eun-Young
    • Korean Journal of Adult Nursing
    • /
    • v.20 no.5
    • /
    • pp.731-742
    • /
    • 2008
  • Purpose: The purpose of this study was to analyze how a nursing student recognizes PBL with simulation education and its relationship to academic achievement. Methods: The study objects were the students in C college who learn through PBL using simulator for 15 weeks(September 2007 to December 2007). Learning element recognition was developed by Cho(2002) and three key evaluations(performance, self-evaluation, and colleague evaluation) were designed by professors. Results: Learning element recognition ranged from 2.37 to 4.83 with the average at 3.94. For Learning element recognition, students who preferred discussion score 4.15. This was statistically more significant than those who do not. Students who preferred presentations show significantly higher score in colleague evaluation. For Learning element recognition and academic achievement, self-evaluation and colleague evaluation showed relationship to PBL learning element. Conclusion: There was definitely a relationship with PBL learning element and academic achievement after learning the PBL with simulation education.

  • PDF

A Study on the Contents and Consumers' Recognition of Clothing Product Evaluation Statements in the Internet Apparel Shopping Mall (인터넷 쇼핑몰의 의류 상품평 내용과 소비자 인식에 관한 연구)

  • Choi Eun-Young
    • The Research Journal of the Costume Culture
    • /
    • v.12 no.6 s.53
    • /
    • pp.984-998
    • /
    • 2004
  • The purpose of this study was to analyze contents of clothing product evaluation statements in the internet shopping mall and to discover consumers' recognition and evaluation of it. The data were collected from 151 consumers' statements in the four internet apparel shopping malls and a questionnaire was developed to measure consumers' recognition of clothing product evaluation statements. The questionnaire was administrated 272 consumers over 18 years old. The results of this study were as follows; First, The contents of clothing product evaluation statements in the internet shopping blog, were divided into three categories which were product, service and consumer buying decision process. Product category include evaluation of clothing product, description of difference between real product and product on the screen, and advice of uses. Service category include quickness and kindness in delivery, store preference for good service. For consumer buying decision process, motivation of purchasing, perceived risk, expression of satisfaction from good buying and canvassing for purchasing were included. Second, consumer recognized that clothing product evaluation statements has function of furnishing information, confirmation of purchasing decision, risk reduction of internet shopping, and interesting entertainment. Consumers also were dependent on product evaluation statements for making purchasing decision. And it was trusted by consumers. This recognition & evaluation were correlated with consumer's clothing product knowledge, involvement, risk perception of internet shopping, experiences of internet shopping. Managerial implications are provided for internet shopping mall.

  • PDF

A Research on the development of evaluation model for the government's recognition regarding the program accrediting organizations in Higher Education (고등교육 프로그램 평가인증기관의 정부인정 평가모형 개발에 관한 연구)

  • Kim, Kyung-Soo;Hwang, Myung-Ku;Lee, Tae-Hee
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.13 no.1
    • /
    • pp.87-98
    • /
    • 2012
  • The Ministry of Education, Science and Technology has been implementing the government's recognition project regarding the program accrediting organizations in Higher Education. This research is to establish an evaluation model for the government's recognition process of the program accrediting organizations, and develop the evaluation categories, items and indices for the model. The research has set the concept for the government's recognition regarding the program accrediting organizations and designed an evaluation model for such organizations. The evaluation model embraces a preliminary evaluation process, assessing an eligibility of the accrediting organizations for the higher education based on the formalities set forth for the government recognition organization accrediting process. It also includes the main evaluation process, which assess the eligibility based on the evaluation standards stipulated in the associated legislation and regulations. In addition, through in-depth verification processes by experts, this research finalized 2 evaluation domains, 5 evaluation categories, 24 evaluation items and 33 evaluation indices.

AI-based language tutoring systems with end-to-end automatic speech recognition and proficiency evaluation

  • Byung Ok Kang;Hyung-Bae Jeon;Yun Kyung Lee
    • ETRI Journal
    • /
    • v.46 no.1
    • /
    • pp.48-58
    • /
    • 2024
  • This paper presents the development of language tutoring systems for nonnative speakers by leveraging advanced end-to-end automatic speech recognition (ASR) and proficiency evaluation. Given the frequent errors in non-native speech, high-performance spontaneous speech recognition must be applied. Our systems accurately evaluate pronunciation and speaking fluency and provide feedback on errors by relying on precise transcriptions. End-to-end ASR is implemented and enhanced by using diverse non-native speaker speech data for model training. For performance enhancement, we combine semisupervised and transfer learning techniques using labeled and unlabeled speech data. Automatic proficiency evaluation is performed by a model trained to maximize the statistical correlation between the fluency score manually determined by a human expert and a calculated fluency score. We developed an English tutoring system for Korean elementary students called EBS AI Peng-Talk and a Korean tutoring system for foreigners called KSI Korean AI Tutor. Both systems were deployed by South Korean government agencies.

Recognition of Emotion and Emotional Speech Based on Prosodic Processing

  • Kim, Sung-Ill
    • The Journal of the Acoustical Society of Korea
    • /
    • v.23 no.3E
    • /
    • pp.85-90
    • /
    • 2004
  • This paper presents two kinds of new approaches, one of which is concerned with recognition of emotional speech such as anger, happiness, normal, sadness, or surprise. The other is concerned with emotion recognition in speech. For the proposed speech recognition system handling human speech with emotional states, total nine kinds of prosodic features were first extracted and then given to prosodic identifier. In evaluation, the recognition results on emotional speech showed that the rates using proposed method increased more greatly than the existing speech recognizer. For recognition of emotion, on the other hands, four kinds of prosodic parameters such as pitch, energy, and their derivatives were proposed, that were then trained by discrete duration continuous hidden Markov models(DDCHMM) for recognition. In this approach, the emotional models were adapted by specific speaker's speech, using maximum a posteriori(MAP) estimation. In evaluation, the recognition results on emotional states showed that the rates on the vocal emotions gradually increased with an increase of adaptation sample number.