• 제목/요약/키워드: Staff-line detection

검색결과 10건 처리시간 0.023초

카메라 기반 악보 영상 인식을 위한 오선 검출 및 삭제 알고리즘 (Staff-line Detection and Removal Algorithm for Mobile Phone-based Recognition of Musical Images)

  • 손화정;김수형;오성열
    • 한국콘텐츠학회논문지
    • /
    • 제7권11호
    • /
    • pp.34-42
    • /
    • 2007
  • 본 논문에서는 휴대폰 카메라에서 촬영한 악보 영상에서 오선을 검출하고 삭제하는 방법을 제안한다. 오선 검출 및 삭제는 악보 영상을 인식하기 위한 전처리 기술로서, 기울어짐이나 휘어짐과 같은 왜곡에 손상된 영상에도 효과적으로 적용할 수 있어야 한다. 제안 방법은 기울어짐이나 휘어짐의 정도에 따라 보표를 분할하여 오선을 검출한다. 보표의 분할 개수는 분할 위치에서 좌표값의 차이에 대한 평균값이 임계값 이하가 될 때까지 반복하여 계산한다. 따라서, 분할 개수는 기울어짐의 정도에 따라 적응적으로 추정될 수 있다. 실험을 위해, 휴대폰 카메라로 촬영한 임의 악보 영상을 $1^{\circ}{\sim}3^{\circ}$로 기울어거나 강 약의 휘어짐을 주어 여러 가지 영상을 구성하였다. 실험 결과, 제안 방법이 실험 영상에 대해 정확한 오선 검출 및 삭제가 가능함을 보였다.

손사보 악보의 광학음악인식을 위한 CNN 기반의 보표 및 마디 인식 (Staff-line and Measure Detection using a Convolutional Neural Network for Handwritten Optical Music Recognition)

  • Park, Jong-Won;Kim, Dong-Sam;Kim, Jun-Ho
    • 한국정보통신학회논문지
    • /
    • 제26권7호
    • /
    • pp.1098-1101
    • /
    • 2022
  • With the development of computer music notation programs, when drawing sheet music, it is often drawn using a computer. However, there are still many use of hand-written notations for educational purposes or to quickly draw sheet music such as listening and dictating. In previous studies, OMR focused on recognizing the printed music sheet made by music notation program. the result of handwritten OMR with camera is poor because different people have different writing methods, and lens distortion. In this study, as a pre-processing process for recognizing handwritten music sheet, we propose a method for recognizing a staff using linear regression and a method for recognizing a bar using CNN. F1 scores of staff recognition and barline detection are 99.09% and 95.48%, respectively. This methodologies are expected to contribute to improving the accuracy of handwriting.

Optical Music Score Recognition System for Smart Mobile Devices

  • Han, SeJin;Lee, GueeSang
    • International Journal of Contents
    • /
    • 제10권4호
    • /
    • pp.63-68
    • /
    • 2014
  • In this paper, we propose a smart system that can optically recognize a music score within a document and can play the music after recognition. Many historic handwritten documents have now been digitalized. Converting images of a music score within documents into digital files is particularly difficult and requires considerable resources because a music score consists of a 2D structure with both staff lines and symbols. The proposed system takes an input image using a mobile device equipped with a camera module, and the image is optimized via preprocessing. Binarization, music sheet correction, staff line recognition, vertical line detection, note recognition, and symbol recognition processing are then applied, and a music file is generated in an XML format. The Music XML file is recorded as digital information, and based on that file, we can modify the result, logically correct errors, and finally generate a MIDI file. Our system reduces misrecognition, and a wider range of music score can be recognized because we have implemented distortion correction and vertical line detection. We show that the proposed method is practical, and that is has potential for wide application through an experiment with a variety of music scores.

Camera-based Music Score Recognition Using Inverse Filter

  • Nguyen, Tam;Kim, SooHyung;Yang, HyungJeong;Lee, GueeSang
    • International Journal of Contents
    • /
    • 제10권4호
    • /
    • pp.11-17
    • /
    • 2014
  • The influence of acquisition environment on music score images captured by a camera has not yet been seriously examined. All existing Optical Music Recognition (OMR) systems attempt to recognize music score images captured by a scanner under ideal conditions. Therefore, when such systems process images under the influence of distortion, different viewpoints or suboptimal illumination effects, the performance, in terms of recognition accuracy and processing time, is unacceptable for deployment in practice. In this paper, a novel, lightweight but effective approach for dealing with the issues caused by camera based music scores is proposed. Based on the staff line information, musical rules, run length code, and projection, all regions of interest are determined. Templates created from inverse filter are then used to recognize the music symbols. Therefore, all fragmentation and deformation problems, as well as missed recognition, can be overcome using the developed method. The system was evaluated on a dataset consisting of real images captured by a smartphone. The achieved recognition rate and processing time were relatively competitive with state of the art works. In addition, the system was designed to be lightweight compared with the other approaches, which mostly adopted machine learning algorithms, to allow further deployment on portable devices with limited computing resources.

재활 의료 보조를 위한 딥러닝 기반 무인 의료 시스템의 설계 및 성능평가 (Design and performance evaluation of deep learning-based unmanned medical systems for rehabilitation medical assistance)

  • 최동규;장종욱
    • 한국정보통신학회논문지
    • /
    • 제25권12호
    • /
    • pp.1949-1955
    • /
    • 2021
  • 최근 코로나 상황을 겪으면서 국가들은 의료인력과 그 기술에 대한 필요성을 심각하게 느끼고 있다. 고령화되고 있는 사회에 따라 실제로 의료진의 수는 줄고 있으며, 이러한 문제점을 해결하기 위해서 실제 의사가 하는 의료 행위 중고도의 전문성을 요구하지 않는 부분을 대체 할 수 있는 연구가 필요하다. 본 논문에서는 존재하는 다양한 딥러닝 영상처리 기반 기술을 활용하여 의료진이 직접 환자를 대면해야 하는 재활 분야에 적용할 수 있는 회복 상태를 확인하는 업무에 관한 무인 의료 시스템과 관련한 실제 연구 방법들을 서술하고 제안한다. 제안하는 방법은 실제 동작 비교에 사용했던 방법인 각도계나 사진에 선을 긋는 방법과 같은 수동적인 계산을 대체한다. 실시간으로 수행하므로 빠른 진단에 도움을 주며, 동작 수행 일치도에 대한 데이터를 확인할 수 있기에 의료진이 필요한 정보를 쉽게 제공한다.

고속열차 운행에 따른 호남고속철도 궤도회로 귀선전류 영향 분석 (Analysis of Return Current Effect for Track Circuit on Ho-Nam high Speed Line)

  • 백종현
    • 한국통신학회논문지
    • /
    • 제42권5호
    • /
    • pp.1110-1116
    • /
    • 2017
  • 동작 특성에 따라 궤도회로 장치는 신호기 장치, 선로전환기 및 기타 안전과 관련된 장치의 직접 또는 간접 제어를 위해 설치되며, 주로 열차의 검지, 지상에서 차상으로 제어정보 전송, 궤도 깨짐 검지 및 귀선 전류 전송에 사용된다. 특히 귀선 전류는 신호시스템, 전력시스템 및 전차선 및 궤도회로장치와 관련이 있다. 신호시스템에서 가장 중요한 구성 요소 중 하나인 귀선 전류는 선로변 유지보수자의 안전 및 전철화에 따른 철도 관련 전기시스템의 보호를 위해 적합하게 처리되어야 한다. 따라서, 과전류 상태로 인한 귀선 전류 불평형과 시스템 유도 장애 및 고장을 방지하기 위해서는 귀선 전류의 정확한 분석이 필요하다. 또한, 귀선전류 고조파에 의해 오동작이 발생하면 열차 운행 중단 등의 문제가 발생될 수 있다. 본 논문에서는 이러한 귀선 전류 측정 및 분석 방법을 제시하고 고속열차 운행에 따른 호남고속철도 노선에서의 귀선전류 고조파 시험 결과를 제시하고 있다.

ITX 차량 운행에 의한 AF 무절연 궤도회로의 귀선전류 영향 분석 (Analysis of Return Current Effect for AF Non-insulated Track Circuit in ITX Vehicle Operation)

  • 백종현;김용규;윤용기;장동욱;신동호
    • 전기학회논문지
    • /
    • 제62권4호
    • /
    • pp.584-590
    • /
    • 2013
  • Depending on the operating characteristics, track circuit is installed for the purpose of control directly or indirectly of the signal device, point switch machine and other security device. These are mainly used for train detection, transmission of information, broken train detection and transmission of return current. Especially, the return current is related to signal system, power system and catenary line, and track circuit systems. It is one of the most important component shall be dealt for the safety of track side staff and for the protection of railway-related electrical system according to electrification. Therefore, an accurate analysis of the return current is needed to prevent the return current unbalance and the system induced disorder and failure due to an over current condition. Also, if the malfunction occurred by the return current harmonics, it can cause problems including train operation interruption. In this paper, we presented measurement and analysis method at return current and it's harmonics by train operation. By the test criteria, we evaluated for safety. Hereafter, it is expected to contribute to the field associated with it.

A Covariance-matching-based Model for Musical Symbol Recognition

  • Do, Luu-Ngoc;Yang, Hyung-Jeong;Kim, Soo-Hyung;Lee, Guee-Sang;Dinh, Cong Minh
    • 스마트미디어저널
    • /
    • 제7권2호
    • /
    • pp.23-33
    • /
    • 2018
  • A musical sheet is read by optical music recognition (OMR) systems that automatically recognize and reconstruct the read data to convert them into a machine-readable format such as XML so that the music can be played. This process, however, is very challenging due to the large variety of musical styles, symbol notation, and other distortions. In this paper, we present a model for the recognition of musical symbols through the use of a mobile application, whereby a camera is used to capture the input image; therefore, additional difficulties arise due to variations of the illumination and distortions. For our proposed model, we first generate a line adjacency graph (LAG) to remove the staff lines and to perform primitive detection. After symbol segmentation using the primitive information, we use a covariance-matching method to estimate the similarity between every symbol and pre-defined templates. This method generates the three hypotheses with the highest scores for likelihood measurement. We also add a global consistency (time measurements) to verify the three hypotheses in accordance with the structure of the musical sheets; one of the three hypotheses is chosen through a final decision. The results of the experiment show that our proposed method leads to promising results.

Development of an Imaging Based Gang Protection System

  • Grimm, M.;Pelz, M.
    • International Journal of Railway
    • /
    • 제1권4호
    • /
    • pp.149-156
    • /
    • 2008
  • During maintenance or construction works in or at the tracks of railways, high risks for passengers and railway staff, especially for the workers on the construction site exist. The high risks result out of the movement of rail vehicles, like trains or construction vehicles, which must be faced by using any available technical and operational technologies for securing them against the environment. Therefore, it is necessary to evaluate the level of protection continuously and to identify new and innovative methods and technologies for the protection of the gang (construction worker, machines and material). Especially on construction sites at line sections with two or more parallel tracks but also with single tracks, there are still a lot of incidents and accidents mostly with seriously injured persons or fatalities. These were mainly gang members that breach the railway-loading gage. By using proper warning or protection systems, the avoidance of such accidents must be achieved. The latest developments. in gang protection systems concern on the one hand fixed barriers in the middle between the construction site and the operated track and on the other hand construction vehicles equipped with automatic warning systems. The disadvantage of such protection methods is that the gang can be warned against an approaching train but a monitoring of the gang members cannot be performed. Only one part of a potential dangerous situation will be detected. If the gang members will overhear the acoustic warning signal of the security staff and the workers will not leave the danger zone in the track, the driver of the approaching train had no chance to react to the dangerous situation. An accident is often inevitable. While the detection of acoustic warning signals by the gang members working on a construction site is very difficult, the acoustical planning of an automatic warning system has to be designed for an acoustic short range level of one meter besides the construction vehicle. The decision about the use of today's technical warning system (fixed systems, automatic warning systems, etc.) must be geared to the technical feasibility and the level of safety which is needed. Criteria for decision guidance to block a track should be developed by danger estimation and economical variables. To realize the actual jurisdiction and to minimize the hazards of railway operations by the use of construction vehicles near the tracks further developments are needed. This means, that the warning systems have to be enhanced to systems for protection, which monitor the realization of the warning signal as a precondition for giving a movement authority to a train. This method can protect against accidents caused by predictable wrongdoing. The actual state of the art technique of using a collective warning combined with additional security staff is no longer acceptable. Therefore, the Institute of Transportation System of the German Aerospace Center in Braunschweig (Germany) will develop a gang warning and protection system based upon imaging methods, with optical sensors such as video in visible and invisible ranges, radar, laser, and other. The advantage of such a system based on the possibility to monitor both the gang itself and the railway-loading gauge either of the parallel track or of the same track still in use. By monitoring both situations, the system will be able to generate a warning message for the approaching train, that there are obstacles in the track, so that the train can be stopped to prevent an accident. And also the gang workers will be warned, while they breach their area.

  • PDF

결핵균 분비항원을 이용한 결핵의 혈청학적 진단 방법에 대한 평가 (Evaluation of a Serodiagnostic Method for Tuberculosis by Using Secreted Protein Antigens of Mycobacterium Tuberculosis)

  • 배길한;박은미;김상재
    • Tuberculosis and Respiratory Diseases
    • /
    • 제48권3호
    • /
    • pp.315-323
    • /
    • 2000
  • 연구배경 : 현행 도말 및 배양등의 미생물학적 검사법의 제한점을 보완 또는 보조할 수 있는 신속한 결핵진단 방법의 하나로서 가장 많이 연구 되어온 분야가 혈청학적인 방법이다. 이 중 현재까지 결핵의 혈청학적 진단에 유용성이 높은 것으로 평가되는 항원의 하나가 38KDa으로 대표되는 결핵균 분비항원이다. 마침, 이 38KDa 항원을 주항원 성분으로 하여, 간편하게 실험할 수 있도록 kit화된 제품이 국내외에서 널리 시판되고 있기에(ICT-TB, 호주 ICT Diagnostics사) 이를 이용, 결핵의 혈청학적 진단이 얼마나 유용할 것인지를 평가하고자 하였다. 방 법 : 결핵이 없는 7세 이하 아동 21명과 건강 성인 47명 등 총 68명의 대조군과, 치료 개시 전에는 균양성이었으나 ICT 검사 당시는 균이 나오지는 않았던 치료 중인 폐결핵환자 82명 (결핵성 흉막염 환자 3명 포함) 및 균양성으로 당시 치료 중이던 폐결핵환자 40명 등, 총 122명의 결핵환자를 대상으로 하여 결핵의 혈청학적 진단용 kit인 ICT를 이용하여 시험하였다. 결 과 : 1. 결핵환자가 아닌 대조용 대상자 68명(7세 이하 아동 21명 포함)에 대한 ICT의 양성반응률 (위양성률)은 13.2%였고, 음성반응률 (결핵환자가 아닌 것으로 판정되는 율, true negative)은 86.8%였다. 2. 시험된 대상 결핵환자 122명에 대한 ICT에 의한 양성반응률은 86.9%, 음성반응률은 13.1%였다. 3. 균양성 폐결핵 환자 40명에 대한 ICT 양성률은 95.0% (38명), 음성률은 5.0% (2명)였다. 4. 폐외결핵환자 3명을 포함한, 현재 치료 중에 있는 균음성 결핵환자에 82명에 대한 ICT의 양성반응률은 82.9%(68 명), 음성반응률은 17.1%(14명)였다. 그러나, 균양성 결핵환자와 균음성인 결핵환자간 ICT 양성률에는 통계적으로 유의한 차이가 없었다(P>0.05). 5.ICT의 민강도와 특이도는 모두 87%였으며, 위양성률과 위음성률도 같은 13%였다. 또 유병율이 64% 수준일 때의 양성예측률은 92.2%, 음성예측률은 78.7%였다. 결 론 : ICT의 높은 위양성률과 진단능률(diagnosability) 등을 고려할 때, 결핵이 의심되지만 기존의 도말 및 배양검사 결과를 얻기 어려운 대상자에게만 필요에 따라 제한적으로 활용해볼 수 있는 검사인 것으로 판단되었다.

  • PDF