• Title/Summary/Keyword: Staff line Detection

Search Result 10, Processing Time 0.029 seconds

Staff-line Detection and Removal Algorithm for Mobile Phone-based Recognition of Musical Images (카메라 기반 악보 영상 인식을 위한 오선 검출 및 삭제 알고리즘)

  • Son, Hwa-Jeong;Kim, Soo-Hyung;Oh, Sung-Ryul
    • The Journal of the Korea Contents Association
    • /
    • v.7 no.11
    • /
    • pp.34-42
    • /
    • 2007
  • In this paper, we propose a staff-line detection and removal algorithm from a music score image obtained by a mobile phone camera. As a preprocessing technique to recognize a music score image, staff-line detection and removal should be efficiently applied to the skewed or curved images. The proposed method detects a staff-line by dividing a staff according to the degree of distortion. The number of division is calculated by dividing a staff repletely until an average of differences of y coordinates in every divided position is smaller than a threshold. Therefore, the number of division can be adaptively estimated according to the degree of the distortion. For an experiment, we make various kinds of images by rotating one from $1^{\circ}\;to\;3^{\circ}$ or curving slightly upward. The results show that the proposed method performed well on the experiment images.

Staff-line and Measure Detection using a Convolutional Neural Network for Handwritten Optical Music Recognition (손사보 악보의 광학음악인식을 위한 CNN 기반의 보표 및 마디 인식)

  • Park, Jong-Won;Kim, Dong-Sam;Kim, Jun-Ho
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.26 no.7
    • /
    • pp.1098-1101
    • /
    • 2022
  • With the development of computer music notation programs, when drawing sheet music, it is often drawn using a computer. However, there are still many use of hand-written notations for educational purposes or to quickly draw sheet music such as listening and dictating. In previous studies, OMR focused on recognizing the printed music sheet made by music notation program. the result of handwritten OMR with camera is poor because different people have different writing methods, and lens distortion. In this study, as a pre-processing process for recognizing handwritten music sheet, we propose a method for recognizing a staff using linear regression and a method for recognizing a bar using CNN. F1 scores of staff recognition and barline detection are 99.09% and 95.48%, respectively. This methodologies are expected to contribute to improving the accuracy of handwriting.

Optical Music Score Recognition System for Smart Mobile Devices

  • Han, SeJin;Lee, GueeSang
    • International Journal of Contents
    • /
    • v.10 no.4
    • /
    • pp.63-68
    • /
    • 2014
  • In this paper, we propose a smart system that can optically recognize a music score within a document and can play the music after recognition. Many historic handwritten documents have now been digitalized. Converting images of a music score within documents into digital files is particularly difficult and requires considerable resources because a music score consists of a 2D structure with both staff lines and symbols. The proposed system takes an input image using a mobile device equipped with a camera module, and the image is optimized via preprocessing. Binarization, music sheet correction, staff line recognition, vertical line detection, note recognition, and symbol recognition processing are then applied, and a music file is generated in an XML format. The Music XML file is recorded as digital information, and based on that file, we can modify the result, logically correct errors, and finally generate a MIDI file. Our system reduces misrecognition, and a wider range of music score can be recognized because we have implemented distortion correction and vertical line detection. We show that the proposed method is practical, and that is has potential for wide application through an experiment with a variety of music scores.

Camera-based Music Score Recognition Using Inverse Filter

  • Nguyen, Tam;Kim, SooHyung;Yang, HyungJeong;Lee, GueeSang
    • International Journal of Contents
    • /
    • v.10 no.4
    • /
    • pp.11-17
    • /
    • 2014
  • The influence of acquisition environment on music score images captured by a camera has not yet been seriously examined. All existing Optical Music Recognition (OMR) systems attempt to recognize music score images captured by a scanner under ideal conditions. Therefore, when such systems process images under the influence of distortion, different viewpoints or suboptimal illumination effects, the performance, in terms of recognition accuracy and processing time, is unacceptable for deployment in practice. In this paper, a novel, lightweight but effective approach for dealing with the issues caused by camera based music scores is proposed. Based on the staff line information, musical rules, run length code, and projection, all regions of interest are determined. Templates created from inverse filter are then used to recognize the music symbols. Therefore, all fragmentation and deformation problems, as well as missed recognition, can be overcome using the developed method. The system was evaluated on a dataset consisting of real images captured by a smartphone. The achieved recognition rate and processing time were relatively competitive with state of the art works. In addition, the system was designed to be lightweight compared with the other approaches, which mostly adopted machine learning algorithms, to allow further deployment on portable devices with limited computing resources.

Design and performance evaluation of deep learning-based unmanned medical systems for rehabilitation medical assistance (재활 의료 보조를 위한 딥러닝 기반 무인 의료 시스템의 설계 및 성능평가)

  • Choi, Donggyu;Jang, Jongwook
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.12
    • /
    • pp.1949-1955
    • /
    • 2021
  • With the recent COVID-19 situation, countries are seriously feeling the need for medical personnel and their technologies. PDepending on the aging society, the number of medical staff is actually decreasing, and in order to solve this problem, research is needed to replace the part that does not require high expertise among actual medical practices performed by doctors. This paper describes and proposes actual research methods related to unmanned medical systems that use various deep learning image processing-based technologies to check the recovery status applicable to rehabilitation areas where medical staff should face patients directly. The proposed method replaces passive calculations such as a protractor or a method of drawing a line in a photograph, which is the method used for actual motion comparison. Since it is performed in real time, it helps to diagnose quickly, and it is easy for medical staff to provide necessary information because data on the degree of match of motion performance can be checked.

Analysis of Return Current Effect for Track Circuit on Ho-Nam high Speed Line (고속열차 운행에 따른 호남고속철도 궤도회로 귀선전류 영향 분석)

  • Baek, Jong-hyen
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.42 no.5
    • /
    • pp.1110-1116
    • /
    • 2017
  • Depending on the operating characteristics, track circuit is installed for the purpose of direct or indirect control of the signal device, point switch machine and other security device. These are mainly used for train detection, transmission of information, broken rail detection and transmission of return current. Especially, the return current is related to signal system, power system and catenary line, and track circuit systems. It is one of the most important component shall be dealt for the safety of track side staff and for the protection of railway-related electrical system according to electrification. Therefore, an accurate analysis of the return current is needed to prevent the return current unbalance and the system induced disorder and failure due to an over current condition. Also, if the malfunction occurred by the return current harmonics, it can cause problems including train operation interruption. In this paper, we presented measurement and analysis method at return current and it's harmonics by high speed train operation on the honam high speed line.

Analysis of Return Current Effect for AF Non-insulated Track Circuit in ITX Vehicle Operation (ITX 차량 운행에 의한 AF 무절연 궤도회로의 귀선전류 영향 분석)

  • Beak, Jong-Hyen;Kim, Yong-Kyu;Yoon, Yong-Ki;Jang, Dong-Wook;Shin, Dong-Ho
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.62 no.4
    • /
    • pp.584-590
    • /
    • 2013
  • Depending on the operating characteristics, track circuit is installed for the purpose of control directly or indirectly of the signal device, point switch machine and other security device. These are mainly used for train detection, transmission of information, broken train detection and transmission of return current. Especially, the return current is related to signal system, power system and catenary line, and track circuit systems. It is one of the most important component shall be dealt for the safety of track side staff and for the protection of railway-related electrical system according to electrification. Therefore, an accurate analysis of the return current is needed to prevent the return current unbalance and the system induced disorder and failure due to an over current condition. Also, if the malfunction occurred by the return current harmonics, it can cause problems including train operation interruption. In this paper, we presented measurement and analysis method at return current and it's harmonics by train operation. By the test criteria, we evaluated for safety. Hereafter, it is expected to contribute to the field associated with it.

A Covariance-matching-based Model for Musical Symbol Recognition

  • Do, Luu-Ngoc;Yang, Hyung-Jeong;Kim, Soo-Hyung;Lee, Guee-Sang;Dinh, Cong Minh
    • Smart Media Journal
    • /
    • v.7 no.2
    • /
    • pp.23-33
    • /
    • 2018
  • A musical sheet is read by optical music recognition (OMR) systems that automatically recognize and reconstruct the read data to convert them into a machine-readable format such as XML so that the music can be played. This process, however, is very challenging due to the large variety of musical styles, symbol notation, and other distortions. In this paper, we present a model for the recognition of musical symbols through the use of a mobile application, whereby a camera is used to capture the input image; therefore, additional difficulties arise due to variations of the illumination and distortions. For our proposed model, we first generate a line adjacency graph (LAG) to remove the staff lines and to perform primitive detection. After symbol segmentation using the primitive information, we use a covariance-matching method to estimate the similarity between every symbol and pre-defined templates. This method generates the three hypotheses with the highest scores for likelihood measurement. We also add a global consistency (time measurements) to verify the three hypotheses in accordance with the structure of the musical sheets; one of the three hypotheses is chosen through a final decision. The results of the experiment show that our proposed method leads to promising results.

Development of an Imaging Based Gang Protection System

  • Grimm, M.;Pelz, M.
    • International Journal of Railway
    • /
    • v.1 no.4
    • /
    • pp.149-156
    • /
    • 2008
  • During maintenance or construction works in or at the tracks of railways, high risks for passengers and railway staff, especially for the workers on the construction site exist. The high risks result out of the movement of rail vehicles, like trains or construction vehicles, which must be faced by using any available technical and operational technologies for securing them against the environment. Therefore, it is necessary to evaluate the level of protection continuously and to identify new and innovative methods and technologies for the protection of the gang (construction worker, machines and material). Especially on construction sites at line sections with two or more parallel tracks but also with single tracks, there are still a lot of incidents and accidents mostly with seriously injured persons or fatalities. These were mainly gang members that breach the railway-loading gage. By using proper warning or protection systems, the avoidance of such accidents must be achieved. The latest developments. in gang protection systems concern on the one hand fixed barriers in the middle between the construction site and the operated track and on the other hand construction vehicles equipped with automatic warning systems. The disadvantage of such protection methods is that the gang can be warned against an approaching train but a monitoring of the gang members cannot be performed. Only one part of a potential dangerous situation will be detected. If the gang members will overhear the acoustic warning signal of the security staff and the workers will not leave the danger zone in the track, the driver of the approaching train had no chance to react to the dangerous situation. An accident is often inevitable. While the detection of acoustic warning signals by the gang members working on a construction site is very difficult, the acoustical planning of an automatic warning system has to be designed for an acoustic short range level of one meter besides the construction vehicle. The decision about the use of today's technical warning system (fixed systems, automatic warning systems, etc.) must be geared to the technical feasibility and the level of safety which is needed. Criteria for decision guidance to block a track should be developed by danger estimation and economical variables. To realize the actual jurisdiction and to minimize the hazards of railway operations by the use of construction vehicles near the tracks further developments are needed. This means, that the warning systems have to be enhanced to systems for protection, which monitor the realization of the warning signal as a precondition for giving a movement authority to a train. This method can protect against accidents caused by predictable wrongdoing. The actual state of the art technique of using a collective warning combined with additional security staff is no longer acceptable. Therefore, the Institute of Transportation System of the German Aerospace Center in Braunschweig (Germany) will develop a gang warning and protection system based upon imaging methods, with optical sensors such as video in visible and invisible ranges, radar, laser, and other. The advantage of such a system based on the possibility to monitor both the gang itself and the railway-loading gauge either of the parallel track or of the same track still in use. By monitoring both situations, the system will be able to generate a warning message for the approaching train, that there are obstacles in the track, so that the train can be stopped to prevent an accident. And also the gang workers will be warned, while they breach their area.

  • PDF

Evaluation of a Serodiagnostic Method for Tuberculosis by Using Secreted Protein Antigens of Mycobacterium Tuberculosis (결핵균 분비항원을 이용한 결핵의 혈청학적 진단 방법에 대한 평가)

  • Bai, Gill-Han;Park, Eun-Mi;Kim, Sang-Jae
    • Tuberculosis and Respiratory Diseases
    • /
    • v.48 no.3
    • /
    • pp.315-323
    • /
    • 2000
  • Background : An immunochromatographic assay (ICT Diagnostics) which facilitates the diagnosis of tuberculosis(TB) by detecting serum antibodies mainly directed against specific 38KDa of Mycobacterium tuberculosis has come into the market. The test consists of a cardboard folding device containing nitrocellulose strip and absorbent pads. The whole procedure is completed within 15 min and does not require any additional equipment. The test has been reported to be sensitive and specific in diagnosing active TB. Thus the test had been evaluated with sera from TB patients and TB-free subjects. Method : Sera from patients with active pulmonary tuberculosis(40 sputum positives for Mycobacterium tuberculosis, 79 sputum negatives, and 3 extrapulmonary tuberculosis) were obtained from the Double-Cross Chest Clinic of the Korean National Tuberculosis Association (KNTA) in Seoul. The control group consisted of TB-free 68 subjects(21 children under 7 years old and 47 healthy staff members of KNTA). Results : Nine out of 68(13.2%) TB-free controls had positive antibody response. Total 106 of 122(86.9%) radiologically active patients had positive antibodies while 16 (13.1%) showed negative reaction. Antibody was detected in 38 of 40(95.0%) sputum positive patients and 68 of 82(82.9%) sputum negative patients who were under the antituberculosis chemotherapy. The sensitivity and specificity were all 87% and the positive predictive value was 92.2% while the negative predictive value was 78.7%, when the prevalence of TB in the sample was 64.2%. Our results clearly show that the detection of antibodies which mainly react with the 38KDa antigen of M. tuberculosis is not suitable as the first-line method of diagnosis but considered only as an adjunctive test to standard techniques of tuberculosis diagnosis. when considering its high false positivity.

  • PDF