• Title/Summary/Keyword: Audio Analysis

Search Result 537, Processing Time 0.028 seconds

DECODE: A Novel Method of DEep CNN-based Object DEtection using Chirps Emission and Echo Signals in Indoor Environment (실내 환경에서 Chirp Emission과 Echo Signal을 이용한 심층신경망 기반 객체 감지 기법)

  • Nam, Hyunsoo;Jeong, Jongpil
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.21 no.3
    • /
    • pp.59-66
    • /
    • 2021
  • Humans mainly recognize surrounding objects using visual and auditory information among the five senses (sight, hearing, smell, touch, taste). Major research related to the latest object recognition mainly focuses on analysis using image sensor information. In this paper, after emitting various chirp audio signals into the observation space, collecting echoes through a 2-channel receiving sensor, converting them into spectral images, an object recognition experiment in 3D space was conducted using an image learning algorithm based on deep learning. Through this experiment, the experiment was conducted in a situation where there is noise and echo generated in a general indoor environment, not in the ideal condition of an anechoic room, and the object recognition through echo was able to estimate the position of the object with 83% accuracy. In addition, it was possible to obtain visual information through sound through learning of 3D sound by mapping the inference result to the observation space and the 3D sound spatial signal and outputting it as sound. This means that the use of various echo information along with image information is required for object recognition research, and it is thought that this technology can be used for augmented reality through 3D sound.

Information Technologies as an Incentive to Develop the Creative Potential of the Educational Process

  • Natalia, Vdovychenko;Volodymyr, Kukorenchuk;Alina, Ponomarenko;Mykola, Honcharenko;Eduard, Stranadko
    • International Journal of Computer Science & Network Security
    • /
    • v.22 no.4
    • /
    • pp.408-416
    • /
    • 2022
  • The new millennium is characterized by an unprecedented breakthrough in knowledge and information and communication technologies, and the challenges of the XXI century require modernized paradigms of interaction in all spheres of life. Education continues to play a key role in national and global growth. The key role of education and its leadership in developing creative potential, as the main paradigm of the countries' stability, have significantly influenced educational centers. The developers of educational programs use information technologies as an incentive to develop creative potential of educational process. Professional training of the educational candidate is enhanced by the use of information technologies, so the educational applicants should develop technological skills to be productive members of society. Using the latest achievements in the field of information technologies for the organization of the educational process helps to form the operational style of education applicants' thinking, which provides the ability to acquire skills of processing information, that is presented in the text, graphic, tabular form, and increase the level of general and informational culture necessary for better orientation in the modern information space. The purpose of the research is to determine the effectiveness of information technologies as an incentive to develop creative potential of educational process on the basis of the survey, to establish advantages and ability to provide high-quality education in the context of using information technologies. Methods of research: comparative analysis; systematization; generalization, survey. Results. Based on the survey conducted among students and teachers, it has been found out that the teachers use the following information technologies for the development of creative potential of the educational process: to provide video and audio communication process (100%), Moodle (95,6%), Duolingo (89,7%), LinguaLeo (89%), Google Forms (88%) and Adobe Captivate Prime (80,6%). It is determined that modular digital learning environments (97,9%), interactive exercises tools (96,3%), ICT for video and audio communication (96%) and interactive exercises tools (95,1%) are most conducive to the development of creative potential of the educational process. As a result of the research, it was revealed that implementation of information technologies for the development of creative potential of educational process in educational institutions is a complex process due to a large number of variables, which should be taken into account both on the educational course and on the individual level. It has been determined that the using the model of implementation information technologies for the development of creative potential in educational process, which is stimulated due to this model, benefits both students and teachers by establishing a reliable bilateral connection between teacher and education applicant.

A Study on Audio-Visual Expression of Biometric Data Based on the Polysomnography Test (수면다원검사에 기반한 생체데이터 시청각화 연구)

  • Kim, Hee Soo;Oh, Na Yea;Park, Jin Wan
    • Korea Science and Art Forum
    • /
    • v.35
    • /
    • pp.145-155
    • /
    • 2018
  • The goal of the study is to provide a new type of audio-visualization method through case analysis and work production based on Polysomnography(PSG) data that is difficult to interpret or not familiar to the public. Most art works are produced with conscious actions during waking hours. On the other hand, during sleep, we get into the world of unconsciousness. Therefore, through the experiment, want to discover if could get something new when we were in the subconscious state, and if so, wondered what kind of art could be made through it. The study method is to consider definition of sleep and sleep data first. The sleep data were classified into normal group and Narcolepsy, Insomnia, and sleep apnea by focusing on sleep disorder graphs that is measured by sleep polygraph. After that, I refined and converted the acquired biometric data into a text-based script. The degree of sleep in the text form of the script was rendered as a 3D animated image using Maya. In addition, the heart rate data script was transformed into a midi format, and the audition was implemented in the garage band. After Effects combines the image and sound to create four single channel images of 3 minutes and 20 seconds each. As a result of the research, I made an opportunity for anyone easy to understand the results, having difference with the normal data, through art instead of using difficult medical term. It also showed the possibility of artistic expression even when conscious actions did not occur. Through the results of this research, I expect the expansion and diversity of artistic audiovisual expression of biometric data.

A New Tempo Feature Extraction Based on Modulation Spectrum Analysis for Music Information Retrieval Tasks

  • Kim, Hyoung-Gook
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.6 no.2
    • /
    • pp.95-106
    • /
    • 2007
  • This paper proposes an effective tempo feature extraction method for music information retrieval. The tempo information is modeled by the narrow-band temporal modulation components, which are decomposed into a modulation spectrum via joint frequency analysis. In implementation, the tempo feature is directly extracted from the modified discrete cosine transform coefficients, which is the output of partial MP3(MPEG 1 Layer 3) decoder. Then, different features are extracted from the amplitudes of modulation spectrum and applied to different music information retrieval tasks. The logarithmic scale modulation frequency coefficients are employed in automatic music emotion classification and music genre classification. The classification precision in both systems is improved significantly. The bit vectors derived from adaptive modulation spectrum is used in audio fingerprinting task That is proved to be able to achieve high robustness in this application. The experimental results in these tasks validate the effectiveness of the proposed tempo feature.

  • PDF

Analysis of the Content of Telephone Counseling with Breastfeeding mothers (모유수유 전화 상담 내용의 분석)

  • 김혜숙
    • Journal of Korean Academy of Nursing
    • /
    • v.25 no.1
    • /
    • pp.17-29
    • /
    • 1995
  • This study was done to analysis data on breastfeeding mothers. This stud was conducted using data from telephone counseling in one metropolitan area. The subjects who had received consultation about breastfeeding were 100 breastfeeding mothers. The period of consultation was from Mar. 9, 1994 to August 23, 1994. Consultants were referred from UNICEF, hospitals, TV, newspapers or magazines. Analysis of the problem patterns resulted in 11 classifications. These were physio -anatomical factors(11 cases) , psychological factors(15 cases), breastfeeding methods(21 cases), breastfeeding intervals and frequency(19 cases) , disease in the breastfeeding mothers(13 cases), disease in the babies (12 cases), lack of support (4 cases), food and drugs while breastfeeding(5 cases), weaning(11 cases), others(27 cases). The highest frequency was for breastfeeding methods (21 cases). When the contents of the counselling were analyzed for the 100 cases, 36 problem patterns were identified. Patterns with over 10 responses were diarrhea, insufficient milk supply, sore and cracked nipples, weaning, inverted nipples and jaundice. The age of infants when mothers were telephoned was as below : 1 week(28 cases), 2 weeks(12 cases), 3-4 weeks(18 cases), 5-8 weeks(7 cases), 9 weeks-3 menths(4 cases), 4 menths-6 months(12 cases), over 6 months(2 cases), and the number of pregnant women was 12. The nursing diagnosis were classified according to problem patterns and each diagnosis was assigned an appropriate Problem Pattern The total number of nursing diagnoses was 22. When clients are referred for counselling nurses need guidelines about problems, possible causes and nursing. In this study, the example of guidelines for sore nipples is suggested. The recommendations based on the telephone counseling results are as follows : Prenatal education about the advantages of breastfeeding and breast care, and home visits after delivery for counseling related to breastfeeding. During the hospital stay, nursing intervention such as education on breastfeeding methods using slides, audio-visual tapes, pamphlets are needed as well as an initial trial of breastfeeding. Further research is indicated on the perceived lack of breast milk and on the effectiveness of nursing interventions to pro-mote breastfeeding.

  • PDF

Exploratory Approach of Social Gameplay Behavior Pattern : Case Study of World of Warcrafts (소셜 게임플레이 행동패턴의 탐색적 접근 : World of Warcrafts를 중심으로)

  • Song, Seung-Keun
    • The Journal of the Korea Contents Association
    • /
    • v.13 no.5
    • /
    • pp.37-47
    • /
    • 2013
  • The objective of this research is to discover the rule of gameplay related to the task interdependence to analyse the behavior pattern of social gameplay. Previous literatures related to the gameplay were reviewed and game which was suitable for the gameplay of the task interdependence was selected. A party-play includes a team of five people in the experiment during the gameplay with think-aloud method and video/audio data about action protocol and verbal report were collected. The video observation and protocol analysis were conducted to analyse data. The objective coding scheme were developed from consolidated sequence model task analysis. The player's behavior was analysed. The result was revealed that four rules and four modified rules were included into the total eight behavior pattern. A behavior graph integrated with five gameplay was written. The excellent cooperative spot and error and failure place could be identified. The social gameplay behavior graph is expected to be the key practical design guideline on whether the level design and balance design are proper.

Analysis of the dentistry-related contents uploaded on YouTube Korea (YouTube 내의 치과 관련 한국어 컨텐츠 현황 분석 및 활용 방안)

  • Jo, Jaehyun;Kwon, Hyuckjun;Jung, Seoyeon;Hu, Kyung-Seok;Jung, Il-Young;Seo, Jeong-Taeg
    • The Journal of the Korean dental association
    • /
    • v.57 no.12
    • /
    • pp.728-735
    • /
    • 2019
  • Objective: Previous studies suggested the potential influence of YouTube videos regarding dentistry on the mass population. However, there was not any clear investigation for Korean population. We aimed to systemically analyze the type of the dentistry-related videos uploaded on YouTube Korea and the accounts used for uploading, and to assess their effect on the view count of the content. Methods: Classification, type of the accounts, and view count of the videos listed by the keyword 'dentistry' were analyzed, which were uploaded on YouTube Korea platform from September 2017 to April 2019. Kruskal-Wallis test with post hoc analysis was used to assess the effect of the classification of the videos and the type of accounts on the view count. Results: 1.026 videos were enrolled to the analysis. Primary classification of the videos was information/education, advertisement, life, news, child contents, autonomous sensory meridian response, broadcast, cartoon/game, humor, and music. Secondary classification of the videos was dental experience, advertisement, role-playing, information/education., humor, cartoon/game, child contents, life, and broadcast. Type of the accounts was dentistry associates, general public, media company, and government office (sorted by frequency). Subject of the most videos (93.6%) was general public. There was statistically significance in the view count of the videos according to the primary and secondary classifications, the account used for uploading, and target subject of the videos. Conclusion: Dentists and their associates should recognize the importance of YouTube platform and try to monitor and intervene the dentistry-related contents, considering its huge impact on the general public.

  • PDF

An Exploratory Approach to Textile Designer's Cognition Model -focused on the Stage of Motif Development- (텍스타일 디자이너의 인지 모형에 대한 탐색적 접근 -모티브 개발 단계를 중심으로-)

  • 송승근;이주현
    • Science of Emotion and Sensibility
    • /
    • v.6 no.1
    • /
    • pp.55-62
    • /
    • 2003
  • This study was an exploratory approach to the cognitive model of textile designers on the stage of motif development in textile design process. Prior to the main research, several previous studies adopting methods of video/audio protocol analysis were reviewed. On the basis of the review, the categories of design action were derived as an analysis frame by application of top-down access method, meanwhile the sub-groups of each category of design action were identified through a bottom-up access method. To summarize the research result, total three categories of textile design action appeared based on the theory of ‘Human processor’ model : ‘motor action’, ‘perceptual action’ and 'cognitive action'. In next, a new coding scheme suitably explaining these three categories of fertile design action was developed. Finally, a cognitive model of textile designer on the stage of motif development, employing the new coding scheme, was suggested in this study.

  • PDF

New Input Keyword Extraction of Equipments Involved in Ignition Using Morphological Analysis (형태소 분석을 이용한 발화관련 기기의 새로운 입력 키워드 추출)

  • Kim, Eun Ju;Choi, Jeung Woo;Ryu, Joung Woo
    • Fire Science and Engineering
    • /
    • v.28 no.2
    • /
    • pp.91-97
    • /
    • 2014
  • New types of fire accidents appear or the existing types disappeared because of rapidly changing society. We proposed a methodology of extracting new nouns from fire investigation data each of which is an accident report producted by fire investigators. The new nouns could be used in modifying the existing categories for classifying fire accidents. We analysed morphology of the product names and the ignition summaries using the proposed method for the fire accidents classified as the etc sub-category of the category of equipments involved in ignition. In this paper, we found "dryer" as a new sub-category of the agricultural equipment category and "boiler" in the seasonal appliance category from the product names of the fire accidents. We also extracted the new input keywords of "aquarium" and "monitor" in the commercial facilities category and the video, audio apparatus category from the ignition summaries respectively. Using the four subcategories, we reclassified 548 (14.39%) of 3,808 fire accidents assigned to the etc sub-category.

Development of Experience System for Sasang Constitution Analysis (사상체질 분석 체험 시스템 개발)

  • So, Ji-Ho;Jeon, Young-Ju
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.5
    • /
    • pp.9-13
    • /
    • 2020
  • Sasang Constitutional Medicine is a traditional Korean medicine optimized for personalized medicine, and despite its effective clinical efficacy, the inaccuracy of constitutional diagnosis has been pointed out as a limitation. To improve the accuracy, a constitutional analysis algorithm based on quantitative data was developed. In this study, a constitutional analysis experience system applied with the algorithm was developed and repeatability was evaluated. The system analyzes the constitution of the experiencer by collecting front and side facial images, audio, and questionnaire and calculating the integrated constitution probability value. To evaluate the repeatability of the probability values of the system was performed five times each for three people, and the coefficient of variation was 4.778%, indicating that the repeatability was sufficient. The system could contribute to the promotion of the awareness of Sasang medicine.