• Title/Summary/Keyword: Crawling system

Search Result 110, Processing Time 0.024 seconds

Development of Python-based Annotation Tool Program for Constructing Object Recognition Deep-Learning Model (물체인식 딥러닝 모델 구성을 위한 파이썬 기반의 Annotation 툴 개발)

  • Lim, Song-Won;Park, Goo-man
    • Journal of Broadcast Engineering
    • /
    • v.25 no.3
    • /
    • pp.386-398
    • /
    • 2020
  • We developed an integrative annotation program that can perform data labeling process for deep learning models in object recognition. The program utilizes the basic GUI library of Python and configures crawler functions that allow data collection in real time. Retinanet was used to implement an automatic annotation function. In addition, different data labeling formats for Pascal-VOC, YOLO and Retinanet were generated. Through the experiment of the proposed method, a domestic vehicle image dataset was built, and it is applied to Retinanet and YOLO as the training and test set. The proposed system classified the vehicle model with the accuracy of about 94%.

The Study on Clinical relations of Mamok and Abnormal sensations (마목(麻木)과 이상감각(異常感覺)과의 연관성에 관한 연구(1))

  • Ko, Seong-Kyu
    • The Journal of Korean Medicine
    • /
    • v.18 no.1
    • /
    • pp.251-266
    • /
    • 1997
  • The results are as follows. 1. Oriental medical terms which express abnormal sensations are Bulin, Mamok, Mamokbulin. 2. Bulin, Oriental medical terminology, was used from Naegyeong's era to the Song Dynasty era and expressed as one of the symptoms in Jungpung(Stroke), Bi syndrome(Obstruction syndrom of Gi and Hyeol), Wi syndrome(Flaccid paralysis of the limbs), Hyeolbi(One of the Bi syndroms). But since the Keum Dynasty era, Mamok or Mamokbulin were more used than Bulin and that was refered as seperated disease. 3. Ma is paresthesia or dysthesia on the skin and the limbs, and the symtoms are not itchy, patients are felt like insect's crawling or bite. Mok is a stubborn symptom , the patients are felt like tree, which don't know pain and itching sensation. And therefore Ma is similar to positive phenomena and Mok is similar to negative phenomena in clinical aspect. 4. Mamok is GiHyeol(Gi is functional activities, Hyeol is blood) and Gyeonglak(Meridian system)'s disease. It's main causes are Giheo(Deficiency of Gi) and Hyeolhel(dificiency of Blood) and inducing tactors are Pung-Han-Seub(pathogenic wind-cold-dump) and Damtak(Phlegm-turbity), Eohyeol(Stagnated blood). 5. Mamok is induced from mononeuritis, multiple mononeuritis, polyneuropathy in the peripheral nervous lesions and also induced from cervical spondylosis, spinal tumour, multiple sclerosis, cerebrospinal vascular disease in central nervous systems.

  • PDF

Research on the Drinking Culture of the Choseon dynasty's Ruling Class using Semantic Network Analysis

  • Mi-Hye, Kim;Yeon-Hee, Kim
    • CELLMED
    • /
    • v.13 no.2
    • /
    • pp.3.1-3.21
    • /
    • 2023
  • In this study, the drinking culture of the Choseon dynasty is examined with the text frequency analysis technique on the entire 『Choseonwangjosilok (朝鮮王朝實錄)』. This study examined a total of 1,968 volumes and 948 books about 27 kings of Choseon , which spans a total of 518 years, through web crawling on the National Institute of Korean History website. Python 3.8 was used to extract sentences related to alcohol, Rhino 1.4.5 was used for morphological analysis to extract nouns, and Gephi 0.9.2 was used for semantic network analysis. According to 『Choseonwangjosilok (朝鮮王朝實錄)』 about alcohol culture, the results of the analysis are as follow: Alcoholic beverages were more often used in court or in ritual ceremonies rather than those based on specific ingredients or manufacturing methods commonly used by the general public. regarding the ruling class through semantic network analysis l in the 『Choseonwangjosilok (朝鮮王朝實錄)』, the Choseon dynasty was found to be highly associated with political issues related to maintaining the power relations within the Korean royal court system. At times, alcohol was used to maintain personal relationships, while at other times it was seen as an essential item in state ceremonies. It was also used as a highly political means to maintain and strengthen national power.

Analysis of Media Trends and Social Perceptions on Nursing Law Legislation (간호법 제정에 대한 언론 동향 및 사회적 인식 분석)

  • Lee, Seung-Hee;Joo, Min-Ho
    • Journal of Korean Academy of Nursing
    • /
    • v.53 no.4
    • /
    • pp.439-452
    • /
    • 2023
  • Purpose: This study aimed to derive considerations for the enactment of nursing law by analyzing the trends and social perceptions of nursing law mentioned in major daily newspapers, cafes, and blogs. Methods: Main texts and comments that included nursing law as a keyword were collected from major daily news and online postings from January 2021 to August 2022. The data collected through web crawling were analyzed using a TousFlux program used for big data analysis. Results: During the period of study, the awareness level around nursing law enactment increased. In particular, public concern over nursing law enactment intensified due to the two political parties' policy pledges related to nursing law in January 2022 and the failure to introduce the nursing law to the national assembly judiciary committee in May 2022. Except in December 2021, public perception of nursing law enactment was generally favorable, with public opinion tilting more in favor of than against enactment. Conclusion: Public opinion should be considered when drafting and implementing the nursing law to make it easier for the people to understand what the law constitutes. In addition, it is necessary to pay attention to and continuously promote the relationship between medical care and nursing in the nursing law system of developed nations. Lastly, nursing law enactment can enhance nurses' retention intention and provide a sense of efficacy to medical services.

Machine Learning for Flood Prediction in Indonesia: Providing Online Access for Disaster Management Control

  • Reta L. Puspasari;Daeung Yoon;Hyun Kim;Kyoung-Woong Kim
    • Economic and Environmental Geology
    • /
    • v.56 no.1
    • /
    • pp.65-73
    • /
    • 2023
  • As one of the most vulnerable countries to floods, there should be an increased necessity for accurate and reliable flood forecasting in Indonesia. Therefore, a new prediction model using a machine learning algorithm is proposed to provide daily flood prediction in Indonesia. Data crawling was conducted to obtain daily rainfall, streamflow, land cover, and flood data from 2008 to 2021. The model was built using a Random Forest (RF) algorithm for classification to predict future floods by inputting three days of rainfall rate, forest ratio, and stream flow. The accuracy, specificity, precision, recall, and F1-score on the test dataset using the RF algorithm are approximately 94.93%, 68.24%, 94.34%, 99.97%, and 97.08%, respectively. Moreover, the AUC (Area Under the Curve) of the ROC (Receiver Operating Characteristics) curve results in 71%. The objective of this research is providing a model that predicts flood events accurately in Indonesian regions 3 months prior the day of flood. As a trial, we used the month of June 2022 and the model predicted the flood events accurately. The result of prediction is then published to the website as a warning system as a form of flood mitigation.

Development of Restaurant Recommendation System Using K-Pop Hashtag Crawling (K-POP 연관 해시태그 크롤링을 이용한 맛집 추천 시스템 개발)

  • Kim, Hwa-Seon;Lee, Chae-Yeon;Cho, Seo-Yun;Nah, Jeong-Eun
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2022.11a
    • /
    • pp.878-880
    • /
    • 2022
  • COVID-19 상황 속에서도 전 세계 Twitter K-POP 콘텐츠 관련 트윗 양은 78억 건 이상으로 매년 성장세를 보인다. Twitter 내 K-POP 팬들은 아티스트 관련 해시태그를 포함한 트윗을 작성하여 같은 팬덤끼리 실시간으로 정보를 전달하고 생산한다. 이러한 맛집 트윗들은 K-POP 팬들이 Twitter 내에서 신뢰도 있는 맛집 정보를 얻는 용도로 사용된다. 하지만 팬들이 정보를 얻기 위해서는 여러 맛집 해시태그로 검색하고 리트윗 수가 많은 트윗을 직접 찾아야 한다. 기존의 맛집 추천 시스템은 서비스 제공자 중심의 구조를 띤다. 서비스 제공자가 일방적으로 정보를 전달하거나, 사용자 리뷰 갱신 간격이 길다는 한계가 존재한다. 본 논문에서는 Twitter 내 K-POP 맛집 해시태그가 포함된 트윗을 Twitter API와 Tweepy를 사용하여 크롤링하였다. 수집한 데이터의 좋아요 수와 리트윗 수를 바탕으로 데이터 필터링을 진행하여 bot user와 광고 계정이 제외된 맛집 관련 트윗을 추출한다. 최종적으로는 추출한 트윗의 정보를 마커로 표시하여 웹 사이트를 제작하였다. K-POP 팬들은 맛집 해시태그를 검색하여 일일이 찾을 필요 없이 웹 사이트에 방문하여 맛집 위치를 확인할 수 있다. 웹 사이트 사용자의 위치가 지도상에 표시되어 가까운 맛집을 찾기도 편리하다. 본 논문에서는 맛집의 위치를 서대문구로 한정하여 진행했다.

Development of a Collection System of Bait Links to Social Media on Dark Web to Track Drug Crimes (마약 범죄 추적을 위한 다크웹 상의 소셜미디어 유인 링크 수집체계 개발)

  • Sol-Kyu Park;Jiyeon Kim;Chang-Hoon Kim
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2024.01a
    • /
    • pp.123-125
    • /
    • 2024
  • 다크웹(Dark Web)은 마약, 불법 촬영물, 해킹, 무기 등 불법 콘텐츠의 공유 및 거래가 이루어지는 인터넷 영역으로서 최근에는 소셜미디어와 연계된 형태로 범죄 양상이 변화하고 있다. 본 논문에서는 최근 국내 외 사회 문제로 대두되고 있는 마약 범죄를 추적하기 위한 다크웹 수사 기술로서 다크웹 사용자를 소셜미디어로 유인하는 마약 정보 수집체계를 개발한다. 먼저 미국 마약단속국에서 공개한 대표적인 마약 용어 3개의 표준어 및 은어를 검색 키워드로 사용하여 마약 관련 다크웹을 수집하고, 수집된 다크웹을 크롤링하여 소셜미디어 계정 링크를 추출한다. 본 논문에서는 다양한 소셜미디어 중, 트위터 및 텔레그램 접속 링크를 수집하였으며 실험 결과, 접속 가능한 총 54개 다크웹 도메인의 9,046개 웹 페이지에서 트위터 유인 링크 567개, 텔레그램 유인 링크 118개를 추출하였다.

  • PDF

A Design of Estimate-information Filtering System using Artificial Intelligent Technology (인공지능 기술을 활용한 부동산 허위매물 필터링 시스템)

  • Moon, Jeong-Kyung
    • Convergence Security Journal
    • /
    • v.21 no.1
    • /
    • pp.115-120
    • /
    • 2021
  • An O2O-based real estate brokerage web sites or apps are increasing explosively. As a result, the environment has been changed from the existing offline-based real estate brokerage environment to the online-based environment, and consumers are getting very good feelings in terms of time, cost, and convenience. However, behind the convenience of online-based real estate brokerage services, users often suffer time and money damage due to false information or malicious false information. Therefore, in this study, in order to reduce the damage to consumers that may occur in the O2O-based real estate brokerage service, we designed a false property information filtering system that can determine the authenticity of registered property information using artificial intelligence technology. Through the proposed research method, it was shown that not only the authenticity of the property information registered in the online real estate service can be determined, but also the temporal and financial damage of consumers can be reduced.

Analysis for Daily Food Delivery & Consumption Trends in the Post-Covid-19 Era through Big Data

  • Jeong, Chan-u;Moon, Yoo-Jin;Hwang, Young-Ho
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.1
    • /
    • pp.231-238
    • /
    • 2021
  • In this paper, we suggest a method of analysis for daily food delivery & consumption trends through big data of the post-Covid-19 era. Through analysis of big data and the database system, four analyzed factors, excluding weather, was proved to have significant correlation with delivery sales for 'Baedarui Minjok' of a catering delivery application. The research found that KBS, MBC and SBS Media showed remarkable results in food delivery & consumption sales soaring up to about 60 percent increase on the day after the Covid-19 related new article was issued. In addition, it proved that mobile media and web surfing were the main factors in increasing sales of food delivery & consumption applications, suggesting that viral marketing and emotional analysis by crawling data from SNS used by Millennials might be an important factor in sales growth. It can contribute the companies in the economic recession era to survive by providing the method for analyzing the big data and increasing their sales.

Design and analysis of monitoring system for illegal overseas direct purchase based on C2C (C2C에 기반으로 해외직구 불법거래에 관한 모니터링 시스템 설계 및 분석)

  • Shin, Yong-Hun;Kim, Jeong-Ho
    • Journal of Digital Convergence
    • /
    • v.20 no.5
    • /
    • pp.609-615
    • /
    • 2022
  • In this paper, we propose a monitoring system for illegal overseas direct purchase based on C2C transaction between individuals. The Customs Act stipulates that direct purchases from overseas are exempted from taxation only if they are less than a certain amount (US$150, but US$200 in the US) or are recognized as self-used goods. The act of reselling overseas direct purchase items purchased with exemption from taxation online, etc., is a crime of smuggling without a report. Nevertheless, the number of re-sells on online second-hand websites is increasing, and it is becoming a controversial social issue of continuous violation of the Customs Act. Therefore, this study collects unspecified transaction details related to overseas direct purchase, refines the data in a big data method, and designs it as a monitoring system through natural language processing, etc. analyzed. It will be possible to use it to crack down on illegal transactions of overseas direct purchase goods.