• Title/Summary/Keyword: fast searching

Search Result 319, Processing Time 0.022 seconds

An Implementation and Performance Evaluation of Fast Web Crawler with Python

  • Kim, Cheong Ghil
    • Journal of the Semiconductor & Display Technology
    • /
    • v.18 no.3
    • /
    • pp.140-143
    • /
    • 2019
  • The Internet has been expanded constantly and greatly such that we are having vast number of web pages with dynamic changes. Especially, the fast development of wireless communication technology and the wide spread of various smart devices enable information being created at speed and changed anywhere, anytime. In this situation, web crawling, also known as web scraping, which is an organized, automated computer system for systematically navigating web pages residing on the web and for automatically searching and indexing information, has been inevitably used broadly in many fields today. This paper aims to implement a prototype web crawler with Python and to improve the execution speed using threads on multicore CPU. The results of the implementation confirmed the operation with crawling reference web sites and the performance improvement by evaluating the execution speed on the different thread configurations on multicore CPU.

A Fast Redundancy Analysis Algorithm in ATE for Repairing Faulty Memories

  • Cho, Hyung-Jun;Kang, Woo-Heon;Kang, Sung-Ho
    • ETRI Journal
    • /
    • v.34 no.3
    • /
    • pp.478-481
    • /
    • 2012
  • Testing memory and repairing faults have become increasingly important for improving yield. Redundancy analysis (RA) algorithms have been developed to repair memory faults. However, many RA algorithms have low analysis speeds and occupy memory space within automatic test equipment. A fast RA algorithm using simple calculations is proposed in this letter to minimize both the test and repair time. This analysis uses the grouped addresses in the faulty bitmap. Since the fault groups are independent of each other, the time needed to find solutions can be greatly reduced using these fault groups. Also, the proposed algorithm does not need to store searching trees, thereby minimizing the required memory space. Our experiments show that the proposed RA algorithm is very efficient in terms of speed and memory requirements.

A Study of products Searching Expert System Using Kansei Engineering (감성공학을 이용한 제품검색 시스템의 설계)

  • Ahn, Beum-Jun
    • Proceedings of the Korean Society for Emotion and Sensibility Conference
    • /
    • 1999.11a
    • /
    • pp.43-46
    • /
    • 1999
  • Today multi-item and small lot production has been applied to the general production system for consumers' needs. Therefore the production for consumers' needs have been product every moment, and buying have been made through various forms. But it is not easy for consumers to find the products which they want among many products. Furthermore although in the internet shopping mall many products can be presented to consumers, there are no ways to search fast the products which they want. This study has observed the fact that generally consumers' purchasing start with the image of products for their needs. So we suggest the way to show fast the most near products which consumers want in the internet by accepting Kansei words as product image.

  • PDF

The Design for the fast process in the complex and various information. (복잡하고 다양한 정보 속에서 빠른 정보 처리 디자인 -색의 범주화를 통한 빠른 정보처리)

  • Min, Kyoung-Geun
    • 한국HCI학회:학술대회논문집
    • /
    • 2009.02a
    • /
    • pp.1150-1155
    • /
    • 2009
  • In the information society, the amount of information have been increased by technological development. It is not easy to deal with information for fast data processing because of increasing of the complexity and diversity of data. So this paper will confirm the fact that the color plays the role of the classification of complex information and can make data processing fast. Experiment 1 shows that the searching time of target(line name) is more faster when the color of a subway line is equal to the color of station`s name. Experiment 2 using the task for classification of word mixed in various categories shows that color category processing is more faster rather than semantic category processing and the effect of this task is far better when color difference is more clear.

  • PDF

Fast Motion Estimation Algorithm for H.264 Video Coding Standard (H.264 동영상 표준 부호화 방식을 위한 고속 움직임 추정 기법)

  • Yoon Sung-Hyun;Choi Kwon-Yul;Lee Seongsoo;Hong Min-Cheol
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.30 no.11C
    • /
    • pp.1091-1097
    • /
    • 2005
  • In this paper, we propose fast motion estimation algorithm. Local statistics of a motion vector is highly correlated to motion vectors of its neighboring blocks. According to the property, block-based motion search range is adaptively determined in order to reduce unnecessary search points. Based on the determined search range, motion vector is obtained by variable step search motion estimation. Experimental results show that comparing to Full search motion estimation, the motion searching points of proposed algorithm is reduced as much as $98\%$. Moreover, PSNR and Bit Rate are almost same to Full search method.

Fast VQ Encoding Algorithm (백터 양자화의 고속 부호화 알고리즘)

  • 채종길;황금찬
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.19 no.4
    • /
    • pp.685-690
    • /
    • 1994
  • A problem associated with vector quantization(VQ) is the computational complexity incurred in searching for a codevector with the closet to a given input vector, where the complexity increases exponentionally with proportion to codebook size and then limits practical application. In this paper, a simple and fast, but efficient, VQ encoding algorithm is presented using a reference codevector as start codevector of premature exit condition, which eliminates distance claculation of unlikely codevectors. The algorithm is to find reference codevector having the possibility to be the nearest vector to input vector first and then to incorporate premature exit condition. The proposed algorithm needs only 10~15% of mathematical operations compared with the conventional full search VQ. Algorithm the number of additions and comparsions of the proposed algorithm is not reduced greatly, the number of multiplication is reduced up to 70~80% compared with other fast VQ encoding methods.

  • PDF

Construction of Retrieval-Based Medical Database

  • Shin Yong-Won;Koo Bong-Oh;Park Byung-Rae
    • Biomedical Science Letters
    • /
    • v.10 no.4
    • /
    • pp.485-493
    • /
    • 2004
  • In the current field of Medical Informatics, the information increases, and changes fast, so we can access the various data types which are ranged from text to image type. A small number of technician digitizes these data to establish database, but it is needed a lot of money and time. Therefore digitization by many end-users confronting data and establishment of searching database is needed to manage increasing information effectively. New data and information are taken fast to provide the quality of care, diagnosis which is the basic work in the medicine. And also It is needed the medical database for purpose of private study and novice education, which is tool to make various data become knowledge. However, current medical database is used and developed only for the purpose of hospital work management. In this study, using text input, file import and object images are digitized to establish database by people who are worked at the medicine field but can not expertise to program. Data are hierarchically constructed and then knowledge is established using a tree type database establishment method. Consequently, we can get data fast and exactly through search, apply it to study as subject-oriented classification, apply it to diagnosis as time-depended reflection of data, and apply it to education and precaution through function of publishing questions and reusability of data.

  • PDF

A Method for Expanding the Adaptive Hexagonal Search Pattern Using the Second Local Matching Point (차순위 국부 정합점을 이용한 적응형 육각 탐색의 패턴 확장 방법)

  • Kim Myoung-Ho;Lee Hyoung-Jin;Kwak No-Yoon
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2005.05a
    • /
    • pp.362-368
    • /
    • 2005
  • This paper is related to the fast block matching algorithm, especially a method for expanding the search pattern using the second local matching point in the adaptive hexagonal search. To reduce the local minima problem in fast motion estimation, the proposed method expands the search pattern by adding new searching points selected by using the second local matching point to conventional search pattern formed by the first local matching point in the adaptive hexagonal search. According to estimating the motion vector by applying block matching algorithm based on hexagonal search to the expanded search pattern, the proposed method can effectively carry out fast motion estimation to improve the performance in terms of compensated image quality.

  • PDF

A Fast Fractal Image Decoding Using the Encoding Algorithm by the Limitation of Domain Searching Regions (정의역 탐색영역 제한 부호화 알고리듬을 이용한 고속 프랙탈 영상복원)

  • 정태일;강경원;권기룡;문광석;김문수
    • Proceedings of the Korea Institute of Convergence Signal Processing
    • /
    • 2000.12a
    • /
    • pp.125-128
    • /
    • 2000
  • The conventional fractal decoding was required a vast amount computational complexity. Since every range blocks was implemented to IFS(iterated function system). In order to improve this, it has been suggested to that each range block was classified to iterated and non-iterated regions. If IFS region is contractive, then it can be performed a fast decoding. In this paper, a searched region of the domain in the encoding is limited to the range region that is similar with the domain block, and IFS region is a minimum. So, it can be performed a fast decoding by reducing the computational complexity for IFS in fractal image decoding.

  • PDF

IMT: A Memory-Efficient and Fast Updatable IP Lookup Architecture Using an Indexed Multibit Trie

  • Kim, Junghwan;Ko, Myeong-Cheol;Shin, Moon Sun;Kim, Jinsoo
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.4
    • /
    • pp.1922-1940
    • /
    • 2019
  • IP address lookup is a function to determine nexthop for a given destination IP address. It takes an important role in modern routers because of its computation time and increasing Internet traffic. TCAM-based IP lookup approaches can exploit the capability of parallel searching but have a limitation of its size due to latency, power consumption, updatability, and cost. On the other hand, multibit trie-based approaches use SRAM which has relatively low power consumption and cost. They reduce the number of memory accesses required for each lookup, but it still needs several accesses. Moreover, the memory efficiency and updatability are proportional to the number of memory accesses. In this paper, we propose a novel architecture using an Indexed Multibit Trie (IMT) which is based on combined TCAM and SRAM. In the proposed architecture, each lookup takes at most two memory accesses. We present how the IMT is constructed so as to be memory-efficient and fast updatable. Experiment results with real-world forwarding tables show that our scheme achieves good memory efficiency as well as fast updatability.