• Title/Summary/Keyword: StyleGAN3

Search Result 8, Processing Time 0.022 seconds

Generation of wind turbine blade surface defect dataset based on StyleGAN3 and PBGMs

  • W.R. Li;W.H. Zhao;T.T. Wang;Y.F. Du
    • Smart Structures and Systems
    • /
    • v.34 no.2
    • /
    • pp.129-143
    • /
    • 2024
  • In recent years, with the vigorous development of visual algorithms, a large amount of research has been conducted on blade surface defect detection methods represented by deep learning. Detection methods based on deep learning models must rely on a large and rich dataset. However, the geographical location and working environment of wind turbines makes it difficult to effectively capture images of blade surface defects, which inevitably hinders visual detection. In response to the challenge of collecting a dataset for surface defects that are difficult to obtain, a multi-class blade surface defect generation method based on the StyleGAN3 (Style Generative Adversarial Networks 3) deep learning model and PBGMs (Physics-Based Graphics Models) method has been proposed. Firstly, a small number of real blade surface defect datasets are trained using the adversarial neural network of the StyleGAN3 deep learning model to generate a large number of high-resolution blade surface defect images. Secondly, the generated images are processed through Matting and Resize operations to create defect foreground images. The blade background images produced using PBGM technology are randomly fused, resulting in a diverse and high-resolution blade surface defect dataset with multiple types of backgrounds. Finally, experimental validation has proven that the adoption of this method can generate images with defect characteristics and high resolution, achieving a proportion of over 98.5%. Additionally, utilizing the EISeg annotation method significantly reduces the annotation time to just 1/7 of the time required for traditional methods. These generated images and annotated data of blade surface defects provide robust support for the detection of blade surface defects.

Enhanced ACGAN based on Progressive Step Training and Weight Transfer

  • Jinmo Byeon;Inshil Doh;Dana Yang
    • Journal of the Korea Society of Computer and Information
    • /
    • v.29 no.3
    • /
    • pp.11-20
    • /
    • 2024
  • Among the generative models in Artificial Intelligence (AI), especially Generative Adversarial Network (GAN) has been successful in various applications such as image processing, density estimation, and style transfer. While the GAN models including Conditional GAN (CGAN), CycleGAN, BigGAN, have been extended and improved, researchers face challenges in real-world applications in specific domains such as disaster simulation, healthcare, and urban planning due to data scarcity and unstable learning causing Image distortion. This paper proposes a new progressive learning methodology called Progressive Step Training (PST) based on the Auxiliary Classifier GAN (ACGAN) that discriminates class labels, leveraging the progressive learning approach of the Progressive Growing of GAN (PGGAN). The PST model achieves 70.82% faster stabilization, 51.3% lower standard deviation, stable convergence of loss values in the later high resolution stages, and a 94.6% faster loss reduction compared to conventional methods.

An Image-to-Image Translation GAN Model for Dental Prothesis Design (치아 보철물 디자인을 위한 이미지 대 이미지 변환 GAN 모델)

  • Tae-Min Kim;Jae-Gon Kim
    • Journal of Information Technology Services
    • /
    • v.22 no.5
    • /
    • pp.87-98
    • /
    • 2023
  • Traditionally, tooth restoration has been carried out by replicating teeth using plaster-based materials. However, recent technological advances have simplified the production process through the introduction of computer-aided design(CAD) systems. Nevertheless, dental restoration varies among individuals, and the skill level of dental technicians significantly influences the accuracy of the manufacturing process. To address this challenge, this paper proposes an approach to designing personalized tooth restorations using Generative Adversarial Network(GAN), a widely adopted technique in computer vision. The primary objective of this model is to create customized dental prosthesis for each patient by utilizing 3D data of the specific teeth to be treated and their corresponding opposite tooth. To achieve this, the 3D dental data is converted into a depth map format and used as input data for the GAN model. The proposed model leverages the network architecture of Pixel2Style2Pixel, which has demonstrated superior performance compared to existing models for image conversion and dental prosthesis generation. Furthermore, this approach holds promising potential for future advancements in dental and implant production.

Towards a NFT-based Metaverse Fashion Contents Platform using 3D Conversion (3D 변환을 활용한 NFT 기반 메타버스 패션 컨텐츠 플랫폼)

  • Kim, Min-Ho;Han, Su-Han;Park, Min-Gyu;Jung, Dong-Ju;Lee, Byung-Jeong
    • Annual Conference of KIPS
    • /
    • 2022.05a
    • /
    • pp.329-332
    • /
    • 2022
  • 본 연구에서는 하나의 2D 이미지를 StyleGAN을 통해 다각도의 이미지를 생성하고, 그것을 다시 Kaolin으로 구현한 역그래픽 렌더러의 입력으로 받아 3D 오브젝트로 변환한다. 또한, 클레이튼 기반의 블록체인을 통해 NFT 기술을 통하여 3D 오브젝트를 NFT로 만들 수 있도록 한다. 최종적으로 2D 이미지를 메타버스에서 활용할 수 있는 3D 패션 아이템으로 변환하고 NFT를 발행하여 거래한다. 본 연구는 개인이 자유롭게 메타버스 콘텐츠를 제공하고 거래하여 메타버스 활성화에 기여할 것으로 기대한다.

ISFRNet: A Deep Three-stage Identity and Structure Feature Refinement Network for Facial Image Inpainting

  • Yan Wang;Jitae Shin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.3
    • /
    • pp.881-895
    • /
    • 2023
  • Modern image inpainting techniques based on deep learning have achieved remarkable performance, and more and more people are working on repairing more complex and larger missing areas, although this is still challenging, especially for facial image inpainting. For a face image with a huge missing area, there are very few valid pixels available; however, people have an ability to imagine the complete picture in their mind according to their subjective will. It is important to simulate this capability while maintaining the identity features of the face as much as possible. To achieve this goal, we propose a three-stage network model, which we refer to as the identity and structure feature refinement network (ISFRNet). ISFRNet is based on 1) a pre-trained pSp-styleGAN model that generates an extremely realistic face image with rich structural features; 2) a shallow structured network with a small receptive field; and 3) a modified U-net with two encoders and a decoder, which has a large receptive field. We choose structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), L1 Loss and learned perceptual image patch similarity (LPIPS) to evaluate our model. When the missing region is 20%-40%, the above four metric scores of our model are 28.12, 0.942, 0.015 and 0.090, respectively. When the lost area is between 40% and 60%, the metric scores are 23.31, 0.840, 0.053 and 0.177, respectively. Our inpainting network not only guarantees excellent face identity feature recovery but also exhibits state-of-the-art performance compared to other multi-stage refinement models.

The spatial structure and characteristics of the Sijeon around Jongno in Hanseong-bu(漢城府) in the Early 20th Century (20세기 초 한성부 종로 주변 시전 건물의 공간구조와 특징)

  • Jeong, Su-In;Han, Dong-Soo
    • Journal of architectural history
    • /
    • v.31 no.1
    • /
    • pp.7-17
    • /
    • 2022
  • The purpose of this thesis is to understand the shape of The Sijeon (Licensed-Markets) established around the Jongno and Namdaemun-ro Avenues in Hanyang during the Joseon Dynasty in the 19th and 20th centuries and then to examine the relationship with the urban structures of Hanyang City. By investigating the excavation results of the Cheongjin and Gongpyeong areas, drawings, photos, and documentary records related to the city, this study classified the building types in the Jonggak area. As a result, since the 19th century, the basic form of Sijeon with 2 Gan(間, bay) in the front facade and 3 Gan(間) on the side, in other words, 5M in the front and 8M in the side was arranged in parallel, and it was a type with a corridor-type courtyard inside. The inner sides of Jongno Avenue had an atypical flat shape that suited the more free lot, and a courtyard-type plan with a single entrance was also confirmed in the one or two Bang(房, district). This study reflected the operation method of the Sijeon buildings b between the one unit and the other units, which affected the internal spatial structures, and it found that the size and style of the Sijeon buildings were closely relevant to the size of the lots near Jongno Avenue.

A Study of Architectural and Design Elements of Secondary Shirines in Traditional Buddhist Temples in Korea (한국 전통사찰에 있어서 부불전의 건축요소와 의장적 특성에 관한 연구)

  • Cho, Jeong-Sik
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.38 no.5
    • /
    • pp.102-112
    • /
    • 2010
  • The purpose of this study is to identify the architectural design elements of secondary shrines in traditional Buddhist temples in Korea. For this study, a survey of six kinds of secondary shrines (Myemgbujem, Yeongsanjeon, Eungjinjem, Yaksajeoun, Gwaneumjeon, Mireukjeon), according to specified design elements(building sizes, roof styles, Gongpo, Dancheong, shape of Datjip), was conducted. The results of this study are summarized as follows; Myeongbujem is built in every temples(25 examples), most having simila1ities in sizes and architectural elements(roof, Gongpo structure, Dancheong, Datjip). The majority of Yemgsanjeon(l4 examples) and Eungjinjem shrines(l5 examples) are mostly 3-Gan sized buildings, having a Matbaejibung and Ikkmg structural system. Gwaneumjeon, on the other hands, has 1he most elaborate architectural elements. Among 12 cases, 8 buildings have Paljakjibung, 9 buildings have Silk-Dancheong in innerspace, and Datjip are included in six buildings. Yaksajeon shrines are small in mnnber, but most of these shrines have a Dapo structure, and, despite of their size, are designated as cultural properties.

Broadening the Understanding of Sixteenth-century Real Scenery Landscape Painting: Gyeongpodae Pavilion and Chongseokjeong Pavilion (16세기(十六世紀) 실경산수화(實景山水畫) 이해의 확장 : <경포대도(鏡浦臺圖)>, <총석정도(叢石亭圖)>를 중심으로)

  • Lee, Soomi
    • MISULJARYO - National Museum of Korea Art Journal
    • /
    • v.96
    • /
    • pp.18-53
    • /
    • 2019
  • The paintings Gyeongpodae Pavilion and Chongseokjeong Pavilion were recently donated to the National Museum of Korea and unveiled to the public for the first time at the 2019 special exhibition "Through the Eyes of Joseon Painters: Real Scenery Landscapes of Korea." These two paintings carry significant implications for understanding Joseon art history. Because the fact that they were components of a folding screen produced after a sightseeing tour of the Gwandong regions in 1557 has led to a broadening of our understanding of sixteenth-century landscape painting. This paper explores the art historical meanings of Gyeongpodae Pavilion and Chongseokjeong Pavilion by examining the contents in the two paintings, dating them, analyzing their stylistic characteristics, and comparing them with other works. The production background of Gyeongpodae Pavilion and Chongseokjeong Pavilion can be found in the colophon of Chongseokjeong Pavilion. According to this writing, Sangsanilro, who is presumed to be Park Chung-gan (?-1601) in this paper, and Hong Yeon(?~?) went sightseeing around Geumgangsan Mountain (or Pungaksan Mountain) and the Gwandong region in the spring of 1557, wrote a travelogue, and after some time produced a folding screen depicting several famous scenic spots that they visited. Hong Yeon, whose courtesy name was Deokwon, passed the special civil examination in 1551 and has a record of being active until 1584. Park Chung-gan, whose pen name was Namae, reported the treason of Jeong Yeo-rip in 1589. In recognition of this meritorious deed, he was promoted to the position of Deputy Minister of the Ministry of Punishments, rewarded with the title of first-grade pyeongnan gongsin(meritorious subject who resolved difficulties), and raised to Lord of Sangsan. Based on the colophon to Chongseokjeong Pavilion, I suggest that the two paintings Gyeongpodae Pavilion and Chongseokjeong Pavilion were painted in the late sixteenth century, more specifically after 1557 when Park Chung-gan and Hong Yeon went on their sightseeing trip and after 1571 when Park, who wrote the colophon, was in his 50s or over. The painting style used in depicting the landscapes corresponds to that of the late sixteenth century. The colophon further states that Gyeongpodae Pavilion and Chongseokjeong Pavilion were two paintings of a folding screen. Chongseokjeong Pavilion with its colophon is thought to have been the final panel of this screen. The composition of Gyeongpodae Pavilion recalls the onesided three-layered composition often used in early Joseon landscape paintings in the style of An Gyeon. However, unlike such landscape paintings in the An Gyeon style, Gyeongpodae Pavilion positions and depicts the scenery in a realistic manner. Moreover, diverse perspectives, including a diagonal bird's-eye perspective and frontal perspective, are employed in Gyeongpodae Pavilion to effectively depict the relations among several natural features and the characteristics of the real scenery around Gyeongpodae Pavilion. The shapes of the mountains and the use of moss dots can be also found in Welcoming an Imperial Edict from China and Chinese Envoys at Uisungwan Lodge painted in 1557 and currently housed in the Kyujanggak Institute for Korean Studies at Seoul National University. Furthermore, the application of "cloud-head" texture strokes as well as the texture strokes with short lines and dots used in paintings in the An Gyeon style are transformed into a sense of realism. Compared to the composition of Gyeongpodae Pavilion, which recalls that of traditional Joseon early landscape painting, the composition of Chongseokjeong Pavilion is remarkably unconventional. Stone pillars lined up in layers with the tallest in the center form a triangle. A sense of space is created by dividing the painting into three planes(foreground, middle-ground, and background) and placing the stone pillars in the foreground, Saseonbong Peaks in the middle-ground, and Saseonjeong Pavilion on the cliff in the background. The Saseonbong Peaks in the center occupy an overwhelming proportion of the picture plane. However, the vertical stone pillars fail to form an organic relation and are segmented and flat. The painter of Chongseokjeong Pavilion had not yet developed a three-dimensional or natural spatial perception. The white lower and dark upper portions of the stone pillars emphasize their loftiness. The textures and cracks of the dense stone pillars were rendered by first applying light ink to the surfaces and then adding fine lines in dark ink. Here, the tip of the brush is pressed at an oblique angle and pulled down vertically, which shows an early stage of the development of axe-cut texture strokes. The contrast of black and white and use of vertical texture strokes signal the forthcoming trend toward the Zhe School painting style. Each and every contour and crack on the stone pillars is unique, which indicates an effort to accentuate their actual characteristics. The birds sitting above the stone pillars, waves, and the foam of breaking waves are all vividly described, not simply in repeated brushstrokes. The configuration of natural features shown in the above-mentioned Gyeongpodae Pavilion and Chongseokjeong Pavilion changes in other later paintings of the two scenic spots. In the Gyeongpodae Pavilion, Jukdo Island is depicted in the foreground, Gyeongpoho Lake in the middle-ground, and Gyeongpodae Pavilion and Odaesan Mountain in the background. This composition differs from the typical configuration of other Gyeongpodae Pavilion paintings from the eighteenth century that place Gyeongpodae Pavilion in the foreground and the sea in the upper section. In Chongseokjeong Pavilion, stone pillars are illustrated using a perspective viewing them from the sea, while other paintings depict them while facing upward toward the sea. These changes resulted from the established patterns of compositions used in Jeong Seon(1676~1759) and Kim Hong-do(1745~ after 1806)'s paintings of Gwandong regions. However, the configuration of the sixteenth-century Gyeongpodae Pavilion, which seemed to have no longer been used, was employed again in late Joseon folk paintings such as Gyeongpodae Pavilion in Gangneung. Famous scenic spots in the Gwandong region were painted from early on. According to historical records, they were created by several painters, including Kim Saeng(711~?) from the Goryeo Dynasty and An Gyeon(act. 15th C.) from the early Joseon period, either on a single scroll or over several panels of a folding screen or several leaves of an album. Although many records mention the production of paintings depicting sites around the Gwandong region, there are no other extant examples from this era beyond the paintings of Gyeongpodae Pavilion and Chongseokjeong Pavilion discussed in this paper. These two paintings are thought to be the earliest works depicting the Gwandong regions thus far. Moreover, they hold art historical significance in that they present information on the tradition of producing folding screens on the Gwandong region. In particular, based on the contents of the colophon written for Chongseokjeong Pavilion, the original folding screen is presumed to have consisted of eight panels. This proves that the convention of painting eight views of Gwangdong had been established by the late sixteenth century. All of the existing works mentioned as examples of sixteenth-century real scenery landscape painting show only partial elements of real scenery landscape painting since they were created as depictions of notable social gatherings or as a documentary painting for practical and/or official purposes. However, a primary objective of the paintings of Gyeongpodae Pavilion and Chongseokjeong Pavilion was to portray the ever-changing and striking nature of this real scenery. Moreover, Park Chung-gan wrote a colophon and added a poem on his admiration of the scenery he witnessed during his trip and ruminated over the true character of nature. Thus, unlike other previously known real-scenery landscape paintings, these two are of great significance as examples of real-scenery landscape paintings produced for the simple appreciation of nature. Gyeongpodae Pavilion and Chongseokjeong Pavilion are noteworthy in that they are the earliest remaining examples of the historical tradition of reflecting a sightseeing trip in painting accompanied by poetry. Furthermore, and most importantly, they broaden the understanding of Korean real-scenery landscape painting by presenting varied forms, compositions, and perspectives from sixteenth-century real-scenery landscape paintings that had formerly been unfound.