• 제목/요약/키워드: cross-modal

검색결과 144건 처리시간 0.018초

유아의 감각양식간 전이 - 촉각에서 시각으로의 전이 - (Cross modal Transfer in Infancy : Transfer from Touch to Vision)

  • 홍희영
    • 아동학회지
    • /
    • 제7권1호
    • /
    • pp.67-84
    • /
    • 1986
  • The purpose of the present research was to investigate cross-modal transfer, especially tactual-to-visual transfer in infancy and to study the relation between failure of cross-modal transfer performance and length of familiarization period. The subjects of this study were 60 infants, 10 boys and 10 girls at each level: six, nine, and twelve months of age. All were normal, healthy, full-term babies. The mothers' educational achievement was controlled at more than 12 years of schooling. There were two separate experimental conditions, one 30-sec and one 60-sec familiarization period. Each experimental condition consisted of a tactual familiarization and a visual recognition memory test. Each child was presented with these 2 sets of cross-modal stimuli in one of the 2 experimental conditions. Infants' visual responses in the visual recognition memory test were videotaped for 20 seconds. Visual fixation time to novel and familiar stimuli was observed throughout the test. The data was analyzed with t-test, percentage of total fixation time to novel stimuli, and ANOVA. The results showed that: 1) Significant differences were found in the cross-modal transfer performance from touch to vision between the 3 age groups. This is, 6 and 9 month old infants didn't show cross-modal transfer in the 30-sec condition, but 12 month old infants did show cross-modal transfer in the 30-second. 2) In all 3 age groups, no significant differences were found in cross-modal transfer performance between the two conditions.

  • PDF

3D Cross-Modal Retrieval Using Noisy Center Loss and SimSiam for Small Batch Training

  • Yeon-Seung Choo;Boeun Kim;Hyun-Sik Kim;Yong-Suk Park
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제18권3호
    • /
    • pp.670-684
    • /
    • 2024
  • 3D Cross-Modal Retrieval (3DCMR) is a task that retrieves 3D objects regardless of modalities, such as images, meshes, and point clouds. One of the most prominent methods used for 3DCMR is the Cross-Modal Center Loss Function (CLF) which applies the conventional center loss strategy for 3D cross-modal search and retrieval. Since CLF is based on center loss, the center features in CLF are also susceptible to subtle changes in hyperparameters and external inferences. For instance, performance degradation is observed when the batch size is too small. Furthermore, the Mean Squared Error (MSE) used in CLF is unable to adapt to changes in batch size and is vulnerable to data variations that occur during actual inference due to the use of simple Euclidean distance between multi-modal features. To address the problems that arise from small batch training, we propose a Noisy Center Loss (NCL) method to estimate the optimal center features. In addition, we apply the simple Siamese representation learning method (SimSiam) during optimal center feature estimation to compare projected features, making the proposed method robust to changes in batch size and variations in data. As a result, the proposed approach demonstrates improved performance in ModelNet40 dataset compared to the conventional methods.

A cross-modal naming study: Effects of prosodic boundaries on the comprehension of relative clauses in Japanese

  • Kang, Soyoung;Kashiwagi, Akiko;Nakayama, Mineharu;Speer, Shari R.
    • 비교문화연구
    • /
    • 제24권
    • /
    • pp.157-169
    • /
    • 2011
  • Compared to studies on prosodic effects on the comprehension of syntactic ambiguity in English, there are relatively few that investigated prosodic effects in East-Asian languages. This study examined the role of prosodic information in processing syntactically ambiguous sentences in Japanese. For syntactically ambiguous sentences containing relative clauses, this paper investigated whether prosodic information is immediately available during the process of these ambiguous sentences. Results from an auditory comprehension experiment with an on-line, cross-modal naming task seemingly suggest that contrary to the findings from the off-line study that examined the same constructions, prosodic information may not be immediately available to Japanese listeners. A possible account for failure to obtain effects of prosodic information is provided.

Estimation of semi-rigid joints by cross modal strain energy method

  • Wang, Shuqing;Zhang, Min;Liu, Fushun
    • Structural Engineering and Mechanics
    • /
    • 제47권6호
    • /
    • pp.757-771
    • /
    • 2013
  • We present a semi-rigid connection estimation method by using cross modal strain energy method. While rigid or pinned assumptions are adopted for steel frames in traditional modeling via finite element method, the actual behavior of the connections is usually neither. Semi-rigid joints enable connections to be modeled as partially restrained, which improves the quality of the model. To identify the connection stiffness and update the FE model, a newly-developed cross modal strain energy (CMSE) method is extended to incorporate the connection stiffness estimation. Meanwhile, the relations between the correction coefficients for the CMSE method are derived, which enables less modal information to be used in the estimation procedure. To illustrate the capability of the proposed parameter estimation algorithm, a four-story frame structure is demonstrated in the numerical studies. Several cases, including Semi-rigid joint(s) on single connection and on multi-connections, without and with measurement noise, are investigated. Numerical results indicate that an excellent updating is achievable and the connection stiffness can be estimated by CMSE method.

Shape Optimization of Rotating Cantilever Beams Considering Their Varied Modal Characteristics

  • Cho, Jung-Eun;Yoo, Hong-Hee
    • Journal of Mechanical Science and Technology
    • /
    • 제18권2호
    • /
    • pp.246-252
    • /
    • 2004
  • The modal characteristics of rotating structures vary with the rotating speed. The material and the geometric properties of the structures as well as the rotating speed influence the variations of their modal characteristics. Very often, the modal characteristics of rotating structures need to be specified at some rotating speeds to meet their design requirements. In this paper, rotating cantilever beam is chosen as a design target structure. Optimization problems are formulated and solved to find the optimal shapes of rotating beams with rectangular cross section.

Incomplete Cholesky Decomposition based Kernel Cross Modal Factor Analysis for Audiovisual Continuous Dimensional Emotion Recognition

  • Li, Xia;Lu, Guanming;Yan, Jingjie;Li, Haibo;Zhang, Zhengyan;Sun, Ning;Xie, Shipeng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제13권2호
    • /
    • pp.810-831
    • /
    • 2019
  • Recently, continuous dimensional emotion recognition from audiovisual clues has attracted increasing attention in both theory and in practice. The large amount of data involved in the recognition processing decreases the efficiency of most bimodal information fusion algorithms. A novel algorithm, namely the incomplete Cholesky decomposition based kernel cross factor analysis (ICDKCFA), is presented and employed for continuous dimensional audiovisual emotion recognition, in this paper. After the ICDKCFA feature transformation, two basic fusion strategies, namely feature-level fusion and decision-level fusion, are explored to combine the transformed visual and audio features for emotion recognition. Finally, extensive experiments are conducted to evaluate the ICDKCFA approach on the AVEC 2016 Multimodal Affect Recognition Sub-Challenge dataset. The experimental results show that the ICDKCFA method has a higher speed than the original kernel cross factor analysis with the comparable performance. Moreover, the ICDKCFA method achieves a better performance than other common information fusion methods, such as the Canonical correlation analysis, kernel canonical correlation analysis and cross-modal factor analysis based fusion methods.

Modal transformation tools in structural dynamics and wind engineering

  • Solari, Giovanni;Carassale, Luigi
    • Wind and Structures
    • /
    • 제3권4호
    • /
    • pp.221-241
    • /
    • 2000
  • Structural dynamics usually applies modal transformation rules aimed at de-coupling and/or minimizing the equations of motion. Proper orthogonal decomposition provides mathematical and conceptual tools to define suitable transformed spaces where a multi-variate and/or multi-dimensional random process is represented as a linear combination of one-variate and one-dimensional uncorrelated processes. Double modal transformation is the joint application of modal analysis and proper orthogonal decomposition applied to the loading process. By adopting this method the structural response is expressed as a double series expansion in which structural and loading mode contributions are superimposed. The simultaneous use of the structural modal truncation, the loading modal truncation and the cross-modal orthogonality property leads to efficient solutions that take into account only a few structural and loading modes. In addition the physical mechanisms of the dynamic response are clarified and interpreted.

향수제품 디자인을 위한 색과 향의 교차-양상 연상관계 (Cross-Modal Associations between Colors and Fragrances for Commercial Perfume Design)

  • 김유진
    • 감성과학
    • /
    • 제11권3호
    • /
    • pp.427-439
    • /
    • 2008
  • 향수제품의 향에 적합한 색을 향수병과 포장지에 적용함으로써, 제품의 향을 소비자들에게 효과적으로 전달할 수 있다. 이에 본 연구는 두 개의 실험연구를 통해 색과 향의 교차-양상 연상관계를 조사하였다. 첫 번째 실험에서는 현재 시장에 출시되어 있는 약 200여개 향수병의 색을 분석하여 향의 종류에 따른 차별화된 색채 디자인 패턴을 발견하였다. 두 번째 실험에서는 국내 소비자들을 대상으로 향과 색의 대응관계를 조사하였다. 향수병을 볼 수 없는 상황에서 피실험자들에게 세 가지 향수제품의 향을 맡은 후 연상되는 색을 선택하게 하였다. 그 결과 세 가지 향수제품 모두 차별화된 색상(hue) 대응이 이루어졌고, 선정된 색상은 실제 향수병의 색상과 상당히 유사한 색상 영역에 분포하였다. 또한 향수제품의 세 가지 향 노트(상향, 중향, 하향)에 따라 연상되는 색의 현저한 톤(tone) 변화를 발견하였다. 위의 두 가지 실험을 통해 시중에 판매되고 있는 향수제품에 있어 향과 색 간의 뚜렷한 교차-양상 연상관계가 있음을 제안하였다.

  • PDF

임의 경계조건을 가진 원통셸 구조의 유체영향계수 해석 (An Analysis on the Fluid-Loading Coefficients of Cylindrical Shell Structure With Arbitrary end Conditions)

  • 전재진;정우진
    • 소음진동
    • /
    • 제6권3호
    • /
    • pp.297-303
    • /
    • 1996
  • The general approach using sine series expansions was represented to evaluate the radiation loading from a vibrating surface on a simply supported cylinder. In this paper, the fluid-loading coefficients (radiation impedance) for a submerged finite cylindrical shell with an arbitrary end condition are defined and evaluated. The vibrations of cylindrical shell are expressed by using cosine series expansions to analyze the radiation impedance for a finite cylindrical shell. It is possible to represent the displacements at both ends of cylindrical shell in comparison with sine series. The direct and cross modal components of fluid-loading coefficients are shown and the validity of cosine series expansions are verified from the results of numerical computations. This approach and results are directly applicable in the analysis of sound radiation from subemerged finite cylindrical shell with arbitrary end conditions.

  • PDF