DOI QR코드

DOI QR Code

Construction of Abalone Sensory Texture Evaluation System Based on BP Neural Network

  • Li, Xiaochen (Dept of Mechanical Engineering, Dalian Polytechnic University) ;
  • Zhao, Yuyang (Dept of Mechanical Engineering, Dalian Polytechnic University) ;
  • Li, Renjie (Dept of Mechanical Engineering, Dalian Polytechnic University) ;
  • Zhang, Ning (Dept of Information Communications Engineering, Tongmyong University) ;
  • Tao, Xueheng (Dept of Mechanical Engineering, Dalian Polytechnic University) ;
  • Lee, Eung-Joo (Dept of Information Communications Engineering, Tongmyong University)
  • Received : 2019.05.29
  • Accepted : 2019.06.25
  • Published : 2019.07.31

Abstract

The effects of different heat treatments on the sensory characteristics of abalones are studied in this study. In this paper, the sensory evaluation of abalone samples under different heat treatment conditions is carried out, and the evaluation results are analyzed. The three-dimensional (3D) scanning and reverse engineering are used in tooth modeling of the sensory evaluation of abalone samples under different heat treatment conditions. Besides, the chewing movement models are simplified into three modes, including the cutting mode, compressing mode and grinding mode, which are simulated using finite element simulation. The elastic modulus of the abalone samples is obtained through the compression testing using a texture analyzer to distinguish their material properties under different heat treatments and to obtain simulated mechanical parameters. Finally, taking the mechanical parameters of the finite element simulation of abalone chewing as input and sensory evaluation parameters as the output, BP neural network is established in which the sensory texture evaluation model of abalone samples is obtained. Through verification, the neural network prediction model can meet the requirements of food texture evaluation, with an average error of 9.12%.

Keywords

1. INTRODUCTION

 Abalone, a kind of edible sea snail, has been recognized as one of the most highly-valued seafood, especially in Asian countries, which can be attributed to its delicious taste and nutritional richness. China is endowed with abundant seafood resources. This paper aims to study the Haliotis discus distributed in Bohai Sea [1,2]. The Haliotis discus species has contained protein, fat, vitamins, glycogen, and many other trace elements, which has high nutritional value and is thereby widely used for healthcare [3]. The abalone aquaculture production has grown rapidly in China in recent years, which gives rise to the emergence of new products (such as ready-to-eat abalone) as consumer favorites. Characteristics, including texture, aroma, color, appearance, and size, are of great importance to evaluate the quality of ready-to-eat abalone under different heat treatments. The existing research on the quality evaluation of abalone meat mainly focused on the sensory evaluation, Texture profile analysis methods and the electronic sensing technology. Of them, sensory evaluation was a relatively accurate evaluation method, which could evoke measure, analyze and explain product according to responses through vision, olfaction, feeling, taste, and hearing. However, such a method was time consuming, laborious and error-prone during the evaluation process. On the other hand, the Texture profile analysis method had been used to evaluate the physical or mechanical indicators of food using a texture analyzer, which could establish the relationship between the test signal and the texture parameters to analyze the food texture. This method was fairly objective; However, its results were far removed from expectations as a result of the different instrumental structures and human masticatory organs. With the recent rapid development of electronic technology, an increasing number of researchers had applied the electronic sensing technologies, including electromyography and the piezoelectric-film sensor, in the texture analysis of food [4]. In the meantime, many kinds of bionic equipment had emerged (like the electronic tongue), which could simulate the human perception methods for testing [5]. However, these methods were expensive and complicated, which did not align with the requirements of the enterprise.

 In this study, the effects of heat treatment conditions on the sensory characteristics of abalones are analyzed. Concretely, the mechanical properties of abalone are measured under different treatment conditions through the finite element simulation. Furthermore, an evaluation model is established based on the back propagation (BP) artificial network to predict the sensory hardness, springiness, and smell using the mechanical properties obtained from the finite element simulation.

2. MATERIALS AND METHODS

2.1 Materials and Sample preparation

 Fresh abalones (Haliotis discus hannai Ino), 70 ± 5 g (including shell) in weight and 8±1 cm in length, are purchased from the Dalian seafood market. The abalone meat is removed from the shell and the viscera is preserved in icy water prior to the experiments [6]. All processed abalone meat is divided into 30 groups, followed by thermal treatment using a thermostat at a power of 1500 W in a water bath (HH-4 Changzhou Rui Zhibo equipment manufacture Co. Ltd.) at 60, 80, 85, 90 and 100℃ for 15, 30, 60, 120, 240 and 360 min, respectively [7]. In addition, an experiment table containing 30 sets of experiments is shown in Table 1, while meat processing in the water bath is presented in Fig. 1, and the processed abalone samples are displayed in Fig. 2.

Table 1. Factors and levels table for experimental design.

MTMDCW_2019_v22n7_790_t0001.png 이미지

MTMDCW_2019_v22n7_790_f0001.png 이미지

Fig. 1. The thermal processing of abalone meat.

MTMDCW_2019_v22n7_790_f0002.png 이미지

Fig. 2. The processed abalone samples.

2.2 Methods

2.2.1 Sensory Evaluation

 The abalone meat used for sensory evaluation is cut into cubes at the dimension of 14×14×14 mm. Typically, a sensory evaluation team including 6 men and 5 women with good distinctions and descriptive abilities, is established to carry out the sensory evaluation according to the double-blind method in the well-ventilated and partition booths under fluorescent light. Concretely, the hardness, springiness, and chewiness of the abalone meat are evaluated using a 5-point scale. The sensory evaluation index criteria are shown in Table 2.

Table 2. Sensory index criteria of abalone meat

MTMDCW_2019_v22n7_790_t0002.png 이미지

2.2.2 Determination of Mechanical Properties

 The constitutive properties of food are generally quite complex, but most mechanical properties of food before breaking are close to the linear elasticity. On this account, the abalone samples are assumed to be materials with isotropy and linear elasticity. The Poisson's ratio of all processed samples is set at 0.4 and the density is set at 1.2 g/cm3. Obviously, the abalone samples under different heat treatments have different material properties, which can be distinguished by the elastic modulus measure through the compression experiments. Specifically, the elastic modulus is measured according to the following method.

 Firstly, the tested abalone samples are cut into cylinders about 12 mm (diameter) ×10 mm (height) in size. The upper sample surface is the stress surface, which is perpendicular to the muscle fiber. Five duplicates are set for each sample. Secondly, a texture analyzer (FTC, Virginia, USA) fitted with a P/100 probe is used for compression experiments, as shown in the Fig. 3. Each sample undergoes compression experiment at a compression level of 60% (relative to sample height), a test speed of 60 mm/min and the triggering stress of 0.1 N [8].

MTMDCW_2019_v22n7_790_f0003.png 이미지

Fig. 3. TPA texture experimental device.

 Finally, when the degree of compression is less than 30%, if the stress-strain curve can be used as a straight line fitting based on MATLAB, the elastic modulus of the sample can be easily calculated according to Hooke's law.

 The calculation formula is as follows:

\(E=\sigma / \varepsilon=(F / A) /(\triangle L / L)\)       (1)

 Where

 \(E\) is the elastic modulus;

 \(A\) represents the effective area;

 \(F/A\) stands for the stress;

 \(\triangle L / L\) indicates the strain;

2.2.3 Reconstruction of the Tooth Surface Model

 The dental model of healthy adult men is taken as a sample. A set of reference points on the object surface are applied to assist in measuring the object. Moreover, the 3D data of the incremental reference point and density point clouds are acquired using the ATOS 3D optical scanner, as shown in Fig.4. The point cloud model is then encapsulated into a polygon that is repaired and smoothed. Besides, the 3D solid model of the sample is reconstructed using the scan to the 3D function of Solidworks (Fig. 5).

MTMDCW_2019_v22n7_790_f0004.png 이미지

Fig. 4. Working diagram of ATOS optical scanner.

MTMDCW_2019_v22n7_790_f0005.png 이미지

Fig. 5. The reconstruction diagrams of incisor and molar three-dimensional models.

2.2.4 The Simplified Chewing Movement Model

 Chewing movement is a complex phenomenon involving the mandible, masticatory muscles, and temporomandibular joint (TMJ). In this study, the simplified chewing movement models are constructed based on the modern occlusion theory and temporomandibular articulation movement theory, which are further divided into three movements, including cutting movement, compressing movement and grinding movement. The whole process of chewing and crushing food is then simulated [9,10].

 Cutting movement is the beginning stage of chewing movement, in which one end of food is fixed and the other one is restricted by the upper incisor. Food will be distorted due to the horizontal and vertical displacement of the lower incisor, as shown in Fig. 6.

MTMDCW_2019_v22n7_790_f0006.png 이미지

Fig. 6. The simplified diagrams of cutting movement.

 Compressing movement can further break the food into smaller food particles through the molars. In this process, food is supported and maintained by the protruding part of the molar. Due to the difference in the shape of upper and lower molars, the deformation will occur when the food bottom is subjected to the vertical extrusion of the lower molars, which can be ascribed to the difference in the shape between the upper and lower molars, as shown in Fig. 7.

MTMDCW_2019_v22n7_790_f0007.png 이미지

Fig. 7. The simplified diagrams of compressing move- ment.

 Molars begin to grind food that has been squeezed into small particles. The material will be clamped at the upper and lower teeth and remains at rest. Later, the lower molars begin to move horizontally and vertically, which can thereby crush food, as shown in Fig. 8.

MTMDCW_2019_v22n7_790_f0008.png 이미지

Fig. 8. The simplified diagrams of grinding movement.]

2.2.5 Simulation of Chewing Movement

 The chewing movements, including cutting movement, compressing movement, and grinding movement, are simulated and analyzed with the application of ANSYS 15. The simulation process of an incisor in cutting food is shown in Fig. 9. In the cutting movement, the upper incisor remains immobile, while the lower ones are subjected to a displacement of 1.2 mm in both horizontal and vertical directions. Fig. 10 has shown the compressing movement of molars to press food. During this process, the lower molars only have a displacement of 1.2 mm in a vertical direction. The grinding movement is achieved through the upper and lower molars under the comprehensive effects of extrusion, cutting and tearing, resulting in food destruction. Moreover, the food grinding movement process is also simulated, as shown in Fig. 11. Typically, the lower molars have a displacement of 1.2 mm in both horizontal and vertical directions.

MTMDCW_2019_v22n7_790_f0009.png 이미지

Fig. 9. Simulation of movement process in the cutting mode.

MTMDCW_2019_v22n7_790_f0010.png 이미지

Fig. 10. Simulation of movement process in the compressing mode.

MTMDCW_2019_v22n7_790_f0011.png 이미지

Fig. 11. Simulation of movement process in the grinding mode.

 30 groups of abalone samples are simulated through the three chewing movement models under different heat treatment processes. The stress value of food can be calculated after tooth occlusion with Ansys software.

2.2.6 Neural Network Analysis

 The neural network is the abbreviation of an artificial neural network (Artificial neural network, ANN), which is a computer system with artificial intelligence that mimics the biological process of the brain. It has broad application prospects in many academic fields. The neural network is calculated by a large number of artificial neurons connected in parallel in a certain form, and most of them can be classified as an adaptive system that changes the internal structure according to external information. Some scholars had theoretically demonstrated that the three-layer neural network could approximate any function with arbitrary precision, and the neural network with more than three layers could accurately complete the classification of any non-orthogonal set.

 So far, more than 40 kinds of neural networks had been used by researchers at high frequencies and could be roughly divided into Hopfield networks, BP networks, and RBF networks. The BP ( Back Propagation) neural network is short for error backpropagation neural network [11]. It is a multi-layer feedforward neural network trained according to the error backpropagation algorithm which is simple, can be modeled with fewer data and can be approximated by learning. Nonlinear mapping is also the most extensive and successful neural network in current applications. Xiaodan Wang analyzed the correlation between texture parameters and tenderness of beef. The neural network model was constructed by MATLAB software to achieve a rapid and non-destructive evaluation of meat tenderness grade which was validated. Hui Zhao used the MATLAB toolbox to construct a prediction model of corn quick-freezing time and combined with the genetic algorithm to optimize the BP neural network. The accuracy of the model was verified by verification. The BP neural network structure is shown in Fig. 12.

MTMDCW_2019_v22n7_790_f0012.png 이미지

Fig. 12. BP neural network structure.

 In this study, this network is used to establish the prediction equations of sensory parameters, and the mechanical parameters obtained from the simulation analysis of chewing movement are used as the inputs, whereas the sensory evaluation data serves as the desired outputs. Additionally, the mechanical parameters of maximum von-mises stress and maximum shear stress are selected as the input layer neurons, while the sensory evaluation parameters of hardness, springiness, and chewiness are used as the output layer neurons. To be specific, parameters of the training model are as follows: the allowable error of 1×10-6, the learning rate of around 0.01, the dynamic constant of roughly 0.8, and the maximum number of iterations of approximately 1000 [12].

3. RESULTS AND ANALYSIS

3.1 Effects of Different Heating Conditions on Sensory Evaluations

 Fig. 13 has displayed the changes in the hardness, springiness, chewiness, and smell of abalone meat under different heat treatments. The results suggest that, during high-temperature heating (≥ 80℃), the hardness, springiness, and chewiness of abalone meat are decreased with the extension of heating time. In addition, it is also found that a higher heating temperature will lead to a more obvious reduction tendency. Furthermore, Fig. 13 demonstrates that the springiness and hardness tend to be abnormal at 60℃ compared with those at the higher heating temperatures. Such abnormal phenomena may be explained by its microstructure [13, 14]. Typically, the network structure becomes a honeycomb after 60 min of heating, and the tighter network structure of honeycomb can increase the hardness, springiness, and chewiness of abalone meat.

MTMDCW_2019_v22n7_790_f0013.png 이미지

Fig. 13. Sensory changes in abalone meat during the heating process.

3.2 Determination of Elastic Modulus

 The proportional coefficient of stress and strain in elastic deformation is referred to as the elastic modulus, which can be used to indicate the difficulty of elastic deformation. In this study, the compression experiments of abalone samples under different heating treatments are carried out using the texture analyzer. Taking sample 1 as an example, the stress-strain curve is shown in Fig. 14. When the compression ratio range is less than 30%, 30%∼50% and 50%∼60%, the curves are fitted to three linear elastic curves, I, II and III, respectively [15]. This is caused by the change in water loss rate of abalone. Along with the whole compression process, the change of water loss rate can be divided into three stages: the rising stage, the constant speed stage and descending stage [16]. In the rising stage, the water content decreases rapidly from inside to outside. The reason is that the water content of abalone is higher in the early stage, and most of the free water and a small part of the equilibrium water are quickly extruded under compression. In the constant speed stage, the free water content of abalone is less, and the loss of equilibrium water is the main factor, so the water content decreases slowly compared with the rising stage, and the water loss rate is constant [17]. In the descending stage, the water content of abalone has approached the equilibrium moisture content, the smaller the water gradient, and the smaller the power of water transfer [18], so the water loss rate slowly decreases. In addition, the relation coefficient between the regression equation and the stress-strain curve is over 0.95. According to Hooke's law, the slope of the linear regression equation is the elastic modulus.

 The regression equation of sample 1 part Ⅰ (<30%):

 \(\sigma=2.73 \varepsilon+0.048\)       (2)

 The elastic modulus of sample 1 is calculated to be 2.73×104 Pa, while that of the other samples can be obtained by the same method, as shown in Table 3.

Table 3. Elastic Modulus under different heating conditions

MTMDCW_2019_v22n7_790_t0003.png 이미지

3.3 Simulation Analysis of Chewing

 The Von-Mises stress and shear stress of the 30 groups of abalone samples are measured in three chewing simulation models, as shown in Table 4-6. Of them, S′ is the vector sum of the vertical and horizontal displacement of moving teeth; while Mises and shear represent the Von-Mises stress and shear stress, respectively.

 It can be found from Table 4 and 5 that, the compressing movement will produce greater shear stress and Von-Mises stress when the displacement vector is less than the cutting movement. This can potentially explain for the reason why people tend to use molars to break hard food. Afterward, the grinding movement will produce greater shear stress and Von-Mises stress than those of the compressing movement (Tab.6), indicating that grinding movement may play an important role in breaking elastic food.

Table 4. Influence of heating processing on the cutting effect

MTMDCW_2019_v22n7_790_t0004.png 이미지

Table 5. Influence of heating processing on the compressing effect

MTMDCW_2019_v22n7_790_t0005.png 이미지

Table 6. Influence of heating processing on the grinding effect

MTMDCW_2019_v22n7_790_t0006.png 이미지

3.4 Analysis of the Predictive Sensory Evaluation Model

3.4.1 Correlation Analysis

 Correlation between the mechanical characteristics of the chewing simulation system and the sensory evaluation is analyzed using the Pearson correlation. The results have indicated all good correlations, with the correlation coefficients (r) of over 0.71 (Tab.7). As a result, the mechanical characteristics of abalone samples can be used to predict the sensory hardness, springiness, and chewiness.

 Only the statistically significant correlation coefficients upon Pearson correlation analysis are presented. *p≤0.05; **p ≤0.01.

Table 7. Correlation matrix

MTMDCW_2019_v22n7_790_t0007.png 이미지

3.4.2 Determining the Hidden Layer Nodes

 The number of neurons in the hidden layer will greatly affect the accuracy of the prediction model; However, it is quite difficult to determine the numbers of hidden neurons. In our study, as can be observed from the results, the number of hidden layer nodes is 17.

3.4.3 Validation of the Predictive Texture Model

 The sensory evaluation data of abalone meat are predicted using the BP neural network. The results show little difference between the predicted and measured values, with relatively small average calculation error.

 According to the data displayed in Table 8, the maximum error is 27.46%, while the minimum is 2.12%, and the average is 9.12%. These results demonstrate that the established BP neural network has a good prediction effect, which is also associated with the superiority of high prediction efficiency. Thus, the mechanical characteristics of the chewing simulation system can be used to predict the human sensory evaluation results using the BP neural network model [19].

Table 8. Comparison of predictions using the BP neural network model with the actual results

MTMDCW_2019_v22n7_790_t0008.png 이미지

4. CONCLUSIONS

 In this study, the sensory characteristics of abalone meat are analyzed under different heat treatments. Our findings suggest significant reductions in springiness, hardness and chewiness of abalone meat at a shorter heating time (120 min) will result in a slow downward trend. Moreover, the heating condition at 60℃ is abnormal compared to that at higher temperatures, which may be resulted from changes in chemical forces.

 The stress-strain curve of the sample is obtained by a compression test using a texture analyzer, which is fitted using MATLAB software and the elastic modulus of the abalone sample is obtained. Also, reverse engineering technology is used to reconstruct the 3D models of incisors and molars; At the same time, the chewing movement models have been simplified and divided into three modes, including cutting mode, compressing mode and grinding mode. Subsequently, the whole process of chewing and crushing abalone is simulated using the finite element simulation, which allows obtaining the mechanical properties of abalone samples under different heat treatments.

 Using Pearson's correlation analysis method, it is found through correlation analysis that the correlation between the elasticity of sensory texture evaluation and the simulation cutting mode exceeds 0.71, which proves that the two have good correlation. Therefore, the chew simulation test results can be used to predict the springiness, hardness, and chewiness of the sensory texture evaluation. Thus, the BP neural network is introduced to predict the sensory evaluation parameters (including sensory hardness, springiness, and chewiness) based on the mechanical properties obtained from chewing simulation analysis. Our findings indicate that the average error of the prediction model can reach 9.12%. To sum up, this method is associated with great advantages and application prospects, which can be attributed to its simplicity, handling convenience, and high accuracy.

References

  1. J. Dong, X. Fang, H. Wang, X. Zhang, and X. Tao, "Abalone Muscle Texture Evaluation and Prediction Based on TPA Experiment," Journal of Food Quality, Vol. 2, No. 1, pp. 1-9, 2017. https://doi.org/10.1111/j.1745-4557.1979.tb00654.x
  2. B. Zhu, Research on the Theory and Technology of Seafood Processing, Science Press, 16 Donghuangchenggen North Street, Beijing, 2010.
  3. Y. Wang, W.L. Kang, S.G. Xin, and W.Q. Xing, "Analysis of Trace Elements in Abalone and Sea Cucumber," Spectroscopy and Spectral Analysis, Vol. 29, No. 2, pp. 511-514, 2009. https://doi.org/10.3964/j.issn.1000-0593(2009)02-0511-04
  4. Z. Sun, Y. Sun, Y. Li, J. Liu, and J. Li, "Design and Experiment of Bionic Food Texture Analyzer," Transactions of the Chinese Society for Agricultural Machinery, Vol. 43, No. 1, pp. 230-234, 2012. https://doi.org/10.6041/j.issn.1000-1298.2012.01.041
  5. P. Antonio, D. Luis, T.P. Barcelos, S.M. Jorge, and M. Adelio, "An Electronic Tongue for Juice Level Evaluation in Non-alcoholic Beverages," Procedia Chemistry, Vol. 1, No. 1, pp. 1023-1026, 2009. https://doi.org/10.1016/j.proche.2009.07.255
  6. G. Xiao, B. Zhu, X. Dong, X. Chen, and S. Chen, "Effects of Hot Processing Conditions on Partial Processing Properties of Abalone," Journal of Dalian Institute of Light Industry, Vol. 31, No. 1, pp. 1-7, 2012.
  7. B. Zhu, X. Dong, L. Sun, G. Xiao, X. Chen, Y. Murata, et. al., "Effect of Thermal Treatment on the Texture and Microstructure of Abalone Muscle (Haliotis Discus)," Food Science and Biotechnology, Vol. 20, No. 6, pp. 1467-1473, 2011. https://doi.org/10.1007/s10068-011-0203-6
  8. W. Cheng, Y. Zhou, J. Zhang, and Y. Ruan, “Effects of Additives on Elasticity Modulus of Fish Balls Prepared by Broken Rice and Aristichys Nobilis,” China Food Additives, Vol. 2, No. 6, pp. 205-209, 2012.
  9. L. Chen, Y. Sun, J. Liu, and G. Xie, "Simulation Analysis of Food Materials Damage Effect Based on Chewing Movement," Modern Food Science and Technology, Vol. 1, No. 5, pp. 147-152, 2014.
  10. J. Chen, "Food Oral Processing-A Review," Food Hydrocolloids, Vol. 23, No. 1, pp. 1-25, 2009. https://doi.org/10.1016/j.foodhyd.2007.11.013
  11. L. Chen, Y. Sun, J. Liu, and G. Xie, "Simulation Analysis of Food Materials Damage Effect Based on Chewing Movement," Modern Food Science and Technology, Vol. 30, No. 1, pp. 147-152, 2014.
  12. Y. Jia, C. Ji, X. Luo, and N. Chen, "Classifying Beef Muscle and Fat Pixels Using Bp-ga Neural Network," Transactions of the Chinese Society of Agricultural Engineering, Vol. 11, No. 6, pp. 216-219, 2007.
  13. L. Deng, Y. Li, X. Dong, Y. Wang, Q. Xin, and J. Pan, "Chemical Interactions and Textural Characteristics of Abalone Pleopod Muscle Protein during Heating," Transactions of the Chinese Society of Agricultural Engineering, Vol. 30, No. 18, pp. 307-316, 2014.
  14. Y. Zhang, X. Gao, J. Xu, Y. Sun, Y. Chang, and C. Xue, "Comparative Study on Natural Drying and Hot-air Drying of Abalone," Transactions of the Chinese Society of Agricultural Engineering, Vol. 24, No. 1, pp. 296-299, 2008. https://doi.org/10.3321/j.issn:1002-6819.2008.01.058
  15. Y. He, "The Research on Piecewise Linear Fitting of Tool Wear Curver," Mechanical and Electrical Engineering Technology, Vol. 44, No. 12, pp. 88-89, 2015. https://doi.org/10.3969/j.issn.1009-9492.2015.12.024
  16. Z. Gao, Study on Drying Technology and Product Characteristics of Abalone, PhD Thesis of Fujian Agriculture and Forestry University, 2011.
  17. S. Huang and L. Fan, "A Kinetics Study on the Combined Drying of the Osmotic Dehydration and Vacuum Frying for the Carrot Chips," Modern Food Science and Technology, Vol. 29, No. 2, pp. 223-225, 2013.
  18. F. Jia and Y. Zhou, "Study on Moisture Diffusion Regularity of Brown Rice under Storage Conditions," Journal of the Chinese Cereals and Oils Association, Vol. 27, No. 1, pp. 87-90, 2012. https://doi.org/10.3969/j.issn.1003-0174.2012.01.019
  19. R.Y. Zhan and E.J. Lee, "Human Face Recognition used Improved Back-Propagation (BP) Neural Network," Journal of Korea Multimedia Society, Vol. 21, No. 4, pp. 471-477, 2018. https://doi.org/10.9717/KMMS.2018.21.4.471