• Korean Journal of Biological Psychiatry
• /
• v.7 no.1
• /
• pp.85-98
• /
• 2000

Objective : There are four possible explanations for the sexual dysfunction of schizophrenics. The first is the possibility of a real structural aspect. The second possibility is that sexual function changes secondary to the illness. The third possibility is that there are medical and sociocultural barriers to sexual expression for chronic schizophrenics. The fourth possibility is that sexual dysfunction due to antipsychotic medication. However, we didn't know the precise cause of sexual dysfunction in schizophrenics. Therefore, the purpose of this study was to explore the mechanism of illness itself and antipsychotics on sexual dysfunction in male schizophrenics. Methods : The serum prolactin(PRL), testosterone(TST), and the plasma serotonin(5-HT) concentrations were measured by radioimmunoassay and high performance liquid chromatography method for 100 healthy male schizophrenics according to the DSM-IV. Concomitantly, the severity of psychotic symptoms using Clinical Global Impression(CGI), Brief Psychiatric Rating Scale(BPRS), Positive and Negative Syndrome Scale(PANSS), and the severity of side effects for antipsychotics using Extrapyramidal Side Effects Scale(EPSE), Anticholinergic Side Effects Scale(ACSE), the cognitive function using PANSS-Cognitive Function(PANSS-CF), Mini Mental State Exam-Korean(MMSE-K), and the sexual dysfunction using Sexual Functioning Questionnaire(SFQ), Questionnaire for Sexual Dysfunction in Men were assessed. The PRL, TST, and 5-HT levels of 50 healthy male controls who had no medical, neurological, and psychiatric illnesses were evaluated. The sexual function using SFQ(items FGa, FNa) were also assessed. Furthermore, the correlation with age, education, religion, economic status, age at onset, duration of illnesses, duration of admission, levels of PRL, TST, 5-HT, antipsychotic dosages, potency, benztropine, total duration of medication, EPSE, ACSE, CGI, BPRS, PANSS, PANSS-CF, MMSE-K and sexual dysfunctions were identified in male schizophrenics. Results : 1) The frequencies of sexual dysfunctions for schizophrenics(80%) were significantly(p<0.001) higher than those for controls(42%). The sexual dysfunctions according to sexual response cycle were 'low sexual desire' 76%, 'impairment of achieving erection' 75%, 'impairment of maintaining erection' 75%, 'impairment of obtaining orgasm' 32%, 'impairment in the quality of orgasm' 61%, 'impairment in quantity of ejaculate' 44%, 'premature ejaculation' 15%, and 'delayed ejaculation' 50%. 2) The PRL, 5-HT levels of schizophrenics($28.5{\pm}20.6ng/ml$, $298.5{\pm}89.1ng/ml$) were significantly(p<0.001) higher than those of controls($10{\pm}5.6ng/ml$, $169.2{\pm}37.8ng/ml$), while the TST levels of schizophrenics($4.3{\pm}1.5ng/ml$) and controls($4.5{\pm}1.2ng/ml$) were not significantly different. The sexual dysfunctions of schizophrenics who had abnormal 5-HT levels($4.7{\pm}1.3$ scores) were significantly(p<0.05) higher than those of who had normal 5-HT levels($3.8{\pm}1.6$ scores) on item D7. 3) The sexual dysfunctions of unmarried schizophrenics were significantly(p<0.01 : p<0.05) higher than those of married schizophrenics($6.1{\pm}2.8$ scores, $4.7{\pm}1.3$ scores on item FGa : ${\beta}$=-0.211 on item FNa). The sexual dysfunctions were positively correlated with the rise of 5-HT levels(r=0.209, p<0.05 on item D4 and r=0.241, p<0.05 on item D7), the higher age at onset(r=0.275, p<0.01 on item FNa : r=-0.202, p<0.05 on item FDa), the longer duration of illnesses(r=0.237, p<0.05 on item D6), the longer duration of admission(r=0.234, p<0.05 on item D4 : r=0.328, p<0.05 on item D6), the longer total duration of medication(r=0.237, p<0.05 on item D6). However, age, education, religion, economic status, PRL, TST levels, antipsychotics dosage, potency, benztropine, ACSE, CGI, BPRS, PANSS, PANSS-CF, MMSE-K scores were not correlated with increased sexual dysfunctions. Conclusions : Male schizophrenics have significantly more sexual dysfunction to compare with controls. The higher frequencies of sexual dysfunctions were low sexual desire and erectile disorder. The unmarried, higher age at onset, and longer duration of diseases were positively correlated with increased sexual dysfunctions. Also high 5-HT levels were positively correlated with increased sexual dysfunctions. This means that studies of plasma 5-HT levels, albeit questionable indicators of central 5-HT function, offer some additional support for the association of sexual dysfunction with excess 5-HT activity as primary pathology of schizophrenia. Our findings suggest that excess 5-HT activity seems to affect the patient's sexual function.

• Journal of the Korean Institute of Traditional Landscape Architecture
• /
• v.37 no.3
• /
• pp.62-82
• /
• 2019

Taking the three Wuyi-Gugok Drawings, 『A Picture Showing the Boundary Between Mountains and Rivers: A』, 『Landscape of the Jiuqu River in the Wuyi Mountain: B』 and 『Eighteen Sceneries of Wuyi Mountain: C』, which were produced in the mid-Qing Dynasty as the research objects and after investigating the names recorded in the paintings, this paper tries to analyze the scenic spots, scene types and images in the literature survey. Also, based on the number of Scenic type and the number of Scenic name in each Gok, landscape richness(LR) and landscape similarity(LS) of the Gugok scenic spots, the cognitive characteristics of the landscape in the 18th century were carefully observed. The results are as follows. Firstly, according to the description statistics of scenic spot types in Wuyi Mountain Chronicle, there were 41 descriptions of scenery names in the three paintings, among which rock, peak and stone accounted for the majority. According to the data, the number of rocks, peaks and stones in Wuyi-Gugok landscape accounted for more than half, which reflected the characteristics of geological landscape such as Danxia landform in Wuyi-Gugok landscape. Secondly, the landscape of Gugok Stream(九曲溪) was diverse and full of images. The 1^st Gok Daewangbong(大王峰) and Manjeongbong(幔亭峰), the 2^nd Gok Oknyeobong(玉女峰), the 3^rd Gok Sojangbong(小藏峰), the 4^th Gok Daejangbong(大藏峰), the 5^th Gok Daeeunbyeong(大隱屛) and Muijeongsa(武夷精舍), the 6^th Gok Seonjangbong(仙掌峰) and Cheonyubong(天游峰) all had outstanding landscape in each Gok. However, the landscape features of the 7^th~9^th Gok were relatively low. Thirdly, according to the landscape image survey of each Gok, the image formation of Gugok cultural landscape originates from the specificity of the myths and legends related to Wuyi Mountain, and the landscape is highly well-known. Due to the specificity, the landscape recognition was very high. In particular, the 1^st Gok and the 5^th Gok closely related to the Taoist culture based on Muigun, the Stone Carving culture and the Boat Tour culture related to neo-confucianism culture of Zhu Xi. Fourthly, according to the analysis results of landscape similarity of 41 landscape types shown in the figure, the similarity of A and C was very high. The morphological description and the relationship of distant and near performance was very similar. Therefore, it could be judged that this was obviously influenced by one painting. As a whole, the names of the scenes depicted in the three paintings were formed at least in the first half of 18^th century through a long history of inheritance, accumulated myths and legends, and the names of the scenes. The order of the scenery names in three Drawings had some differences. But among the scenery names appearing in all three Drawings, there were 21 stones, 20 rocks and 17 peaks. Stones, rocks and peaks guided the landscape of Gugok Streams in Wuyi Mountain. Fifthly, Seonjodae(仙釣臺) in A and C was described in the 4^th Gok, but what deserved attention was that it was known as the scenery name of the 3^rd Gok in Korean. In addition, Seungjindong(升眞洞) in the 1^st Gok and Seokdangsa(石堂寺) in the 7^th Gok were not described in Drawings A, B and C. This is a special point that needs to be studied in the future.

• Journal of The Korean Association For Science Education
• /
• v.40 no.5
• /
• pp.515-529
• /
• 2020

'Scientific inquiry experiments', which was newly created subjects in the 2015 revised curriculum, was expected in the aspect of learning science and developing core competences through science practices. Based on changed view of evaluation, assessments of a practice-centered subject 'Scientific inquiry experiments' should be try to conducted in various ways, but many challenges were reported. In this study, through analysis of current status of assessment of the subject, we intended to find the way of conducting and supporting 'Scientific inquiry experiments'. We collected assessment materials and explanatory description about them from 25 teachers who taught 'Scientific inquiry experiments' in 2018 and 2019. And we analyzed the cases with framework which were consisted with three main categories: elements, standards, methods of assessments. Also, we investigated how the results of assessment were utilized. For the validity, we requested verification of the results of our data analysis to experts of science education and science teachers. From them, we also collected their opinions about our analysis. As a result of the study, teachers assessed some elements of inquiry skills such as 'analysis and interpreting the data', 'conducting inquiry' more than others which were closely related to what subject-matter the teachers used to organized inquiry program with. In the aspect of domain of assessments, though cognitive domain and affective domain as well as skills were evaluated, we also found that the assessment of those domains had some limitation. In terms of standard of assessment, the goals of assessment were presented in most cases, but there were relatively few cases which had the specific criteria and the stepwise statements of expected performance of students. The time and subject of the assessment were mainly post-class and teachers, and others such as in-class assessments, peer-assessments were used only in specific contexts. In all cases, the results of assessments used for calculating students' grade, but in some cases, we could observe that the results used for improving teaching and feedback for students. Based on these results, we discussed how to support the assessments of 'Scientific inquiry experiments'.

• Sleep Medicine and Psychophysiology
• /
• v.21 no.2
• /
• pp.80-84
• /
• 2014

Introduction: Sleep has numerous important physiological and cognitive functions that may be particularly important to elite athletes. Sleep deprivation can have significant effects on athletic performance. However, there are few published data related to the amount of sleep obtained by elite athletes. We investigated sleep patterns of Korean women golfers using sleep-related questionnaires. Methods: For this study, 98 Korean university women golfers and 46 age- and sex-matched controls were recruited. All subjects were asked to complete the self-administered sleep questionnaire consisting of questions about habitual sleep patterns (sleep onset time, sleep latency, awakening time in the morning, day time napping time), exercise habits, Epworth Sleepiness Scale (ESS), Insomnia Severity Index (ISS), Pittsburgh Sleep Quality Index (PSQI), validation of the Perceived Stress Scale (PSS), and Beck Anxiety Inventory (BAI). Results: The sleep onset time was significantly earlier (pm 23 : $05{\pm}00$ : 52 and 00 : $14{\pm}00$ : 51 ; t = 5.287, p < 0.001), the waking time was later (am 07 : $21{\pm}01$ : 09 and 6 : $35{\pm}00$ : 32; t = -2.715, p = 0.008), the weekday total sleep time was greater ($417.77{\pm}78.18$ minute and $351.52{\pm}77.83$ minute ; t = 4.406, p = 0.001), and the daytime nap time was greater ($77.73{\pm}41.28$ minute and $20.22{\pm}33.03$ minute ; t = 7.623, p < 0.001) in the golf athletes compared to the controls. The PSQI scores were significantly lower, but estimated sleep latency and ESS, ISS, PSS, and BAI scores were not different among the two groups. Conclusion: This study suggests that Korean university women golfers have good sleep patterns resulting in no difference in sleep-related stress compared to age- and sex-matched control students.

• Korean Journal of Psychosomatic Medicine
• /
• v.9 no.1
• /
• pp.28-36
• /
• 2001

Objectives : This study was undertaken to identify the clinical and psychological characteristics in patients of mental disability assessment following traumatic brain injury who had the finding with or without abnormal brain imaging study. Methods : A consecutive series of 59 patients were assessed in hospital from January 1994 to December 1998. Patients were divided into 2 groups based on normal or abnormal brain imaging and the two groups were compared in demographic characteristics, psychiatric symptoms, type of head injury, clinical psychological findings. There were 27 patients with abnormal findings and 32 with normal findings in brain imaging study. Results : Abnormal finding group in brain imaging study had significantly higher incidence of psychosis, decreased memory, decreased appetite, increased nihilistic idea, and intracranial hemorrhage. Also, abnormal finding group showed significantly lower level of performance on the block design subtest of K-WAIS and had significantly lower scores on F, hypochodriasis, depression, hysteria, psychopathic deviate, psychasthenia and schizophrenia subscale of the MMPI. Conclusion : The findings suggest that the patients undergone brain surgery due to intracranial hemorrage at that time of brain injury may have higher frequency of abnormal findings in brain imaging study, complain more cognitive and affective symptoms, and have lower the abstract concept formation and perceptual organization abilities.

• Clinical and Experimental Pediatrics
• /
• v.48 no.8
• /
• pp.826-831
• /
• 2005

Purpose : This study is directed to evaluate standardized developmental test performances of infants and children who, as fetuses, had mild isolated cerebral ventriculomegaly diagnosed by ultrasound. Methods : All prenatal sonographic findings from 2001 to 2002 were evaluated. Live isolated mild ventriculomegaly(IMVM) of 10-15 mm were observed in 95 cases(1.1 percent). Standardized developmental testing of 40 cases of IMVM and 36 cases in a comparison group were offered to parents Both groups of children were adjusted to normal antepatum subjects with respect to sex, race, indication for ultrasound and gestational age at the time of ultrasound. Test of cognitive and motor development(Bayley Scales of Infant Development, Second Edition; BSID-II) were administered by developmental examiners. Results : Forty cases and 34 comparison sujects completed the testing. The IMVM and comparison groups were similar with respect to parental age, gestational age, birth weight, familial socioeconomic status. The IMVM subjects scored lower than the comparison group on both the BSID-II, but there was not statistically significant. differences; metal development index(MDI)($92.7{\pm}12.9$ vs $94.7{\pm}14.1$, P=0.47) and psychomotor development index(PDI)($100.3{\pm}14.1$ vs $101.3{\pm}10.7$, P=0.75). Eleven cases(27.5 percent) of IMVM group and five cases(14.7 percent) of the comparison group were developmentally delayed, but most cases in both groups showed mild delays. Resolution or lack of progression, lateral ventricle diameter ${\leq}12mm$ and females were associated with better scores, but there were not statistically significant. Polarity, and head circumference were not related to later development. Conclusion : This study show children with MIVM did not delay performance in the developmental test, but we might suggest a tendency to increase the risk of mild developmental delay.

• Journal of the Korean Society of Food Science and Nutrition
• /
• v.45 no.7
• /
• pp.938-947
• /
• 2016

Antioxidant activities and neuroprotective effects of ethyl acetate fraction from Dendropanax morbifera (EFDM) against high glucose-induced oxidative stress and neurotoxicity were investigated to confirm their physiological activities. An 80% ethanolic extract of D. morbifera showed the highest contents of total phenolic compounds as well as 2,2'-azino-bis(3-ethylbenzothiazoline-6-sulfonic acid) and 1,1-diphenyl-2-picrylhydrazyl radical scavenging activities. The extract was fractionated using several solvents, and the ethyl acetate fraction showed the highest activities in ferric reducing/antioxidant power and malondialdehyde inhibitory assays. To evaluate the neuroprotective effect based on antioxidant activities, cell viability was assessed using PC12 and MC-IXC cells in $H_2O_2$- and high glucose-induced cytotoxic assays, respectively. EFDM evidently showed neuroprotective effects in all cells (neuron-like PC12 cells and human brain-originated neuroblastoma MC-IXC cells). Inhibitory effect of the extract on acetylcholinesterase (AChE) as an acetylcholine-hydrolyzing enzyme was performed to examine the effect on cognitive function. EFDM presented an AChE inhibitory effect. Finally, high-performance liquid chromatography analysis showed that the major phenolic compound of EFDM is probably a rutin.

• Asia pacific journal of information systems
• /
• v.21 no.3
• /
• pp.71-96
• /
• 2011

Within the traditional medical delivery system, patients residing in medically vulnerable areas, those with body movement difficulties, and nursing facility residents have had limited access to good healthcare services. However, Information and Communication Technology (ICT) provides us with a convenient and useful means of overcoming distance and time constraints. ICT is integrated with biomedical science and technology in a way that offers a new high-quality medical service. As a result, rapid technological advancement is expected to play a pivotal role bringing about innovation in a wide range of medical service areas, such as medical management, testing, diagnosis, and treatment; offering new and improved healthcare services; and effecting dramatic changes in current medical services. The increase in aging population and chronic diseases has caused an increase in medical expenses. In response to the increasing demand for efficient healthcare services, a telehealth service based on ICT is being emphasized on a global level. Telehealth services have been implemented especially in pilot projects and system development and technological research. With the service about to be implemented in earnest, it is necessary to study its overall acceptance by consumers, which is expected to contribute to the development and activation of a variety of services. In this sense, the study aims at positively examining the structural relationship among the acceptance factors for telehealth services based on the Technology Acceptance Model (TAM). Data were collected by showing audiovisual material on telehealth services to online panels and requesting them to respond to a structured questionnaire sheet, which is known as the information acceleration method. Among the 1,165 adult respondents, 608 valid samples were finally chosen, while the remaining were excluded because of incomplete answers or allotted time overrun. In order to test the reliability and validity of the assessment scale items, we carried out reliability and factor analyses, and in order to explore the causal relation among potential variables, we conducted a structural equation modeling analysis using AMOS 7.0 and SPSS 17.0. The research outcomes are as follows. First, service quality, innovativeness of medical technology, and social influence were shown to affect perceived ease of use and perceived usefulness of the telehealth service, which was statistically significant, and the two factors had a positive impact on willingness to accept the telehealth service. In addition, social influence had a direct, significant effect on intention to use, which is paralleled by the TAM used in previous research on technology acceptance. This shows that the research model proposed in the study effectively explains the acceptance of the telehealth service. Second, the research model reveals that information privacy concerns had a insignificant impact on perceived ease of use of the telehealth service. From this, it can be gathered that the concerns over information protection and security are reduced further due to advancements in information technology compared to the initial period in the information technology industry, and thus the improvement in quality of medical services appeared to ensure that information privacy concerns did not act as a prohibiting factor in the acceptance of the telehealth service. Thus, if other factors have an enormous impact on ease of use and usefulness, concerns over these results in the initial period of technology acceptance may become irrelevant. However, it is clear that users' information privacy concerns, as other studies have revealed, is a major factor affecting technology acceptance. Thus, caution must be exercised while interpreting the result, and further study is required on the issue. Numerous information technologies with outstanding performance and innovativeness often attract few consumers. A revised bill for those urgently in need of telehealth services is about to be approved in the national assembly. As telemedicine is implemented between doctors and patients, a wide range of systems that will improve the quality of healthcare services will be designed. In this sense, the study on the consumer acceptance of telehealth services is meaningful and offers strong academic evidence. Based on the implications, it can be expected to contribute to the activation of telehealth services. Further study is needed to assess the acceptance factors for telehealth services, such as motivation to remain healthy, health care involvement, knowledge on health, and control of health-related behavior, in order to develop unique services according to the categorization of customers based on health factors. In addition, further study may focus on various theoretical cognitive behavior models other than the TAM, such as the health belief model.

• Sleep Medicine and Psychophysiology
• /
• v.3 no.1
• /
• pp.85-95
• /
• 1996

Obstructive sleep apnea syndrome(OSAS) in childhood is unique and different n-om that in adulthood in several aspects, including pathophysiology, clinical features, diagnostic criteria, complications, management, and prognosis. Characteristic features of childhood OSAS in comparison with the adult form are the variety of severe complications such as developmental delay, more prominent behavioral and cognitive impairments, vivid cardiovascular symptoms, and increased death risk, warranting a special attention to the possible diagnosis of OSAS in children who snore. However, the childhood OSAS is often neglected and unrecognized. We, therefore, report a case of very severe OSAS in a 5-year-old boy who was sucessfully treated with continuous positive airway pressure(CPAP) treatment. Interestingly, the patient was comor-bid with the attention deficit hyperactivity disorder. Prior to the initial visit to us, adenotonsillectomy had been done at the age of 4 with no significant improvement of apneic symptoms and heavy snoring. On the initial diagnostic procedures, marked degree of snoring was audible even in the daytime wake state and the patient was observed to be very hyperactive. Increased pulmonary vascularity with borderline cardiomegaly was noted on chest X-ray. The baseline polysomnography revealed that the patient was very sleep-apneic and snored very heavily, with the respiratory disturbance index(RDI) of 46.9 per hour of sleep, the mean SaO2 of 78.8%, and the lowest SaO2 of 40.0%(the lowest detectable oxygen level by the applied oxymeter). The second night polysomnography was done for CPAP titration and the optimal pressure turned out to be $8.0\;cmH_2O$. The applied CPAP treatment was well tolerated by the patient and was found to be very effective in alleviating heavy snoring and severe repetitive sleep apneas. After 18 months of the CPAP treatment, the patient was followed up with nocturnal polysomnography(baseline and CPAP nights) and clinical examination. Sleep apneas were still present without CPAP on the baseline night. However, the severity of OSAS was significantly decreased(RDI of 15.7, mean SaO2 of 96.2%, and the lowest SaO2 of 83.0%), compared to the initial polysomnographic findings before initiation of long-term CPAP treatment. Wechsler intelligence tests done before and after the CPAP treatment were compared with each other and surprising improvement of intelligence(total 9 points, performance 16 points) was noted. Clinically he was found to be markedly improved in his attention deficit hyperactive behavior after CPAP treatment, but with minimal change of TOVA(test of variables of attention) scores except conversion of reaction time score into normal range. On the chest X-ray taken after 18 months of CPAP application, the initial cardiopulmonary abnormalities were not found at all. We found that the CPAP treatment in a young child is very effective, safe, and well-tolerated and also improves the co-morbid attention deficit hyperactive symptoms. Overall, the growth and development of the child has been facilitated with the long-term use of CPAP. Cardiovascular complications induced by OSAS have been also normalized with CPAP treatment. We suggest that early diagnosis and active treatment intervention of OSAS in children are crucial in preventing and ameliorating possible serious complications caused by repetitive sleep apneas and consequent hypoxic damage during sleep.

• Journal of Intelligence and Information Systems
• /
• v.20 no.2
• /
• pp.179-192
• /
• 2014

Keeping in line with the recent changes in the information technology environment, the online learning environment that supports multiple users' participation such as MOOC (Massive Open Online Courses) has become important. One of the largest professional associations in Information Technology, IEEE Computer Society, announced that "Supporting New Learning Styles" is a crucial trend in 2014. Popular MOOC services, CourseRa and edX, have continued to build active learning environment with a large number of lectures accessible anywhere using smart devices, and have been used by an increasing number of users. In addition, collaborative web services (e.g., blogs and Wikipedia) also support the creation of various user-uploaded learning materials, resulting in a vast amount of new lectures and learning materials being created every day in the online space. However, it is difficult for an online educational system to keep a learner' motivation as learning occurs remotely, with limited capability to share knowledge among the learners. Thus, it is essential to understand which materials are needed for each learner and how to motivate learners to actively participate in online learning system. To overcome these issues, leveraging the constructivism theory and collective intelligence, we have developed a social bookmarking system called WeStudy, which supports learning material sharing among the users and provides personalized learning material recommendations. Constructivism theory argues that knowledge is being constructed while learners interact with the world. Collective intelligence can be separated into two types: (1) collaborative collective intelligence, which can be built on the basis of direct collaboration among the participants (e.g., Wikipedia), and (2) integrative collective intelligence, which produces new forms of knowledge by combining independent and distributed information through highly advanced technologies and algorithms (e.g., Google PageRank, Recommender systems). Recommender system, one of the examples of integrative collective intelligence, is to utilize online activities of the users and recommend what users may be interested in. Our system included both collaborative collective intelligence functions and integrative collective intelligence functions. We analyzed well-known Web services based on collective intelligence such as Wikipedia, Slideshare, and Videolectures to identify main design factors that support collective intelligence. Based on this analysis, in addition to sharing online resources through social bookmarking, we selected three essential functions for our system: 1) multimodal visualization of learning materials through two forms (e.g., list and graph), 2) personalized recommendation of learning materials, and 3) explicit designation of learners of their interest. After developing web-based WeStudy system, we conducted usability testing through the heuristic evaluation method that included seven heuristic indices: features and functionality, cognitive page, navigation, search and filtering, control and feedback, forms, context and text. We recruited 10 experts who majored in Human Computer Interaction and worked in the same field, and requested both quantitative and qualitative evaluation of the system. The evaluation results show that, relative to the other functions evaluated, the list/graph page produced higher scores on all indices except for contexts & text. In case of contexts & text, learning material page produced the best score, compared with the other functions. In general, the explicit designation of learners of their interests, one of the distinctive functions, received lower scores on all usability indices because of its unfamiliar functionality to the users. In summary, the evaluation results show that our system has achieved high usability with good performance with some minor issues, which need to be fully addressed before the public release of the system to large-scale users. The study findings provide practical guidelines for the design and development of various systems that utilize collective intelligence.