Nutrition Research and Practice

The Korean Nutrition Society (한국영양학회)
권호 표지
DOI QR코드

DOI QR Code

Reproducibility of a food frequency questionnaire: Korea Nurses' Health Study

  • Song, Sihan (Department of Food and Nutrition, College of Human Ecology, Seoul National University) ;
  • Kim, Bohye (College of Nursing, Ewha Womans University) ;
  • Pang, Yanghee (College of Nursing, Ewha Womans University) ;
  • Kim, Oksoo (College of Nursing, Ewha Womans University) ;
  • Lee, Jung Eun (Department of Food and Nutrition, College of Human Ecology, Seoul National University)
  • Received : 2020.10.27
  • Accepted : 2021.07.05
  • Published : 2022.02.01
Download PDF
⟨ Previous Next ⟩

Abstract

BACKGROUND/OBJECTIVES: This study aimed to examine the reproducibility of food frequency questionnaires (FFQs) designed for young female nurses in the Korea Nurses' Health Study. SUBJECTS/METHODS: The reproducibility of web-based, self-administered FFQs was evaluated among 243 Korean female nurses. The first FFQ (FFQ1) was administered from March 2014 to February 2019 and the second FFQ (FFQ2) from November 2019, with a mean interval of 2.8 years between the FFQs (range, 9 months-5.6 years). Pearson and Spearman correlation coefficients (r values) and quartile agreements between FFQ1 and FFQ2 were calculated for intakes of energy, nutrients, and foods. RESULTS: Pearson correlation coefficients ranged from 0.41 to 0.55 (median r = 0.51) for energy and raw nutrients and from 0.16 to 0.46 (median r = 0.36) for energy-adjusted nutrients. Spearman correlation coefficients ranged from 0.25 to 0.72 (median r = 0.41) for food items. The percentages of women who were classified into the same or adjacent quartile were 77% to 84% (median = 82%) for raw nutrients and 69% to 86% (median = 78%) for foods. CONCLUSIONS: The results indicated that the web-based FFQ used in the Korea Nurses' Health Study has acceptable reproducibility.

Keywords

Acknowledgement

This work was supported by the Research Program funded by the Korea National Institute of Health (2013-E63006-00, 2013-E63006-01, 2019-ER710-100, 2019-ER710-102).

References

  1. Peters SA, Woodward M, Jha V, Kennedy S, Norton R. Women's health: a new global agenda. BMJ Glob Health 2016;1:e000080. https://doi.org/10.1136/bmjgh-2016-000080
  2. World Health Organization. World Health Statistics 2019: Monitoring Health for the SDGs, Sustainable Development Goals. Geneva: World Health Organization; 2019.
  3. Colditz GA, Philpott SE, Hankinson SE. The impact of the Nurses' Health Study on population health: prevention, translation, and control. Am J Public Health 2016;106:1540-5. https://doi.org/10.2105/AJPH.2016.303343
  4. Design of the Women's Health Initiative clinical trial and observational study. The Women's Health Initiative Study Group. Control Clin Trials 1998;19:61-109. https://doi.org/10.1016/S0197-2456(97)00078-0
  5. Zheng W, Chow WH, Yang G, Jin F, Rothman N, Blair A, Li HL, Wen W, Ji BT, Li Q, et al. The Shanghai Women's Health Study: rationale, study design, and baseline characteristics. Am J Epidemiol 2005;162:1123-31. https://doi.org/10.1093/aje/kwi322
  6. Folsom AR, Kushi LH, Anderson KE, Mink PJ, Olson JE, Hong CP, Sellers TA, Lazovich D, Prineas RJ. Associations of general and abdominal obesity with multiple health outcomes in older women: the Iowa Women's Health Study. Arch Intern Med 2000;160:2117-28. https://doi.org/10.1001/archinte.160.14.2117
  7. Darnton-Hill I, Nishida C, James WP. A life course approach to diet, nutrition and the prevention of chronic diseases. Public Health Nutr 2004;7:101-21. https://doi.org/10.1079/PHN2003584
  8. Barker DJ. Maternal nutrition, fetal nutrition, and disease in later life. Nutrition 1997;13:807-13. https://doi.org/10.1016/S0899-9007(97)00193-7
  9. Willett W. Nutritional Epidemiology. New York (NY): Oxford University Press; 2012.
  10. Hu FB, Satija A, Rimm EB, Spiegelman D, Sampson L, Rosner B, Camargo CA Jr, Stampfer M, Willett WC. Diet assessment methods in the Nurses' Health Studies and contribution to evidence-based nutritional policies and guidelines. Am J Public Health 2016;106:1567-72. https://doi.org/10.2105/AJPH.2016.303348
  11. Yu E, Rimm E, Qi L, Rexrode K, Albert CM, Sun Q, Willett WC, Hu FB, Manson JE. Diet, lifestyle, biomarkers, genetic factors, and risk of cardiovascular disease in the Nurses' Health Studies. Am J Public Health 2016;106:1616-23. https://doi.org/10.2105/AJPH.2016.303316
  12. Kim O, Ahn Y, Lee HY, Jang HJ, Kim S, Lee JE, Jung H, Cho E, Lim JY, Kim MJ, et al. The Korea Nurses' Health Study: a prospective cohort study. J Womens Health (Larchmt) 2017;26:892-9. https://doi.org/10.1089/jwh.2016.6048
  13. Yun SH, Shim JS, Kweon S, Oh K. Development of a food frequency questionnaire for the Korea National Health and Nutrition Examination Survey: data from the fourth Korea National Health and Nutrition Examination Survey (KNHANES IV). Korean J Nutr 2013;46:186-96. https://doi.org/10.4163/kjn.2013.46.2.186
  14. Kim DW, Song S, Lee JE, Oh K, Shim J, Kweon S, Paik HY, Joung H. Reproducibility and validity of an FFQ developed for the Korea National Health and Nutrition Examination Survey (KNHANES). Public Health Nutr 2015;18:1369-77. https://doi.org/10.1017/S1368980014001712
  15. Kim Y, Je Y. Moderate coffee consumption is inversely associated with the metabolic syndrome in the Korean adult population. Br J Nutr 2018;120:1279-87. https://doi.org/10.1017/s0007114518002635
  16. Kim Y, Je Y. A modified Mediterranean diet score is inversely associated with metabolic syndrome in Korean adults. Eur J Clin Nutr 2018;72:1682-9. https://doi.org/10.1038/s41430-018-0156-4
  17. Shin S, Kim SA, Ha J, Lim K. Sugar-sweetened beverage consumption in relation to obesity and metabolic syndrome among Korean adults: a cross-sectional study from the 2012-2016 Korean national health and nutrition examination survey (KNHANES). Nutrients 2018;10:1467. https://doi.org/10.3390/nu10101467
  18. Choi A, Ha K, Joung H, Song Y. Frequency of consumption of whole fruit, not fruit juice, is associated with reduced prevalence of obesity in Korean adults. J Acad Nutr Diet 2019;119:1842-1851.e2. https://doi.org/10.1016/j.jand.2019.04.015
  19. Kim H, Lee K, Rebholz CM, Kim J. Association between unhealthy plant-based diets and the metabolic syndrome in adult men and women: a population-based study in South Korea. Br J Nutr 2021;125:1-14. https://doi.org/10.1017/s0007114519002757
  20. Bao Y, Bertoia ML, Lenart EB, Stampfer MJ, Willett WC, Speizer FE, Chavarro JE. Origin, methods, and evolution of the three Nurses' Health Studies. Am J Public Health 2016;106:1573-81. https://doi.org/10.2105/AJPH.2016.303338
  21. Korea Disease Control and Prevention Agency. Nutrient Database for Food Frequency Questionnaire in the Korea National Health and Nutrition Examination Survey. Cheongju: Korea Disease Control and Prevention Agency; 2015.
  22. Ahn Y, Kwon E, Shim JE, Park MK, Joo Y, Kimm K, Park C, Kim DH. Validation and reproducibility of food frequency questionnaire for Korean genome epidemiologic study. Eur J Clin Nutr 2007;61:1435-41. https://doi.org/10.1038/sj.ejcn.1602657
  23. Park MK, Noh HY, Song NY, Paik HY, Park S, Joung H, Song WO, Kim J. Validity and reliability of a dish-based, semi-quantitative food frequency questionnaire for Korean diet and cancer research. Asian Pac J Cancer Prev 2012;13:545-52. https://doi.org/10.7314/APJCP.2012.13.2.545
  24. Bae YJ, Choi HY, Sung MK, Kim MK, Choi MK. Validity and reproducibility of a food frequency questionnaire to assess dietary nutrients for prevention and management of metabolic syndrome in Korea. Nutr Res Pract 2010;4:121-7. https://doi.org/10.4162/nrp.2010.4.2.121
  25. Imaeda N, Fujiwara N, Tokudome Y, Ikeda M, Kuriki K, Nagaya T, Sato J, Goto C, Maki S, Tokudome S. Reproducibility of a semi-quantitative food frequency questionnaire in Japanese female dietitians. J Epidemiol 2002;12:45-53. https://doi.org/10.2188/jea.12.45
  26. Ishihara J, Sobue T, Yamamoto S, Yoshimi I, Sasaki S, Kobayashi M, Takahashi T, Iitoi Y, Akabane M, Tsugane S, et al. Validity and reproducibility of a self-administered food frequency questionnaire in the JPHC Study Cohort II: study design, participant profile and results in comparison with Cohort I. J Epidemiol 2003;13:S134-47.
  27. Tsubono Y, Kobayashi M, Sasaki S, Tsugane S; JPHC. Validity and reproducibility of a self-administered food frequency questionnaire used in the baseline survey of the JPHC Study Cohort I. J Epidemiol 2003;13:S125-33. https://doi.org/10.2188/jea.13.1sup_125
  28. Franceschi S, Barbone F, Negri E, Decarli A, Ferraroni M, Filiberti R, Giacosa A, Gnagnarella P, Nanni O, Salvini S, et al. Reproducibility of an Italian food frequency questionnaire for cancer studies. Results for specific nutrients. Ann Epidemiol 1995;5:69-75. https://doi.org/10.1016/1047-2797(95)92893-D
  29. Riboli E, Toniolo P, Kaaks R, Shore RE, Casagrande C, Pasternack BS. Reproducibility of a food frequency questionnaire used in the New York University Women's Health Study: effect of self-selection by study subjects. Eur J Clin Nutr 1997;51:437-42. https://doi.org/10.1038/sj/ejcn/1600422
  30. Bohlscheid-Thomas S, Hoting I, Boeing H, Wahrendorf J. Reproducibility and relative validity of energy and macronutrient intake of a food frequency questionnaire developed for the German part of the EPIC project. European Prospective Investigation into Cancer and Nutrition. Int J Epidemiol 1997;26 Suppl 1:S71-81. https://doi.org/10.1093/ije/26.suppl_1.S71
  31. Goldbohm RA, van't Veer P, van den Brandt PA, van't Hof MA, Brants HA, Sturmans F, Hermus RJ. Reproducibility of a food frequency questionnaire and stability of dietary habits determined from five annually repeated measurements. Eur J Clin Nutr 1995;49:420-9.
  32. Tsubono Y, Nishino Y, Fukao A, Hisamichi S, Tsugane S. Temporal change in the reproducibility of a selfadministered food frequency questionnaire. Am J Epidemiol 1995;142:1231-5. https://doi.org/10.1093/oxfordjournals.aje.a117582
  33. Pisani P, Faggiano F, Krogh V, Palli D, Vineis P, Berrino F. Relative validity and reproducibility of a food frequency dietary questionnaire for use in the Italian EPIC centres. Int J Epidemiol 1997;26 Suppl 1:S152-60. https://doi.org/10.1093/ije/26.suppl_1.S152
  34. Willett WC, Sampson L, Browne ML, Stampfer MJ, Rosner B, Hennekens CH, Speizer FE. The use of a self-administered questionnaire to assess diet four years in the past. Am J Epidemiol 1988;127:188-99. https://doi.org/10.1093/oxfordjournals.aje.a114780
  35. Nagel G, Zoller D, Ruf T, Rohrmann S, Linseisen J. Long-term reproducibility of a food-frequency questionnaire and dietary changes in the European Prospective Investigation into Cancer and Nutrition (EPIC)-Heidelberg cohort. Br J Nutr 2007;98:194-200. https://doi.org/10.1017/S0007114507691636
  36. Lee Y, Park K. Reproducibility and validity of a semi-quantitative FFQ for trace elements. Br J Nutr 2016;116:864-73. https://doi.org/10.1017/S0007114516002622
  37. Willett WC, Sampson L, Stampfer MJ, Rosner B, Bain C, Witschi J, Hennekens CH, Speizer FE. Reproducibility and validity of a semiquantitative food frequency questionnaire. Am J Epidemiol 1985;122:51-65. https://doi.org/10.1093/oxfordjournals.aje.a114086
  38. Colditz GA, Willett WC, Stampfer MJ, Sampson L, Rosner B, Hennekens CH, Speizer FE. The influence of age, relative weight, smoking, and alcohol intake on the reproducibility of a dietary questionnaire. Int J Epidemiol 1987;16:392-8. https://doi.org/10.1093/ije/16.3.392
  39. Munger RG, Folsom AR, Kushi LH, Kaye SA, Sellers TA. Dietary assessment of older Iowa women with a food frequency questionnaire: nutrient intake, reproducibility, and comparison with 24-hour dietary recall interviews. Am J Epidemiol 1992;136:192-200. https://doi.org/10.1093/oxfordjournals.aje.a116485
  40. Martin-Moreno JM, Boyle P, Gorgojo L, Maisonneuve P, Fernandez-Rodriguez JC, Salvini S, Willett WC. Development and validation of a food frequency questionnaire in Spain. Int J Epidemiol 1993;22:512-9. https://doi.org/10.1093/ije/22.3.512
  41. Mannisto S, Virtanen M, Mikkonen T, Pietinen P. Reproducibility and validity of a food frequency questionnaire in a case-control study on breast cancer. J Clin Epidemiol 1996;49:401-9. https://doi.org/10.1016/0895-4356(95)00551-X
  42. Xing X, Burr JA, Brasure JR, Neugut AI, Marshall JR. Reproducibility of nutrient intake in a food frequency questionnaire used in a general population. Nutr Cancer 1996;25:259-68. https://doi.org/10.1080/01635589609514450
  43. Katsouyanni K, Rimm EB, Gnardellis C, Trichopoulos D, Polychronopoulos E, Trichopoulou A. Reproducibility and relative validity of an extensive semi-quantitative food frequency questionnaire using dietary records and biochemical markers among Greek schoolteachers. Int J Epidemiol 1997;26 Suppl 1:S118-27. https://doi.org/10.1093/ije/26.suppl_1.S118
  44. Ocke MC, Bueno-de-Mesquita HB, Pols MA, Smit HA, van Staveren WA, Kromhout D. The Dutch EPIC food frequency questionnaire. II. Relative validity and reproducibility for nutrients. Int J Epidemiol 1997;26 Suppl 1:S49-58. https://doi.org/10.1093/ije/26.suppl_1.S49
  45. Romieu I, Parra S, Hernandez JF, Madrigal H, Willett W, Hernandez M. Questionnaire assessment of antioxidants and retinol intakes in Mexican women. Arch Med Res 1999;30:224-39. https://doi.org/10.1016/S0188-0128(99)00017-2
  46. Shu XO, Yang G, Jin F, Liu D, Kushi L, Wen W, Gao YT, Zheng W. Validity and reproducibility of the food frequency questionnaire used in the Shanghai Women's Health Study. Eur J Clin Nutr 2004;58:17-23. https://doi.org/10.1038/sj.ejcn.1601738
  47. Parr CL, Veierod MB, Laake P, Lund E, Hjartaker A. Test-retest reproducibility of a food frequency questionnaire (FFQ) and estimated effects on disease risk in the Norwegian Women and Cancer Study (NOWAC). Nutr J 2006;5:4. https://doi.org/10.1186/1475-2891-5-4
  48. Horn-Ross PL, Lee VS, Collins CN, Stewart SL, Canchola AJ, Lee MM, Reynolds P, Clarke CA, Bernstein L, Stram DO. Dietary assessment in the California Teachers Study: reproducibility and validity. Cancer Causes Control 2008;19:595-603. https://doi.org/10.1007/s10552-008-9124-y
  49. Mirmiran P, Esfahani FH, Mehrabi Y, Hedayati M, Azizi F. Reliability and relative validity of an FFQ for nutrients in the Tehran lipid and glucose study. Public Health Nutr 2010;13:654-62. https://doi.org/10.1017/s1368980009991698
  50. Xing X, Burr JA, Brasure JR, Neugut AI, Marshall JR. Reproducibility of food intake in a food frequency questionnaire used in a general population. Nutr Cancer 1995;24:85-95. https://doi.org/10.1080/01635589509514396
  51. Ocke MC, Bueno-de-Mesquita HB, Goddijn HE, Jansen A, Pols MA, van Staveren WA, Kromhout D. The Dutch EPIC food frequency questionnaire. I. Description of the questionnaire, and relative validity and reproducibility for food groups. Int J Epidemiol 1997;26 Suppl 1:S37-48.
  52. Esfahani FH, Asghari G, Mirmiran P, Azizi F. Reproducibility and relative validity of food group intake in a food frequency questionnaire developed for the Tehran Lipid and Glucose Study. J Epidemiol 2010;20:150-8. https://doi.org/10.2188/jea.JE20090083
  53. Evans JR, Mathur A. The value of online surveys. Internet Res 2005;15:195-219. https://doi.org/10.1108/10662240510590360
  54. Wright KB. Researching Internet-based populations: advantages and disadvantages of online survey research, online questionnaire authoring software packages, and web survey services. J Comput Mediat Commun 2005;10:JCMC1034.
  55. Naska A, Lagiou A, Lagiou P. Dietary assessment methods in epidemiological research: current state of the art and future prospects. F1000 Res 2017;6:926. https://doi.org/10.12688/f1000research.10703.1
  56. Beasley JM, Davis A, Riley WT. Evaluation of a web-based, pictorial diet history questionnaire. Public Health Nutr 2009;12:651-9. https://doi.org/10.1017/S1368980008002668
  57. Gonzalez Carrascosa R, Garcia Segovia P, Martinez Monzo J. Paper and pencil vs online self-administered food frequency questionnaire (FFQ) applied to university population: a pilot study. Nutr Hosp 2011;26:1378-84.
  58. Lo Siou G, Csizmadi I, Boucher BA, Akawung AK, Whelan HK, Sharma M, Al Rajabi A, Vena JE, Kirkpatrick SI, Koushik A, et al. The comparative reliability and feasibility of the past-year Canadian diet history questionnaire II: comparison of the paper and web versions. Nutrients 2017;9:133. https://doi.org/10.3390/nu9020133
  59. Zazpe I, Santiago S, De la Fuente-Arrillaga C, Nunez-Cordoba JM, Bes-Rastrollo M, Martinez-Gonzalez MA. Paper-based versus web-based versions of self-administered questionnaires, including foodfrequency questionnaires: prospective cohort study. JMIR Public Health Surveill 2019;5:e11997. https://doi.org/10.2196/11997
  60. Engle A, Lynn LL, Koury K, Boyar AP. Reproducibility and comparability of a computerized, selfadministered food frequency questionnaire. Nutr Cancer 1990;13:281-92. https://doi.org/10.1080/01635589009514070
  61. Labonte ME, Cyr A, Baril-Gravel L, Royer MM, Lamarche B. Validity and reproducibility of a web-based, self-administered food frequency questionnaire. Eur J Clin Nutr 2012;66:166-73. https://doi.org/10.1038/ejcn.2011.163
  62. Fallaize R, Forster H, Macready AL, Walsh MC, Mathers JC, Brennan L, Gibney ER, Gibney MJ, Lovegrove JA. Online dietary intake estimation: reproducibility and validity of the Food4Me food frequency questionnaire against a 4-day weighed food record. J Med Internet Res 2014;16:e190. https://doi.org/10.2196/jmir.3355
  63. Kristal AR, Kolar AS, Fisher JL, Plascak JJ, Stumbo PJ, Weiss R, Paskett ED. Evaluation of web-based, self-administered, graphical food frequency questionnaire. J Acad Nutr Diet 2014;114:613-21. https://doi.org/10.1016/j.jand.2013.11.017
  64. Marshall SJ, Livingstone KM, Celis-Morales C, Forster H, Fallaize R, O'Donovan CB, Woolhead C, Marsaux CF, Macready AL, Navas-Carretero S, et al. Reproducibility of the online Food4Me food-frequency questionnaire for estimating dietary intakes across Europe. J Nutr 2016;146:1068-75. https://doi.org/10.3945/jn.115.225078
  65. Matthys C, Pynaert I, De Keyzer W, De Henauw S. Validity and reproducibility of an adolescent web-based food frequency questionnaire. J Am Diet Assoc 2007;107:605-10. https://doi.org/10.1016/j.jada.2007.01.005
  66. Filippi AR, Amodio E, Napoli G, Breda J, Bianco A, Jemni M, Censi L, Mammina C, Tabacchi G. The web-based ASSO-food frequency questionnaire for adolescents: relative and absolute reproducibility assessment. Nutr J 2014;13:119. https://doi.org/10.1186/1475-2891-13-119
  67. Overby NC, Johannesen E, Jensen G, Skjaevesland AK, Haugen M. Test-retest reliability and validity of a web-based food-frequency questionnaire for adolescents aged 13-14 to be used in the Norwegian Mother and Child Cohort Study (MoBa). Food Nutr Res 2014;58.