Vitamin D3 for Life

Live Enlightened

Research libraryVitamin D3 For Life
Study design and methods

Secondary relevance to vitamin D This paper mainly addresses another topic and also reports a vitamin D analysis, result or scientific synthesis.

This paper mainly addresses another topic and also reports a vitamin D analysis, result or scientific synthesis.

Why this paper is included

Supporting source evidence:

The statistical significance threshold was at P < 0.05. *Twenty-one of which were not assessable anymore as included only one cohort study per association. †Sixteen of which were not assessable anymore as included only one cohort study per associationOverview of the included umbrella reviewsTopicFirst authorYearType of studiesN total studies aMedian [IQR]Min to max.bN total associationscN associations includedConvincingHighly suggestiveSuggestiveWeakNon-significantOne exposure with multiple outcomes Adiposity and cancer outcomesKyrgiou2017OBS5076 [4; 11.50](2 to 44)19467d8 (11.9%)14 (20.9%)15 (22.4%)11 (16.4%)19 (28.4%) Antidepressant and adverse eventsDragioti2019OBS10126 [4; 11.25](2 to 44)1201203 (2.5%)8 (6.7%)24 (20%)38 (31.7%)47 (39.2%) Antipsychotics and life-threatening eventsPapola2019OBS689 [6.75; 12.75](6 to 24)661 (16.7%)2 (33.3%)3 (50%)0 (0%)0 (0%) Low-dose aspirin and health outcomesVeronese2020OBS-RCTNR3.50 [3; 7.75](2 to 32)156420 (0%)0 (0%)0 (0%)11 (26.2%)31 (73.8%) Aspirin and cancer outcomesSong2020OBSNR11 [7; 18.25](3 to 309)2718e0 (0%)0 (0%)0 (0%)12 (66.7%)6 (33.3%) Birth weight and later life eventsBelbasis2016OBSNR10 [6.25; 16](3 to 45)78783 (3.8%)8 (10.3%)10 (12.8%)29 (37.2%)28 (35.9%) Chocolate and health outcomesVeronesem2018OBS-RCTNR5 [4; 6](4 to 6)1970 (0%)0 (0%)0 (0%)4 (57.1%)3 (42.9%) Chronic kidney disease and mortalityKim2020OBS-RCTNR9 [4; 14](2 to 26)105490 (0%)0 (0%)22 (44.9%)11 (22.4%)16 (32.7%) Coffee and cancer riskZhao2020OBS44815 [7; 21.25](4 to 54)36360 (0%)3 (8.3%)7 (19.4%)7 (19.4%)19 (52.8%) C-reactive protein and health outcomesMarkozannes2020OBS-MR9526 [4; 11](3 to 53)3091132 (1.8%)12 (10.6%)14 (12.4%)67 (59.3%)18 (15.9%) Depression and mortalityMachado2018OBS2466 [4; 12](3 to 111)17170 (0%)4 (23.5%)2 (11.8%)11 (64.7%)0 (0%) Antidepressants during pregnancy and neonatal outcomesBiffi2020OBSNR7 [4; 10](3 to 28)69690 (0%)5 (7.2%)11 (15.9%)18 (26.1%)35 (50.7%) Dietary Fiber and health outcomesVeronese2018OBSNR12 [6; 19](3 to 26)21212 (9.5%)1 (4.8%)9 (42.9%)6 (28.6%)3 (14.3%) Fish and ω-3 Fatty Acids consumptions and cancer outcomesLee2020OBSNR5 [3; 10](2 to 17)5752f0 (0%)0 (0%)2 (3.8%)10 (19.2%)40 (76.9%) Influenza vaccine in elderly and health outcomesDemurtas2020OBS-RCTNR3.50 [2; 6.75](2 to 27)60381 (2.6%)3 (7.9%)6 (15.8%)15 (39.5%)13 (34.2%) Handgrip strength and health outcomesSoysal2020OBSNR9 [8; 10.50](7 to 34)118e0 (0%)1 (12.5%)1 (12.5%)4 (50%)2 (25%) Human immunodeficiency virus infections and health outcomesGrabovac2019OBSNR8 [4; 13.50](2 to 43)55550 (0%)0 (0%)9 (16.4%)30 (54.5%)16 (29.1%) Metformin and cancer outcomesYu2019OBS3277 [5; 15](2 to 29)33331 (3%)3 (9.1%)5 (15.2%)14 (42.4%)10 (30.3%) Magnesium and health outcomesVeronese2019OBS-RCTNR6 [3; 9.50](3 to 32)55190 (0%)0 (0%)2 (10.5%)7 (36.8%)10 (52.6%) Obesity and gynecology/obstetric outcomesKalliala2017OBS-RCT4276 [3; 9](2 to 40)24814411 (7.6%)28 (19.4%)23 (16%)42 (29.2%)40 (27.8%) Physical activity and cancer outcomesRezende2017OBS2976 [3.25; 10](2 to 38)46461 (2.2%)2 (4.3%)5 (10.9%)5 (10.9%)33 (71.7%) Physical activity and atrial fibrillation outcomesValenzuela2020OBSNR8 [7; 19](6 to 20)550 (0%)0 (0%)0 (0%)3 (60%)2 (40%) Statins and multiple non-cardiovascular outcomesYazhou2018OBS-RCTNR6 [4; 9](2 to 27)2781150 (0%)2 (1.7%)21 (18.3%)42 (36.5%)50 (59.8%) Serum uric acid and health outcomesLi2017OBS-RCT-MRNR5 [3; 9](2 to 31)152760 (0%)7 (9.2%)9 (11.8%)41 (53.9%)19 (25%) Type 2 diabetes mellitus and cancerTsilidis2015OBS47414 [9; 21](5 to 45)27272 (7.4%)4 (14.8%)4 (14.8%)10 (37%)7 (25.9%) Tea consumption and cancerKim2020OBSNR10 [6.75; 16](4 to 53)15068g0 (0%)1 (1.5%)2 (2.9%)18 (26.5%)47 (69.1%) Telomere length and health outcomesSmith2019OBSNR5.50 [3; 8](2 to 20)50500 (0%)1 (2%)0 (0%)23 (46%)26 (52%) Vitamin D and health outcomesTheodoratou2014OBS-RCTNR7 [5; 10](2 to 37)48480 (0%)6 (12.5%)7 (14.6%)16 (33.3%)19 (39.6%)Multiple exposures with one outcome Risk factor for attention deficit hyperactivity disorderKim2020OBSNR6 [4; 9](2 to 30)63635 (7.9%)3 (4.8%)11 (17.5%)26 (41.3%)18 (28.6%) Risk and protective factors for mental disorders with onset in childhood/adolescenceMarco2020OBS1926 [4.50; 9](2 to 26)23230 (0%)0 (0%)1 (4.3%)8 (34.8%)14 (60.9%) Environmental factors and serum biomarkers for atrial fibrillationBelbasis2020OBSNR6 [4; 8](3 to 31)51516 (11.8%)11 (21.6%)8 (15.7%)10 (19.6%)16 (31.4%) Factors associated to lonelinessSolmi2020OBSNR13 [8; 18](3 to 31)550 (0%)0 (0%)1 (20%)4 (80%)0 (0%) Risk factor for amyotrophic lateral sclerosisBelbasis2016OBSNR8 [5.75; 9.25](3 to 20)16160 (0%)0 (0%)3 (18.8%)6 (37.5%)7 (43.8%) Risk and protective factors for anxiety and obsessive compulsive disordersFullana2019OBS2163 [2; 6](2 to 112)427128fg4 (3.1%)2 (1.6%)3 (2.3%)60 (46.9%)59 (46.1%) Environmental risk factors and biomarkers for autism spectrum disorderKim2019OBSNR8 [3.50; 13](2 to 24)67678 (11.9%)7 (10.4%)11 (16.4%)26 (38.8%)15 (22.4%) Environmental risk factors for bipolar disorderBortolato2017OBS548 [5; 10](3 to 13)771 (14.3%)1 (14.3%)2 (28.6%)2 (28.6%)1 (14.3%) Risk factors for colorectal cancer metastasis and recurrenceXu2020OBSNR6 [3.50; 9](2 to 41)47470 (0%)0 (0%)4 (8.5%)27 (57.4%)16 (34%) Non-genetic biomarkers and colorectal cancer riskZhang2020OBS-RCT-MRNR7 [3; 10](2 to 28)112650 (0%)0 (0%)4 (6.2%)25 (38.5%)36 (55.4%) Risk factors for chronic obstructive pulmonary diseaseBellou2019OBS-MRNR5 [4; 11](3 to 22)22180 (0%)0 (0%)8 (44.4%)5 (27.8%)5 (27.8%) Environmental risk factors for dementiaBellou2017OBSNR7 [4.75; 13](3 to 43)76767 (9.2%)5 (6.6%)10 (13.2%)33 (43.4%)21 (27.6%) Risk factors for depressionKohler2018OBS-MRNR7.50 [5; 11](3 to 77)1401340 (0%)0 (0%)41 (30.6%)57 (42.5%)36 (26.9%) Risk factors for eating disordersSolmi2020OBSNR6 [4; 9](2 to 33)49490 (0%)0 (0%)6 (12.2%)35 (71.4%)8 (16.3%) Risk factors for endometrial cancerRaglan2019OBS6044 [3; 6](2 to 28)1271273 (2.4%)13 (10.2%)14 (11%)26 (20.5%)71 (55.9%) Environmental risk factors for obesitySolmi2018OBS-RCT1668 [6; 10.75](2 to 22)60264 (15.4%)2 (7.7%)1 (3.8%)15 (57.7%)4 (15.4%) Prognostic biomarkers for gastric cancerZhou2019OBS>10007 [4; 11](3 to 51)1191193 (2.5%)7 (5.9%)3 (2.5%)82 (68.9%)24 (20.2%) Risk factors for gestational diabetesGiannakou2019OBSNR8 [5; 14](3 to 40)61611 (1.6%)13 (21.3%)9 (14.8%)28 (45.9%)10 (16.4%) Peripheral biomarkers and major mental disordersCarvalho2020OBSNR7 [5; 13](3 to 55)358318g0 (0%)0 (0%)3 (0.9%)175 (55%)140 (44%) Environmental risk factors for multiple sclerosisBelbasis2015OBSNR8 [6; 12](3 to 30)44442 (4.5%)2 (4.5%)2 (4.5%)17 (38.6%)21 (47.7%) Prognostic biomarkers for pancreatic ductal adenocarcinomaWang2020OBS>3004 [3; 6](2 to 43)63630 (0%)2 (3.2%)1 (1.6%)41 (65.1%)19 (30.2%) Environmental risk factors and Parkinson’sBellou2016OBS7557 [5; 10](2 to 67)75752 (2.7%)6 (8%)9 (12%)18 (24%)40 (53.3%) Risk and protective factors for prostate cancerMarkozannes2016OBS19075 [3.75; 7](2 to 45)248176d0 (0%)2 (1.1%)7 (4%)25 (14.2%)142 (80.7%) Non-genetic risk factors for pre-eclampsiaGiannakou2017OBSNR7 [4; 12.25](3 to 34)13064h1 (1.6%)11 (17.2%)5 (7.8%)22 (34.4%)25 (39.1%) Risk and protective factors for psychosisRuada2018OBS6836 [3; 9](2 to 55)170128i1 (0.8%)2 (1.6%)11 (8.6%)64 (50%)50 (39.1%) Environmental risk factors for rheumatic diseasesBelbasis2018OBSNR10.50 [7; 13](3 to 51)42420 (0%)0 (0%)7 (16.7%)26 (61.9%)9 (21.4%) Risk factors and peripheral biomarkers for schizophrenia spectrum disordersBelbasis2017OBS-MRNR8 [5.25; 13](3 to 42)98981 (1%)4 (4.1%)5 (5.1%)52 (53.1%)36 (36.7%) Non-genetic risk factors for skin cancerBelbasis2016OBSNR10 [7; 18](3 to 41)85854 (4.7%)9 (10.6%)11 (12.9%)34 (40%)27 (31.8%) Risk factors for type 2 diabetes mellitusBellou2018OBS-MRNR9.50 [6; 14](3 to 88)15514211 (7.7%)34 (23.9%)28 (19.7%)43 (30.3%)26 (18.3%)IQR interquartile range, MA meta-analyses, MR Mendelian randomization, NR not reported, OBS observational studies, OCD obsessive and compulsive disorders, RCT randomized controlled trialsaTotal number of primary studies included in the meta-analyses assessed by the umbrella reviewsbMedian number IQR and minimum and maximum number of primary studies included in the associations assessedcTotal number of associations assessed in the included umbrella reviewsdThe umbrella review presented data for continuous and binary outcomes but their principal analyses focused only on continuous outcomes which we included hence the lowest number of included associations in our work compared with the original umbrella revieweSome associations were excluded as they were assessed by a mix of RCTs and observational studiesfAssociations assessed by only one study were removedgDuplicated associations were excludedhExcluded associations assessing genetic factorsiThe authors of the umbrella review mention 170 associations but only report 145.

Source: Eligible umbrella reviews and meta-analyses of observational associations. View original paper

Relevance classification does not establish study quality, causation or editorial approval.

Study design Review / evidence synthesis.

Review / evidence synthesis

Reviews existing research; the exact review methods need further assessment.

Meta-analysis reported · Blinding not applicable to this review · Research setting awaiting verification

How this paper was classified

Automatic source-based classification; awaiting editorial verification. This is not a quality score.

Validity of observational evidence on putative risk and protective factors: appraisal of 3744 meta-analyses on 57 topics

Source: Article title.

View supporting evidence in the original paper

What the study types mean
Systematic review
Uses explicit methods to identify, assess and summarise research on a defined question.
Scoping review
Maps the extent and characteristics of research on a topic.
Narrative review
Discusses existing research; systematic-review methods have not been established by this classification.
Review / evidence synthesis
Reviews existing research; the exact review methods need further assessment.
Randomised controlled trial
Assigns participants or groups to comparison interventions by chance.
Non-randomised intervention study
Examines an intervention without random allocation.
Cohort study
Examines exposures and outcomes over time within a defined group.
Case-control study
Compares people with an outcome against people without it, examining exposures.
Cross-sectional study
Examines a population at a particular point in time.
Observational study
Observes exposures and outcomes without assigning the exposure; the subtype is not established here.
Case report
Describes an individual case.
Case series
Describes a group of individual cases.
Secondary analysis
Analyses existing study data; this paper is not automatically another independent trial.
Laboratory study
Investigates biological processes in a laboratory setting.
Qualitative study
Examines experiences or meanings using qualitative methods.
Genetic instrumental-variable study
Uses genetic variation as an instrument to investigate relationships; this is not a randomised treatment trial.
Study protocol
Describes planned methods and is not evidence that the planned study has reported results.
Multiple reported designs
More than one design is explicitly reported; examine the supporting methods.
Study design awaiting verification
The available source does not establish a sufficiently clear study design.

Meta-analysis combines numerical results from studies. Blinding describes who was unaware of treatment allocation. Neither is a separate quality grade. Study design, vitamin D relevance and document format are independent filters.

Abstracts

Validity of observational evidence on putative risk and protective factors: appraisal of 3744 meta-analyses on 57 topics

Review / evidence synthesis · BMC Medicine · 2021

Original publication title

Validity of observational evidence on putative risk and protective factors: appraisal of 3744 meta-analyses on 57 topics

Perrine Janiaud; Arnav Agarwal; Ioanna Tzoulaki; Evropi Theodoratou; Konstantinos K. Tsilidis; Evangelos Evangelou; John P. A. Ioannidis

© The Author(s) 2021

Original publication · Publisher record · CC BY 4.0 · CC0

Source wording retained. Formatting, section navigation and display-title punctuation adapted for this research record.

Authors’ conclusion

Acknowledging that no gold-standard exists to judge whether an observational association is genuine, statistically significant results are common in observational studies, but they are rarely convincing or corroborated by randomized evidence.

An extract from the source publication. Read it in context.

At a glance

Abstract: What background does the paper provide?

The validity of observational studies and their meta-analyses is contested. Here, we aimed to appraise thousands of meta-analyses of observational studies using a pre-specified set of quantitative criteria that assess the significance, amount, consistency, and bias of the evidence. We also aimed to compare results from meta-analyses of observational studies against meta-analyses of randomized controlled trials (RCTs) and Mendelian randomization (MR) studies.

Source: Background

Abstract: What methods does the paper describe?

We retrieved from PubMed (last update, November 19, 2020) umbrella reviews including meta-analyses of observational studies assessing putative risk or protective factors, regardless of the nature of the exposure and health outcome. We extracted information on 7 quantitative criteria that reflect the level of statistical support, the amount of data, the consistency across different studies, and hints pointing to potential bias. These criteria were level of statistical significance (pre-categorized according to 10−6, 0.001, and 0.05 p-value thresholds), sample size, statistical significance for the largest study, 95% prediction intervals, between-study heterogeneity, and the results of tests for small study effects and for excess significance.

Source: Methods

Abstract: Results

3744 associations (in 57 umbrella reviews) assessed by a median number of 7 (interquartile range 4 to 11) observational studies were eligible. Most associations were statistically significant at P < 0.05 (61.1%, 2289/3744). Only 2.6% of associations had P < 10−6, ≥1000 cases (or ≥20,000 participants for continuous factors), P < 0.05 in the largest study, 95% prediction interval excluding the null, and no large between-study heterogeneity, small study effects, or excess significance. Across the 57 topics, large heterogeneity was observed in the proportion of associations fulfilling various quantitative criteria.

The quantitative criteria were mostly independent from one another. Across 62 associations assessed in both RCTs and in observational studies, 37.1% had effect estimates in opposite directions and 43.5% had effect estimates differing beyond chance in the two designs. Across 94 comparisons assessed in both MR and observational studies, such discrepancies occurred in 30.8% and 54.7%, respectively.

Source: Results

Abstract: Conclusions

Acknowledging that no gold-standard exists to judge whether an observational association is genuine, statistically significant results are common in observational studies, but they are rarely convincing or corroborated by randomized evidence.

Source: Conclusions
Authors’ abstract

Background

The validity of observational studies and their meta-analyses is contested. Here, we aimed to appraise thousands of meta-analyses of observational studies using a pre-specified set of quantitative criteria that assess the significance, amount, consistency, and bias of the evidence. We also aimed to compare results from meta-analyses of observational studies against meta-analyses of randomized controlled trials (RCTs) and Mendelian randomization (MR) studies.

Methods

We retrieved from PubMed (last update, November 19, 2020) umbrella reviews including meta-analyses of observational studies assessing putative risk or protective factors, regardless of the nature of the exposure and health outcome. We extracted information on 7 quantitative criteria that reflect the level of statistical support, the amount of data, the consistency across different studies, and hints pointing to potential bias. These criteria were level of statistical significance (pre-categorized according to 10−6, 0.001, and 0.05 p-value thresholds), sample size, statistical significance for the largest study, 95% prediction intervals, between-study heterogeneity, and the results of tests for small study effects and for excess significance.

Results

3744 associations (in 57 umbrella reviews) assessed by a median number of 7 (interquartile range 4 to 11) observational studies were eligible. Most associations were statistically significant at P < 0.05 (61.1%, 2289/3744). Only 2.6% of associations had P < 10−6, ≥1000 cases (or ≥20,000 participants for continuous factors), P < 0.05 in the largest study, 95% prediction interval excluding the null, and no large between-study heterogeneity, small study effects, or excess significance. Across the 57 topics, large heterogeneity was observed in the proportion of associations fulfilling various quantitative criteria.

The quantitative criteria were mostly independent from one another. Across 62 associations assessed in both RCTs and in observational studies, 37.1% had effect estimates in opposite directions and 43.5% had effect estimates differing beyond chance in the two designs. Across 94 comparisons assessed in both MR and observational studies, such discrepancies occurred in 30.8% and 54.7%, respectively.

Conclusions

Acknowledging that no gold-standard exists to judge whether an observational association is genuine, statistically significant results are common in observational studies, but they are rarely convincing or corroborated by randomized evidence.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12916-021-02020-6.

Publication and source details

Original title: Validity of observational evidence on putative risk and protective factors: appraisal of 3744 meta-analyses on 57 topics

Perrine Janiaud; Arnav Agarwal; Ioanna Tzoulaki; Evropi Theodoratou; Konstantinos K. Tsilidis; Evangelos Evangelou; John P. A. Ioannidis

BMC Medicine · 2021

© The Author(s) 2021https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.http://dx.doi.org/10.13039/100009827Laura and John Arnold FoundationSue and Bob O’DonnellCancer Research UK (GB)C31250/A22804Theodoratou Evropi

Repository JATS snapshot; version as supplied

Source retrieved: 2026-11-12T12:11:49.029302+00:00

DOI: 10.1186/s12916-021-02020-6 · PMC8259334