Table 1 How has trustworthiness in research evidence evolved?
Year | Obstacle | Source | |
|---|---|---|---|
P Values | 2016 | The P value is arbitrary and does not convey any evidence related to the effect size. | Yaddanapudi LN. The American Statistical Association statement on P-values explained. J Anaesthesiol Clin Pharmacol. 2016;32(4):421-3. |
Estimates of Effect and Precision | 2021 | Assumptions are that the effect size and the variability of the effect are sufficient to attain confidence in estimating the treatment effect. | Elkins MR, Pinto RZ, Verhagen A, Grygorowicz M, Soderlund A, Guemann M, et al. Statistical inference through estimation: recommendations from the International Society of Physiotherapy Journal Editors. J Man Manip Ther. 2022;30(3):133-8. |
Post-Randomization Biases in Research | 2021 | Post-randomization biases occur after data collection, and initial results are obtained. | Andrade C. HARKing, Cherry-Picking, P-Hacking, Fishing Expeditions, and Data Dredging and Mining as Questionable Research Practices. J Clin Psychiatry. 2021;82(1). |
Post-Randomization Biases in RCTs | 2021 | Post-randomization biases cannot be ruled out in randomized clinical trials (RCTs) in International Society of Physiotherapy Journal Editors (ISPJE) member journals 64.5% of the time. | Riley SP, Swanson BT, Shaffer SM, Sawyer SF, Cleland JA. The Unknown Prevalence of Post-randomization Bias in 15 Physical Therapy Journals: A Methods Review. J Orthop Sports Phys Ther. 2021;51(11):542-50. |
Post-Randomization Biases in SRs | 2022 | Post-randomization biases cannot be ruled out in RCTs within systematic reviews (SRs) in ISPJE member journals 8.9% of the time; 58.3% of the SRs included RCTs with unknown external validity; and 35% of the RCTs included in the SRs were low in methodological quality. | Riley SP, Swanson BT, Shaffer SM, Somma MJ, Flowers DW, Sawyer SF. Is the quality of systematic reviews influenced by prospective registration: a methods review of systematic musculoskeletal physical therapy reviews. J Man Manip Ther. 2022:1-14. |