Supplementary Table 4. Quality assessment of each study using Modified Newcastle Ottawa Scale. |
| Study |
Selection Bias |
Exposure Bias |
Comparability Bias |
Outcome Bias |
Definition of population |
Source population |
Typical of average population |
Sample size |
How performance using hop test(s) was decided |
Demonstrates outcome was not present at time of hop testing |
Comparability of cohort on the bias of the design or analysis |
Validity and reliability of outcomes |
Assessment of outcome(s) of interest |
Adequacy of follow up |
| Bodkin et al., 2022 |
Low |
Low |
Low |
High |
High |
Low |
Low |
High |
High |
Low |
| Cristiani et al., 2022 |
Low |
Low |
Low |
High |
Low |
Low |
Low |
Low |
Low |
Low |
| Cristiani et al., 2025 |
Low |
Low |
Low |
High |
Low |
Low |
Low |
Low |
Low |
Low |
| Faleide et al., 2021 |
Low |
Low |
Low |
High |
Low |
Low |
Low |
High |
High |
High |
| Figueroa et al., 2025 |
Low |
Low |
Low |
Low |
High |
Low |
High |
Low |
Low |
Low |
| Fältström et al., 2023 |
Low |
Low |
High |
High |
Low |
Low |
High |
Low |
Low |
Low |
| Girdwood et al., 2024 |
Low |
Low |
Low |
High |
Low |
Low |
Low |
High |
High |
High |
| Grindem et al., 2016 |
Low |
Low |
Low |
High |
Low |
Low |
Low |
Low |
Low |
Low |
| Ithurburn et al., 2019 |
Low |
Low |
Low |
High |
Low |
Low |
High |
Low |
Low |
High |
| Jang et al., 2014 |
Low |
Low |
High |
High |
High |
Low |
High |
High |
High |
High |
| Kew et al., 2022 |
Low |
Low |
Low |
High |
High |
Low |
High |
High |
High |
Low |
| Kim et al., 2022 |
Low |
Low |
Low |
High |
High |
Low |
High |
Low |
Low |
Low |
| King et al., 2021 |
Low |
Low |
Low |
High |
Low |
Low |
Low |
Low |
Low |
Low |
| Kitaguchi et al., 2020 |
Low |
Low |
Low |
Low |
High |
Low |
Low |
High |
High |
High |
| Kyritsis et al., 2016 |
Low |
Low |
Low |
High |
Low |
Low |
High |
Low |
Low |
Low |
| Legnani et al., 2024 |
Low |
Low |
Low |
Low |
Low |
Low |
High |
Low |
Low |
Low |
| Marigi et al., 2023 |
Low |
Low |
Low |
High |
Low |
Low |
High |
Low |
Low |
High |
| Marty-Diloy et al., 2025 |
Low |
Low |
Low |
High |
Low |
Low |
High |
High |
High |
Low |
| Moksnes et al., 2009 |
Low |
Low |
High |
High |
Low |
Low |
High |
Low |
Low |
High |
| Müller et al., 2015 |
Low |
Low |
Low |
High |
Low |
Low |
Low |
Low |
Low |
Low |
| Nawasreh et al., 2018 |
Low |
Low |
Low |
High |
High |
Low |
Low |
Low |
Low |
High |
| Niederer et al., 2024 |
Low |
Low |
Low |
High |
Low |
Low |
Low |
Low |
Low |
Low |
| Niederer et al., 2025 |
Low |
Low |
Low |
High |
High |
Low |
High |
Low |
Low |
Low |
| Novaretti et al., 2018 |
Low |
Low |
Low |
Low |
High |
Low |
Low |
Low |
Low |
High |
| Nyland et al., 2025 |
Low |
Low |
Low |
High |
Low |
Low |
High |
High |
High |
Low |
| Ohji et al., 2024 |
Low |
Low |
Low |
High |
Low |
High |
Low |
Low |
Low |
Low |
| Ohji et al., 2021a |
Low |
Low |
Low |
High |
Low |
High |
Low |
Low |
Low |
Low |
| Ohji et al., 2021b |
Low |
Low |
Low |
High |
Low |
High |
High |
Low |
Low |
Low |
| Paterno et al., 2022 |
Low |
Low |
Low |
High |
High |
Low |
Low |
Low |
Low |
Low |
| Paterno et al., 2025 |
Low |
Low |
Low |
High |
Low |
Low |
Low |
Low |
Low |
Low |
| Piussi et al., 2023 |
Low |
Low |
Low |
High |
Low |
Low |
Low |
High |
High |
High |
| Senorski et al., 2017 |
Low |
Low |
Low |
High |
Low |
Low |
High |
Low |
Low |
High |
| Simonsson et al., 2024 |
Low |
Low |
Low |
High |
Low |
Low |
High |
Low |
Low |
Low |
| Toole et al., 2017 |
Low |
Low |
Low |
High |
Low |
Low |
High |
Low |
Low |
Low |
| Ueda et al., 2022 |
Low |
Low |
Low |
High |
High |
High |
Low |
High |
High |
High |
| van Melick et al., 2022 |
Low |
Low |
Low |
High |
Low |
Low |
High |
High |
High |
High |
| Webster et al., 2017 |
Low |
Low |
Low |
High |
High |
Low |
High |
High |
High |
Low |
| Webster et al., 2018 |
Low |
Low |
Low |
High |
High |
Low |
High |
Low |
Low |
Low |
| Webster et al., 2019a |
Low |
Low |
Low |
High |
High |
Low |
High |
High |
High |
High |
| Webster et al., 2019b |
Low |
Low |
Low |
High |
Low |
Low |
High |
High |
High |
High |
| Webster et al., 2020 |
Low |
Low |
Low |
High |
High |
Low |
Low |
Low |
Low |
Low |
| Welling et al., 2020 |
Low |
Low |
Low |
High |
Low |
Low |
High |
High |
High |
High |
| Zsidai et al., 2026 |
Low |
Low |
Low |
High |
Low |
Low |
High |
Low |
Low |
Low |
|
|