An investigation funded by GambleAware, a British gambling charity, has uncovered that online questionnaires carry a “specific risk” of selection bias when evaluating gambling-related harm, which, if not adequately addressed, could inflate the number of individuals affected.
Nevertheless, the research acknowledges that due to the high cost and limited sample size of in-person surveys, the measurement of gambling-related harm should progressively transition towards online surveys, with less frequent in-person “standards” utilized for calibration.
The research, conducted by Professor Patrick Sturgis and Professor Youni Khullar of the London School of Economics, aimed to examine the impact of survey methodology disparities on the accuracy of gambling harm estimates.
GambleAware commissioned the study in response to a 2019 YouGov study that identified higher rates of gambling-related harm in the UK compared to those reported in the 2016 and 2018 Health Survey for England. The charity stated that this discrepancy raised concerns about the actual extent of problem gambling in the UK.
Experts emphasize that all YouGov investigations were carried out through web-based questionnaires, while earlier undertakings concentrated on in-person discussions. Additional web-based questionnaires by Yonder and another investigation by YouGov also revealed higher rates of gambling issues.
Investigators in their findings highlight that the primary reason for this disparity is attributable to selection bias in online surveys, which tend to incorporate individuals who are at ease with online technology and frequent internet users.
“Selection bias poses a particular risk for online surveys as they either exhibit very low response rates or employ non-probability sampling,” the study observes.
Experts also point out that these individuals are more likely to engage in frequent online gambling, consequently, relying solely on web-based questionnaires often overestimates the detrimental effects of gambling.
Nevertheless, despite this discovery, researchers assert that online methodologies will emerge as the most effective research approaches in the future, but only if methodological testing and development plans are integrated to mitigate selection bias.
Investigators also emphasize that considering the escalating costs of in-person surveys, web-based questionnaires will present a more economical option, consequently, more research and broader studies can be conducted to gain a more comprehensive understanding of problem gambling levels.
Moreover, researchers suggest that in-person surveys should not be entirely discontinued, proposing the utilization of probability sampling and in-person interviews to provide regular benchmarks.
Dr. Sturges, a prominent scholar in the realm of wagering, has unearthed that online questionnaires tend to inflate the count of individuals grappling with gambling issues in comparison to face-to-face interviews. Nevertheless, Dr. Sturges proposes that we transition towards online data gathering for future studies, as it is more budget-friendly and enables larger and more frequent polls. This strategy should be balanced with regular in-person surveys to guarantee precision.
Alison Clare, Head of Research at GambleAware, underscores the significance of utilizing the most reliable evidence to guide their prevention, therapy, and assistance programs. In today’s digital era, possessing dependable online survey data is essential. GambleAware’s annual UK Treatment and Support Survey serves as a valuable instrument for comprehending the demand for gambling support and treatment services across the UK.
The most recent survey, conducted by YouGov, unveiled an upswing in the number of problematic gamblers seeking aid. The survey discovered that 63% of problematic gamblers reported utilizing some form of treatment, counsel, or assistance in the preceding year, in contrast to 54% in 2019. This surge highlights the burgeoning need for readily available and effective support services for those wrestling with gambling issues.
