
CanTEST is a source of local and global information about the changing drug market. Photo: CanTEST.
The eSafety Commissioner has been urged to intervene after automated content moderation on social media blocked and banned drug warnings from CanTEST.
The fixed pill-testing site operates social media channels that publish alerts when particularly concerning, rare or highly potent drugs have been detected in Canberra.
One such warning that was removed last December related to the detection of dangerously potent MDMA.
The warning was put out three days before Canberra’s Split Milk Festival, and the appeals process was unsuccessful.
Directions Health Services runs CanTEST in partnership with Pill Testing Australia and the Canberra Alliance for Harm Minimisation & Advocacy (CAHMA).
Directions Health Services CEO Stephanie Stephens said the deletion of such time-sensitive information was “incredibly concerning”.
“Publishing guidelines are in place to try and make things safer for people, but it’s having the opposite effect,” she said.
“[Messaging is part of our] attempt to stop overdoses and save lives, as well as help avoid enormous costs to our health system.
“Without social media, we can’t reach a wider audience.”
Using the example of the December MDMA post, Ms Stephens said the length of the appeal process meant Directions wasn’t able to quickly let people know, before the festival, that the exceptionally potent pills were in the ACT.
“We reach hundreds of thousands of people [on social media] … who are seeking to make informed choices about the substances they’re using,” she said.
“We struggled to get [the MDMA] messaging out as strongly as we could have.
“This appears to happen as a blanket ban, making it very difficult to dispute … and prove that it’s health information that’s been funded by the [ACT] Government.”
According to its latest report, CanTEST posted five community notices relating to high-purity samples or unexpected detections between 21 January and 20 February this year.
It’s a concern echoed by the Australian Injecting and Illicit Drug Users League (AIVL).
CEO John Gobeil said Pill Testing Australia and New Zealand’s KnowYourStuffNZ have also had posts removed, accounts suspended or permanently deleted on Facebook, Instagram and TikTok due to automated content moderation systems flagging the public health alerts as promoting drug use.
He described the actions as “reckless and dangerous”, stating that they had serious implications for people who use drugs, as well as medical and health professionals.
“These services rely on social media to tell people where they are, what’s in circulation and how to stay safe. If those messages are blocked, people don’t know the service exists, and they lose the chance to make safer decisions,” he said.
“It is also read by on-site medical teams, paramedics, and emergency departments, so they can prepare. Put simply, Meta [which owns Facebook and Instagram] is silencing health workers who are simply trying to stop people from overdosing.”
Mr Gobeil expressed his concern that the moderation systems seemed unable to distinguish between drug promotion and public health advice, in many cases from services funded by government, and that this was “undermining the entire drug checking effort”.
“We know Meta will remedy this if regulators force them, but otherwise won’t bother to teach its algorithm how harm reduction saves lives,” he said.
“It’s as much a failure of values as it is of content moderation.”
AIVL called on the eSafety Commissioner to “use every available lever” to get both Meta and TikTok to act.
“Social media companies need to establish a clear, accessible pathway for public health organisations to have content reviewed by human moderators before automated removal,” Mr Gobeil said.
“They should urgently pick up the phone to our members to understand the nature and purpose of their work and end their risky crusade against popular life-saving public health information.”
The eSafety Commissioner’s role (and the office) is to implement and enforce the Online Safety Act.
This includes obligations for service providers to take steps to reduce the risk of unlawful and harmful material from being published.
An eSafety spokesperson said these requirements did not extend to lawful material such as public health information relating to drugs.
“The removal of material of this nature is a matter for the services involved and should be raised directly with those services,” they said.
Despite its inability to act in this instance, the spokesperson encouraged public health awareness organisations to “take a multi-channel approach” when sharing information.
“Relying on a range of communication channels can help ensure critical information remains accessible to the communities who need it,” they said.
“eSafety strongly recommends individuals or organisations raise any legitimate concerns of this nature directly with the platforms involved.”
Meta and TikTok were contacted for comment, but neither responded by deadline.
Original Article published by Claire Fenwicke on Region Canberra.


