A quick warning at the top of my post that the links to articles relate to things that may be political or may upset some people due to their content.
I watched a documentary a while back about deepfakes being used to create questionable content of prominent figures and then being used as blackmail material. I don't want to get into the details of it because it's not safe for this site, but I'm sure you can imagine.
So long as the internet and society discriminates against any group, groupthink human taught AI will also promote those stereotypes and close those doors.
I'm wary of getting into too much political stuff, but one example about how technology failed people is the Horizon scandal over here, where many, many post office workers were accused (and many convicted and jailed) for embezzlement from the Post Office, when in fact there were faulty software algorithms involved. General overview here for anyone unfamiliar:
https://www.bbc.co.uk/news/business-56718036What is the most concerning about that, aside the human cost, is that people did know there were issues and we're finding out now how much of that got swept aside because the tech couldn't possibly be the problem. Far easier to believe lots of very normal post office workers from all over the country were all committing fraud at the same time...right?
Despite issues like this, the government are trying to get a last minute amendment through the online safety bill which will allow the Department for Work and Pensions to monitor bank accounts of benefit claimants, their friends and family to 'prevent fraud'.
https://www.disabilityrightsuk.org/news/dr-uk-says-scrap-dwp-plans-use-ai-scan-benefit-claimants-bank-accountsIn short, they are preparing to spend more money and rely more on tech and AI to do stuff rather than human beings, despite the big red flag of the Horizon scandal.
The DWP is apparently also monitoring social media accounts already using AI (at great public expense) to 'look for fraud'.
Not that I think fraud is ok or should be let go, but...it's like smashing up a whole house because you need new windows. And in the case of disability benefit, there isn't really a case for account monitoring, because the benefits work differently from income support benefits.
Moreover, there's so little fraud from claimants of disability benefit (0.2% of claims I think is the figure). It's a considerable amount lower than the amount of error in the DWP's decision making and benefit awarding process (they quote it at 4% overall).
This one is not an 'in the future' thing. It's literally right down the road, and honestly, it's terrifying.