May 19, 2023
2 mins read

Writing with AI tools can have bias, reveals study

To probe, Maurice Jakesch, a doctoral student in the field of information science from the varsity, asked more than 1,500 participants to write a paragraph answering the question, “Is social media good for society?”..reports Asian Lite News

Just as social media can facilitate spread of misinformation, Artificial Intelligence (AI)-powered writing assistants that autocomplete sentences or offer “smart replies” can be biased and produce shifts in opinion, and hence can be misused, warned researchers calling for more regulation.

Researchers from Cornell University in the US said the biases baked into AI writing tools — whether intentional or unintentional — could have concerning repercussions for culture and politics.

To probe, Maurice Jakesch, a doctoral student in the field of information science from the varsity, asked more than 1,500 participants to write a paragraph answering the question, “Is social media good for society?”

People who used an AI writing assistant that was biased for or against social media were twice as likely to write a paragraph agreeing with the assistant, and significantly more likely to say they held the same opinion, compared with people who wrote without AI’s help.

“The more powerful these technologies become and the more deeply we embed them in the social fabric of our societies,” Jakesch said, “the more careful we might want to be about how we’re governing the values, priorities and opinions built into them.”

These technologies deserve more public discussion regarding how they could be misused and how they should be monitored and regulated, the researchers said. Jakesch presented the study at the 2023 CHI Conference on Human Factors in Computing Systems in April.

Further, the team found that the survey revealed that a majority of the participants did not even notice the AI was biased and didn’t realise they were being influenced.

When repeating the experiment with a different topic, the research team again saw that participants were swayed by the assistants.

“We’re rushing to implement these AI models in all walks of life, but we need to better understand the implications,” said Mor Naaman, Professor at the Jacobs Technion-Cornell Institute at Cornell Tech.

“Apart from increasing efficiency and creativity, there could be other consequences for individuals and also for our society — shifts in language and opinions,” Naaman added.

ALSO READ-New ChatGPT, Bard like AI tool to turn thoughts into text

Previous Story

Fake ChatGPT apps exploiting users

Next Story

‘l will win the next election and stay on as PM’

Latest from Tech Lite

India to host AI impact summit 2026

India to host 2026 AI Summit, boosting global dialogue on safe, inclusive tech, while Gujarat launches state-wide AI plan for governance, growth, and public welfare. India is set to host the AI

Apple Appoints Sabih Khan as New COO

Khan will take over from Jeff Williams, who is stepping down from the role this month and will retire later this year…reports Asian Lite News Apple has announced that Sabih Khan, an

EVs Drive Cleaner Cities

Each EV is equipped with GPS tracking for real-time monitoring and efficiently serves the city’s 159.46 square kilometre area The use of electric vehicles (EVs) in household waste collection is ushering in

India’s Digital Decade Rise

Arundhati Bhattacharya, President and CEO at Salesforce-South Asia and recipient of the Padma Shri, sat down with IANS at an event in the capital to reflect on India’s transformation into a digital
Go toTop

Don't Miss

54% of Indian firms implemented AI

About 38 per cent of Indian companies revealed that they

Oracle brings generative AI capabilities to healthcare

The challenge for marketers, sellers, and service agents is to