AI translation sounds convincing, but it can be riddled with hidden errors

edited by Swati Mestri, reviewed by Andrew Zinin

This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:

Add to Preferred Sources Credit: Matheus Bertelli from Pexels Generative artificial intelligence (AI) tools are more widespread than ever, and one of the functions they offer is fast, real-time translation. Some people are even questioning the need to ever learn another language if near-instant translation is so widely available to all of us, often for free.

However, those translations are far from perfect. While AI translations are very fluent, fluency doesn't equal accuracy. Even proficient bilinguals can overlook errors hidden under the surface.

Some of the mistakes in AI translation come from a lack of learning data, insufficient prompts or even hallucinations —confident presentation of false information, a hallmark of AI chatbots.

Other errors reflect something more fundamental: the inherent complexity and flexibility of human language, and the linguistic or cultural differences between two languages.

In my professional work reviewing real AI translations between English and Chinese, I have found some revealing examples of this problem. English and Chinese are two of the most used languages, with a large amount of data for AI to learn from; the issues could be more serious if you're working on less common languages.

For those using generative AI to translate, it's important to keep these risks in mind.

Words can have multiple meanings, and AI may not always choose the right one.

In one translation I reviewed, an international student described Australian professors as laid-back because they wore flip-flops to class. AI interpreted the Australian term "thongs" as G-strings (underwear) rather than flip-flops (footwear).

Tense can be problematic too. English verbs clearly indicate tense through forms such as "go," "went" and "is going." Chinese verbs don't change in the same way. Instead, time is often conveyed through context or other words. When translating Chinese into English, AI can choose the wrong tense, changing whether something has happened, is happening or will happen.

A sentence can have different interpretations that are grammatically correct but different in meaning.

For example, "You can see him in the store" can mean he is in the store—or you're in the store when you see him. A human translator can often resolve such ambiguity by considering the context, but AI makes a decision by predicting the next possible words.

And if a mistake is made, it can be difficult to spot later when the overall AI output sounds completely natural. Without careful checking against the original, the meaning can be changed without you noticing.

Accuracy involves more than getting individual words and sentences right. Information must also flow across a text, which is known as cohesion. And languages often achieve cohesion differently.

For example, English frequently uses the definite article "the" to refer back to something previously mentioned. "The" doesn't exist in Chinese; cohesion is achieved by repeating the same word over and over throughout the text.

AI can sometimes connect these references incorrectly, leaving readers confused about who or what is being discussed.

Language doesn't just communicate information. People also use it to establish relationships and connect with others.

Different languages and cultures can build similar relationships in different ways, depending on cultural or ideological differences. For example, government communications in Australia often use "we" and "you" to build a closer relationship with the general public. By contrast, another language—such as Chinese—may prefer third person and more formal words for distance and authority.

Translation is also about introducing new ideas to another language or reflecting evolving beliefs about existing expressions.

For example, terms such as "neurodiversity" may not have widely established equivalents in another language.

And when communities want to address stigma inherent in certain expressions, they might intentionally replace previously used words with new and emerging ones. For example, Chinese terminology referring to transgender people has evolved—more inclusive expressions are gaining recognition.

AI may reproduce older or less appropriate terminology, particularly where newer expressions are underrepresented in its training data. A translation can therefore be linguistically understandable yet socially insensitive.

Just as AI is a black box, your AI translation is also a black box. No large language model can guarantee your AI translation always comes out perfectly. But overall, AI translation tends to be more reliable when:

The translation provided by a chatbot will also be more accurate if it's combined with neural machine translation technology—this is AI that's dedicated to translation specifically and trained accordingly. It's not a feature usually available on the common free AI platforms.

However, even when all the boxes are checked, accuracy can't be guaranteed; errors can crop up, and hallucinations can happen. You trust it at your own risk.

Remember, generative AI doesn't truly understand the complex and often ambiguous human experiences in a text. It may be good enough for understanding the general idea of a text, but its quality is never guaranteed without human input.

Swati Mestri holds a bachelor's degree in Electronics Engineering and has worked as a content editor since 2019. She has experience editing research documents across technology, health care, and materials science, and has a particular interest in technology and space. Full profile →

Master's in physics with research experience. Long-time science news enthusiast. Plays key role in Science X's editorial success. Full profile →

This article is republished from The Conversation under a Creative Commons license. Read the original article.