▾Artificial intelligence writes poems but struggles with math. Why can't ChatGPT and other chatbots handle even basic arithmetic? We reveal the causes of AI's mathematical mistakes, from tokenization which breaks numbers into unintelligible fragments, to the statistical learning approach that fails in mathematics.
Artificial intelligence, including ChatGPT, can write poems, compose music, and translate texts. Yet, it often stumbles on simple mathematical tasks. Why can't a chatbot, that handles complex language tasks, deal with math at an elementary school level?
Tokenization: When numbers break into pieces
One of the key problems is tokenization. This process divides data into smaller parts, called tokens. Imagine it like assembling a puzzle, where words are broken down into syllables. The tokenizer, the AI model responsible for this process, does not understand the meaning of numbers.
It may happen that the number 380 is perceived as one token, while 381 is perceived as two (38 and 1). This disrupts the relationships between digits and complicates the calculation.
A statistical machine that falters with numbers
Another reason for ChatGPT's mathematical difficulties is its statistical nature. The chatbot learns based on a vast amount of examples and looks for patterns in them. For instance, it learns that the phrase "Dear Sir" is often followed by the phrase "we are reaching out to you".
However, this approach faces challenges in mathematics. ChatGPT can guess that the product of numbers ending in 2 will end in 4, but it cannot handle intermediate results. Simply put, the ChatGPT model tries to guess the result based on learned patterns instead of performing a precise calculation.
The challenge of multiplication
A study conducted by Yuntian Deng from the University of Waterloo showed that ChatGPT struggles with multiplying numbers greater than four digits. The reason is that any error in a calculation step shows up in the final result.
Imagine it as a domino effect – one error triggers a chain reaction, and the result is completely off. However, there is hope that ChatGPT will improve in the future. Deng and his colleagues also tested the o1 model from OpenAI, which is characterized by logical reasoning capabilities.
This model achieved significantly better results than the standard GPT-4o and was able to correctly solve multiplications of nine-digit numbers. The o1 model thinks through the problem step by step, allowing for more accurate results.
Digital nomads: How technology is changing the job market and the way we travel
Digital nomadism is no longer the preserve of adventurers, but a phenomenon that is changing the job market and tourism industry. How has technology enabled working from anywhere in the world? What does it bring to companies and employees? And what challenges and downsides does this lifestyle carry?
What can quadruped robots do – and where will they find their place?
Quadruped robots – the four-legged helpers of the future – are no longer just sci-fi. They oversee construction sites, can map hazardous environments, and may one day even bring you coffee. With progress, however, come new questions: how much can we trust these machines? And where will they find their place – from the household to demanding terrains? Let's explore what robots like the Kawasaki CORLEO can do today.
What is Bluetooth 5.3 and how does it differ from previous versions?
Bluetooth 5.3 brought improvements for IoT devices like smartwatches and sensors. It offers lower latency, higher energy efficiency, and better connection stability. However, it's not the only one, with its close relative Bluetooth 5.4 and the upcoming Bluetooth 6.0. Join us as we explore how it differs from previous versions and what to expect in the future.
NAS systems: how to effectively manage large volumes of data?
The vast amount of data can be a challenge, but NAS systems offer a solution for both homes and small businesses. Central storage, automatic backups, data sharing, and multimedia features—all in one device. How to choose the right NAS, set it up, and utilize its potential? Our article guides you through everything you need to know to keep your data safe.
Network cable: How to choose it? And when is it better than Wi-Fi?
Are you deciding between Wi-Fi and a network cable? Our article will help you find out when Ethernet is the better choice. You'll learn how to choose the right cable and how to connect and maintain it. Whether you're gaming, streaming 4K videos, or working with large files, our article will help you find the best solution.
7 best AI tools for video editing and generation in 2025
Create quality video in minutes using artificial intelligence. Meet the seven best AI video generators for 2025. From professional Synthesia with an extensive avatar library and support for 140 languages to photorealistic Google Veo and creative Runway.