If you are getting stressed about upcoming exams then you’re not alone, so is this artificially intelligent (AI) machine.
Last week, a top AI system was pitted against nearly 10 million students to face the maths paper for a much-feared Chinese university entrance exam, known as gaokao. Unfortunately for robotkind, its results were pretty mediocre.
The computer – a humming tower of eleven servers with no Internet connection called AI-MATHS – scored 105 points out of 150 points. On another version of the test, it scored 100. Although that beats the passing score of 90, humanities students had previously scored an average of 109 last year.
That said, the machine finished the exam in 10 minutes when humans are given two hours to complete the exam.
Scientists recently said artificial intelligence will be able to beat humans at everything by 2060, whether that's quizzes, exams, chess, or the game Go. In response to the study, Elon Musk then tweeted that he believes AI-superiority will actually be earlier, around 2030 or 2040.
That doesn’t mean this AI is slow off the mark, however. The computer itself would be able to deal with raw numbers with no problem. Instead, the purpose of this task was to understand the examination in terms of language, something that computers are not so sharp with at the moment.
"This is not a make-or-break test for a robot. The aim is to train artificial intelligence to learn the way humans reason and deal with numbers," said Lin Hui, CEO of Chengdu Zhunxingyunxue Technology, who developed the AI, according to Chinese news agency Xinhua.
“For example, the robot had a hard time understanding the words 'students' and 'teachers' on the test and failed to understand the question, so it scored zero for that question.”
Gaokao is infamously rigorous and renowned for being overwhelming stressful for the young people that take it. Made up of four three-hour papers in Chinese, English, mathematics, and a choice of either sciences or humanities, the series of tests rely on an extensive range of knowledge, problem-solving skills, and obscure creative thinking. The mathematics exam itself is said to be about as tough as the same level college exam in the West.
Nevertheless, the researchers continue to work with China's Ministry of Science and Technology and remain optimistic their AI will improve in the exams in no time at all.
“I hope next year the machine can improve its performance on logical reasoning and computer algorithms and score over 130," Lin added.