New AI system can detect sarcasm on Twitter

MIT scientists have developed a new artificial intelligence system that can detect sarcasm in tweets better than humans, an advance that may help computers automatically spot and remove online hate speech and abusive comments. Detecting the sentiment of social media posts can also track attitudes towards brands and products, and identify signals that might indicate trends in the financial markets. A deeper understanding of Twitter may also help understand how information and influence flows through the network. The researchers originally aimed to develop a system capable of detecting racist posts on Twitter. However, the meaning of many messages could not be properly understood without some understanding of sarcasm. The algorithm uses deep learning, a popular machine- learning technique that relies on training a very large simulated neural network to recognise subtle patterns using a large amount of data. Researchers took advantage of emojis to help the algorithm identify and label emotional content. The researchers found that their system performed far better than the best existing algorithms in each case. They also found that it was better than the humans at spotting sarcasm and other emotions on Twitter. It was 82 per cent accurate at identifying sarcasm correctly, compared with an average score of 76 per cent for the human volunteers.