CYBER THREATS ARE ON THE INCREASE, BUT IS YOUR SECURITY SUITE REALLY PROTECTING YOU? WE PIT 10 OF THE BEST PRODUCTS AGAINST EACH OTHER TO FIND OUT
Cyber threats are on the increase, but is your security suite really protecting you? We pit 10 of the best products against each other to nd out
Every year the risk of attack goes up, with cyber criminals finding newer, smarter ways of attacking you. While Windows 10 has boosted base security levels, you’re still not completely safe.
Nothing shows this as much as the results of our testing. The last time we tested security suite, the lowest-rated product managed a protection rating of 88.1%; this year, the worst product managed just 48%. That’s quite terrifying.
Fortunately, there are better products out there that can dramatically improve your protection and stop you getting hacked or your private details being stolen.
HOW WE TEST
Testing security software means turning to the experts. This year all the tests were performed by SE Labs, run by Simon Edwards.
SE Labs uses the Anti-Malware Testing Standards Organization (AMTSO) standard for testing. What this means is that all of the products have been tested thoroughly in a way that the results demonstrate realworld performance.
All products are tested using a double form of attack. First, there are threats collected in the wild, which means the kinds of threats that your computer is exposed to. These should be relatively straightforward for a product to deal with. Second, products are exposed to targeted attacks. These are created using publicly available free hacking tools, so no unique malware was written and there’s no technical reason why any software should do poorly here.
When it comes to blocking a threat, there are degrees of success. Ideally, a product should block malware before it runs, but some products let an exploit attack, stopping it after it’s detected. To show this, products that block a threat completely are rated higher than those that don’t. Products that allow malware through are heavily penalised. The scoring system works like this:
If the product detects the threat with any degree of useful information, it is awarded one point.
Threats that are disallowed from even starting their malicious activities are blocked. Blocking products score two points.
NEUTRALISED (+1) Products that kill all running malicious processes ‘neutralise’ the threat and win one point.
COMPLETE REMEDIATION (+1)
If, in addition to neutralising a threat, the product removes all significant traces of the attack, it gains an additional one point.
If the threat compromises the system, the product loses five points. This loss may be reduced to four points if it manages to detect the threat (see Detected, above), as this at least alerts the
user, who may now take steps to secure the system.
Protection ratings are then weighted, scoring products that protect against threats far higher than those that were compromised. This information is then scored as a percentage.
It’s important that any security product lets legitimate programs carry on without being blocked. After all, any AV software that proves too annoying to use will likely be turned off. Products were also tested to see how they dealt with false positives.
Again, there are degrees of success here. A product that blocks the latest version of Word was given a lower score than a product that blocked an obscure utility. How the information is presented to the user is also taken into account. It’s rare for security software to simply block software, and it will usually
ag up a warning with either a recommendation to block or continue.
All of this information is put together as a total accuracy rating, scored as a percentage, demonstrating the overall effectiveness of a product. We’ve graphed the total accuracy rating. We’ve also graphed each suite’s accuracy in identifying legitimate software, so you can see which are the best for avoiding annoying false positives.
SE Labs tested the current versions of products available, performing tests for a three month period. Typically, version upgrades don’t affect the performance of a product, but new features are added. Instead, most security software is updated at least daily to improve its threat detection and blocking.
For our reviews, we’ve used the best-value version of a product available. Typically, higher-cost suites just pile on the features and number of supported devices; lower-cost packages have the same basic protection.
Security software isn’t just about malware, and manufacturers have added lots of features over the years to cover all areas. Some add-ons are a waste of time; others are surprisingly useful. You’ll often get credential/password managers that integrate into your web browser. These can do some useful things, including generating impossibleto-guess passwords, auto lling password forms and auto lling other web forms, such as store checkouts. These are all protected by a master password known only by you.
Parental controls vary slightly, and aren’t available with all packages, but they let you set up lters for adult content, with preset
lters and customisable lists of URLs to block. Many of them also allow you to limit the time your children spend online.
Many of the packages we’ve reviewed this year have mobile versions available. Some packages include mobile as standard, but with many, protecting your smartphone or tablet requires an additional subscription. Generally available for Android, some also work on iOS.
It’s arguable how useful these products are, as mobile operating systems are well locked down, and apps are mostly available only through of cial stores, so it’s far harder to get a mobile virus. We don’t recommend prioritising mobile protection over desktop protection, and the mobile performance of each product has not been tested.
THE PRICE IS RIGHT
We’ve listed the of cial manufacturer’s pricing for each product, but you may be able to nd a better deal online by buying a boxed copy of a product. Don’t worry if the product you buy seems out of date, such as the 2017 version; all software will update to the latest current version on installation. You can used boxed software for future updates, too, rather than having to renew your licence through the manufacturer after a year.
“The last time we tested security suites, the lowest-rated product managed a protection rating of 88.1%; this year, the worst product managed just 48%”