The best endpoint security suite is...

The best endpoint security suite is...

Malicious software (malware) plays a central role in the continuing power struggle between the attackers and defenders of our computer systems. Therefore it is crucial to independently test the capabilities of the security products we trust to defend us.

There are many methods and techniques to test these products, various levels of configuration that can be applied, and multiple areas of potential focus. This report concentrates on two main security technology areas: out-of-the-box anti-malware detection (specifically virus and spyware detection) and default desktop firewall protection.

How we tested

System set-up: each test machine ran a fully updated and patched version of Microsoft Windows XP Professional (Service Pack 3). Security suites were then installed and updated to use the latest software versions. The solutions were tested using the default settings to ensure a fair and comparable test.

Anti-malware: all products were installed on separate identical hardware and software combinations using only default protection settings. All products were updated at the same date and time using a standard internet connection. The internet was disabled and physically disconnected following the update process to ensure that the products were frozen at a particular point. All products were completely isolated during testing.

Malware test sets were introduced to each product using standard inbound vectors, devices and protocols that included HTTP, SMTP/POP3, FTP, DVD and USB injection mechanisms to accurately represent real-world threats. Each test set also contained malware-free samples.

Firewall: solutions were tested in several areas, focusing on commonly used programs and services that require network access (internal and external). An external system was configured with various tools to identify potentially open ports on each endpoint. It is important to note that in a real-world deployment setting it is recommended that internal endpoints be protected by a separate corporate firewall at the network gateway, in line with good security practice. This testing, however, removed this layer of security in order to measure the effectiveness of the protection afforded by each desktop firewall. Ideally, it is expected that each firewall solution should deny ICMP requests and show all ports as closed or appropriately filtered. This helps protect against common network mapping techniques and automated probes during any pre-attack reconnaissance phase.

Advertisement

Talkback 13 comments

    Awesome Hi Tech! Eugene -- 03/11/09

    Wow! Hold onto these work experience kids that did this! Mind numbingly awesome tech and security work! Well done ZD. I wish this went on for another 10 pages at least. I just did not want this work to end!

    Feedback Renai LeMay -- 03/11/09 (in reply to #320390463)

    hey Eugene,

    please feel free to email me personally with any criticism about the article, happy to hear what we should do better.

    renai.lemay@zdnet.com.au

    Cheers,

    Renai LeMay
    News Editor
    ZDNet.com.au

    AVG Internet Security Business Edition 9.0 Craig Kensek -- 03/11/09

    AVG introduced Internet Security Business Edition 9.0 in late October. Among it's enhancements is an improved firewall. http://www.avg.com/us-en/product-avg-internet-security-business-edition for more information. An optimization scan capability has been added, as well, which improves future scans by up to 50% .

    Anti virus comparison story Anonymous -- 03/11/09

    I can only go from my point of view - working in the field, hands on, every day, as a freelancer.

    I consistently get money from Nortons who I love. Without them I wouldnt make as much money getting rid of viruses from infected machines with up to date and working Nortons on it. In my tests, I have found the best to be Sophos simply because I image the C drives and when they viruses are all gone, take time to write the image to a spare drive and have Sophos trial installed, AVG 9 free installed on another machine and have recently tried Kaspersky. Kaspersky found the least of those 3 with Trend and many other antiviruses (over months on different machines) installed. AVG free consistently found all but about 4 viruses and Sophos found the most.

    Even with all THAT, absolutely NONE of them, updated and working, found ALL of them. Quite often, I have detected unknown viruses and submitted them to be told they were new, to various companies. Sorry, but your tests are really not "real time". If you want real tests, you really ought to find people like me who are in the trenches all day and late into the night, often and get US to test the antiviruses for you, periodically. The truth is that you need MORE than an antivirus program if you think you have an infection that your current one doesnt detect AND you need the knowledge to find and eradicate unknown viruses, too. You wont learn THAT in any course available

    Awesome Anonymous -- 04/11/09

    Great article guys finally an impartial look at this field naming names! please keep it up. Ignore the manufacturer whinging here.

    Easily pleased... Anonymous -- 04/11/09 (in reply to #320390569)

    You are easily pleased. Why not just go get some brochures or checkout the websites from the tested vendors. It's about the same level of information and detail. There's nothing here. Did you write this review?

    Missed the point (and the detail) Anonymous -- 05/11/09 (in reply to #320390578)

    I think 'Easily pleased' has missed the point and the detail unfortunately. There are useful metrics and an impartial assessment of possible 'flaws' included that you obviously would not find in a vendor brochure, and no, I did not write the review (I simply read it thoroughly).

    Easily pleased Anonymous -- 06/11/09 (in reply to #320390685)

    @Missed the point, who are you addressing? Sounds like the world. :p I repeat, you are easily pleased. Either that or you are an awesome troll and I commend you for sucking me in.

    Copy from the product Carol -- 05/11/09 (in reply to #320390578)

    I agree with you. There's nothing here. May be Mr Ian just installed all these software and did a preview.

    No critical comment on the products ... it's just like the Gartner Magic Quadrant , every product is a magic ...

    Not 17 years experience of testing Sherron -- 05/11/09

    Hi...please don't spoil the name of RMIT ...

    The content does not really reflect the 17 years of testing experience from RMIT ....

    No One Following Links ? Anonymous -- 06/11/09

    Are you guys nuts?

    "Malware test sets were introduced to each product using standard inbound vectors, devices and protocols that included HTTP, SMTP/POP3, FTP, DVD and USB injection mechanisms to accurately represent real-world threats. Each test set also contained malware-free samples" and then the results ; http://www.zdnet.com.au/reviews/software/security/soa/The-best-endpoint-security-suite-is-/0,139023452,339299322-13,00.htm
    AV vendors will not promote those in their brochures, well none I have seen !

    Good Work ZDNet keep it up! Pete -- 10/11/09

    Even if a lot of people see this as a brochure or just scratching the surface, at least the results can show which AV software really doesn't stack up. I'm guessing anyone using Trend Micro and reading this will change immediately (If they are not rebuilding due to too many trojans already).
    I think this is a great indicator for people that do not want to spend too much time reviewing the products themselves to have a quick over view, all in one place.
    ...and by all means if you diagree this is a great forum to express your views, so don't hold back, or start flaming. Just tell us how it is in YHO.
    Great job guys!

    BTW - Malwarebytes.org Pete -- 10/11/09

    Hi Guys,
    Does anyone have an opinion on malwarebytes.org? I've found that it can detect and repair toor kit viruses that other products don't pick up. So I run a scan with this tool once per month or so, just in case. I also run AVG as my everyday virus detector, and ZoneAlarm for the firewall.
    Any opinions on this setup?

Add your opinion

Back to top

Featured