Test Lab: SE Labs Logo
Test Title: “Q1 2018 Endpoint Protection: Enterprise, Small Business, and Consumer”
AMTSO Test ID: AMTSO-PP1-TP201

  • Statement from Test Lab:

    March 2018 – Endpoint Protection
    Enterprise, Small Business, and Consumer

    SE Labs tests a variety of endpoint security products from a range of well-known vendors in an effort to judge which were the most effective.  Each enterprise, small business, or consumer class product are exposed to the same threats, which are a mixture of targeted attacks using well-established techniques, public email,  and web-based threats that are known or found to be live on the internet at the time of the test.  The Test Reports indicate how effectively the products were at detecting and/or protecting against those threats in real time.

    Compliance Status: CONFIRMED COMPLIANT with Draft Standard v6.1

    Publication Date: May 9, 2018

    Published Test Report (Enterprise – PDF)

    Published Test Report (Small Business – PDF)

    Published Test Report (Consumer – PDF)

    Participation information
    Test Subject Vendor Status Phase 1 Feedback Attestations Comments (Phase 1) Phase 2 feedback Comments (Phase 2)
    Avast PARTICIPANT Completed Completed None None None
    AVG PARTICIPANT Completed Completed None None None
    Avira INCLUDED None None None SUBMITTED SUBMITTED
    Bitdefender INCLUDED None None None None None
    Bullguard INCLUDED None None None None None
    Check Point INCLUDED None None None None None
    CrowdStrike PARTICIPANT None (Waived) None SUBMITTED SUBMITTED
    ESET PARTICIPANT Completed Completed None None None
    F-Secure INCLUDED None None None None None
    Kaspersky Lab PARTICIPANT None (Waived) None NO ISSUES None
    Malwarebytes INCLUDED None None None None None
    Microsoft PARTICIPANT None (Waived) None NO ISSUES None
    Panda PARTICIPANT Completed Completed None None None
    Sophos PARTICIPANT Completed Completed None NO ISSUES None
    Symantec PARTICIPANT None (Waived) None NO ISSUES None
    Trend Micro INCLUDED None None None None None
    Webroot PARTICIPANT None (Waived) None NO ISSUES SUBMITTED
    Notable Commentary:

    AVIRA:
    “Avira did not participate as a voluntary in this test.”
    “Avira has not received any preliminary information regarding the test results, therefore we cannot take a position. Therefore we choose the first option, so far there are no issues known.”

    CROWDSTRIKE:
    “The test appeared to deviate from the planned schedule due to delays in communication, but with appropriate adjustments for our response.”
    “Communication is relevant and fair, but the timeliness needs improvement. There were regular delays in responses from the tester.”
    “The timeliness of communication could use improvement.”
    “Due to delays in communication and test execution we are still waiting for the post-dispute details of the tests.”

    WEBROOT:
    “As discussed with Simon, Webroot will have commentary placed at the end of the test stating that testing took place prior to the release of new script and anti-exploit features in WSA.”

    See feedback tab for full details of feedback and Commentary.

  • Notification date: December 20, 2017
    Test plan shared on notification

    Test Plan

    Commencement date: January 5, 2018
    Phase 1 Commentary Completion Date: February 1, 2018
    Completion date (expected): April 2, 2018
    Completion date (actual): April 16, 2018
    Phase 2 Commentary Completion Date: May 4, 2018
    Publication date: May 9, 2018
    Compliance confirmed date: May 10, 2018

    Published Test Report (Enterprise – PDF)

    Published Test Report (Small Business – PDF)

    Published Test Report (Consumer – PDF)

  • Test component: “Home Anti-Malware Protection Jan-Mar 2018”:

    Avast Free Antivirus
    AVG Antivirus Free Edition
    Avira Free Security Suite
    Bitdefender Internet Security
    Bullguard Internet Security
    Check Point ZoneAlarm
    ESET Smart Security
    F-Secure Safe
    Kaspersky Internet Security
    Microsoft Windows Defender
    Symantec Norton Security
    Trend Micro Internet Security
    Webroot Antivirus

    Test component: “Small Business Endpoint Protection“:

    ESET Endpoint Security
    Kaspersky Small Office Security
    Malwarebytes Endpoint Security
    Microsoft System Center Endpoint Protection
    Panda Endpoint Protection
    Sophos Central Endpoint
    Symantec Endpoint Protection Cloud
    Trend Micro Worry Free Security Services
    Webroot SecureAnywhere Endpoint Protection

    Test component: “Enterprise Endpoint Protection“:

    Crowdstrike Falcon
    ESET Endpoint Security
    Kaspersky Endpoint Security
    Malwarebytes Endpoint Security
    Microsoft System Center Endpoint Protection
    Panda Endpoint Protection
    Sophos Central Endpoint
    Symantec Endpoint Securityn Enterprise Edition
    Trend Micro OfficeScan, Intrusion Defense Firewall
    Webroot SecureAnywhere Endpoint Protection

  • Phase 1 Commentary Completion Date: February 1, 2018
    Phase 2 Commentary Completion Date: May 4, 2018

    Avast

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    AVG

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Avira

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: SOME ITEMS MARKED AS LESS THAN SATISFACTORY

    Commentary (Phase 2): COMMENTARY SUBMITTED as follows:

    Configuration checks: I was not offered an opportunity to audit the configuration of my product
    Comments on the configuration audit process: “Avira did not participate as a voluntary in this test.”
    Adherence to the test plan: I confirm that, to the best of my knowledge, the tester followed the published test plan throughout
    Comments on the tester’s adherence to the test plan: “Avira has not received any preliminary information regarding the test results, therefore we cannot take a position. Therefore we choose the first option, so far there are no issues known.”
    Communications: I confirm that all communications between the tester and my company were handled in a timely, relevant and fair manner
    Comments on communications: “This statement refers to the announcement and information we received before the test.”
    Feedback and disputes: I was not given an opportunity to review and dispute the test data
    Comments on the feedback and dispute processes: “Avira did not participate as a voluntary in this test.”

    Bitdefender

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Bullguard

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Check Point

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    CrowdStrike

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Tester waived attestation requirements)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: SOME ITEMS MARKED AS LESS THAN SATISFACTORY

    Commentary (Phase 2): COMMENTARY SUBMITTED as follows:

    Adherence to the test plan: I am aware of one or more deviations from the original test plan, but I consider these deviations to be appropriate and acceptable
    Comment on the tester’s adherence to the test plan: “The test appeared to deviate from the planned schedule due to delays in communication, but with appropriate adjustments for our response.”
    Communications: I have some issues with the way communications between the tester and my company were handled
    Comment on communications: “Communication is relevant and fair, but the timeliness needs improvement. There were regular delays in responses from the tester.”
    Feedback and disputes: I was given an opportunity to review and dispute the test data, but there were issues with the process
    Comments on the feedback and dispute processes: “The timeliness of communication could use improvement.”
    Other comments on the execution of this test: “Due to delays in communication and test execution we are still waiting for the post-dispute details of the tests.”

    ESET

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    F-Secure

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Kaspersky Lab

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Tester waived attestation requirements)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Malwarebytes

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Microsoft

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Tester waived attestation requirements)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Panda

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Sophos

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Symantec

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Tester waived attestation requirements)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Trend Micro

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Webroot

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Tester waived attestation requirements)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): COMMENTARY SUBMITTED as follows:

    Other comments on the execution of this test: “As discussed with Simon, Webroot will have commentary placed at the end of the test stating that testing took place prior to the release of new script and anti-exploit features in WSA.”

  • Compliance status: CONFIRMED COMPLIANT with Draft Standard v6.1 – 2018-05-10

    Compliance Report