Test Lab: SE Labs Logo
Test Title: SE Labs Q4 2018 Endpoint Protection: Enterprise, Small Business, and Consumer
AMTSO Test ID: AMTSO-LS1-TP004

  • Statement from Test Lab:

    “September-December 2018 – Endpoint Protection
    Enterprise, Small Business, and Consumer

    SE Labs tests a variety of endpoint security products from a range of well-known vendors in an effort to judge which were the most effective. Each enterprise, small business, or consumer class product are exposed to the same threats, which are a mixture of targeted attacks using well-established techniques, public email, and web-based threats that are known or found to be live on the internet at the time of the test. The Test Reports indicate how effectively the products were at detecting and/or protecting against those threats in real time.”

    Test Plan

    Participants: 16
    These Vendors chose to adopt Participant status under the AMTSO Standard, gaining certain guaranteed rights in return for attestations

    “Included” Vendors: 20
    These Vendors did not chose to adopt Participant status under the AMTSO Standard, but may have engaged with the test lab in other ways

    Compliance Status: Confirmed compliant with AMTSO Standard v1.1

    Published test Report (Consumer)

    Published test Report (SMB)

    Published test Report (Enterprise)

    Publication Date: 2019-02-08

    Participation information
    Consumer Product title Status Phase 1 Feedback Attestations Comments (Phase 1) Phase 2 feedback Comments (Phase 2)
    AVAST Avast Free Antivirus PARTICIPANT COMPLETED COMPLETED None COMPLETED None
    AVG AVG Antivirus Free Edition PARTICIPANT COMPLETED COMPLETED None COMPLETED None
    Avira Avira Free Security Suite PARTICIPANT COMPLETED COMPLETED None COMPLETED None
    ESET ESET Smart Security PARTICIPANT COMPLETED COMPLETED None COMPLETED None
    F-Secure SecureSafe INCLUDED None None None None None
    G-Data G-Data Internet Security INCLUDED None None None None None
    Kaspersky Lab Kaspersky Internet Security PARTICIPANT COMPLETED COMPLETED None COMPLETED None
    K7 Computing Antivirus Premium INCLUDED None None None COMPLETED SUBMITTED
    McAfee McAfee Internet Security INCLUDED None None None None None
    Microsoft Windows Defender INCLUDED None None None None None
    Quick Heal Internet Security INCLUDED None None None None None
    Symantec Norton Security PARTICIPANT None (Waived) None COMPLETED None
    Trend Micro Trend Micro Internet Security INCLUDED COMPLETED None SUBMITTED None None
    Webroot Webroot Antivirus INCLUDED None None None None None
    SMB
    BitDefender Gravity Zone Endpoint Security PARTICIPANT COMPLETED COMPLETED None None None
    ESET ESET Endpoint Security PARTICIPANT COMPLETED COMPLETED None COMPLETED None
    Kaspersky Lab Kaspersky Small Office Security PARTICIPANT COMPLETED COMPLETED None COMPLETED None
    MalwareBytes MalwareBytes Endpoint Security INCLUDED None None None None None
    McAfee Small Business INCLUDED None None None None None
    Microsoft Windows Defender ATP’s Antivirus INCLUDED None None None None None
    Sophos Sophos Intercept X Advanced PARTICIPANT COMPLETED COMPLETED None COMPLETED None
    Symantec Symantec Endpoint Protection Cloud PARTICIPANT None (Waived) None COMPLETED None
    Trend Micro Trend Micro Worry Free Security Services INCLUDED COMPLETED None SUBMITTED None None
    Trustport Antivirus for Business INCLUDED None None None None None
    Webroot Secure Anywhere Endpoint Protection INCLUDED None None None None None
    Enterprise
    BitDefender Gravity Zone Endpoint Security PARTICIPANT COMPLETED COMPLETED None None None
    Crowdstrike Crowdstrike Falcon INCLUDED None None None None None
    ESET ESET Endpoint Security PARTICIPANT COMPLETED COMPLETED None COMPLETED None
    Kaspersky Lab Kaspersky Endpoint Security PARTICIPANT COMPLETED COMPLETED None COMPLETED None
    MalwareBytes MalwareBytes Endpoint Security INCLUDED None None None None None
    McAfee McAfee Endpoint Security INCLUDED None None None None None
    Microsoft Windows Defender ATP’s Antivirus INCLUDED None None None None None
    Sophos Sophos Intercept X Advanced PARTICIPANT COMPLETED COMPLETED None COMPLETED None
    Symantec Symantec Endpoint Security Enterprise Edition PARTICIPANT None (Waived) None COMPLETED None
    Trend Micro Trend Micro OfficeScan, Intrusion Defense Firewall INCLUDED COMPLETED None SUBMITTED None None
    Trustport Antivirus for Business INCLUDED None None None None None
    Notable Commentary:

    K7 Computing (Phase 2):

    We were neither given the opportunity to adopt participant status nor were we provided with any opportunity to verify the test results for our product before they were published. Since we were not provided the opportunity to participate in the test the tester of its own accord chose the most basic K7 product which would be at a distinct disadvantage given the nature of the test as described in the test plan. We at K7 have already communicated to the tester that our K7 Total Security product, with an additional web protection feature, would have faired far better in the same test.

    AMTSO Note: AMTSO has confirmed that K7 Computing was provided with proper notification of this test, along with an invitation to provide Commentary and options to adopt Participant status.

  • Notification date: 2018-09-19
    Notification method: Publicly posted Test Plan, Contact List announcement

    Test Plan

    Commencement date: 2018-09-24

    Phase 1 Commentary dates: 2018-11-08 – 2018-11-19
    Phase 2 Commentary dates: 2019-02-08 – 2019-02-18

    Publication date: 2019-02-08

    Published test Report (Consumer)

    Published test Report (SMB)

    Published test Report (Enterprise)

  • SE Labs “Q4 2018 Endpoint Protection: Enterprise, Small Business, and Consumer” covers the following products:

    Test component: “Home Anti-Malware Protection Sep-Dec 2018“:

    AVAST Avast Free Antivirus
    AVG AVG Antivirus Free Edition
    Avira Avira Free Security Suite
    ESET ESET Internet Security
    F-Secure SecureSafe
    G-Data G-Data Internet Security
    Kaspersky Lab Kaspersky Internet Security
    K7 Computing Antivirus Premium
    McAfee McAfee Internet Security
    Microsoft Windows Defender
    Quick Heal Quick Heal Internet Security
    Symantec Norton Security
    Trend Micro Trend Micro Internet Security
    Webroot Webroot Antivirus

    Test component: “Small Business Endpoint Protection“:

    Bitdefender Bitdefender GravityZone Endpoint Security
    ESET ESET Endpoint Security
    Kaspersky Lab Kaspersky Small Office Security
    MalwareBytes MalwareBytes Endpoint Security
    McAfee McAfee Small Business
    Microsoft Microsoft System Center Endpoint Protection
    Sophos Intercept X Advanced
    Symantec Symantec Endpoint Protection Cloud
    Trend Micro Trend Micro Worry Free Security Services
    Trustport Trustport Antivirus for Business
    Webroot Webroot SecureAnywhere Endpoint

    Test component: “Enterprise Endpoint Protection“:

    Bitdefender Bitdefender GravityZone Endpoint Security
    Crowdstrike Crowdstrike Falcon
    ESET ESET Endpoint Security
    Kaspersky Lab Kaspersky Endpoint Security
    MalwareBytes MalwareBytes Endpoint Security
    McAfee McAfee Endpoint Security
    Microsoft Microsoft System Center Endpoint Protection
    Sophos Sophos Central Endpoint
    Symantec Symantec Endpoint Security Enterprise Edition
    Trend Micro Trend Micro OfficeScan, Intrusion Defense Firewall
    Trustport Antivirus for Business

  • Phase 1 Commentary dates: 2018-11-08 – 2018-11-19
    Phase 2 Commentary dates: 2019-02-08 – 2019-02-18

    Commentary received:

    Avast

    Test Components covered: Home

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    AVG

    Test Components covered: Home

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Avira

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    BitDefender

    Test Components covered: SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    CrowdStrike

    Test Components covered: Enterprise

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    ESET

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    F-Secure

    Test Components covered: Home

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    G Data

    Test Components covered: Home

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    K7 Computing

    Test Components covered: Home

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: COMPLETED

    COMMENTARY SUBMITTED as follows:

    We were neither given the opportunity to adopt participant status nor were we provided with any opportunity to verify the test results for our product before they were published. Since we were not provided the opportunity to participate in the test the tester of its own accord chose the most basic K7 product which would be at a distinct disadvantage given the nature of the test as described in the test plan. We at K7 have already communicated to the tester that our K7 Total Security product, with an additional web protection feature, would have faired far better in the same test.

    Kaspersky Lab

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    MalwareBytes

    Test Components covered: SMB, Enterprise

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    McAfee

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Microsoft

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Quick Heal

    Test Components covered: Home

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Sophos

    Test Components covered: SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Symantec

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Trend Micro

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    COMMENTARY SUBMITTED as follows:

    We are unable to commit the full 100% resource to participate in this test. In such cases we will offer the recommended customer use-case configuration which is as close to real-world scenario and not the out-of-box configuration on stand-alone nonintegrated network defense posture. We thank SE Labs for the open communication and offered opportunity to participate in a future iteration.

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Trustport

    Test Components covered: SMB, Enterprise

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Webroot

    Test Components covered: Home, SMB

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

  • Compliance Status: Confirmed compliant with AMTSO Standard v1.1

    Compliance report