Test Lab: SE Labs Logo
Test Title: SE Labs Q3 2019 Endpoint Protection: Enterprise, Small Business, and Consumer
AMTSO Test ID: AMTSO-LS1-TP012

  • Statement from Test Lab:

    “July-September 2019 – Endpoint Protection Enterprise, Small Business, and Consumer

    SE Labs tests a variety of endpoint security products from a range of well-known vendors in an effort to judge which were the most effective. Each enterprise, small business, or consumer class product are exposed to the same threats, which are a mixture of targeted attacks using well-established techniques, public email, and web-based threats that are known or found to be live on the internet at the time of the test. The Test Reports indicate how effectively the products were at detecting and/or protecting against those threats in real time.”

    Test Plan

    Participants: 25
    These Vendors chose to adopt Participant status under the AMTSO Standard, gaining certain guaranteed rights in return for attestations

    “Included” Vendors: 9
    These Vendors did not chose to adopt Participant status under the AMTSO Standard, but may have engaged with the test lab in other ways

    Compliance Status: Confirmed compliant with AMTSO Standard v1.1

    Published test Report (Consumer)

    Published test Report (SMB)

    Published test Report (Enterprise)

    Publication Date: 2019-10-04

    Participation information
    Consumer Product title Status Phase 1 Feedback Attestations Comments (Phase 1) Phase 2 feedback Comments (Phase 2)
    AVAST Free Antivirus PARTICIPANT Completed Completed None Completed None
    AVG Antivirus Free Edition PARTICIPANT Completed Completed None Completed None
    Avira Free Security Suite PARTICIPANT Completed Completed None Completed None
    Check Point ZoneAlarm INCLUDED Completed None Submitted None None
    Comodo Internet Security Premium INCLUDED None None None None None
    ESET Internet Security PARTICIPANT None (Waived) None None None
    F-Secure Safe INCLUDED Completed None None Completed None
    G-Data Internet Security INCLUDED None None None None None
    Kaspersky Internet Security PARTICIPANT Completed Completed None Completed None
    McAfee Internet Security PARTICIPANT None (Waived) None None None
    Microsoft Windows Defender PARTICIPANT None (Waived) None None None
    Sophos Home Premium PARTICIPANT Completed Completed None Completed None
    Symantec Norton Security PARTICIPANT None (Waived) None None None
    Trend Micro Internet Security INCLUDED None None None None None
    Webroot Internet Security INCLUDED None None None None None
    SMB
    BitDefender Gravity Zone Endpoint Security PARTICIPANT Completed Completed None None None
    ESET Endpoint Security PARTICIPANT None (Waived) None None None
    Kaspersky Small Office Security PARTICIPANT Completed Completed None Completed None
    McAfee Endpoint Security PARTICIPANT None (Waived) None None None
    Microsoft Windows Defender ATP’s Antivirus PARTICIPANT None (Waived) None None None
    Sophos Intercept X PARTICIPANT Completed Completed None Completed None
    Symantec Endpoint Protection Cloud PARTICIPANT None (Waived) None None None
    Trend Micro Worry Free Security Services INCLUDED None None None None None
    VIPRE Endpoint Security INCLUDED None None None None None
    Enterprise
    BitDefender Gravity Zone Endpoint Security PARTICIPANT None (Waived) None None None
    Crowdstrike Falcon PARTICIPANT Completed Completed None Completed None
    ESET Endpoint Security PARTICIPANT None (Waived) None None None
    Kaspersky Endpoint Security PARTICIPANT Completed Completed None Completed None
    McAfee Endpoint Security PARTICIPANT None (Waived) None None None
    Microsoft Windows Defender ATP’s Antivirus PARTICIPANT None (Waived) None None None
    Sophos Intercept X PARTICIPANT Completed Completed None Completed None
    Symantec Endpoint Security Enterprise Edition PARTICIPANT None (Waived) None None None
    Trend Micro OfficeScan, Intrusion Defense Firewall INCLUDED None None None None None
    VIPRE Endpoint Security INCLUDED None None None None None
    Notable Commentary:

    Check Point (Phase 1):

    “There was zero communication received prior to the testing. (Not taking into account “Call for Phase 1 Commentary” email received from Amtso). In the case of better communication, we are open to change our participation position.“

  • Notification date: 2019-06-11
    Notification method: Publicly posted Test Plan, Contact List announcement

    Test Plan

    Commencement date: 2019-06-24

    Phase 1 Commentary dates: 2019-06-24 – 2019-07-02
    Phase 2 Commentary dates: 2019-10-09 – 2019-10-16

    Publication date: 2019-10-06

    Published test Report (Consumer)

    Published test Report (SMB)

    Published test Report (Enterprise)

  • SE Labs “Q3 2019 Endpoint Protection: Enterprise, Small Business, and Consumer” covers the following products:

    Test component: “Home Anti-Malware Protection“:

    AVAST Free Antivirus
    AVG Antivirus Free Edition
    Avira Free Security Suite
    Check Point ZoneAlarm Free Antivirus
    Comodo Internet Security Premium
    ESET Internet Security
    F-Secure Safe
    G-Data Internet Security
    Kaspersky Internet Security
    McAfee Internet Security
    Microsoft Windows Defender
    Sophos Home Premium
    Symantec Norton Security
    Trend Micro Internet Security
    Webroot Antivirus

    Test component: “Small Business Endpoint Protection“:

    BitDefender Gravity Zone Endpoint Security
    ESET Endpoint Security
    Kaspersky Small Office Security
    McAfee Endpoint Security
    Microsoft Windows Defender Enterprise
    Sophos Intercept X Advanced
    Symantec Endpoint Protection Cloud
    Trend Micro Worry Free Security Services
    VIPRE Endpoint Security

    Test component: “Enterprise Endpoint Protection“:

    BitDefender Gravity Zone Endpoint Security
    Crowdstrike Falcon
    ESET Endpoint Security
    Kaspersky Endpoint Security
    McAfee Endpoint Security
    Microsoft Windows Defender Enterprise
    Sophos Intercept X Advanced
    Symantec Endpoint Security Enterprise Edition
    Trend Micro OfficeScan, Intrusion Defense Firewall
    VIPRE Endpoint Security

  • Phase 1 Commentary dates: 2019-06-24 – 2019-07-02
    Phase 2 Commentary dates: 2019-10-09 – 2019-10-16
    Commentary received:

    Avast

    Test Components covered: Home

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    AVG

    Test Components covered: Home

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Avira

    Test Components covered: Home

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    BitDefender

    Test Components covered: SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Check Point

    Test Components covered: Home

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): COMMENTARY SUBMITTED as follows:

    “There was zero communication received prior to the testing. (Not taking into account “Call for Phase 1 Commentary” email received from Amtso). In the case of better communication, we are
    open to change our participation position.    ”

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Comodo

    Test Components covered: Home

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    CrowdStrike

    Test Components covered: Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    ESET

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    F-Secure

    Test Components covered: Home

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    G Data

    Test Components covered: Home

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Kaspersky Lab

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    McAfee

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Microsoft

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Sophos

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Symantec

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Trend Micro

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    VIPRE

    Test Components covered: SMB, Enterprise

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

  • Compliance Status: Confirmed compliant with AMTSO Standard v1.1

    Compliance report