Test Lab: SE Labs Logo
Test Title: SE Labs Q4 2019 Endpoint Protection: Enterprise, Small Business, and Consumer
AMTSO Test ID: AMTSO-LS1-TP016

  • Statement from Test Lab:

    “October-December 2019 – Endpoint Protection Enterprise, Small Business, and Consumer

    SE Labs tests a variety of endpoint security products from a range of well-known vendors in an effort to judge which were the most effective. Each enterprise, small business, or consumer class product are exposed to the same threats, which are a mixture of targeted attacks using well-established techniques, public email, and web-based threats that are known or found to be live on the internet at the time of the test. The Test Reports indicate how effectively the products were at detecting and/or protecting against those threats in real time.”

    Test Plan

    Participants: 15
    These Vendors chose to adopt Participant status under the AMTSO Standard, gaining certain guaranteed rights in return for attestations

    “Included” Vendors: 17
    These Vendors did not chose to adopt Participant status under the AMTSO Standard, but may have engaged with the test lab in other ways

    Compliance Status: Confirmed compliant with AMTSO Standard v1.2

    Published test Report (Consumer)

    Published test Report (SMB)

    Published test Report (Enterprise)

    Publication Date: 2019-12-23

    Participation information
    Consumer Product title Status Phase 1 Feedback Attestations Comments (Phase 1) Phase 2 feedback Comments (Phase 2)
    AVAST Free Antivirus PARTICIPANT Completed Completed None Completed Submitted
    AVG Antivirus Free Edition PARTICIPANT Completed Completed None Completed Submitted
    Avira Free Security Suite PARTICIPANT None (Waived) None Completed None
    Check Point ZoneAlarm INCLUDED None None None None None
    Comodo Internet Security Premium INCLUDED None None None None None
    ESET Internet Security INCLUDED None None None None None
    F-Secure Safe INCLUDED Completed None None Completed None
    Kaspersky Internet Security PARTICIPANT None (Waived) None Completed None
    McAfee Internet Security PARTICIPANT None (Waived) None None None
    Microsoft Windows Defender PARTICIPANT None (Waived) None None None
    NANO Antivirus Pro INCLUDED None None None None None
    Sophos Home Premium PARTICIPANT None (Waived) None Completed None
    Symantec Norton Security PARTICIPANT None (Waived) None None None
    Trend Micro Internet Security INCLUDED None None None None None
    Webroot Antivirus INCLUDED None None None None None
    SMB
    BitDefender Gravity Zone Endpoint Security INCLUDED None None None None None
    ESET Endpoint Security INCLUDED None None None None None
    Kaspersky Small Office Security PARTICIPANT None (Waived) None Completed None
    McAfee Endpoint Security PARTICIPANT None (Waived) None None None
    Microsoft Windows Defender ATP’s Antivirus PARTICIPANT None (Waived) None None None
    Sophos Intercept X PARTICIPANT None (Waived) None Completed None
    Symantec Endpoint Protection Cloud PARTICIPANT None (Waived) None None None
    Trend Micro Worry Free Security Services INCLUDED None None None None None
    VIPRE Endpoint Security INCLUDED None None None None None
    Enterprise
    BitDefender Gravity Zone Endpoint Security INCLUDED None None None None None
    Crowdstrike Falcon PARTICIPANT None (Waived) None Completed None
    ESET Endpoint Security INCLUDED None None None None None
    Kaspersky Endpoint Security PARTICIPANT None (Waived) None Completed None
    McAfee Endpoint Security PARTICIPANT None (Waived) None None None
    Microsoft Windows Defender ATP’s Antivirus PARTICIPANT None (Waived) None None None
    SentinelOne Endpoint Protection Platform INCLUDED None None None None None
    Sophos Intercept X PARTICIPANT None (Waived) None Completed None
    Symantec Endpoint Security Enterprise Edition PARTICIPANT None (Waived) None None None
    Trend Micro OfficeScan, Intrusion Defense Firewall INCLUDED None None None None None
    VIPRE Endpoint Security INCLUDED None None None None None
    Webroot SecureAnywhere Endpoint Protection INCLUDED None None None None None
    Notable Commentary:

    Avast/AVG (Phase 2):

    “I did not receive info that the dispute phase started.”

    Response from test lab:

    “SE Labs provide a free dispute process and provides relevant data on request from any vendor in the test. Vendors are notified about the start of the dispute process by AMTSO as part of the Standard certification process and need to take the initiative to request the dispute data. In this case, as soon as SE Labs became aware that Avast wanted the data, after the disputes deadline had passed, the data was provided.“

  • Notification date: 2019-09-16
    Notification method: Publicly posted Test Plan, Contact List announcement

    Test Plan

    Commencement date: 2019-09-17

    Phase 1 Commentary dates: 2019-09-25 – 2019-10-02
    Phase 2 Commentary dates: 2019-12-09 – 2019-12-17

    Publication date: 2019-12-23

    Published test Report (Consumer)

    Published test Report (SMB)

    Published test Report (Enterprise)

  • SE Labs “Q4 2019 Endpoint Protection: Enterprise, Small Business, and Consumer” covers the following products:

    Test component: “Home Anti-Malware Protection“:

    AVAST Free Antivirus
    AVG Antivirus Free Edition
    Avira Free Security Suite
    Check Point ZoneAlarm Free Antivirus
    Comodo Internet Security Premium
    ESET Internet Security
    F-Secure Safe
    Kaspersky Internet Security
    McAfee Internet Security
    Microsoft Windows Defender
    NANO Antivirus Pro
    Sophos Home Premium
    Symantec Norton Security
    Trend Micro Internet Security
    Webroot SecureAnywhere Endpoint Protection

    Test component: “Small Business Endpoint Protection“:

    BitDefender Gravity Zone Endpoint Security
    ESET Endpoint Security
    Kaspersky Small Office Security
    McAfee Endpoint Security
    Microsoft Windows Defender Enterprise
    Sophos Intercept X Advanced
    Symantec Endpoint Protection Cloud
    Trend Micro Worry Free Security Services
    VIPRE Endpoint Security

    Test component: “Enterprise Endpoint Protection“:

    BitDefender Gravity Zone Endpoint Security
    Crowdstrike Falcon
    ESET Endpoint Security
    Kaspersky Endpoint Security
    McAfee Endpoint Security
    Microsoft Windows Defender Enterprise
    SentinelOne Endpoint Protection Platform
    Sophos Intercept X Advanced
    Symantec Endpoint Security Enterprise Edition
    Trend Micro OfficeScan, Intrusion Defense Firewall
    VIPRE Endpoint Security
    Webroot SecureAnywhere Endpoint Protection

  • Phase 1 Commentary dates: 2019-09-25 – 2019-10-02
    Phase 2 Commentary dates: 2019-12-09 – 2019-12-17
    Commentary received:

    Avast

    Test Components covered: Home

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: SOME ITEMS MARKED AS LESS THAN SATISFACTORY

    Commentary (Phase 2): COMMENTARY SUBMITTED as follows:

    “I did not receive info that the dispute phase started.”

    Response from test lab:

    “SE Labs provide a free dispute process and provides relevant data on request from any vendor in the test. Vendors are notified about the start of the dispute process by AMTSO as part of the Standard certification process and need to take the initiative to request the dispute data. In this case, as soon as SE Labs became aware that Avast wanted the data, after the disputes deadline had passed, the data was provided.”

    AVG

    Test Components covered: Home

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: SOME ITEMS MARKED AS LESS THAN SATISFACTORY

    Commentary (Phase 2): COMMENTARY SUBMITTED as follows:

    “I did not receive info that the dispute phase started.”

    Response from test lab:

    “SE Labs provide a free dispute process and provides relevant data on request from any vendor in the test. Vendors are notified about the start of the dispute process by AMTSO as part of the Standard certification process and need to take the initiative to request the dispute data. In this case, as soon as SE Labs became aware that Avast wanted the data, after the disputes deadline had passed, the data was provided.”

    Avira

    Test Components covered: Home

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    BitDefender

    Test Components covered: SMB, Enterprise

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Check Point

    Test Components covered: Home

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Comodo

    Test Components covered: Home

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    CrowdStrike

    Test Components covered: Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO RESPONSE (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    ESET

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    F-Secure

    Test Components covered: Home

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Kaspersky Lab

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO RESPONSE (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    McAfee

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Microsoft

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    NANO

    Test Components covered: Home

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    SentinelOne

    Test Components covered: Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Sophos

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Symantec

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Trend Micro

    Test Components covered: Home, SMB, Enterprise

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    VIPRE

    Test Components covered: SMB, Enterprise

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Webroot

    Test Components covered: SMB, Enterprise

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

  • Compliance Status: Confirmed compliant with AMTSO Standard v1.2

    Compliance report