Test Lab: MRG Effitas Logo
Test Title: MRG Effitas Q4 2019 360 Degree Assessment and Certification
AMTSO Test ID: AMTSO-LS1-TP018

  • Statement from Test Lab:

    “A first-of-its-kind test that covers all angles, our pioneering 360 Degree Protection Test targets the key threats faced by internet users. In each test case we employ the full spectrum of Early Life Malware. We use a Time-To-Detect metric to measure how long it takes each application to detect and neutralize missed threats.”

    Test Plan

    Participants: 8
    These Vendors chose to adopt Participant status under the AMTSO Standard, gaining certain guaranteed rights in return for attestations

    “Included” Vendors: 4
    These Vendors did not chose to adopt Participant status under the AMTSO Standard, but may have engaged with the test lab in other ways

    Compliance Status: Confirmed compliant with AMTSO Standard v1.2

    Published test Report

    Publication Date: 2020-01-31

    Participation information
    Vendor Status Phase 1 Feedback Attestations Comments (Phase 1) Phase 2 feedback Comments (Phase 2)
    Avast PARTICIPANT None (Waived) None Completed None
    Avira PARTICIPANT None (Waived) None Completed None
    BitDefender PARTICIPANT None (Waived) None None None
    CrowdStrike PARTICIPANT None (Waived) None None None
    ESET INCLUDED None None None None None
    F-Secure PARTICIPANT None (Waived) None Completed None
    Kaspersky PARTICIPANT None (Waived) None Completed None
    Microsoft INCLUDED None None None None None
    McAfee INCLUDED None None None None None
    Sophos PARTICIPANT None (Waived) None Completed Submitted
    Symantec PARTICIPANT None (Waived) None None None
    Trend Micro INCLUDED None None None None None
    Notable Commentary

    Sophos (Phase 2):

    “While we received preliminary results with an opportunity to dispute, we did not receive any acknowledgement of our disputes and it appears as if they were ignored/rejected without any feedback. We’ve reached out directly to MRG to try and understand where the failure occurred and find a solution to the problem.”

    AMTSO note: Discussion between commenting vendor and test lab facilitated by AMTSO, communication issues settled amicably.

  • Test Plan

    Notification date: 2019-10-15
    Notification method: Publicly posted test plan, Contact List notice

    Commencement date: 2019-10-23

    Phase 1 Commentary dates: 2019-10-21 – 2019-10-28
    Phase 2 Commentary dates: 2020-02-10 – 2020-02-17

    Publication date: 2020-01-31

    Published test Report

  • MRG Effitas “Q4 2019 360 Degree Assessment and Certification” (ID AMTSO-LS1-TP018) covered the following products:

    Avast Business Antivirus
    Avira Antivirus Pro
    BitDefender Endpoint Security
    CrowdStrike Falcon Protect
    ESET Endpoint Security
    F-Secure Computer Protection Premium
    Kaspersky Small Office Security
    McAfee Endpoint Security
    Microsoft Windows Defender
    Sophos Intercept X
    Symantec Endpoint Protection Cloud
    Trend Micro Worry-Free Business Security

  • Phase 1 Commentary dates: 2019-10-21 – 2019-10-28
    Phase 2 Commentary dates: 2020-02-10 – 2020-02-17

    Commentary received:

    • Avast

      Vendor Status: PARTICIPANT

      Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

      Commentary (Phase 1): NO COMMENTARY SUBMITTED

      Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

      Commentary (Phase 2): NO COMMENTARY SUBMITTED

    • Avira

      Vendor Status: PARTICIPANT

      Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

      Commentary (Phase 1): NO COMMENTARY SUBMITTED

      Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

      Commentary (Phase 2): NO COMMENTARY SUBMITTED

    • Bitdefender

      Vendor Status: PARTICIPANT

      Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

      Commentary (Phase 1): NO COMMENTARY SUBMITTED

      Vendor Confirmation Status: NO RESPONSE

      Commentary (Phase 2): NO COMMENTARY SUBMITTED

    • CrowdStrike

      Vendor Status: PARTICIPANT

      Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

      Commentary (Phase 1): NO COMMENTARY SUBMITTED

      Vendor Confirmation Status: NO RESPONSE

      Commentary (Phase 2): NO COMMENTARY SUBMITTED

    • Eset

      Vendor Status: INCLUDED

      Vendor Attestation Status: NO ATTESTATIONS PROVIDED

      Commentary (Phase 1): NO COMMENTARY SUBMITTED

      Vendor Confirmation Status: NO RESPONSE

      Commentary (Phase 2): NO COMMENTARY SUBMITTED

    • F-Secure

      Vendor Status: PARTICIPANT

      Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

      Commentary (Phase 1): NO COMMENTARY SUBMITTED

      Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

      Commentary (Phase 2): NO COMMENTARY SUBMITTED

    • Kaspersky Lab

      Vendor Status: PARTICIPANT

      Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

      Commentary (Phase 1): NO COMMENTARY SUBMITTED

      Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

      Commentary (Phase 2): NO COMMENTARY SUBMITTED

    • McAfee

      Vendor Status: INCLUDED

      Vendor Attestation Status: NO ATTESTATIONS PROVIDED

      Commentary (Phase 1): NO COMMENTARY SUBMITTED

      Vendor Confirmation Status: NO RESPONSE

      Commentary (Phase 2): NO COMMENTARY SUBMITTED

    • Microsoft

      Vendor Status: INCLUDED

      Vendor Attestation Status: NO ATTESTATIONS PROVIDED

      Commentary (Phase 1): NO COMMENTARY SUBMITTED

      Vendor Confirmation Status: NO RESPONSE

      Commentary (Phase 2): NO COMMENTARY SUBMITTED

    • Sophos

      Vendor Status: PARTICIPANT

      Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

      Commentary (Phase 1): NO COMMENTARY SUBMITTED

      Vendor Confirmation Status: ONE ITEM MARKED AS LESS THAN SATISFACTORY (Dispute process)

      Commentary (Phase 2): COMMENTARY SUBMITTED as follows:

      “While we received preliminary results with an opportunity to dispute, we did not receive any acknowledgement of our disputes and it appears as if they were ignored/rejected without any feedback. We’ve reached out directly to MRG to try and understand where the failure occurred and find a solution to the problem.”

      AMTSO note: Discussion between commenting vendor and test lab facilitated by AMTSO, communication issues settled amicably.

    • Symantec

      Vendor Status: PARTICIPANT

      Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)

      Commentary (Phase 1): NO COMMENTARY SUBMITTED

      Vendor Confirmation Status: NO RESPONSE

      Commentary (Phase 2): NO COMMENTARY SUBMITTED

    • Trend Micro

      Vendor Status: INCLUDED

      Vendor Attestation Status: NO ATTESTATIONS PROVIDED

      Commentary (Phase 1): NO COMMENTARY SUBMITTED

      Vendor Confirmation Status: NO RESPONSE

      Commentary (Phase 2): NO COMMENTARY SUBMITTED

  • Compliance Status: Confirmed compliant with AMTSO Standard v1.2

    Compliance report