Test Lab: MRG Effitas Logo
Test Title: MRG Effitas Q3 2018 360 Degree Assessment and Certification
AMTSO Test ID: AMTSO-LS1-TP003

  • Statement from Test Lab:

    “A first-of-its-kind test that covers all angles, our pioneering 360 Degree Protection Test targets the key threats faced by internet users. In each test case we employ the full spectrum of Early Life Malware. We use a Time-To-Detect metric to measure how long it takes each application to detect and neutralize missed threats.”

    Test Plan

    Participants: 7
    These Vendors chose to adopt Participant status under the AMTSO Standard, gaining certain guaranteed rights in return for attestations

    “Included” Vendors: 4
    These Vendors did not chose to adopt Participant status under the AMTSO Standard, but may have engaged with the test lab in other ways

    Compliance Status: Confirmed compliant with AMTSO Standard v1.0

    Publication Date: 2018-12-01

    Published test Report

    Participation information
    Vendor Status Phase 1 Feedback Attestations Comments (Phase 1) Phase 2 Feedback Comments (Phase 2)
    Avast INCLUDED Completed Completed Submitted Completed Submitted
    Avira PARTICIPANT None (Waived) None Completed None
    BitDefender PARTICIPANT Completed Completed None Completed None
    ESET PARTICIPANT None (Waived) None Completed None
    F-Secure PARTICIPANT Completed Completed None Completed None
    Kaspersky PARTICIPANT None (Waived) None Completed Submitted
    Microsoft INCLUDED None None None None None
    McAfee INCLUDED None None None None None
    Symantec PARTICIPANT Completed Completed None None None
    Trend Micro INCLUDED None None None None None
    Webroot PARTICIPANT Completed Completed None Completed None

  • Notification date: 2018-08-03
    Notification method: Publicly posted test plan, Contact List notice

    Test Plan

    Commencement date: 2018-08-10

    Phase 1 Commentary dates: 2018-08-14 – 2018-08-24
    Phase 2 Commentary dates: 2018-10-29 – 2018-11-20

    Publication date: 2018-12-01

    Published test Report

  • MRG-Effitas “Q3 2018 360 Degree Assessment and Certification” covered the following products:

    Avast Business Antivirus
    Avira Antivirus Pro Business edition
    BitDefender Gravityzone Advanced Business Security cloud
    ESET Endpoint Security
    F-Secure Protection Service for Business
    Kaspersky Lab Endpoint Security Cloud
    Microsoft Windows Defender
    McAfee Endpoint Security
    Symantec Endpoint Protection
    Trend Micro Worry-Free Services with XGEN
    Webroot SecureAnywhere Business Endpoint Protection

  • Phase 1 Commentary dates: 2018-08-14 – 2018-08-24
    Phase 2 Commentary dates: 2018-10-29 – 2018-11-20

    Commentary received:

    Avast

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): COMMENTARY SUBMITTED as follows:

    “I haven’t seen an option to adopt participant status. Regarding notification about this test I have only found email with subject “Public Test Notification : MRG Effitas Q3 2018 360 Degree Assessment and Certification” from AMTSO.”

    AMTSO Note: Notification message cited includes request to contact tester regarding Participant status.

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): COMMENTARY SUBMITTED as follows:

    “Dispute process haven’t been finished yet.”

    AMTSO Note: Commentary period extended to allow Dispute stage to complete.

    Avira

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Bitdefender

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): COMMENTARY SUBMITTED as follows:

    On section “Configuration Audit”: “We thought that the tester would contact us for the configuration check and the tester thought that we would contact them. So, we never got the chance to do that.”

    AMTSO Note: Configuration audit must be made available but can be on-request only, there is no requirement for the Tester to offer it to Vendors who do not request it.

    On section “Execution of Test”: “Basic Bitdefender Endpoint Security version was used and therefore not all technologies available for the Business environment were used/tested. The Elite version should have protected against the miss in the Exploit category.“

    Eset

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    F-Secure

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Kaspersky Lab

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED (waived)

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): COMMENTARY SUBMITTED as follows:

    On section “Feedback and disputes”: “The dispute process has not been ended by the moment. KL submitted the feedback and await for a tester’s reply.”

    AMTSO Note: Commentary period extended to allow Dispute stage to complete.

    McAfee

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Microsoft

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Symantec

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Trend Micro

    Vendor Status: INCLUDED

    Vendor Attestation Status: NO ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: NO RESPONSE

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

    Webroot

    Vendor Status: PARTICIPANT

    Vendor Attestation Status: ALL ATTESTATIONS PROVIDED

    Commentary (Phase 1): NO COMMENTARY SUBMITTED

    Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY

    Commentary (Phase 2): NO COMMENTARY SUBMITTED

  • Compliance Status: Confirmed compliant with AMTSO Standard v1.0

    Compliance report