Test Lab: SE Labs
Test Title: “Q1 2018 Endpoint Protection: Enterprise, Small Business, and Consumer”
AMTSO Test ID: AMTSO-PP1-TP201
-
Statement from Test Lab:
March 2018 – Endpoint Protection
Enterprise, Small Business, and ConsumerSE Labs tests a variety of endpoint security products from a range of well-known vendors in an effort to judge which were the most effective. Each enterprise, small business, or consumer class product are exposed to the same threats, which are a mixture of targeted attacks using well-established techniques, public email, and web-based threats that are known or found to be live on the internet at the time of the test. The Test Reports indicate how effectively the products were at detecting and/or protecting against those threats in real time.
Compliance Status: CONFIRMED COMPLIANT with Draft Standard v6.1
Publication Date: May 9, 2018
Published Test Report (Enterprise – PDF)
Published Test Report (Small Business – PDF)
Published Test Report (Consumer – PDF)
Participation information
Test Subject Vendor Status Phase 1 Feedback Attestations Comments (Phase 1) Phase 2 feedback Comments (Phase 2) Avast PARTICIPANT Completed Completed None None None AVG PARTICIPANT Completed Completed None None None Avira INCLUDED None None None SUBMITTED SUBMITTED Bitdefender INCLUDED None None None None None Bullguard INCLUDED None None None None None Check Point INCLUDED None None None None None CrowdStrike PARTICIPANT None (Waived) None SUBMITTED SUBMITTED ESET PARTICIPANT Completed Completed None None None F-Secure INCLUDED None None None None None Kaspersky Lab PARTICIPANT None (Waived) None NO ISSUES None Malwarebytes INCLUDED None None None None None Microsoft PARTICIPANT None (Waived) None NO ISSUES None Panda PARTICIPANT Completed Completed None None None Sophos PARTICIPANT Completed Completed None NO ISSUES None Symantec PARTICIPANT None (Waived) None NO ISSUES None Trend Micro INCLUDED None None None None None Webroot PARTICIPANT None (Waived) None NO ISSUES SUBMITTED Notable Commentary:
AVIRA:
“Avira did not participate as a voluntary in this test.”
“Avira has not received any preliminary information regarding the test results, therefore we cannot take a position. Therefore we choose the first option, so far there are no issues known.”CROWDSTRIKE:
“The test appeared to deviate from the planned schedule due to delays in communication, but with appropriate adjustments for our response.”
“Communication is relevant and fair, but the timeliness needs improvement. There were regular delays in responses from the tester.”
“The timeliness of communication could use improvement.”
“Due to delays in communication and test execution we are still waiting for the post-dispute details of the tests.”WEBROOT:
“As discussed with Simon, Webroot will have commentary placed at the end of the test stating that testing took place prior to the release of new script and anti-exploit features in WSA.”See feedback tab for full details of feedback and Commentary.
-
Notification date: December 20, 2017
Test plan shared on notificationCommencement date: January 5, 2018
Phase 1 Commentary Completion Date: February 1, 2018
Completion date (expected): April 2, 2018
Completion date (actual): April 16, 2018
Phase 2 Commentary Completion Date: May 4, 2018
Publication date: May 9, 2018
Compliance confirmed date: May 10, 2018Published Test Report (Enterprise – PDF)
-
Test component: “Home Anti-Malware Protection Jan-Mar 2018”:
Avast Free Antivirus
AVG Antivirus Free Edition
Avira Free Security Suite
Bitdefender Internet Security
Bullguard Internet Security
Check Point ZoneAlarm
ESET Smart Security
F-Secure Safe
Kaspersky Internet Security
Microsoft Windows Defender
Symantec Norton Security
Trend Micro Internet Security
Webroot AntivirusTest component: “Small Business Endpoint Protection“:
ESET Endpoint Security
Kaspersky Small Office Security
Malwarebytes Endpoint Security
Microsoft System Center Endpoint Protection
Panda Endpoint Protection
Sophos Central Endpoint
Symantec Endpoint Protection Cloud
Trend Micro Worry Free Security Services
Webroot SecureAnywhere Endpoint ProtectionTest component: “Enterprise Endpoint Protection“:
Crowdstrike Falcon
ESET Endpoint Security
Kaspersky Endpoint Security
Malwarebytes Endpoint Security
Microsoft System Center Endpoint Protection
Panda Endpoint Protection
Sophos Central Endpoint
Symantec Endpoint Securityn Enterprise Edition
Trend Micro OfficeScan, Intrusion Defense Firewall
Webroot SecureAnywhere Endpoint Protection -
Phase 1 Commentary Completion Date: February 1, 2018
Phase 2 Commentary Completion Date: May 4, 2018-
Avast
Vendor Status: PARTICIPANT
Vendor Attestation Status: ALL ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
AVG
Vendor Status: PARTICIPANT
Vendor Attestation Status: ALL ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Avira
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: SOME ITEMS MARKED AS LESS THAN SATISFACTORY
Commentary (Phase 2): COMMENTARY SUBMITTED as follows:
Configuration checks: I was not offered an opportunity to audit the configuration of my product
Comments on the configuration audit process: “Avira did not participate as a voluntary in this test.”
Adherence to the test plan: I confirm that, to the best of my knowledge, the tester followed the published test plan throughout
Comments on the tester’s adherence to the test plan: “Avira has not received any preliminary information regarding the test results, therefore we cannot take a position. Therefore we choose the first option, so far there are no issues known.”
Communications: I confirm that all communications between the tester and my company were handled in a timely, relevant and fair manner
Comments on communications: “This statement refers to the announcement and information we received before the test.”
Feedback and disputes: I was not given an opportunity to review and dispute the test data
Comments on the feedback and dispute processes: “Avira did not participate as a voluntary in this test.” -
Bitdefender
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Bullguard
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Check Point
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
CrowdStrike
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Tester waived attestation requirements)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: SOME ITEMS MARKED AS LESS THAN SATISFACTORY
Commentary (Phase 2): COMMENTARY SUBMITTED as follows:
Adherence to the test plan: I am aware of one or more deviations from the original test plan, but I consider these deviations to be appropriate and acceptable
Comment on the tester’s adherence to the test plan: “The test appeared to deviate from the planned schedule due to delays in communication, but with appropriate adjustments for our response.”
Communications: I have some issues with the way communications between the tester and my company were handled
Comment on communications: “Communication is relevant and fair, but the timeliness needs improvement. There were regular delays in responses from the tester.”
Feedback and disputes: I was given an opportunity to review and dispute the test data, but there were issues with the process
Comments on the feedback and dispute processes: “The timeliness of communication could use improvement.”
Other comments on the execution of this test: “Due to delays in communication and test execution we are still waiting for the post-dispute details of the tests.” -
ESET
Vendor Status: PARTICIPANT
Vendor Attestation Status: ALL ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
F-Secure
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Kaspersky Lab
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Tester waived attestation requirements)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Malwarebytes
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Microsoft
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Tester waived attestation requirements)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Panda
Vendor Status: PARTICIPANT
Vendor Attestation Status: ALL ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Sophos
Vendor Status: PARTICIPANT
Vendor Attestation Status: ALL ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Symantec
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Tester waived attestation requirements)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Trend Micro
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: FINAL FEEDBACK NOT PROVIDED
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Webroot
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Tester waived attestation requirements)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): COMMENTARY SUBMITTED as follows:
Other comments on the execution of this test: “As discussed with Simon, Webroot will have commentary placed at the end of the test stating that testing took place prior to the release of new script and anti-exploit features in WSA.”
-
Avast
-
Compliance status: CONFIRMED COMPLIANT with Draft Standard v6.1 – 2018-05-10