Test Lab: SE Labs
Test Title: SE Labs Q4 2019 Endpoint Protection: Enterprise, Small Business, and Consumer
AMTSO Test ID: AMTSO-LS1-TP016
-
Statement from Test Lab:
“October-December 2019 – Endpoint Protection Enterprise, Small Business, and Consumer
SE Labs tests a variety of endpoint security products from a range of well-known vendors in an effort to judge which were the most effective. Each enterprise, small business, or consumer class product are exposed to the same threats, which are a mixture of targeted attacks using well-established techniques, public email, and web-based threats that are known or found to be live on the internet at the time of the test. The Test Reports indicate how effectively the products were at detecting and/or protecting against those threats in real time.”
Participants: 15
These Vendors chose to adopt Participant status under the AMTSO Standard, gaining certain guaranteed rights in return for attestations“Included” Vendors: 17
These Vendors did not chose to adopt Participant status under the AMTSO Standard, but may have engaged with the test lab in other waysCompliance Status: Confirmed compliant with AMTSO Standard v1.2
Published test Report (Consumer)
Published test Report (Enterprise)
Publication Date: 2019-12-23
Participation information
Consumer Product title Status Phase 1 Feedback Attestations Comments (Phase 1) Phase 2 feedback Comments (Phase 2) AVAST Free Antivirus PARTICIPANT Completed Completed None Completed Submitted
AVG Antivirus Free Edition PARTICIPANT Completed Completed None Completed Submitted Avira Free Security Suite PARTICIPANT None (Waived) None Completed None Check Point ZoneAlarm INCLUDED None None None None None Comodo Internet Security Premium INCLUDED None None None None None ESET Internet Security INCLUDED None None None None None F-Secure Safe INCLUDED Completed None None Completed None Kaspersky Internet Security PARTICIPANT None (Waived) None Completed None McAfee Internet Security PARTICIPANT None (Waived) None None None Microsoft Windows Defender PARTICIPANT None (Waived) None None None NANO Antivirus Pro INCLUDED None None None None None Sophos Home Premium PARTICIPANT None (Waived) None Completed None Symantec Norton Security PARTICIPANT None (Waived) None None None Trend Micro Internet Security INCLUDED None None None None None Webroot Antivirus INCLUDED None None None None None SMB BitDefender Gravity Zone Endpoint Security INCLUDED None None None None None ESET Endpoint Security INCLUDED None None None None None Kaspersky Small Office Security PARTICIPANT None (Waived) None Completed None McAfee Endpoint Security PARTICIPANT None (Waived) None None None Microsoft Windows Defender ATP’s Antivirus PARTICIPANT None (Waived) None None None Sophos Intercept X PARTICIPANT None (Waived) None Completed None Symantec Endpoint Protection Cloud PARTICIPANT None (Waived) None None None Trend Micro Worry Free Security Services INCLUDED None None None None None VIPRE Endpoint Security INCLUDED None None None None None Enterprise BitDefender Gravity Zone Endpoint Security INCLUDED None None None None None Crowdstrike Falcon PARTICIPANT None (Waived) None Completed None ESET Endpoint Security INCLUDED None None None None None Kaspersky Endpoint Security PARTICIPANT None (Waived) None Completed None McAfee Endpoint Security PARTICIPANT None (Waived) None None None Microsoft Windows Defender ATP’s Antivirus PARTICIPANT None (Waived) None None None SentinelOne Endpoint Protection Platform INCLUDED None None None None None Sophos Intercept X PARTICIPANT None (Waived) None Completed None Symantec Endpoint Security Enterprise Edition PARTICIPANT None (Waived) None None None Trend Micro OfficeScan, Intrusion Defense Firewall INCLUDED None None None None None VIPRE Endpoint Security INCLUDED None None None None None Webroot SecureAnywhere Endpoint Protection INCLUDED None None None None None Notable Commentary:
Avast/AVG (Phase 2):
“I did not receive info that the dispute phase started.”
Response from test lab:
“SE Labs provide a free dispute process and provides relevant data on request from any vendor in the test. Vendors are notified about the start of the dispute process by AMTSO as part of the Standard certification process and need to take the initiative to request the dispute data. In this case, as soon as SE Labs became aware that Avast wanted the data, after the disputes deadline had passed, the data was provided.“
-
Notification date: 2019-09-16
Notification method: Publicly posted Test Plan, Contact List announcementCommencement date: 2019-09-17
Phase 1 Commentary dates: 2019-09-25 – 2019-10-02
Phase 2 Commentary dates: 2019-12-09 – 2019-12-17Publication date: 2019-12-23
-
SE Labs “Q4 2019 Endpoint Protection: Enterprise, Small Business, and Consumer” covers the following products:
Test component: “Home Anti-Malware Protection“:
AVAST Free Antivirus
AVG Antivirus Free Edition
Avira Free Security Suite
Check Point ZoneAlarm Free Antivirus
Comodo Internet Security Premium
ESET Internet Security
F-Secure Safe
Kaspersky Internet Security
McAfee Internet Security
Microsoft Windows Defender
NANO Antivirus Pro
Sophos Home Premium
Symantec Norton Security
Trend Micro Internet Security
Webroot SecureAnywhere Endpoint ProtectionTest component: “Small Business Endpoint Protection“:
BitDefender Gravity Zone Endpoint Security
ESET Endpoint Security
Kaspersky Small Office Security
McAfee Endpoint Security
Microsoft Windows Defender Enterprise
Sophos Intercept X Advanced
Symantec Endpoint Protection Cloud
Trend Micro Worry Free Security Services
VIPRE Endpoint SecurityTest component: “Enterprise Endpoint Protection“:
BitDefender Gravity Zone Endpoint Security
Crowdstrike Falcon
ESET Endpoint Security
Kaspersky Endpoint Security
McAfee Endpoint Security
Microsoft Windows Defender Enterprise
SentinelOne Endpoint Protection Platform
Sophos Intercept X Advanced
Symantec Endpoint Security Enterprise Edition
Trend Micro OfficeScan, Intrusion Defense Firewall
VIPRE Endpoint Security
Webroot SecureAnywhere Endpoint Protection -
Phase 1 Commentary dates: 2019-09-25 – 2019-10-02
Phase 2 Commentary dates: 2019-12-09 – 2019-12-17
Commentary received:-
Avast
Test Components covered: Home
Vendor Status: PARTICIPANT
Vendor Attestation Status: ALL ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: SOME ITEMS MARKED AS LESS THAN SATISFACTORY
Commentary (Phase 2): COMMENTARY SUBMITTED as follows:
“I did not receive info that the dispute phase started.”
Response from test lab:
“SE Labs provide a free dispute process and provides relevant data on request from any vendor in the test. Vendors are notified about the start of the dispute process by AMTSO as part of the Standard certification process and need to take the initiative to request the dispute data. In this case, as soon as SE Labs became aware that Avast wanted the data, after the disputes deadline had passed, the data was provided.”
-
AVG
Test Components covered: Home
Vendor Status: PARTICIPANT
Vendor Attestation Status: ALL ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: SOME ITEMS MARKED AS LESS THAN SATISFACTORY
Commentary (Phase 2): COMMENTARY SUBMITTED as follows:
“I did not receive info that the dispute phase started.”
Response from test lab:
“SE Labs provide a free dispute process and provides relevant data on request from any vendor in the test. Vendors are notified about the start of the dispute process by AMTSO as part of the Standard certification process and need to take the initiative to request the dispute data. In this case, as soon as SE Labs became aware that Avast wanted the data, after the disputes deadline had passed, the data was provided.”
-
Avira
Test Components covered: Home
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
BitDefender
Test Components covered: SMB, Enterprise
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Check Point
Test Components covered: Home
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Comodo
Test Components covered: Home
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
CrowdStrike
Test Components covered: Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO RESPONSE (Waived)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
ESET
Test Components covered: Home, SMB, Enterprise
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
F-Secure
Test Components covered: Home
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Kaspersky Lab
Test Components covered: Home, SMB, Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO RESPONSE (Waived)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
McAfee
Test Components covered: Home, SMB, Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Microsoft
Test Components covered: Home, SMB, Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
NANO
Test Components covered: Home
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
SentinelOne
Test Components covered: Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Sophos
Test Components covered: Home, SMB, Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Symantec
Test Components covered: Home, SMB, Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Trend Micro
Test Components covered: Home, SMB, Enterprise
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
VIPRE
Test Components covered: SMB, Enterprise
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Webroot
Test Components covered: SMB, Enterprise
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Avast
-
Compliance Status: Confirmed compliant with AMTSO Standard v1.2