Test Lab: SE Labs
Test Title: SE Labs Q1 2019 Endpoint Protection: Enterprise, Small Business, and Consumer
AMTSO Test ID: AMTSO-LS1-TP008
-
Statement from Test Lab:
“January-March 2019 – Endpoint Protection Enterprise, Small Business, and Consumer
SE Labs tests a variety of endpoint security products from a range of well-known vendors in an effort to judge which were the most effective. Each enterprise, small business, or consumer class product are exposed to the same threats, which are a mixture of targeted attacks using well-established techniques, public email, and web-based threats that are known or found to be live on the internet at the time of the test. The Test Reports indicate how effectively the products were at detecting and/or protecting against those threats in real time.”
Participants: 26
These Vendors chose to adopt Participant status under the AMTSO Standard, gaining certain guaranteed rights in return for attestations“Included” Vendors: 6
These Vendors did not chose to adopt Participant status under the AMTSO Standard, but may have engaged with the test lab in other waysCompliance Status: Confirmed compliant with AMTSO Standard v1.1
Published test Report (Consumer)
Published test Report (Enterprise)
Publication Date: 2019-06-05
Participation information
Consumer Product title Status Phase 1 Feedback Attestations Comments (Phase 1) Phase 2 feedback Comments (Phase 2) AVAST Free Antivirus PARTICIPANT Completed Completed None Completed None AVG Antivirus Free Edition PARTICIPANT Completed Completed None Completed None Avira Free Security Suite PARTICIPANT None (Waived) None Completed None BullGuard Internet Security INCLUDED None None None None None eScan Internet Security Suite INCLUDED None None None None None ESET Internet Security PARTICIPANT Completed Completed None None None F-Secure Safe INCLUDED None None None None None G-Data Internet Security INCLUDED None None None None None K7 Computing Antivirus Premium INCLUDED Completed Completed Submitted Completed Submitted Kaspersky Internet Security PARTICIPANT Completed Completed None None None McAfee Internet Security PARTICIPANT None (Waived) None None None Microsoft Windows Defender PARTICIPANT None (Waived) None None None Symantec Norton Security PARTICIPANT Completed Completed None Completed None Trend Micro Internet Security PARTICIPANT Completed Completed None None None SMB BitDefender Gravity Zone Endpoint Security PARTICIPANT Completed Completed None None None ESET Endpoint Security PARTICIPANT Completed Completed None None None Kaspersky Small Office Security PARTICIPANT Completed Completed None None None McAfee Endpoint Security PARTICIPANT None (Waived) None None None Microsoft Windows Defender ATP’s Antivirus PARTICIPANT None (Waived) None None None Sophos Intercept X PARTICIPANT Completed Completed None Completed None Symantec Endpoint Protection Cloud PARTICIPANT Completed Completed None Completed None Trend Micro Worry Free Security Services PARTICIPANT Completed Completed None None None Enterprise BitDefender Gravity Zone Endpoint Security PARTICIPANT Completed Completed None None None Crowdstrike Falcon PARTICIPANT None (Waived) None None None ESET Endpoint Security PARTICIPANT Completed Completed None None None Kaspersky Endpoint Security PARTICIPANT Completed Completed None None None McAfee Endpoint Security PARTICIPANT None (Waived) None None None Microsoft Windows Defender ATP’s Antivirus PARTICIPANT None (Waived) None None None Sophos Intercept X PARTICIPANT Completed Completed None Completed None Symantec Endpoint Security Enterprise Edition PARTICIPANT Completed Completed None Completed None Trend Micro OfficeScan, Intrusion Defense Firewall PARTICIPANT Completed Completed None None None TrustPort Antivirus for Business INCLUDED None None None None None Notable Commentary:
K7 Computing (Phase 1):
“K7 was never notified about being included in the test. Therefore K7 was not given the option of providing a suitable product to include in the test. The tester has itself chosen the most basic K7 consumer security product, without K7’s knowledge, which is entirely unsuitable given the premise of the Test Plan. Due diligence on suitability to match the nature of the test has NOT been taken into account at all.”
K7 Computing (Phase 2):
“As mentioned earlier, for reasons best known to SELabs, K7’s flagship K7 Total Security product which supports robust web security was NOT chosen for this test series despite its features being best suited to the test plan executed. Instead, K7’s most basic product has been tested without providing K7 recourse to choosing to be a Participant. K7 has not even been given the preliminary test results, and hence has not had any opportunity to dispute the test results.”
Response from Test Lab:
“We generally respond to requests for results from vendors rather than proactively sending them out. We do not currently have a formal relationship with K7 and so there is no existing process whereby we send data without a request. Had K7 requested this data we would have provided it as soon as possible.
The product selection was made and tested before K7 communicated that it preferred its more fully-featured product to be included in such a challenging test. It is possible that the delay between our initial discussions about this and the results being published has caused confusion at K7’s end, causing the team to think that we selected Antivirus Premium after these discussions, when in fact these results are from earlier in the year. As agreed with K7 after the first stage of commentary, SE Labs has included a comment in the report that registers K7’s belief that K7 Total Security would have been a more appropriate product to include.
SE Labs notes that the test includes a selection of products, many of which are free and/or considered not to be premium offerings. Therefore, while we understand K7’s preference for having a more fully-featured product undergo testing, the test is a fair comparison of a number of anti-malware products available to the public within a range of difference prices.“
-
Notification date: 2019-01-04
Notification method: Publicly posted Test Plan, Contact List announcementCommencement date: 2019-01-09
Phase 1 Commentary dates: 2019-01-23 – 2018-01-30
Phase 2 Commentary dates: 2019-06-03 – 2019-06-10Publication date: 2019-06-05
-
SE Labs “Q1 2019 Endpoint Protection: Enterprise, Small Business, and Consumer” covers the following products:
Test component: “Home Anti-Malware Protection Q1 2019“:
AVAST Free Antivirus
AVG Antivirus Free Edition
Avira Free Security Suite
BullGuard Internet Security
eScan Internet Security Suite
ESET Internet Security
F-Secure Safe
G-Data Internet Security
K7 Antivirus Premium
Kaspersky Internet Security
McAfee Internet Security
Microsoft Windows Defender
Symantec Norton Security
Trend Micro Internet SecurityTest component: “Small Business Endpoint Protection“:
BitDefender Gravity Zone Endpoint Security
ESET Endpoint Security
Kaspersky Small Office Security
McAfee Endpoint Security
Microsoft Windows Defender ATP’s Antivirus
Sophos Intercept X
Symantec Endpoint Protection Cloud
Trend Micro Worry Free Security ServicesTest component: “Enterprise Endpoint Protection“:
BitDefender Gravity Zone Endpoint Security
Crowdstrike Falcon
ESET Endpoint Security
Kaspersky Endpoint Security
McAfee Endpoint Security
Microsoft Windows Defender ATP’s Antivirus
Sophos Intercept X
Symantec Endpoint Security Enterprise Edition
Trend Micro OfficeScan, Intrusion Defense Firewall
TrustPort Antivirus for Business -
Phase 1 Commentary dates: 2019-01-23 – 2018-01-30
Phase 2 Commentary dates: 2019-06-03 – 2019-06-10Commentary received:
Avast
Test Components covered: Home
Vendor Status: PARTICIPANT
Vendor Attestation Status: ALL ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
AVG
Test Components covered: Home
Vendor Status: PARTICIPANT
Vendor Attestation Status: ALL ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
Avira
Test Components covered: Home, SMB, Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (WAIVED)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
BitDefender
Test Components covered: SMB, Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: ALL ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
BullGuard
Test Components covered: Home
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
CrowdStrike
Test Components covered: Enterprise
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
eScan
Test Components covered: Home
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
ESET
Test Components covered: Home, SMB, Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: ALL ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
F-Secure
Test Components covered: Home
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
G Data
Test Components covered: Home
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
K7 Computing
Test Components covered: Home
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): COMMENTARY SUBMITTED as follows:
“K7 was never notified about being included in the test. Therefore K7 was not given the option of providing a suitable product to include in the test. The tester has itself chosen the most basic K7 consumer security product, without K7’s knowledge, which is entirely unsuitable given the premise of the Test Plan. Due diligence on suitability to match the nature of the test has NOT been taken into account at all.”
Vendor Confirmation Status: COMPLETED
COMMENTARY SUBMITTED as follows:
“As mentioned earlier, for reasons best known to SELabs, K7’s flagship K7 Total Security product which supports robust web security was NOT chosen for this test series despite its features being best suited to the test plan executed. Instead, K7’s most basic product has been tested without providing K7 recourse to choosing to be a Participant. K7 has not even been given the preliminary test results, and hence has not had any opportunity to dispute the test results.”
Response from Test Lab:
“We generally respond to requests for results from vendors rather than proactively sending them out. We do not currently have a formal relationship with K7 and so there is no existing process whereby we send data without a request. Had K7 requested this data we would have provided it as soon as possible.
The product selection was made and tested before K7 communicated that it preferred its more fully-featured product to be included in such a challenging test. It is possible that the delay between our initial discussions about this and the results being published has caused confusion at K7’s end, causing the team to think that we selected Antivirus Premium after these discussions, when in fact these results are from earlier in the year. As agreed with K7 after the first stage of commentary, SE Labs has included a comment in the report that registers K7’s belief that K7 Total Security would have been a more appropriate product to include.
SE Labs notes that the test includes a selection of products, many of which are free and/or considered not to be premium offerings. Therefore, while we understand K7’s preference for having a more fully-featured product undergo testing, the test is a fair comparison of a number of anti-malware products available to the public within a range of difference prices.”
Kaspersky Lab
Test Components covered: Home, SMB, Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: ALL ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
McAfee
Test Components covered: Home, SMB, Enterprise
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
Microsoft
Test Components covered: Home, SMB, Enterprise
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
Sophos
Test Components covered: SMB, Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: ALL ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
Symantec
Test Components covered: Home, SMB, Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
Trend Micro
Test Components covered: Home, SMB, Enterprise
Vendor Status: PARTICIPANT
Vendor Attestation Status: NO ATTESTATIONS PROVIDED (Waived)
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: ALL ITEMS MARKED AS SATISFACTORY
Commentary (Phase 2): NO COMMENTARY SUBMITTED
Trustport
Test Components covered: SMB, Enterprise
Vendor Status: INCLUDED
Vendor Attestation Status: NO ATTESTATIONS PROVIDED
Commentary (Phase 1): NO COMMENTARY SUBMITTED
Vendor Confirmation Status: NO RESPONSE
Commentary (Phase 2): NO COMMENTARY SUBMITTED
-
Compliance Status: Confirmed compliant with AMTSO Standard v1.1