SE Labs Q1 2019 Endpoint Protection: Enterprise, Small Business, and Consumer

Test Lab: SE Labs
Test Status: Compliance CONFIRMED
AMTSO Test ID: AMTSO-LS1-TP008

Please note:
This compliance page covers multiple component tests, for details of products covered by each component please see the individual summary pages under “Additional links”

Test Lab

SE Labs

Test Title

SE Labs Q1 2019 Endpoint Protection: Enterprise, Small Business, and Consumer

AMTSO Test ID

AMTSO-LS1-TP008

Platform

Windows

Vendor

AVAST, AVG, Avira, Bitdefender, BullGuard, CrowdStrike, eScan, ESET, F-Secure, G Data, K7 Computing, Kaspersky, McAfee, Microsoft, Symantec, Trend Micro, Trustport

Publication date

2019-06-05

Statement from Test Lab

“January-March 2019 – Endpoint Protection Enterprise, Small Business, and Consumer SE Labs tests a variety of endpoint security products from a range of well-known vendors in an effort to judge which were the most effective. Each enterprise, small business, or consumer class product are exposed to the same threats, which are a mixture of targeted attacks using well-established techniques, public email, and web-based threats that are known or found to be live on the internet at the time of the test. The Test Reports indicate how effectively the products were at detecting and/or protecting against those threats in real time.”

AMTSO Standard compliance info

Notification issued

2019-01-04

Notification method

Publicly posted test plan, Contact list notification

Test plan

Commencement date

2019-01-09

Participants

26
These Vendors chose to adopt Participant status under the AMTSO Standard, gaining certain guaranteed rights in return for attestations.

“Included” Vendors

6

These Vendors did not chose to adopt Participant status under the AMTSO Standard, but may have engaged with the test lab in other ways.

Commentary dates
CommentaryStart dateEnd date
Phase 1 Commentary2019-01-232019-01-30
Phase 2 Commentary2019-06-032019-06-10

Commentary received

VendorCommentary phaseComment
K7 ComputingPhase 1

“K7 was never notified about being included in the test. Therefore K7 was not given the option of providing a suitable product to include in the test. The tester has itself chosen the most basic K7 consumer security product, without K7’s knowledge, which is entirely unsuitable given the premise of the Test Plan. Due diligence on suitability to match the nature of the test has NOT been taken into account at all.”

K7 ComputingPhase 2

“As mentioned earlier, for reasons best known to SELabs, K7’s flagship K7 Total Security product which supports robust web security was NOT chosen for this test series despite its features being best suited to the test plan executed. Instead, K7’s most basic product has been tested without providing K7 recourse to choosing to be a Participant. K7 has not even been given the preliminary test results, and hence has not had any opportunity to dispute the test results.”

Response from Test Lab: “We generally respond to requests for results from vendors rather than proactively sending them out. We do not currently have a formal relationship with K7 and so there is no existing process whereby we send data without a request. Had K7 requested this data we would have provided it as soon as possible. The product selection was made and tested before K7 communicated that it preferred its more fully-featured product to be included in such a challenging test. It is possible that the delay between our initial discussions about this and the results being published has caused confusion at K7’s end, causing the team to think that we selected Antivirus Premium after these discussions, when in fact these results are from earlier in the year. As agreed with K7 after the first stage of commentary, SE Labs has included a comment in the report that registers K7’s belief that K7 Total Security would have been a more appropriate product to include. SE Labs notes that the test includes a selection of products, many of which are free and/or considered not to be premium offerings. Therefore, while we understand K7’s preference for having a more fully-featured product undergo testing, the test is a fair comparison of a number of anti-malware products available to the public within a range of difference prices.

AMTSO Standard compliance status

Confirmed compliant with AMTSO Standard v1.1Compliance report