MRG Effitas Q3 2020 360 Degree Assessment and Certification

Test Lab

MRG Effitas

Test Title

MRG Effitas Q3 2020 360 Degree Assessment and Certification

AMTSO Test ID

AMTSO-LS1-TP028

Platform

Windows

Vendor

AVAST, Avira, Bitdefender, ESET, F-Secure, Microsoft, Symantec, Trend Micro

Publication date

2020-12-16

Statement from Test Lab

“A first-of-its-kind test that covers all angles, our pioneering 360 Degree Protection Test targets the key threats faced by internet users. In each test case we employ the full spectrum of Early Life Malware. We use a Time-To-Detect metric to measure how long it takes each application to detect and neutralize missed threats.”

Tested products

VendorProductVendor status
AVASTBusiness Antivirusparticipant
AviraAntivirus Pro Businessparticipant
BitdefenderGravityZone Advanced Business Security Cloudincluded
ESETEndpoint Securityincluded
F-SecureProtection Services for Buinessparticipant
MicrosoftWindows Defenderincluded
SymantecEndpoint Protectionparticipant
Trend MicroWorry-Free Services with XGENincluded

AMTSO Standard compliance info

Notification issued

2020-07-17

Notification method

Publicly posted test plan, Contact list notification

Test plan

Commencement date

2020-07-24

Participants

4
These Vendors chose to adopt Participant status under the AMTSO Standard, gaining certain guaranteed rights in return for attestations.

“Included” Vendors

4

These Vendors did not chose to adopt Participant status under the AMTSO Standard, but may have engaged with the test lab in other ways.

Commentary dates
CommentaryStart dateEnd date
Phase 1 Commentary2020-08-102020-08-19
Phase 2 Commentary2020-12-162020-12-22

Commentary received

VendorCommentary phaseComment
SymantecPhase 1

Financial malware simulator test methodology – A test should use real malware from the industry instead of generated samples.

F-SecurePhase 2

This comment is regarding the test that was conducted in MRG Effitas 360 degree assessment 2020 Q2 and 360 degree assessment 2020 Q3 Tests. In our opinion the sample used for clean files test were not simulating the real world scenario as experienced every day by users. If we want to simulate a real-world scenario for normal users, the clean set for false positive testing should be composed of common/popular applications from popular software/websites. In the case that handcrafted or newly created applications are to be used, they need to be tested with proper paramaters such as being found in locations related to code development.

AMTSO Standard compliance status

Confirmed compliant with AMTSO Standard v1.3Compliance Report