AMTSO News 2024-02-23

Welcome to our regular roundup of events and activities in and around AMTSO. 

Meetings and Events

We held our latest Testing Town Hall event last week, featuring a deep-dive look at XDR testing from SecureIQLab based on their experiences of designing their first such test. Slide decks and a full recording have been made available to members, and edited highlights can be found on our public website and YouTube channel.

A talk on a similar topic from SE Labs could not be included last week as planned; we hope to get a chance to hear their side of the story at the next event, which will be held on April 10th and should also feature a guest presentation on Android security from Google. Non-members can sign up to attend our events here:

Board and Management

A Board meeting will be held next week with members of our advisory board also in attendance. Among the agenda items is the confirmation of timings for our upcoming Board elections, which will be circulated to members by the end of next week; member representatives will be eligible to stand for one of four open director positions on our Board, with half elected by our tester members. Any members interested in finding out more should contact their regular AMTSO representative for details of the role and process. We also expect to set a date for an online member meeting where members will have a chance to meet and question the Board election candidates, due in early- to mid-May.

RTTL and ThreatList

We continue to sign up reporters for our ThreatList system, as well as test labs interested in making use of the feeds in their tests and certification programs. A number of reporters are already submitting samples regularly and more are working on their processes to do so. Potential reporters are invited to find out more and apply to participate here:

Our regular call of the RTTL working group was held this week, flagging up some minor bugs in the integration between the RTTL and ThreatList systems, which are being worked on, as well as tracking the flow of samples into both systems. A further round of recruitment of new contributors is planned alongside onboarding of ThreatList participants.

Working Groups

We continue to work on our XDR Testing Criteria project, with our initial taxonomy structure being implemented into forms to gather details from both test labs and vendors on the areas each covers in their offerings. A call will be held next week to review and work on next steps, taking on board some of the lessons shared on our recent Testing Town Hall. Our outreach to CISOs and purchasers also continues, as we grow our network of contacts and interested parties and make plans for an open event later in the year. We also have a call scheduled to push forward ideas for a guideline paper and repository of test samples for measuring sandboxes, with several more proposals for guidance and best practices in the pipeline.

AMTSO Standard and Test Calendar

February has been a rather quiet month for our test calendar so far, but we expect to see a glut of new test data emerging in the next few weeks, with tests being run under the AMTSO Standard from AVLab Cybersecurity Foundation, AV-Test, MRG Effitas and AppEsteem all due for release. Here’s a summary of activities from our Standard compliance team:

  • A Public Test Notification was issued for TGL (Testing Ground Labs) covering their upcoming February 2024 Consumer Android Malware Detection Test (AMTSO Test ID: AMTSO-LS1-TP110).
  • A Public Test Notification was issued by MRG-Effitas for their upcoming Q1 2024 360 Degree Android Assessment and Certification (AMTSO Test ID: AMTSO-LS1-TP111).  Additionally, a Public Test Notification was issued by MRG-Effitas for their upcoming Q1 2024 360 Degree Assessment and Certification (Endpoint) (AMTSO Test ID: AMTSO-LS1-TP112). 
  • Phase 2 Commentary Collection was started for the January 2024 and February 2024 VB100 Test Reports (AMTSO Test ID: AMTSO-LS1-TP095) as part of their VB100 2024 Test Series.  This round of commentary collection will be closing on Wednesday, February 28th, 2024 and an incremental Compliance Report will be issued at that time. The February results were issued by Virus Bulletin on February 23rd.

Information on all published and upcoming tests being tracked by AMTSO can be found in our test calendar.


We welcome our newest member, Glasswall.


We send this newsletter to all AMTSO member representatives, as well as non-members who have engaged with AMTSO recently and have an interest in what’s going on in the AMTSO community. If you have any friends or colleagues who would like to be kept informed of developments in the testing world, they can sign up here. If you’d like to know more about joining the AMTSO community, there’s information and an application form here.