AMTSO News 2023-10-13

Welcome to our regular roundup of events and activities in and around AMTSO. 

Meetings and Events

We held our member meetings in London last week. Over 35 member representatives and guests were present with many more connecting remotely for some or all of the sessions. In-depth discussions covered our XDR Testing Criteria and ThreatList projects (more below), issues around software monetization, and much more. A wealth of presentations from members and guests were also featured, these included an excellent keynote from Raza Syed of Microsoft and a last-minute talk on fileless threats from Alex Adamov of NioGuard Security Lab. Slide decks and recordings for most sessions have been made available to members. Plans are now under way for our 2024 events and members are being surveyed on their preferences for timings and locations. Following the meetings AMTSO was present at the annual VB conference, making new connections, catching up with members, and sharing ideas (and snacks) with a wide range of attendees.

Our next event will be another Testing Town Hall call on November 8th. We plan to have a guest speaker from the European Cyber Security Organization alongside presentations from members. Non-members can sign up to attend these events here.

RTTL and ThreatList

Detailed updates on our RTTL project were shared with members last week, and the awarding of our annual prize for best contributor was announced – congratulations to Check Point! We also announced the completion of work on the technical side of our ThreatList project, and expect to open for contributions next week once final setup of onboarding processes is complete. The RTTL team will hold their regular call next week after a break through the London events.

XDR Testing Criteria

Our XDR project got much attention during and after our meetings, and we’ve now set up a regular call schedule to push ahead with this epic undertaking. The first in this cycle was held this week, with the expanded group looking at the development of a taxonomy and structure to help define and easily visualize the components of both solutions and tests.

New Frontiers group

We will also be setting up regular calls for our New Frontiers team to continue to build our outreach to enterprise users and ensure they can access the information they need. Current plans include setting up an advisory panel of leading experts, and holding consultations and events of varying sizes through next year. The first call of this new pattern should be taking place next week, and we hope to be able to provide more details of our plans in the next few months.

AMTSO Standard and Test Calendar

After a short hiatus we’ve been catching up with our test calendar this week, adding another set of new tests released recently including regular reports from AV-Test on Mac security solutions. Here’s a summary of activities from our Standard compliance team:

  • Compliance Confirmation Reports for Testing Ground Labs August 2023 Consumer Android Malware Detection Test (AMTSO Test ID: AMTSO-LS1-TP084) and Business Android Malware Detection Test (AMTSO Test ID: AMTSO-LS1-TP085) were issued on Thursday, October 5th, 2023.
  • AVLab Cybersecurity Foundation’s September 2023 test has entered the dispute phase and they are working with several vendors during this cycle.
  • SecureIQLab’s ACFW Test (AMTSO Test ID: AMTSO-LS1-TP070) has entered the dispute phase and will be working with vendors over the next two weeks.  Phase 2 Commentary Collection is anticipated to begin on Monday, October 23rd, 2023.
  • Updates covering the AMTSO Standard Metrics were delivered as part of the London All-Members meeting on Monday, October 2nd, 2023.  Six test labs are currently running tests under the Standard V1.3 with two testing organizations (AV-Test, Virus Bulletin) planning to launch their first AMTSO compliant tests in Q4 2023 and/or Q1 2024.  The test calendar now contains more than 450 tests with 82 listed to this point in 2023 alone.

Information on all published and upcoming tests being tracked by AMTSO can be found in our test calendar.


We send this newsletter to all AMTSO member representatives, as well as non-members who have engaged with AMTSO recently and have an interest in what’s going on in the AMTSO community. If you have any friends or colleagues who would like to be kept informed of developments in the testing world, they can sign up here. If you’d like to know more about joining the AMTSO community, there’s information and an application form here.