Welcome to our regular roundup of events and activities in and around AMTSO.
Working Groups
A pair of major releases from our working groups this week, starting with the first set of guidelines from our AI Security Working Group. The AMTSO “Guidelines for Testing of Agentic Security Products” aim to provide detailed guidance and advice for testing of security protections for agentic systems, and were developed at speed over the last few months by our newest working group.
In tandem, our Sandbox Working Group has compiled an update to our Sandbox Evaluation Framework focused on handling of LLMs within sandboxing tools. The new set of KPIs provides a structure for testing how well sandboxes handle “LLMs-as-samples” for analysis, expanding on the existing raft of KPIs covering other aspects of sandbox performance.
Both papers have been made available for review by all AMTSO members and the wider public. We will be reaching out to subject-matter experts outside our membership to encourage review and feedback, with comments closing on July 20th. After this any changes needed will be worked on by the relevant groups, and the papers will then move ahead towards formal adoption.
In our other working groups, our Scam & Phishing group held their regular call this week, approving the recent release of their guideline paper, preparing for the first test being run following the guidance, and making a start on gathering ideas for future updates or new papers. Our RTTL team held their meeting last week to check in on the status of our threat-intel sharing system and the development of new features and structures for the upcoming v3.0. Our Multi-Engine team is gathering final feedback on the proposed certification system, which will be officially launched soon, and our Event Planning group continues to work on the content and experience of our October event in Brussels (more below).
Meetings and Events
We’ve added several more talks to the lineup for our October Cyber Research Conference in Brussels, including:
“AI-Powered APT Digital Twins for Cyberdefence Testing” – Alexander Adamov, NioGuard Security Lab
“MCP Hijacking in the Wild: How Agents Get Owned Through Their Tools” – Justin Szczepaniak and Paul Zenker, KPMG
“Evaluating LLM Detection of Obfuscated Binaries in npm Packages” – Alessandra Rizzo & Ariel Ropek, Panther Labs
“AI Agents, Malware, and Everything in Between” – [speaker TBC], OPSWAT
The last few available slots will be confirmed shortly and a full agenda will be released in the next few weeks. Member registration remains open via the member site, and tickets for non-members are expected to be available from the start of July. Full details of the event can be found on the event page.
We also continue to work on plans for our next Testing Town Hall event, which will be held in early July – an agenda and call details will be shared with members and signed-up guest attendees shortly. Any members or non-members interested in sharing some insights with our community are welcome to get in touch to propose a talk at one of our online events. To attend our Testing Town Halls, sign up for event notifications.
Board and Management
Our annual Board elections completed at the start of June, former AMTSO president Dennis Batchelder will be taking a seat on the Board filling the space left by Stefan Dumitrascu, who has stepped down to focus on his role as AMTSO President and CEO. Sitting Board members Alex Vukcevic, Jamz Yaneza and Jesse Song had their re-election for additional terms confirmed. The new Board will officially take over on July 1st.
AMTSO Standard and Test Calendar
Recent updates to our Test Calendar include Android tests from Testing Ground Labs, Windows reports from AV-Test, and the latest VBSpam results from Virus Bulletin. Coming soon we should see the long-awaited Scam & Phishing test from Artifact Security, and a novel public sandbox test from Venak Security leveraging our Sandbox Evaluation Framework. Here’s a summary of recent activities from our Standard compliance team:
- Compliance Reports covering the MRG-Effitas Q1’2026 Android Test (AMTSO Test ID: AMTSO-LS1-TP190) and the Q1’2026 Enterprise Endpoint Test (AMTSO Test ID: AMTSO-LS1-TP191) were issued on Monday, June 5th, 2026 following Phase 2 Commentary collection.
- A Compliance Report covering the MRG-Effitas May 2026 Consumer Assessment and Certification Test (AMTSO Test ID: AMTSO-LS1-TP200) was issued on Monday, June 16th, 2026 following Phase 2 Commentary collection.
- Compliance Reports covering the AV-TEST March-April 2026 Windows 11 Virus Protection Test Report for Business Users (AMTSO Test ID: AMTSO-LS1-TP187) and March-April 2026 Windows 11 Virus Protection Test Report for Home Users (AMTSO Test ID: AMTSO-LS1-TP188) were issued on Tuesday, June 16th, 2026 following Phase 2 Commentary collection.
- Phase 2 Commentary Collections covering the Testing Ground Labs (TGL) April 2026 Consumer Android Malware Detection Test Report (AMTSO Test ID: AMTSO-LS1-TP198) and April 2026 Enterprise Android Malware Detection Test Report (AMTSO Test ID: AMTSO-LS1-TP199) remain open through Monday, June 22nd, 2026.
- Phase 2 Commentary Collection covering the AVLab Cybersecurity May 2026 Advanced “In the Wild” Malware Detection Test (AMTSO Test ID: AMTSO-LS1-TP178) remains open through Wednesday, June 24th, 2026.
Information on all published and upcoming tests being tracked by AMTSO can be found in our Test Calendar.
Membership
We continue to track incoming membership renewal fees as we approach the start of our new member year on July 1st; we also continue to work on onboarding new members, and hope to add some more names to our member list shortly. Anyone interested in becoming an AMTSO member can find more information on our joining page.
ABOUT THIS NEWSLETTER
We send this newsletter to all AMTSO member representatives, as well as non-members who have engaged with AMTSO recently and have an interest in what’s going on in the AMTSO community. If you have any friends or colleagues who would like to be kept informed of developments in the testing world, they can sign up here. If you’d like to know more about joining the AMTSO community, there’s information and an application form here.