Welcome to our regular roundup of events and activities in and around AMTSO.
Meetings and Events
Our next event will be our Cyber Research Conference in Lisbon on October 13th and 14th. The CfP (hosted at Pretalx) is open until the end of July, and we expect to confirm some of the proposals earlier – an initial agenda is available on the main event page, along with more details of the event and a registration form. A simpler one-click form is also available for members on the member site – a quota of free places is available for all members. The agenda plan includes time for AMTSO-specific discussions, and we’ll also be holding in-person meetups for our active working groups, alongside workshops and other special sessions outside of the main track. More details coming soon!
We held our most recent Testing Town Hall call on July 2nd. Our regular Google correspondant Sebastian Porst filled us in on the latest developments and upcoming features in Android security, and OPSWAT’s Jan Miller gave an update on the AMTSO Sandbox Evaluation Framework and the project’s future plans. The main presentations are available to all on the event page or via our YouTube channel, and the full recording and slide decks are available to members via the member site.
The next Testing Town Hall will be in November, we’re lining up speakers now and will update the event page as they’re confirmed.
Working Groups
Our Sandbox project group continues to look at plans to build out a test harness to simplify the testing process and to host results in comparable format, as well as tracking work to get more sandboxes covered by test data under the Framework. AMTSO will be presenting an overview of the Framework and the project as part of the SANS DFIR summit next week – anyone interested in finding our more about the project can sign up to attend for free. AMTSO members are welcome to join the working group to contribute to the project, those providing sandbox technologies are encouraged to get them evaluated for helpful feedback to improve their products, as well as vital data to help users select the right solutions for their needs.
Our Real-World Testing group met again this week, with special guests from Broadcom in attendance. The main focus of dicussion was on the validity of articial or “engineered” samples and scenarios in testing, especially regarding their application in evaluations of scam and phishing protections. The previous call earlier in July featured a discussion with Gen about the Norton “Genie” AI-powered anti-scam toolkit, how it works and how it and similar offerings could best be tested. More members are signing up to join the project as we work to provide guidance on this area of testing.
Our RTTL Threat Intel team continued their regular calls over the last few weeks, with the main focus outside of regular review of the platform and feeds being enagement with CERTs to help them share their finds with the industry, and enrichment of data in the system.
Next week will see another call for the Sandbox team, as well as a meeting of the New Frontiers forward-planning group to follow up on discussion two weeks ago. The agenda will include proposals to encourage more open, detailed, and timely feedback to vendors on issues discovered during testing.
AMTSO Standard and Test Calendar
Recent additions to our Test Calendar include the latest update from AppEsteem’s Unwanted Software testing, a six-month endurance test of Android products from AV-Test, and more business product data from AV-Comparatives. Coming soon we expect to see the Q2 reports from SE Labs. Here’s a summary of recent activities from our Standard compliance team:
Public Test Notifications were released for the following upcoming tests during the reporting period. Annual tests will continue on their normal rhythm. Phase 1 Commentary Collections remain open for all of these tests:
- TGL (Testing Ground Labs) June 2025 Consumer Android Malware Detection Test (AMTSO Test ID: AMTSO-LS1-TP155) on Saturday, June 28th, 2025
- SE Labs Q3 2025 Endpoint Protection Test (AMTSO Test ID: AMTSO-LS1-TP156) on Saturday, June 28th, 2025
- Virus Bulletin Q3’2025 VBSpam Test (AMTSO Test ID: AMTSO-LS1-TP157) on Monday, June 30th, 2025
- SecureIQLabs Advanced Cloud Firewall Test (AMTSO Test Testing is scheduled to begin in August 2025
- Phase 2 Commentary for the AppEsteem UwS Handling Certification (AMTSO Test ID: AMTSO-LS1-TP137) was opened on Friday, July 11th, 2025 and will close on Monday, July 21st, 2025.
AMTSO Compliance Confirmation Reports were issued for the following successfully completed tests during this reporting period following the mandatory Phase 2 Commentary Collections:
- SecureIQLab’s Cloud WAF V4.0 (Q2’2025) test cycle (AMTSO-LS1-TP127) on Monday, June 30th, 2025
- Virus Bulletin’s Q2 2025 VBSpam Test (AMTSO-LS1-TP150) on Monday, June 30th, 2025
- AVLab Cybersecurity Foundation May 2025 Advanced In-the-Wild Malware Test (AMTSO-LS1-TP138) on Monday, June 30th, 2025
- AV-TEST’s May-June Android Consumer 2025 Test Report (AMTSO Test ID: AMTSO-LS1-TP144) on Monday, July 7th
- Testing Ground Labs April 2025 Android Consumer Test (AMTSO-LS1-TP151) on Monday, July 7th
- Testing Ground Labs April 2025 Android Enterprise Test (AMTSO-LS1-TP152) on Monday, July 7th
Information on all published and upcoming tests being tracked by AMTSO can be found in our Test Calendar.
Board and Management
Our July Board call was held last week, the main focus was on planning for the upcoming Lisbon event. We also had our final update from our excellent CMO Marina Ziegler, who will be stepping down from her post shortly – we continue to seek a replacement, anyone interested in taking on the role can find some background in an interview with Marina on our public site, more details are available on the member site.
Membership
We’ve now completed the process of updating our systems and member lists for the new membership year commencing on July 1st, a round of outreach to members with overdue renewal fees will commence shortly and we hope to add some new members soon. Anyone interested in becoming an AMTSO member and contributing their insights to our various projects can find more information on our joining page.
ABOUT THIS NEWSLETTER
We send this newsletter to all AMTSO member representatives, as well as non-members who have engaged with AMTSO recently and have an interest in what’s going on in the AMTSO community. If you have any friends or colleagues who would like to be kept informed of developments in the testing world, they can sign up here. If you’d like to know more about joining the AMTSO community, there’s information and an application form here.