Latest Press Release
AMTSO comments on recent testing issues
San Francisco, California – February 18, 2017 – Testing products in a fair and balanced way is very difficult. Product developers routinely make bold claims about the capabilities of their products. AMTSO supports the right of testers to put these claims to the test, to provide independent validation of their accuracy (or otherwise).
Since our foundation, AMTSO has strongly advocated realistic testing methodologies, exercising all features and layers of all participating products and giving genuine insight into how well they perform at stopping the types of attacks affecting real users in the real world.
We have been asked to explain AMTSO’s opinion on recent privately-commissioned anti-malware tests. We believe that we will be in a much better position to provide useful feedback on specific tests after adoption of the AMTSO standards, but we do want to respond to these inquiries by providing some general statements about problems we’ve seen in recent tests.
- We reject turning off product capabilities while comparing the capabilities of products in real-world use, as we believe that this introduces bias in the results.
- We believe that any claims about what the results of tests show must be valid and accurate, and they must provide both data and evidence that the scenarios tested and the methodologies used do in fact match the resulting claims. In our opinion, test reports without this data and evidence should be rejected.
- We believe that tests that don’t give the tested product vendors an opportunity to engage and to comment on the approach or to validate their configuration are unfair.
- We believe that all comparative tests should follow our draft standards.
- We support the rights of a tester to run any test it wants to, and to test any available product without limitation, consistent with the AMTSO draft standards.
AMTSO is currently running an open pilot to trial the draft standards, and welcomes participation from both member and non-member testers. For more information contact firstname.lastname@example.org
The Anti-Malware Testing Standards Organization (AMTSO) calls for public participation in creating standards for certification and compliance
San Francisco, California – September 6, 2016 – The Anti-Malware Testing Standards Organization (AMTSO) is announcing a call for public participation in developing standards for testing anti-malware products and solutions. These standards will be the basis for AMTSO’s certification program, which is anticipated to launch in the second calendar quarter of 2017.
Anti-malware testing is the critical link between the vendor and end user. If done well, testing can independently verify whether anti-malware solutions work as vendors claim by showing which solutions are most effective at protection. However, improper testing can create misleading results, leading customers to adopt inadequate protection that risks their privacy and security. Dennis Batchelder, General Manager of AMTSO, said, “This is a great opportunity for people outside of AMTSO and even outside of our industry to get involved and help us get our testing standards right. We’d love to see participation from interested individuals, consumer advocates, academics, and publications.”
The Standards Working Group (SWG) will work in cooperation with AMTSO’s membership and other industry participants, and will meet weekly starting September 14, 2016. The SWG will hold an in-person meeting on October 24, 2016, during the AMTSO Member Meeting in Málaga, Spain. Participants may also attend this meeting by conference call. For information on this meeting, please send an email to email@example.com.
The first draft of AMTSO’s testing standards will be available for public review and comment on AMTSO’s website on September 12, 2016. This draft will be updated regularly and comments are invited from all interested parties. AMTSO members will vote on initiating a pilot program to test the standards at the October member meeting, and will consider final approval of the standards and certification program in the second calendar quarter of 2017.
Those interested in joining the SWG or who would like more information, please send an email. Participation is open to both AMTSO members and the general public.
About the Anti-Malware Testing Standards Organization (AMTSO)
AMTSO is a California-based non-profit mutual benefit corporation founded in 2008. AMTSO’s mission is to improve business conditions related to the development, use, testing and rating of anti-malware solutions. AMTSO membership is open to industry-wide academics, reviewers, testers and vendors. Additional information regarding the organization, including charter documents, membership and educational materials are available on the AMTSO website.
M: +1 650 867 2975