Artifact Security Scam and Phishing Evaluation August 2025

Test Lab

Artifact Security

Test Title

Artifact Security Scam and Phishing Evaluation August 2025

AMTSO Test ID

AMTSO-LS1-TP159

Platform

Cross-platform

Vendor

Bitdefender, Gen Digital, McAfee

Publication date

2025-10-22

Statement from Test Lab

Discover the first independent evaluation on how AI Assistants are reshaping the fight against scams. Can LLMs finally provide a decisive solution in this fast evolving landscape? With unparalled transparency in our testing, full detailed results are available on our Github for every single test scenario. Backed by completely independent, unsponsored testing.

Tested products

VendorProductVendor status
BitdefenderPremium Security & Scam Copilotincluded
Gen DigitalNorton 360 Advanced & Genie AI Scam Protectionparticipant
McAfeeTotal Protection & Scam Detectorincluded

AMTSO Standard compliance info

Notification issued

2025-08-11

Notification method

Publicly posted test plan, Contact list notification

Test plan

Commencement date

2025-08-19

Participants

1
These Vendors chose to adopt Participant status under the AMTSO Standard, gaining certain guaranteed rights in return for attestations.

“Included” Vendors

2

These Vendors did not chose to adopt Participant status under the AMTSO Standard, but may have engaged with the test lab in other ways.

Commentary dates

CommentaryStart dateEnd date
Phase 1 Commentary2025-08-122025-10-22
Phase 2 Commentary2025-10-222025-10-29

AMTSO Standard compliance status

Confirmed Compliant with AMTSO Standard v1.3Compliance report