Skip to main content
The state of ai impact assessment
Testing Vendor and Criminal Claims Before You Act on ThemVulnerability & Exposure Management
4 min readFor CISOs & Security Leaders

Testing Vendor and Criminal Claims Before You Act on Them

Scope

When a threat claim arrives with alarming specifics but no proof, your team must decide how much weight to give it, what actions to take, and what to verify. This guide uses the example of Remus Stealer, whose developers claim a feature in version 1.3.9 allows operators to access a compromised Gmail mailbox from the service's dashboard, even after a password change and session revocation. Hudson Rock reviewed the promotional material, questioned the developer and a self-described customer, but did not perform reverse engineering or controlled validation. Use this as a template for assessing similar claims.

Key Concepts and Definitions

Claim. A statement from a party with an incentive to exaggerate, such as criminal marketplaces and security vendors.

Evidence of presence. Screenshots, demos, or testimonials showing a feature exists. Remus's screenshots show message lists, individual emails, and a "Mail" option on compromised device records.

Evidence of capability. Proof that a feature works as claimed, requiring a controlled test or reverse engineering with documented conditions.

Source independence. Whether the person vouching for a capability has a stake in it. A self-described customer who publicly endorses a product is not independent.

Persistence. Continued access after remediation. Always question which remediation steps were taken, in what order, and what the attacker retained.

Requirements Breakdown

Use this five-gate check before a claim changes your risk posture or budget.

  1. Origin. Who is making the claim, and what do they gain? Seller marketing is a hypothesis, not a finding.
  2. Specificity. Does the claim name mechanisms? The Remus developer cited browser memory interaction but withheld details needed to assess claims of evading Google's anti-fraud checks. Withheld detail is a signal itself.
  3. Reproducibility. Has anyone tested it under controlled conditions? Testimonials that skip details can't be reproduced.
  4. Consistency with documented behavior. Google states that password changes invalidate access and refresh tokens used by applications with Gmail permissions. A claim contradicting this needs a proposed mechanism, not just assertion.
  5. Scope. Separate what the evidence shows from what it implies. Remus screenshots don't demonstrate a universal multifactor-authentication bypass, the ability to send mail, or control of every account tied to the address. They don't establish a Gmail zero-day.

Most fresh underground claims land at "plausible, unverified," which is a legitimate classification. Record it as such.

Implementation Guidance

Classify, don't dismiss. "Unverified" doesn't mean "false." Continued access after a password change is possible under some conditions. Your response should match the plausible downside, not the marketing.

Assign confidence labels. Use a simple scale in your threat intelligence workflow: confirmed, probable, unverified, contradicted. Tag every claim with its label and the date. Re-evaluate when an independent test is published.

Ask your intel provider the gate questions. When a vendor brief cites a new capability, ask whether the provider performed reverse engineering or controlled validation, or relayed seller statements. Demand transparency like Hudson Rock's willingness to state what it didn't do.

Run recovery as a multi-layer procedure. Because persistence is unproven, a password change should never be your whole response. Build your account recovery runbook, aligned with NIST SP 800-61 handling phases, around these steps:

  • Begin from a separate, trusted device. Disconnect the suspected infected machine and remove the malware before anyone signs in to accounts from it again.
  • Change the password, then review recent security events and signed-in devices. Remove unfamiliar access, including applications with access to the account and device sessions.
  • Inspect mailbox settings for unauthorized forwarding, filters, delegated access, and changes to remote mail access.
  • Check recovery email, recovery phone number, and verification methods.
  • Clean or rebuild the endpoint. Run trusted security software; Google notes that resetting the computer and reinstalling the operating system is another option.
  • Review other accounts that rely on the mailbox for sign-in or recovery, especially if unfamiliar verification or password-reset messages appear.

Order matters. Securing the account while the endpoint is still infected invites reinfection and re-theft.

Fund prevention over speculation. Practical defense doesn't depend on whether Remus's claim is true. Endpoint Detection and Response coverage, browser hardening, and phishing-resistant authentication reduce infostealer exposure regardless of the claim's validity. Map these to CIS Controls v8.1 and NIST SP 800-63 authenticator guidance.

Common Pitfalls

  • Treating screenshots as proof. A convincing interface shows a feature exists, not that it performs as advertised.
  • Accepting testimonials without a protocol. If the account doesn't document which sessions were reset and when the password changed, you can't tell what was tested.
  • Overcorrecting to panic. Escalating to the board over an unverified claim burns credibility you'll need later.
  • Undercorrecting to dismissal. "Unproven" is not "safe." Keep your recovery procedure at full depth.
  • Resetting credentials on a live infection. Changing a password from an infected device hands the new credential to the same malware.
  • Stopping at the mailbox. The mailbox is a stepping stone because it receives recovery links and verification messages. Downstream accounts need review.

Quick Reference Table

Question What to check Remus example
Who's claiming? Incentive and independence Seller marketing; customer independence not established
Mechanism named? Specific, testable detail Browser memory interaction cited; anti-fraud evasion details withheld
Tested under control? Reverse engineering or controlled validation Neither performed per Hudson Rock
Matches vendor docs? Compare to official behavior Google documents token invalidation on password change
Scope of proof? Claimed vs. demonstrated No demonstrated MFA bypass, mail sending, or zero-day
Confidence label Confirmed / probable / unverified / contradicted Unverified
Response Size to plausible downside Full recovery procedure; endpoint cleanup first

Bookmark the table and apply it to the next claim that sounds too advanced to be true. The discipline is the same each time: label the evidence, size the response to the risk, and revisit when someone publishes a real test.

Promotional banner for the CUI buildout guide

You Might Also Like