Vulnerabilities & CVEs SecurityWeek 1 month ago

Microsoft AI Code of Conduct Sets Cyberattack Boundaries, Chain of Command, Safety Constraints

CN
CyberNew Threat Research Desk
• Original Reporting: SecurityWeek
CyberNew Threat Intel Assessment
Assessed Severity: HIGH
Impacted Surface
Enterprise Perimeter & Network Defense
Intelligence Sector
Vulnerabilities & CVEs

Analyst Takeaway

"Microsoft AI has published a draft “Humanist AI Code of Conduct” for its MAI Models, spelling out safety rules for offensive cyber capabilities, limits on autonomous AI agents, and a dedicated review track for cybersecurity and other specialized uses. According to the code of conduct , models are blocked from producing working exploit code, attack tooling, planning and targeting methodologies,..."

Recommended Defense & Mitigation

  • Access Review: Audit administrative roles, enforce phishing-resistant MFA, and review privilege escalations.
  • Credential Rotation: Rotate high-privilege service credentials and tokens associated with impacted services.
Curated & Verified by CyberNew Threat Intelligence Desk Standard Defense Framework (NIST / MITRE ATT&CK)
AI code of conduct

Microsoft AI has published a draft “Humanist AI Code of Conduct” for its MAI Models, spelling out safety rules for offensive cyber capabilities, limits on autonomous AI agents, and a dedicated review track for cybersecurity and other specialized uses.

According to the code of conduct, models are blocked from producing working exploit code, attack tooling, planning and targeting methodologies, intrusion procedures, evasion techniques, operational guidance, or other assistance that would enable or improve a cyberattack. Microsoft says these restrictions apply regardless of how a request is framed.

The rule falls under what Microsoft calls Absolute Constraints, safeguards that neither the companies deploying its models nor their end users can override. The tech giant draws the line between understanding an attack, or working to defend against one, and gaining the practical means to carry it out.

Within that limit, MAI models can still assist with authorized and lawful defensive work. That includes vulnerability discovery, malware analysis, proof-of-concept exploit development and testing, and general educational material on how attacks work.

Blocking rogue instructions from outside content

The code also addresses instructions that arrive through outside content. Authority over a model’s behavior flows only through the Chain of Command, the document says. This includes the code of conduct itself, then policies set by the companies deploying the model (operators), then individual users’ preferences.

Tool outputs, file contents, webpages and messages from other AI systems carry no authority on their own, according to the code, unless it’s explicitly delegated through that chain without overriding the delegating authority or the Absolute Constraints. Suspicious content needs to be flagged to users and operators when relevant.

Advertisement. Scroll to continue reading.

The models are also required to keep their reasoning visible. This includes no obscured chain of thought, no communicating “in neuralese,” and no concealing actions from human overseers.

Keeping agents on a short leash

Written By Eduard Kovacs

Source Verification & Original Intelligence

This threat report was reviewed by CyberNew analysts and cross-referenced with primary security disclosures from SecurityWeek.

Primary Advisory →