Skip to content

farnooshmemari/soc-benchmark-author

v1.0.0

Extend the Adaptive Agent Harness security-alert benchmark safely: author labelled alerts plus deterministic mock responses for both strategies, then validate schema, mock coverage, and the expected panel-vs-hierarchical outcome before running the benchmark.

What this package declares

The file a client reads when it loads this plugin, exactly as this revision carries it.

plugin.json
{
  "$schema": "https://agent-plugins.org/schemas/1.0.0/plugin.schema.json",
  "name": "soc-benchmark-author",
  "version": "1.0.0",
  "description": "Extend the Adaptive Agent Harness security-alert benchmark safely: author labelled alerts plus deterministic mock responses for both strategies, then validate schema, mock coverage, and the expected panel-vs-hierarchical outcome before running the benchmark.",
  "author": {
    "name": "Farnoosh Memari"
  },
  "keywords": [
    "benchmark alert",
    "new alert",
    "sample_alerts",
    "mock_responses",
    "ground truth",
    "preferred_strategy",
    "credential_compromise",
    "suspicious_access",
    "malware_like_behavior",
    "privilege_escalation"
  ],
  "repository": "https://github.com/FarnooshMemari/adaptive-agent-harness"
}

What else this package ships

These files come with the package and this site does not publish them. They are listed so you know what is there before you install it.

  • validate_benchmark.py
View on GitHub