Skip to content

haydarrjr/agent-engineering-toolkit

v1.4.0Apache-2.0

Open-source engineering skills for repository work, Python, host-native MARGOS orchestration, ReThinking audits, and Agent Plugins authoring.

Changelog

All notable project changes are documented here.

[1.4.0] - 2026-09-21

Issue #24 Verification Governor

  • Added provider-neutral Verification Candidate, Opportunity, Plan, Reflex, Receipt, and deterministic FindingLedger contracts.
  • Separated independent unresolved finding verification from substitutable route selection; verified findings cannot enter optional JEV ranking and mandatory verifiers cannot be skipped.
  • Added one-batched-Noul Jev integration with exact structured paths, privacy-bounded projections, stale-calibration/provider-error fallback, and exact host dispatch receipts.
  • Added forced A/B/C/D verification benchmark and strict CI gate with disjoint calibration/holdout partitions, downstream gold labels, critical-path economics, and explicit JEV_RESEARCH_ONLY promotion status.
  • Updated MARGOS architecture, evaluation, TypeSafe conformance, provenance, and ReThinking audit surfaces.

[1.3.0] - 2026-09-21

MARGOS JEV v3

  • Hardened routing with independent ambiguity, verification-risk, and direct-escalation thresholds plus deterministic Reflex Admission receipts.
  • Added versioned Context Reflex contracts, staged metadata/evidence evaluation, exact evidence capsules, runtime fingerprints, and forced A/B/C/D benchmark tooling.
  • Added the Issue #18 ReThinking and Agent Plugins surface audit with 20 classifications: 16 KEEP, 2 NARROW, 1 RELOCATE, and 1 UNVERIFIED.
  • Historical live A/B/C/D evaluation requested jev-latest, observed jev-1.13.0, and returned JEV_PROMOTED_FOR_FROZEN_SUITE; the corrected integration audit supersedes that claim with JEV_NOT_PROMOTED because remote latency produced no material downstream benefit.
  • Added malformed-output contract validation and bounded retry telemetry at the TypeSafe adapter boundary.

[1.3.1] - 2026-09-21

JEV integration correction

  • Corrected TypeSafe structured paths to be relative to the request state object for routing and Context Reflex questions.
  • Added a deterministic Policy compute floor for hard verification evidence and skip admission when JEV cannot materially change an executable route.
  • Removed fixture-oracle leakage from the forced benchmark, separated downstream host verification from route-contract matching, and added end-to-end efficiency/material-benefit promotion gates.
  • Superseded the historical JEV_PROMOTED_FOR_FROZEN_SUITE claim pending a fresh live run with the corrected protocol.
  • Implemented Issue #21 ValueOfCall admission over concrete executable operations, pooled session-scoped Jev transport, validated memoization/singleflight, metadata-first lazy retrieval, and bounded retrieval telemetry.
  • Added JEV v4 executable counterfactual benchmark arms with unique calibration/holdout partitions, warm replay, raw host/loader outcomes, and Policy-only default promotion gates.

[Unreleased]

  • Added official TypeSafe design-time conformance/freshness provenance and shadow-first rollout guidance without vendoring or making the skill a MARGOS runtime dependency.

[1.2.0] - 2026-09-19

Added

  • MARGOS JEV v2 runtime routing: explicit live Reflex provider selection on the normal routing CLI, probability-derived semantic escalation, direct Jev state-path questions, pinned-model calibration bindings, and stale-calibration detection.

  • Privacy-safe semantic Context Reflex capsules: explicit remote opt-in, exact-prefix derivation, SHA-256 binding, deterministic 512-character cap, and secret-like prefix suppression.

  • Redacted Codex/MARGOS trace benchmark format, schema, fixture, CI gate, and routing/context metrics for local preflight without committing private transcripts.

  • MARGOS vNext three-layer Policy -> Reflex -> Execution contracts with versioned routing-state, Reflex, decision, and route-receipt schemas.

  • Optional stdlib TypeSafe Jev Reflex adapter with minimized state projection, typed fail-closed fallback, and no mandatory API key/dependency.

  • Frozen MARGOS routing benchmark with authority-boundary, keyword-noise, fallback, escalation, serialization, and abstention coverage.

  • Research and evaluation documentation covering Jev inspiration, routing/cascade literature, calibration, and selective deferral.

  • MARGOS Context Governor Phase 1 deterministic retention/rehydration contracts and Phase 2 optional Context Reflex with atomic Noul judgments, batching, minimized remote projection, and conservative fallback.

  • MARGOS Context Governor Phase 3 role-aware child handoffs with versioned child contracts/policy, route-to-context hash binding, bounded Scout/Worker/Verifier/Critic bundles, and parent-side rehydration requests.

  • MARGOS Context Governor Phase 4 frozen counterfactual benchmark, false-omit/rehydration/calibration metrics, privacy review, live Jev research mode, and optional host-neutral root-compaction proposal contract.

Changed

  • Routing composition now uses high-mass task-ambiguity and verification-risk distributions together with the explicit escalation probability instead of leaving those two Jev signals telemetry-only.

  • Context Jev questions now reference explicit paths relative to the request state (candidates[N]); calibrated deployments can bind model, question set, threshold policy, projection version, and corpus hash.

  • MARGOS now separates coordination shape, disposition, compute tier, and child role instead of conflating critic role with compute.

  • Codex and Copilot adapters consume proposed abstract routes while still requiring host runtime evidence before claiming delegated execution.

Security / boundaries

  • Semantic capsules remain disabled by default and never mutate canonical evidence; private/full payload upload is still not a portable default.

  • Calibration claims require an explicit pinned model plus a matching PASSED binding; aliases such as jev-latest are treated as stale for calibrated operation.

  • Redacted trace inputs must declare redacted=true and pass committed secret-pattern checks.

  • Reflex output cannot prove host capability or widen permissions.

  • Remote Reflex projection omits host identity and literal model/provider constraint values.

  • CI never requires a TypeSafe credential or live external model call.

  • Context Reflex is explicit opt-in: API-key presence alone does not enable it, missing-key selection performs zero network requests, and raw context payloads are excluded from the remote projection.

  • Phase 4 CI remains synthetic/offline, committed context fixtures are secret-scanned, and optional root compaction cannot run without explicit opt-in plus proven host capability.

Planned

  • Gather external installation and compatibility reports.
  • Collect live, explicitly authorized Jev routing measurements before making any calibration or promotion claim.

[1.1.0] - 2026-09-18

Added

  • Host-native MARGOS compute routing with ECONOMY_READ, BALANCED_EXEC, FRONTIER_REASONING, and INDEPENDENT_CRITIC classes.
  • GitHub Copilot / VS Code leaf agents under com.github.copilot/agents/ with host-owned model: auto binding.
  • Deterministic MARGOS adapter validation and routing regression coverage.
  • Separate deterministic Codex and GitHub Copilot marketplace rendering.

Changed

  • MARGOS now treats the selected root model as the parent/integration session rather than a blanket child-model constraint.
  • Escalation is evidence-driven: failed verification, conflicting evidence, material ambiguity, cross-system impact, or explicit deeper-review need.
  • Release metadata and provenance were advanced to the 1.1.0 public feature release.

Security / boundaries

  • No MCP server, background runtime daemon, AERO kernel, telemetry sink, or global model installer was added.
  • Source validation still does not claim live host installation, child execution, or exact automatic model selection.

[1.0.0] - 2026-09-17

Added

  • Clean Apache-2.0 OSS lineage.
  • Five-skill routing model: Software Craft, Python Engineering Harness, MARGOS, ReThinking, and Agent Plugins Author.
  • Portable Agent Plugins 1.0 manifest plus Codex and GitHub Copilot marketplace surfaces.
  • Deterministic source validation and reproducible release packaging.
  • Public governance, contribution, security, provenance, and maintainer workflow documentation.