Skip to content

dimpletz/software-evaluator

v1.0.0MIT

Software Evaluators are a collection of agents that help you evaluate cloud-native applications and software procurement decisions.

Software Evaluator v1.0.0

A collection of agents for evaluating cloud-native application readiness and software procurement decisions.

Prerequisites

  • VS Code with the GitHub Copilot Chat extension installed and active.
  • Internet access is required — both agents use web research to gather context before asking questions.

Installation

Install via the VS Code Chat Plugin Marketplace using the dimpletz/prompts-collection marketplace source and enable the software-evaluator plugin.

Usage

Open Copilot Chat, select the desired agent, and provide the application or product you want evaluated.

AgentInvoke when…
Cloud Native App EvaluatorYou want to assess an application's 12-factor compliance and cloud-native readiness.
Software Procurement EvaluatorYou want to evaluate an off-the-shelf software product for fit against your organization's needs.

Components

graph TD
    A[software-evaluator plugin]
    A --> B[Cloud Native App Evaluator]
    A --> C[Software Procurement Evaluator]

    subgraph B_flow [Cloud Native App Evaluator workflow]
        B1[Web research on tech stack] --> B2[Targeted interview<br/>unknowns only] --> B3[12-factor compliance report<br/>+ remediation roadmap]
    end

    subgraph C_flow [Software Procurement Evaluator workflow]
        C1[Web research on product] --> C2[Targeted interview<br/>org-specific questions] --> C3[Fit score report<br/>+ procurement recommendation]
    end

    B --> B_flow
    C --> C_flow

Cloud Native App Evaluator

A research-first 12-factor compliance evaluator. Rather than presenting a generic checklist, it:

  1. Uses web research to learn the user's tech stack, framework defaults, and deployment platform.
  2. Determines which 12-factor concerns are already handled by the platform or framework.
  3. Interviews the user only about application-specific unknowns.
  4. Produces a context-specific compliance report with scores and an actionable remediation roadmap.

Scope: 12-factor App methodology evaluation only. Does not perform general code reviews or security audits.

Software Procurement Evaluator

A research-first procurement fit evaluator based on ISO/IEC 25010. It:

  1. Researches the off-the-shelf product (features, integrations, security certifications, pricing, vendor reputation) from public sources.
  2. Asks the user only about organizational context (existing systems, workflows, scale, compliance requirements, budget).
  3. Scores fit across 10 dimensions and produces a prioritized procurement recommendation report.

Scope: Off-the-shelf software evaluation only. Does not review custom-built source code or make final purchasing decisions.

Author

Dimpletz