or run

npx @tessl/cli init
Log in

Version

Files

tile.json

rubric.jsonevals/scenario-1/

{
  "context": "This criteria evaluates how effectively the engineer uses pnpm's workspace and monorepo capabilities to build the CLI tool. The focus is on proper usage of pnpm workspace configuration, package discovery, filtering, and command execution features.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Workspace initialization",
      "description": "Uses pnpm to create a valid pnpm-workspace.yaml file with proper YAML structure and package glob patterns (e.g., 'packages/*', 'apps/*'). Should use pnpm's workspace configuration format with a 'packages' array.",
      "max_score": 25
    },
    {
      "name": "Package discovery",
      "description": "Uses pnpm workspace commands or APIs to discover and list all packages in a workspace. Should leverage pnpm's built-in package discovery rather than implementing custom file system traversal. May use commands like 'pnpm list' with appropriate flags or pnpm workspace APIs.",
      "max_score": 25
    },
    {
      "name": "Package filtering",
      "description": "Implements package filtering using pnpm's --filter flag or filter API which supports glob patterns for package selection. Should correctly apply filters to limit operations to matching packages using pnpm's filtering capabilities.",
      "max_score": 25
    },
    {
      "name": "Command execution",
      "description": "Executes commands across workspace packages using pnpm's recursive command execution features (e.g., 'pnpm -r exec', 'pnpm --filter exec'). Should properly invoke pnpm to run commands in multiple packages and capture output.",
      "max_score": 25
    }
  ]
}