CtrlK
BlogDocsLog inGet started
Tessl Logo

markusdowne/error-triage-ladder

Diagnoses and routes failures by analyzing error patterns, classifying severity, and applying retry logic, suppression budgets, and escalation rules. Use when handling errors, troubleshooting failures, recovering from API errors or timeouts, deciding whether to retry or escalate an issue, or managing service outages and tool dependency failures. Applies to any scenario where a check has failed, evidence of success is missing, or an unresolved error needs a structured response. Includes explicit untrusted-content/prompt-injection guardrails for third-party inputs.

98

1.16x

Quality

94%

Does it follow best practices?

Impact

100%

1.16x

Average score across 9 eval scenarios

Overview
Skills
Evals
Files

task.mdevals/scenario-7/

CI/CD Artifact Verification Handler

Problem Description

A software company runs a CI/CD pipeline that builds and packages their desktop application. The build step completes without error codes, but the team has noticed that sometimes the output directory is empty or the expected installer file is simply missing — no error was thrown, but there is also no proof that the build succeeded. The pipeline previously just reported "success" based on exit code alone, which led to shipping a release with a broken artifact.

The engineering team wants a Python script that checks a build output directory after a build step completes and implements a robust response when success cannot be confirmed. The script should integrate into their pipeline as a post-build validation step, decide how to handle missing or incomplete outputs, and produce a structured record of what it found and what action it took.

Output Specification

Write a Python script post_build_checker.py that:

  • Accepts a directory path as a command-line argument
  • Checks for the presence of expected output files
  • Implements appropriate handling when outputs are absent or incomplete
  • Writes a triage_result.json file with a structured record of the check outcome

Also write a INTEGRATION.md file explaining how to integrate this script into a CI pipeline and what each field in triage_result.json means.

Input Files

The following files are provided as inputs. Extract them before beginning.

=============== FILE: inputs/expected_files.txt =============== installer.exe installer.dmg checksums.sha256 release_notes.txt

Install with Tessl CLI

npx tessl i markusdowne/error-triage-ladder

evals

SKILL.md

tile.json