Name: experiments/eval-improve
Rating: 0.94 (1 reviews)
Author: experiments

experiments/eval-improve

Analyze eval results, diagnose low-scoring criteria, fix tile content, and re-run evals — the full improvement loop automated

1.02x

Review — 90%

Does it follow best practices?

Validation — 11 / 11 Passed

Validation for skill structure

Evaluation results

100%

Payments Tile Eval Analysis

Eval Bucket Classification

Criteria

Without context

With context

Bucket A: idempotency key

100%

Bucket B: webhook signature

100%

Bucket C: HTTP status codes

100%

Bucket B: currency precision

100%

Bucket D: API version pinning

100%

Bucket D highest priority

100%

Bucket B diagnosis present

100%

Bucket C action suggested

50%

100%

Bucket A no-action

87%

100%

80% threshold applied

80%

100%

Without context: $0.2341 · 1m 10s · 9 turns · 58 in / 3,805 out tokens

With context: $0.4264 · 1m 40s · 17 turns · 2,793 in / 5,504 out tokens

100%

Webhook Processor Tile: Retry Reliability Fix

Targeted Tile Editing

Criteria

Without context

With context

Explicit retry intervals

100%

Rubric language used

100%

HMAC section unchanged

100%

TLS section unchanged

100%

Observability section unchanged

100%

Processing section unchanged

100%

Retry section only changed

100%

Concise addition

100%

Max retry count preserved

100%

Fast acknowledgement preserved

100%

Without context: $0.2012 · 45s · 9 turns · 10 in / 2,794 out tokens

With context: $0.3735 · 1m 18s · 17 turns · 18 in / 4,601 out tokens

100%

Data Pipeline Tile: Consistency Audit

Cross-file Contradiction Detection

Criteria

Without context

With context

Retry count contradiction found

100%

Auth failure contradiction found

100%

All three files referenced

100%

File attribution per contradiction

100%

Auth contradiction despite scope

100%

Verbatim quotes included

100%

Without context: $0.2704 · 1m 21s · 10 turns · 11 in / 4,402 out tokens

With context: $0.5370 · 2m 19s · 21 turns · 83 in / 7,100 out tokens

100%

Code Review Tile: Regression Investigation

Regression Root Cause Analysis

Criteria

Without context

With context

Contradicting clause identified

100%

Contradiction mechanism explained

100%

Remove/clarify approach taken

100%

Specific text targeted

100%

No compensating additions

100%

Other sections preserved

100%

Pre-review list intact

100%

Without context: $0.2102 · 54s · 11 turns · 60 in / 2,721 out tokens

With context: $0.2735 · 1m 13s · 13 turns · 77 in / 4,041 out tokens

100%

API Integration Tile: Eval Rubric Review

Redundant Criteria Management

Criteria

Without context

With context

All redundant criteria identified

100%

Options presented per criterion

100%

Useful criteria preserved

100%

Weight redistribution correct

100%

80% threshold applied

100%

Non-redundant scores unchanged

100%

Below-threshold excluded

100%

Removal option named explicitly

100%

Without context: $0.3455 · 1m 41s · 12 turns · 13 in / 5,637 out tokens

With context: $0.7251 · 2m 49s · 24 turns · 1,587 in / 9,643 out tokens

Install with Tessl CLI

npx tessl i experiments/eval-improve@0.5.0

Evaluated: about 12 hours ago
Agent: Claude Code

Table of Contents

Payments Tile Eval Analysis Webhook Processor Tile: Retry Reliability Fix Data Pipeline Tile: Consistency Audit Code Review Tile: Regression Investigation API Integration Tile: Eval Rubric Review