CtrlK
BlogDocsLog inGet started
Tessl Logo

jbaruch/speaker-toolkit

Four-skill presentation system: ingest talks into a rhetoric vault, run interactive clarification, generate a speaker profile, then create new presentations that match your documented patterns. Includes a 102-entry Presentation Patterns taxonomy (91 observable, 11 unobservable go-live items) for scoring, brainstorming, and go-live preparation.

97

1.24x
Quality

94%

Does it follow best practices?

Impact

98%

1.24x

Average score across 30 eval scenarios

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

task.mdevals/scenario-30/

Vault Clarification Interactive Session

Problem/Feature Description

One talk ("Robocoders: Judgment Day") has been processed through vault-ingress. The automated analysis identified rhetoric patterns, humor beats, and blind spots that the transcript and slides alone cannot fully resolve. The vault is in its initial state — all infrastructure config fields are empty (config.clarification_sessions_completed: 0).

Setup

Download the vault state:

curl -sLO https://github.com/jbaruch/speaker-toolkit/raw/main/eval-resources/scenario-clarification-session/tracking-database.json
curl -sLO https://github.com/jbaruch/speaker-toolkit/raw/main/eval-resources/scenario-clarification-session/rhetoric-style-summary.md

Task

The speaker has just delivered "Robocoders: Judgment Day". The vault has automated observations that need human input before they can be used downstream:

  • The delayed_self_introduction pattern was flagged as surprising — the analysis can't tell whether it was deliberate or accidental.
  • Four humor beats were detected, plus an 8-second transcript gap after slide 15 that may indicate an off-script moment.
  • The demo section (slides 14-16), theatrical opening (slides 1-2), and Q&A section (slides 30-31) have content the transcript can't capture: audience reactions, stage effects, room dynamics.
  • This is the speaker's first session — config.clarification_sessions_completed: 0 and infrastructure config fields are empty.

Run the clarification needed to resolve those gaps and bring the vault to a state where downstream skills (vault-profile, presentation-creator) can rely on it.

Output Specification

Produce an updated tracking-database.json with:

  • config.clarification_sessions_completed incremented to 1
  • All infrastructure config fields populated from speaker responses
  • confirmed_intents array with at least 1 entry (the delayed intro pattern)
  • Each talk entry updated with humor_postmortem (grades per beat) and blind_spot_observations

Also produce an updated rhetoric-style-summary.md incorporating the new findings from the clarification session.

evals

README.md

tile.json