AI Native DevCon 2026 New York — practical agent skills grounded in conference talks
86%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
Low
Low-risk findings worth noting
This worksheet is Tessl's recommended application of Carmont's talk. Use it to test one explanation for a performance or cost change. It is not a record of a completed experiment until results are supplied.
Describe the user's task, observed regression, and available evidence. State separate model, harness, and evaluation hypotheses. For each, record one observation that would support it and one that would weaken it. Mark aggregate numbers that lack comparable inputs.
Record the model and effort setting, harness version, relevant instruction layers, task set, grader, quality measure, cost, and latency. Identify a small set of cases whose intended answers are understood. Note tasks with missing prerequisites or possibly invalid expected answers.
Quote the instruction or describe the component to change. Record its purpose and original justification. Explain whether it duplicates model behavior, contradicts another instruction, imposes an unnecessary sequence, or loads irrelevant context. State the behavior that must survive its removal.
Do not substitute “remove 80%” for a hypothesis. Preserve the user's actual policy and acceptance requirements.
| Case | Existing harness | Reduced harness | Outcome evidence | Cost and latency | Trace explanation |
|---|
Use comparable inputs and record repeated-trial uncertainty where available. Hold back additional representative tasks for checking whether the apparent improvement generalizes. These controls are recommendations here, not fixed procedures supplied by the speaker.
For each regression, identify the smallest targeted guidance that could restore required behavior. Rerun the affected comparison without changing the grader to favor the candidate. Inspect for skipped checks, impossible tasks, and alternate success paths.
End with retain, revise, or reject; the evidence behind that decision; unresolved risks; and the reversible rollout or next experiment. Keep planned results blank and distinguish measured savings from expected savings.
.tessl-plugin
skills
talk-arcolano-autonomy-and-trust
talk-aroussi-decision-context
talk-bevin-agent-assisted-instrument-design
talk-boeckeler-context-lifecycles
talk-braun-context-graphs
talk-carmont-evolving-agent-harnesses
talk-chanezon-gordon-agent-experience-evaluation
talk-cox-secure-agentic-workflows
talk-cunniffe-reusable-agent-platform
talk-davis-agent-tool-policies
talk-debois-concurrent-delivery
talk-dzialets-team-automation
talk-fahmy-harness-api-design
talk-finster-continuous-delivery
talk-fowler-regenerative-software
talk-gavrilescu-factory-architecture
talk-graciolli-amin-verification-aware-programming
talk-gruenbaum-reverse-graph-engineering
talk-hassan-agentic-engineering
talk-hossain-enterprise-agent-adoption
talk-huntley-patch-ready-factories
talk-jain-verifying-intent
talk-katsioloudes-montei-agentic-lifecycle
talk-knox-harness-engineering
talk-kovac-deterministic-memory
talk-lee-perkins-code-readiness
talk-lorenc-machine-speed-security
talk-lubken-software-of-one
talk-meijer-software-specialization
talk-meppiel-versioned-agent-contracts
talk-moss-concurrent-agent-risk
talk-myers-understanding-agent-generated-code
talk-ocytko-scaling-agentic-engineering
talk-oza-automating-design-quality
talk-panzica-agentic-sdlc
talk-pari-patel-agent-awareness
talk-podjarny-trustworthy-software-factories
talk-poulter-factory-improvement
talk-pratik-patel-refined-rag-data
talk-re-ferre-development-platforms
talk-sadogursky-factory-of-factories
talk-shah-training-agent-skills
talk-sharma-mohapatra-evolving-intent
talk-singhal-operating-agents-at-scale
talk-stack-incident-dossiers
talk-tyler-team-coding-benchmarks
talk-wotherspoon-agent-execution-environments
talk-yegge-ai-powered-factories
talk-zuber-leadership-through-coding