AI Native DevCon 2026 New York — practical agent skills grounded in conference talks
86%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
Low
Low-risk findings worth noting
This is Tessl's recommended application of Tyler's talk. It defines a planned benchmark, not completed measurements.
State the decision: model selection, harness choice, workflow routing, or another bounded change. Record each complete stack, including model, harness, configuration, context, tools, budget, and environment. State the accepted outcome and the cost or quality tradeoff that matters.
List authorized repositories, history window, meaningful work types, and excluded trivial changes. Record workflow labels and rough complexity signals. Balance task classes and difficulties so the sample answers the actual decision.
For each task, store the pre-change revision, brief, available context, environment, reference evidence, and grading materials separately. Have a knowledgeable reviewer check that the brief is understandable and solvable. Document known exposure or leakage risk; private does not automatically mean unseen.
Define the deterministic checks, static analysis, intent rubric, and quality rubric needed for the task. State whether success requires every component and retain each component result.
For LLM judges, choose human-reviewed examples spanning workflows, model families, and answer quality. Compare judgments and rankings, inspect disagreement, and revise the rubric where appropriate. Keep a separate validation sample as a recommended control.
| Task class | Candidate stack | Outcome components | Cost per success | Failure cost | Uncertainty |
|---|
State the repetition plan and appropriate uncertainty method. Do not infer meaningful differences from point estimates alone. Keep changed success definitions clearly labeled.
Inspect repeated searches, re-edits, reversions, stopping behavior, and expensive failures. Connect those patterns to task outcomes rather than rewarding a particular step sequence.
End with the scoped recommendation, unsupported generalizations, and next measurement. Do not claim a universal best model, security guarantee, swarm result, or post-training improvement from this benchmark design.
.tessl-plugin
skills
talk-arcolano-autonomy-and-trust
talk-aroussi-decision-context
talk-bevin-agent-assisted-instrument-design
talk-boeckeler-context-lifecycles
talk-braun-context-graphs
talk-carmont-evolving-agent-harnesses
talk-chanezon-gordon-agent-experience-evaluation
talk-cox-secure-agentic-workflows
talk-cunniffe-reusable-agent-platform
talk-davis-agent-tool-policies
talk-debois-concurrent-delivery
talk-dzialets-team-automation
talk-fahmy-harness-api-design
talk-finster-continuous-delivery
talk-fowler-regenerative-software
talk-gavrilescu-factory-architecture
talk-graciolli-amin-verification-aware-programming
talk-gruenbaum-reverse-graph-engineering
talk-hassan-agentic-engineering
talk-hossain-enterprise-agent-adoption
talk-huntley-patch-ready-factories
talk-jain-verifying-intent
talk-katsioloudes-montei-agentic-lifecycle
talk-knox-harness-engineering
talk-kovac-deterministic-memory
talk-lee-perkins-code-readiness
talk-lorenc-machine-speed-security
talk-lubken-software-of-one
talk-meijer-software-specialization
talk-meppiel-versioned-agent-contracts
talk-moss-concurrent-agent-risk
talk-myers-understanding-agent-generated-code
talk-ocytko-scaling-agentic-engineering
talk-oza-automating-design-quality
talk-panzica-agentic-sdlc
talk-pari-patel-agent-awareness
talk-podjarny-trustworthy-software-factories
talk-poulter-factory-improvement
talk-pratik-patel-refined-rag-data
talk-re-ferre-development-platforms
talk-sadogursky-factory-of-factories
talk-shah-training-agent-skills
talk-sharma-mohapatra-evolving-intent
talk-singhal-operating-agents-at-scale
talk-stack-incident-dossiers
talk-tyler-team-coding-benchmarks
talk-wotherspoon-agent-execution-environments
talk-yegge-ai-powered-factories
talk-zuber-leadership-through-coding