AI Native DevCon 2026 New York — practical agent skills grounded in conference talks
86%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
Low
Low-risk findings worth noting
Source: Shrey Shah, Stop Writing Skills. Start Training Them: Self-Improving Skills for Coding Agents, AI Native DevCon New York 2026. Recording. All anchors refer to original numbered cues in the transcript. Short quotations below preserve the supplied transcription, including spoken wording.
| Topic | Source anchor | Exact short quote | Application and scope |
|---|---|---|---|
| Evidence over patching | 00:03:12–00:06:00, cues 41–80 | “you never check whether that line actually helped” | Unmeasured fixes can create hidden regressions. |
| Core loop | 00:06:06–00:07:30, cues 81–103 | “Accept and edit only if the held out score goes up.” | An independent gate controls candidate acceptance. |
| Four components | 00:07:36–00:09:25, cues 104–134 | “tasks.” | Training requires tasks, scorer, editor, and acceptance rule. |
| Three splits | 00:09:39–00:12:11, cues 137–173 | “the last four are the test set.” | The example separates training, evaluation, and final test cases. |
| Cheap-first gate | 00:12:14–00:14:29, cues 174–209 | “There is no LLM in this decision.” | Structural checks and focused rechecks precede paired evaluation. |
| LLM judge | 00:14:33–00:16:25, cues 210–237 | “The judge goes into the score.” | A fixed structured judge scores but does not choose acceptance. |
| Bounded edits and rejections | 00:17:11–00:18:40, cues 249–272 | “remember the rejection.” | Small edits and concise rejection history reduce repeated mistakes. |
| Reported run | 00:18:44–00:21:06, cues 273–305 | “The skill started weak on purpose” | The reported gain concerns a deliberately weak example. |
| Optimizer checks | 00:21:37–00:22:44, cues 313–328 | “If your optimizer improves on pure randomness” | Planted defects and null tests probe the trainer. |
| Consolidation | 00:22:50–00:24:09, cues 329–347 | “every eight steps.” | The speaker describes periodic consolidation and future recursion. |
| Output and product definition | 00:24:19–00:26:25, cues 349–381 | “It is defining what the good looks like.” | The golden dataset defines desired behavior. |
| Memory Q&A | 00:27:01–00:28:48, cues 385–409 | “there is no good answer to this.” | Memory curation remains imperfect and personal. |
| Cost Q&A | 00:29:02–00:30:30, cues 412–432 | “it depends on the complexity of the skill” | Quota and duration anecdotes do not establish fixed training cost. |
.tessl-plugin
skills
talk-arcolano-autonomy-and-trust
talk-aroussi-decision-context
talk-bevin-agent-assisted-instrument-design
talk-boeckeler-context-lifecycles
talk-braun-context-graphs
talk-carmont-evolving-agent-harnesses
talk-chanezon-gordon-agent-experience-evaluation
talk-cox-secure-agentic-workflows
talk-cunniffe-reusable-agent-platform
talk-davis-agent-tool-policies
talk-debois-concurrent-delivery
talk-dzialets-team-automation
talk-fahmy-harness-api-design
talk-finster-continuous-delivery
talk-fowler-regenerative-software
talk-gavrilescu-factory-architecture
talk-graciolli-amin-verification-aware-programming
talk-gruenbaum-reverse-graph-engineering
talk-hassan-agentic-engineering
talk-hossain-enterprise-agent-adoption
talk-huntley-patch-ready-factories
talk-jain-verifying-intent
talk-katsioloudes-montei-agentic-lifecycle
talk-knox-harness-engineering
talk-kovac-deterministic-memory
talk-lee-perkins-code-readiness
talk-lorenc-machine-speed-security
talk-lubken-software-of-one
talk-meijer-software-specialization
talk-meppiel-versioned-agent-contracts
talk-moss-concurrent-agent-risk
talk-myers-understanding-agent-generated-code
talk-ocytko-scaling-agentic-engineering
talk-oza-automating-design-quality
talk-panzica-agentic-sdlc
talk-pari-patel-agent-awareness
talk-podjarny-trustworthy-software-factories
talk-poulter-factory-improvement
talk-pratik-patel-refined-rag-data
talk-re-ferre-development-platforms
talk-sadogursky-factory-of-factories
talk-shah-training-agent-skills
talk-sharma-mohapatra-evolving-intent
talk-singhal-operating-agents-at-scale
talk-stack-incident-dossiers
talk-tyler-team-coding-benchmarks
talk-wotherspoon-agent-execution-environments
talk-yegge-ai-powered-factories
talk-zuber-leadership-through-coding