From Pipelines to Prompts: Surviving the Shift to AI — Panel (Stephane Jourdan, Simon, Samantha)

A practitioner panel of engineers who lived through cloud, DevOps, and DevSecOps transitions, now reflecting on the AI-native shift. Core thesis: the AI shift is more dramatic and faster-spreading than cloud-native because it forces every department to adapt, not just engineering. Teams that survive are those with disciplined feedback loops, rigorous harness engineering, and clear observability.

---

Panelists

• Stephane Jourdan — practitioner and panel moderator/contributor
• Simon (Saxo Bank) — engineering perspective from a financial services context
• Samantha — practitioner focused on operational and organisational dimensions

---

Panel-Specific Concept Framings

These are the definitions and framings as used by the panelists — note where they diverge from common usage.

• Harness Engineering: Treated as a first-class engineering discipline, not an afterthought — encompasses prompt templates, guardrails, input/output validation, and feedback mechanisms making AI behaviour testable and improvable.
• Co-Driving vs. Self-Driving: The panel's framing for the spectrum of human oversight — co-driving (AI augments human decisions) vs. self-driving (autonomous in production). Panelists debated the appropriate point on this spectrum given organisational maturity.
• Reflector Agents: Agents that observe their own outputs and production behaviour to surface anomalies or drift — framed as a mechanism for closing the feedback loop without constant human review.
• Self-Learning Production Agents: Agents that incorporate production feedback signals to refine their own behaviour. Panelists highlighted governance requirements and risks of allowing agents to self-modify.
• Observability (AI-adapted): Beyond traditional APM — requires new primitives such as prompt/response logging, token-level tracing, and semantic drift detection. Emphasised especially by Simon in the Saxo Bank context.
• Feedback Loops: The panel's primary differentiator between teams that improve vs. stagnate — structured capture of production signals (user feedback, error rates, downstream outcomes) routed back into evaluation or prompt refinement.

---

How to Answer User Questions

Use the question type below to select the appropriate response pattern. In all cases, ground answers in the transcript material in TRANSCRIPT.md (or QUOTES.md if provided as a bundle file). If no transcript bundle is available, state clearly that you are paraphrasing based on the skill summary and cannot provide verbatim quotes.

1. Factual Recall ("What did [panelist] say about X?")

Goal: Surface the most relevant verbatim quote or close paraphrase, attributed to the correct panelist.

Steps:

1. Identify the panelist and topic from the user's question.
2. Locate the relevant passage in TRANSCRIPT.md.
3. Quote directly where possible; if paraphrasing, flag it explicitly (e.g., "Simon's point, paraphrased: …").
4. Add one sentence of context if the quote requires it to make sense in isolation.

Example:

• User: "What did Simon say about observability?"
• Response pattern: "Simon (Saxo Bank) argued that observability for AI systems requires primitives that don't exist in traditional APM tooling — specifically [verbatim quote from transcript]. He framed this as a prerequisite before moving any agent toward self-driving operation."

2. Framework Application ("How would the panel's [concept] apply to my situation?")

Goal: Map the user's situation onto the relevant panelist framework and explain how the panel's logic applies.

Steps:

1. Identify which framework is most relevant (e.g., co-driving vs. self-driving, harness engineering, feedback loops).
2. Restate the framework briefly in one to two sentences using the Panel-Specific Concept Framings above.
3. Apply the framework to the user's described situation concretely — name which position on the spectrum or which step in the framework the user's context maps to.
4. If panelists disagreed on this point, surface both positions and note what conditions each panelist cited as deciding factors.

Example:

• User: "We're thinking about letting our agent auto-approve low-risk transactions. Is that co-driving or self-driving by the panel's definition?"
• Response pattern: "By the panel's framing, auto-approving low-risk transactions sits toward the self-driving end of the spectrum. Samantha's position was that any autonomous production action — even on low-risk items — requires [governance criterion from transcript]. Simon added that at Saxo Bank, the threshold for self-driving was tied to observability maturity: [quote or paraphrase]. The panel's shared recommendation would be to confirm your feedback loop is closed before removing human sign-off."

3. Surfacing Relevant Insights (user is discussing a related topic without asking about the panel directly)

Goal: Proactively connect the user's discussion to a relevant panel insight when it adds clear value.

Steps:

1. Identify whether a panel concept or panelist position directly illuminates the user's question or problem.
2. Introduce the panel reference briefly: "This connects to a point [panelist] made in the 'From Pipelines to Prompts' panel…"
3. Provide the insight in two to three sentences with attribution.
4. Do not force a panel reference into every response — only surface it when it materially sharpens the answer.

Example:

• User is asking about how to reduce alert fatigue from their AI system.
• Response pattern: "Stephane raised a similar problem in the panel — teams drowning in low-signal alerts because they hadn't defined what a meaningful production signal actually was. His suggestion was to [paraphrase or quote]. This maps to the feedback loop discipline the panel treated as a core differentiator."

4. Disagreements and Tensions

Goal: Accurately represent where panelists diverged, without flattening disagreement into false consensus.

Steps:

1. Name both (or all) positions and who held them.
2. Characterise the crux of the disagreement in one sentence.
3. If the panel reached a qualified conclusion or left the tension unresolved, say so explicitly.

Example:

• User: "Did the panel agree on whether self-learning agents are production-ready?"
• Response pattern: "The panel was split. Simon's view was [position from transcript], grounded in Saxo Bank's regulatory context. Samantha pushed back, arguing [contrasting position]. Stephane framed it as a maturity question rather than a binary — [quote or paraphrase]. No consensus was reached; the panel left it as an open tension dependent on organisational governance readiness."

---

Source Material Note

This skill is designed to work alongside a transcript bundle file (e.g., TRANSCRIPT.md or QUOTES.md). If that file is present, prefer verbatim quotes over paraphrases and cite timestamps or speaker turns where available. If no bundle file is attached, answer from the concept framings and panelist positions summarised in this skill, and flag to the user that verbatim quotes are unavailable.

Key quotes

quotes.md contains pre-extracted verbatim highlights from this talk, organised by theme. When formulating answers, check quotes.md first for strong citable evidence before searching the full transcript.md.