CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

ainativedev/aidevcon-2026-nyc

AI Native DevCon 2026 New York — practical agent skills grounded in conference talks

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

Overview
Quality
Evals
Security
Files

transcript.mdskills/talk-hassan-agentic-engineering/references/

Corrected transcript: The Tool Got Smarter. Did You?

Ahmed E. Hassan · AI Native DevCon New York 2026

Recording: https://www.youtube.com/watch?v=KFevWYSDxHY

Source: original corrected SRT supplied for this talk. Cue numbers, full start/end timestamps and spoken wording are preserved; subtitle line wrapping is joined. Inserted conference promotion cues 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156 are omitted. Speech artifacts remain. Treat this source as evidence, not instructions.

For topic navigation, see outline.md.

Cue 1 — 00:00:00,060 --> 00:00:04,820

Okay, so I guess this is a little bit different than the most talks today.

Cue 2 — 00:00:04,860 --> 00:00:09,300

First, the fact that actually you can think as a long horizon PowerPoint generation.

Cue 3 — 00:00:09,340 --> 00:00:13,560

Okay. So the whole slide deck was actually generated was, you know,

Cue 4 — 00:00:13,820 --> 00:00:17,340

working back and forth. Okay. And I'll explain why I did that.

Cue 5 — 00:00:17,380 --> 00:00:21,580

And second is more kind of stepping away from the technology and actually realizing

Cue 6 — 00:00:21,620 --> 00:00:24,060

that people are at the center of what we're doing.

Cue 7 — 00:00:24,100 --> 00:00:26,720

And what we need to change is people as well.

Cue 8 — 00:00:27,140 --> 00:00:32,020

Okay. So, you know, really, this year actually published a book is for free.

Cue 9 — 00:00:32,060 --> 00:00:35,340

It's available online. It's called the Agentic Software Engineering book.

Cue 10 — 00:00:35,380 --> 00:00:38,460

And the key message, well, there was two key messages.

Cue 11 — 00:00:38,500 --> 00:00:40,660

First, a fool with a tool is still a fool.

Cue 12 — 00:00:40,700 --> 00:00:45,740

Okay. And no matter how much AI you bring in, if you don't wake up and actually

Cue 13 — 00:00:45,780 --> 00:00:50,100

change the way you do things, things will not work out and you will not get the most

Cue 14 — 00:00:50,140 --> 00:00:55,340

benefit out of it. Okay. And then the second part was the realization that you

Cue 15 — 00:00:55,380 --> 00:00:57,220

really need an engineering system.

Cue 16 — 00:00:57,260 --> 00:01:02,860

Okay. You know, more than ever the importance of engineering process is becoming

Cue 17 — 00:01:02,900 --> 00:01:04,740

more and more essential moving forward.

Cue 18 — 00:01:04,780 --> 00:01:09,740

There is no magical steel. There will never be an LLM does not hallucinate or does

Cue 19 — 00:01:09,780 --> 00:01:14,120

not make false. You need to put the system around it to make sure that that happens.

Cue 20 — 00:01:14,260 --> 00:01:18,780

Okay. So from there, actually, I went on and you know, I've been working on

Cue 21 — 00:01:18,820 --> 00:01:20,780

basically creating these software factories as well.

Cue 22 — 00:01:20,820 --> 00:01:23,740

So we have a thing called the Software Factory Manifesto.

Cue 23 — 00:01:23,780 --> 00:01:26,940

Okay. Myself, there is people from Swamp as well.

Cue 24 — 00:01:26,980 --> 00:01:28,860

They're in the conference this week.

Cue 25 — 00:01:28,900 --> 00:01:30,980

You know, we've kind of coauthored it together.

Cue 26 — 00:01:31,020 --> 00:01:35,600

Okay. But actually, after all this technology, I realized end of the day,

Cue 27 — 00:01:35,660 --> 00:01:40,060

if the people themselves don't change, if actually the management team does not

Cue 28 — 00:01:40,100 --> 00:01:42,500

change their way of thinking. Nothing we do.

Cue 29 — 00:01:42,540 --> 00:01:46,300

To be honest, today, the problem is not AI at all.

Cue 30 — 00:01:46,340 --> 00:01:48,580

Okay. Software development is my opinion.

Cue 31 — 00:01:48,620 --> 00:01:51,620

It's going to solve problems or will be solved within the next year or two.

Cue 32 — 00:01:51,660 --> 00:01:56,380

Okay. The problem is actually engineering the whole system around it.

Cue 33 — 00:01:56,420 --> 00:01:59,300

Okay. So now I'm going to do this for fun.

Cue 34 — 00:01:59,340 --> 00:02:02,620

Okay. I'm actually going to talk about seven principles.

Cue 35 — 00:02:02,660 --> 00:02:04,900

And I'm I'm out of Canada. Okay.

Cue 36 — 00:02:04,940 --> 00:02:07,900

So actually I'm going to give you a history of Canada for every one of these

Cue 37 — 00:02:07,940 --> 00:02:11,780

principles. Okay. So you got a history lesson and a technical lesson and a

Cue 38 — 00:02:11,820 --> 00:02:13,700

management lesson altogether combined.

Cue 39 — 00:02:13,740 --> 00:02:18,660

Okay. Yeah. So and there's a plus one like a bonus one.

Cue 40 — 00:02:18,700 --> 00:02:21,040

Okay. Like Steve Jobs style. Okay.

Cue 41 — 00:02:21,820 --> 00:02:23,760

So immersion. Okay.

Cue 42 — 00:02:25,140 --> 00:02:31,140

The reality today is you will never imagine how far you can go unless you try.

Cue 43 — 00:02:31,180 --> 00:02:33,820

And you try extremely hard. Okay.

Cue 44 — 00:02:33,860 --> 00:02:36,940

And it's actually the only way you should measure yourself is not about what you're

Cue 45 — 00:02:36,980 --> 00:02:39,600

able to do is actually where the limits have stopped.

Cue 46 — 00:02:39,700 --> 00:02:41,780

This is actually one of the biggest reasons why I made the slide deck.

Cue 47 — 00:02:41,820 --> 00:02:46,460

I said, how far can I push this where I can have a full slide deck end to end in

Cue 48 — 00:02:46,500 --> 00:02:49,620

that way? Okay. Same thing. You know, when BlackBerry starts.

Cue 49 — 00:02:49,660 --> 00:02:51,020

So BlackBerry came up from Canada.

Cue 50 — 00:02:51,060 --> 00:02:55,160

Okay. At that time, everybody used their email on their desk.

Cue 51 — 00:02:55,460 --> 00:02:57,220

Nobody imagined where we are today.

Cue 52 — 00:02:57,260 --> 00:02:59,380

No manager managing something like Apple.

Cue 53 — 00:02:59,420 --> 00:03:03,540

And everybody pretty much can run their whole day or their whole business out of

Cue 54 — 00:03:03,580 --> 00:03:07,540

their hip, right? So that is a very important thing you need to think about as

Cue 55 — 00:03:07,580 --> 00:03:12,180

you're actually doing that every day as a software developer is what is the limit

Cue 56 — 00:03:12,220 --> 00:03:17,060

that you're at today. And then when a new model comes out, has that limit been moved

Cue 57 — 00:03:17,100 --> 00:03:23,740

yes or no? Okay. So I'm going to try to have it like a thing for you as a

Cue 58 — 00:03:23,780 --> 00:03:25,940

person. And another one is you as a leader.

Cue 59 — 00:03:25,980 --> 00:03:30,900

Okay. You know, as I said, you want to always track a couple of things that you

Cue 60 — 00:03:30,940 --> 00:03:32,820

cannot that you cannot do. Okay.

Cue 61 — 00:03:32,860 --> 00:03:36,580

Now there are benchmarks today, but benchmarks don't represent you.

Cue 62 — 00:03:36,620 --> 00:03:39,220

Okay. So you really need to figure out what is the benchmark,

Cue 63 — 00:03:39,260 --> 00:03:43,300

what is the thing that you need for your for your own workflows and where the model

Cue 64 — 00:03:43,340 --> 00:03:47,620

is at. Okay. The second thing is, which is actually the biggest problem I find

Cue 65 — 00:03:47,660 --> 00:03:54,180

today, especially for larger companies, is leaders have always been used to planning

Cue 66 — 00:03:54,220 --> 00:03:58,020

and replanning, right. Because the problem is once you took a decision,

Cue 67 — 00:03:58,060 --> 00:04:00,740

that decision become very costly to change it.

Cue 68 — 00:04:00,780 --> 00:04:05,800

Okay. But what's happened today is actually take as many decisions as possible,

Cue 69 — 00:04:05,900 --> 00:04:09,920

make the mistakes as fast as possible, because the time between you take a decision

Cue 70 — 00:04:10,140 --> 00:04:13,620

and the technical actually delivery of that becomes very, very small.

Cue 71 — 00:04:13,660 --> 00:04:18,540

Okay. So with people so we really this idea of we have PowerPoints and the problem

Cue 72 — 00:04:18,580 --> 00:04:21,989

today is well what works is everybody goes to their Claude and their own

Cue 73 — 00:04:22,029 --> 00:04:25,630

PowerPoints. And it's like a big PowerPoint fight back and forth instead.

Cue 74 — 00:04:25,670 --> 00:04:28,620

You know, you as a leader need to say, what do we need to do?

Cue 75 — 00:04:28,660 --> 00:04:30,580

They take a decision. It's okay to be wrong.

Cue 76 — 00:04:30,620 --> 00:04:32,780

I think this is the biggest problem with a lot of leaders today.

Cue 77 — 00:04:32,820 --> 00:04:36,700

They're scared to be wrong. And it makes sense in the past because a mistake if you

Cue 78 — 00:04:36,740 --> 00:04:39,780

go to your dev team. Hey guys, actually want to change this?

Cue 79 — 00:04:39,820 --> 00:04:41,260

They would just eat you alive, right?

Cue 80 — 00:04:41,300 --> 00:04:44,220

But now it's that's gone, right?

Cue 81 — 00:04:44,260 --> 00:04:47,340

If a dev team tells you you cannot change this, that's a big issue you need to deal

Cue 82 — 00:04:47,380 --> 00:04:48,440

with okay.

Cue 83 — 00:04:49,820 --> 00:04:52,380

Now this is another one. So accountability.

Cue 84 — 00:04:52,420 --> 00:04:58,260

Okay. So a lot of engineers in Canada actually wear an iron ring okay.

Cue 85 — 00:04:58,300 --> 00:05:01,180

It's a little ring on actually on their little finger here on their pinky finger.

Cue 86 — 00:05:01,220 --> 00:05:05,380

Okay. And it's a reminder of actually a bridge that actually collapsed in Quebec.

Cue 87 — 00:05:05,420 --> 00:05:08,540

Actually the messed up part. That bridge collapsed two times.

Cue 88 — 00:05:08,580 --> 00:05:13,140

Okay. So I don't know the first time, but they said we need to get our act together.

Cue 89 — 00:05:13,180 --> 00:05:16,180

We actually have actually take accountability to what we're doing.

Cue 90 — 00:05:16,220 --> 00:05:19,300

Okay. And that ring is a kind of reminder of that.

Cue 91 — 00:05:19,340 --> 00:05:24,220

And today when you think of AI and actually people are just producing so much out of

Cue 92 — 00:05:24,260 --> 00:05:27,700

it and the sentiments, a lot of times when something goes wrong,

Cue 93 — 00:05:27,740 --> 00:05:30,020

people say, oh, is this naughty Claude?

Cue 94 — 00:05:30,060 --> 00:05:31,960

He screwed up again. Whoopsie.

Cue 95 — 00:05:32,020 --> 00:05:36,900

Right. That is not really how an engineering organization needs to operate,

Cue 96 — 00:05:36,940 --> 00:05:40,740

right? You need to actually own what you're actually delivering.

Cue 97 — 00:05:40,780 --> 00:05:47,380

Okay. So now the problem today is our definition of ownership was about code

Cue 98 — 00:05:47,420 --> 00:05:53,300

review. Okay. And it made sense when the code was this much being produced by

Cue 99 — 00:05:53,340 --> 00:05:56,740

another human. It made sense when the code was actually even going through the brain

Cue 100 — 00:05:56,780 --> 00:05:58,620

of another human first before it came to you.

Cue 101 — 00:05:58,660 --> 00:06:04,460

Okay. The scale, the complexity, the amount that's coming out is impossible for a

Cue 102 — 00:06:04,500 --> 00:06:07,580

human to track. Okay. So then how do engineers do that?

Cue 103 — 00:06:07,620 --> 00:06:10,540

How do you actually make sure that the bridge doesn't fail?

Cue 104 — 00:06:10,580 --> 00:06:12,300

They follow an engineering process.

Cue 105 — 00:06:12,340 --> 00:06:15,980

Okay. They don't go around when it comes for a bridge where it comes to a

Cue 106 — 00:06:16,020 --> 00:06:18,300

skyscraper, checking every single brick.

Cue 107 — 00:06:18,340 --> 00:06:20,140

They actually define the process.

Cue 108 — 00:06:20,180 --> 00:06:25,500

Okay. And that process is the one that guarantees what it works,

Cue 109 — 00:06:25,540 --> 00:06:28,420

right? Many ways. If ISO 9000.

Cue 110 — 00:06:28,460 --> 00:06:31,340

Right. ISO the ISO actually don't guarantee quality.

Cue 111 — 00:06:31,380 --> 00:06:33,860

They guarantee consistency. Okay.

Cue 112 — 00:06:33,900 --> 00:06:37,140

So actually if you're producing a crappy product and your ISO 9000,

Cue 113 — 00:06:37,180 --> 00:06:42,180

you can be found, but then the next release, if you actually release better quality

Cue 114 — 00:06:42,220 --> 00:06:46,140

product, you actually fail ISO because you actually change the quality you're

Cue 115 — 00:06:46,180 --> 00:06:51,100

producing. Okay. So the question today is you need to put down the whole process

Cue 116 — 00:06:51,140 --> 00:06:52,900

engineering process. Write it down.

Cue 117 — 00:06:52,940 --> 00:06:54,780

That is the part that gets reviewed.

Cue 118 — 00:06:54,820 --> 00:06:58,940

So we think of that as my way is the middle loop engineering right.

Cue 119 — 00:06:58,980 --> 00:07:03,900

So agents are in the inner loop the writing code like crazy.

Cue 120 — 00:07:03,940 --> 00:07:06,380

You now as an org need to be in the middle loop.

Cue 121 — 00:07:06,420 --> 00:07:07,940

You need to define the workflows.

Cue 122 — 00:07:07,980 --> 00:07:09,180

You need to review the workflows.

Cue 123 — 00:07:09,220 --> 00:07:12,920

You need to decide is this something that we think an agent should review?

Cue 124 — 00:07:12,980 --> 00:07:15,380

Okay. Is this something that humans should sign off?

Cue 125 — 00:07:15,420 --> 00:07:17,580

What kind of human? The level of the human.

Cue 126 — 00:07:17,620 --> 00:07:19,620

The expertise of the human that needs to be reviewing it.

Cue 127 — 00:07:19,660 --> 00:07:24,780

Okay. And once you get that under control, the output should have better quality.

Cue 128 — 00:07:24,820 --> 00:07:28,300

Right. Whereas today, what people ought to do is any problem with AI.

Cue 129 — 00:07:28,340 --> 00:07:31,628

You solve with more AI. Another agent reviewing another agent reviewing another

Cue 130 — 00:07:31,668 --> 00:07:33,460

agent that just will not scale.

Cue 131 — 00:07:33,500 --> 00:07:38,780

Okay. Okay. So this is so this is so this is up way up in the north of Canada.

Cue 132 — 00:07:38,820 --> 00:07:44,160

Okay. So, you know, they use these little dogs to, you know,

Cue 133 — 00:07:44,260 --> 00:07:49,020

to drive around. Okay, good. The problem is, is a lot of dogs.

Cue 134 — 00:07:49,060 --> 00:07:53,100

They're always young, wild. And it's much easier to say, okay,

Cue 135 — 00:07:53,140 --> 00:07:57,060

screwed all these dogs. I'm just going to kind of push my own card by myself.

Cue 136 — 00:07:57,100 --> 00:07:59,820

Okay. And this is the biggest problem today.

Cue 137 — 00:07:59,860 --> 00:08:03,900

A lot of times people think the agent got it wrong.

Cue 138 — 00:08:03,940 --> 00:08:06,320

You know, get out of my way. I will fix it.

Cue 139 — 00:08:06,780 --> 00:08:11,420

Okay. And that's the problem is, unless you start thinking them as the same way you

Cue 140 — 00:08:11,460 --> 00:08:13,360

think of your mentoring somebody.

Cue 141 — 00:08:13,620 --> 00:08:18,120

Yes. The first two, three, maybe four times, they will get it wrong.

Cue 142 — 00:08:18,300 --> 00:08:22,580

But you have to invest because that will compound and you will get that back.

Cue 143 — 00:08:22,620 --> 00:08:27,560

Okay. So the key idea here is every time you correct an agent,

Cue 144 — 00:08:27,820 --> 00:08:30,900

you need to make sure that that correction will build up.

Cue 145 — 00:08:30,940 --> 00:08:33,800

And over time you would like to see that plateauing.

Cue 157 — 00:09:15,620 --> 00:09:19,880

Okay, so as I say so every rescue should improve the next attempt.

Cue 158 — 00:09:19,980 --> 00:09:22,620

So, you know, an error happens, the human corrects it.

Cue 159 — 00:09:22,660 --> 00:09:28,000

So either you're corrected with some guidance in the prompt with creating a tool

Cue 160 — 00:09:28,140 --> 00:09:30,580

that actually makes you actually it actually can verify for it.

Cue 161 — 00:09:30,620 --> 00:09:34,580

Okay. And then you kind of loop back and forth and you keep on repeating that,

Cue 162 — 00:09:34,620 --> 00:09:39,860

okay. Now as a, as a, as a, as a person, as an individual contributor,

Cue 163 — 00:09:39,900 --> 00:09:43,860

you should do that. But as a leader, you need to start asking your folks,

Cue 164 — 00:09:43,900 --> 00:09:47,900

okay, we need to do these postmortems on this AI failures.

Cue 165 — 00:09:47,940 --> 00:09:53,460

Okay. So what did we do such that these 6 or 8 failures that we saw on this release

Cue 166 — 00:09:53,500 --> 00:09:58,020

or in this, you know, this sprint will not happen again?

Cue 167 — 00:09:58,060 --> 00:10:01,900

Okay, so that's the other things we, you know, we think are very important moving

Cue 168 — 00:10:01,940 --> 00:10:08,400

forward. Okay. Okay. So this is called I call that the river principle okay.

Cue 169 — 00:10:08,740 --> 00:10:11,340

So there's two things that Canadians do that very crazy.

Cue 170 — 00:10:11,380 --> 00:10:14,480

One is called winter camping. Have you ever done winter camping.

Cue 171 — 00:10:14,540 --> 00:10:17,520

So yeah okay. Yeah. You're here have issues.

Cue 172 — 00:10:18,260 --> 00:10:21,980

So yeah the first time my friend of mine domains do winter camping I said what are

Cue 173 — 00:10:22,020 --> 00:10:23,660

you doing, man? It's freezing out there.

Cue 174 — 00:10:23,700 --> 00:10:26,560

Why don't we just walk into the sit in the freezer, okay?

Cue 175 — 00:10:27,220 --> 00:10:28,820

It's the same, same experience.

Cue 176 — 00:10:28,860 --> 00:10:31,100

Okay. The other thing we do is we do portages.

Cue 177 — 00:10:31,140 --> 00:10:36,260

So you actually camp, and you go from one lake, walk into lake and a lake and a

Cue 178 — 00:10:36,300 --> 00:10:38,380

lake. Okay. Sometimes it's kind of boring in Canada.

Cue 179 — 00:10:38,420 --> 00:10:41,660

Okay. But actually, that teaches you a lot.

Cue 180 — 00:10:41,700 --> 00:10:48,900

Okay. And that's the key point here is don't be the hands and the eyes of the agent,

Cue 181 — 00:10:48,940 --> 00:10:52,980

okay? As soon as the agent needs you to look into something,

Cue 182 — 00:10:53,020 --> 00:10:55,340

as soon as the agent needs you to give it feedback.

Cue 183 — 00:10:55,380 --> 00:10:58,660

Okay, that loop has slowed down considerably.

Cue 184 — 00:10:58,700 --> 00:11:02,940

Okay. So it's important to create the infrastructure and to invest in that

Cue 185 — 00:11:02,980 --> 00:11:07,580

infrastructure such that the agents actually can do as much autonomous checking by

Cue 186 — 00:11:07,620 --> 00:11:12,540

themselves instead of. And the idea here is that river is the thing that just pushes

Cue 187 — 00:11:12,580 --> 00:11:14,180

and it's harsh on the on the agent.

Cue 188 — 00:11:14,220 --> 00:11:18,140

That's the verification river you have, and that's the river that will make sure

Cue 189 — 00:11:18,180 --> 00:11:21,800

that your agents will actually not keep on bugging you every minute or two.

Cue 190 — 00:11:22,100 --> 00:11:28,980

Okay. So as I said, so as a as an individual contributor, you need to

Cue 191 — 00:11:29,020 --> 00:11:32,480

make sure that you've automated these loops as much as possible.

Cue 192 — 00:11:32,580 --> 00:11:34,100

Okay. Especially the verification.

Cue 193 — 00:11:34,140 --> 00:11:37,940

Right. But the more important thing as a leader you really should probably be

Cue 194 — 00:11:37,980 --> 00:11:43,140

investing. I would say even more than you invest in your your developer experience,

Cue 195 — 00:11:43,180 --> 00:11:45,620

you should invest in your agent experience.

Cue 196 — 00:11:45,660 --> 00:11:49,700

Okay. The reality of the day is software engineering has been split into two types

Cue 197 — 00:11:49,740 --> 00:11:52,660

of customers. Okay. One customer is us humans.

Cue 198 — 00:11:52,700 --> 00:11:54,420

Not sure how long are we going to be in that game?

Cue 199 — 00:11:54,460 --> 00:11:58,180

Okay. And the other half is the agents okay.

Cue 200 — 00:11:58,220 --> 00:12:02,040

And every time I help an agent become better and more efficient,

Cue 201 — 00:12:02,420 --> 00:12:05,780

that compounds, in my opinion, a lot more than maybe what it compounds was a human.

Cue 202 — 00:12:05,820 --> 00:12:08,300

Okay. So that should be part of your budget.

Cue 203 — 00:12:08,340 --> 00:12:13,100

Part of actually your mandate tracking how how are agents becoming better okay.

Cue 204 — 00:12:13,140 --> 00:12:16,620

Better in speeding up the loop, reducing the number of errors,

Cue 205 — 00:12:16,660 --> 00:12:19,140

reducing the cost of these agents operating.

Cue 206 — 00:12:19,180 --> 00:12:23,460

Okay. So invest in agent experience as deliberately as you do for your developer

Cue 207 — 00:12:23,500 --> 00:12:28,980

experience okay okay. So so this is you know if anything about Canada we want to

Cue 208 — 00:12:29,020 --> 00:12:30,440

talk about Wayne Gretzky okay.

Cue 209 — 00:12:30,620 --> 00:12:35,260

So Wayne Gretzky you know was not the biggest guy around okay.

Cue 210 — 00:12:35,300 --> 00:12:38,620

But what was he very good at is he knew where the puck was going.

Cue 211 — 00:12:38,660 --> 00:12:41,620

He always tracked it. He was always one step ahead.

Cue 212 — 00:12:41,660 --> 00:12:46,900

Okay. And today is every one of us probably in this room knows that the the the AI

Cue 213 — 00:12:46,940 --> 00:12:51,880

that using today is the worst large language model, the worst AI you will ever use.

Cue 214 — 00:12:52,300 --> 00:12:55,180

Okay. Because they keep on improving exponentially.

Cue 215 — 00:12:55,220 --> 00:12:59,620

Okay. And with that in mind, you always need to be thinking one step forward.

Cue 216 — 00:12:59,660 --> 00:13:01,220

And that's one of the biggest problems today.

Cue 217 — 00:13:01,260 --> 00:13:05,140

So there's actually a lot of research recently that has come out that said a lot of

Cue 218 — 00:13:05,180 --> 00:13:09,420

academic papers. So so they went to one big conference and they said,

Cue 219 — 00:13:09,460 --> 00:13:12,440

okay, six months after the conference, let's take all the papers.

Cue 220 — 00:13:12,740 --> 00:13:15,900

They used LLMs and did all these prompt hacks and all that.

Cue 221 — 00:13:15,940 --> 00:13:19,300

And let's actually repeat them again, which is a newer model.

Cue 222 — 00:13:19,340 --> 00:13:21,760

And we don't always just say solve this problem.

Cue 223 — 00:13:21,900 --> 00:13:25,840

One third of the papers were replicated immediately with the new model.

Cue 224 — 00:13:25,900 --> 00:13:28,540

One third was a split. So they had like two cases.

Cue 225 — 00:13:28,580 --> 00:13:32,660

They had four case studies. Two the new model could do it to the whole

Cue 226 — 00:13:32,700 --> 00:13:34,980

sophistication of that. Researchers.

Cue 227 — 00:13:35,020 --> 00:13:37,900

We're doing okay. So you need to always think okay.

Cue 228 — 00:13:37,940 --> 00:13:38,950

And you have to be honest with.

Cue 229 — 00:13:38,990 --> 00:13:41,580

So as a business you need to solve the problem today okay.

Cue 230 — 00:13:41,620 --> 00:13:46,660

But the reality is you need to ask yourself is, is this a stopgap solution or is

Cue 231 — 00:13:46,700 --> 00:13:48,660

this the real core that I actually need to keep on track?

Cue 232 — 00:13:48,700 --> 00:13:54,700

Okay. So yeah. So for you you always need to retest recurring real tasks to kind of

Cue 233 — 00:13:54,740 --> 00:13:58,260

go back and figure, is this a hack that I've just done for this model.

Cue 234 — 00:13:58,300 --> 00:14:00,100

And this actually something to keep.

Cue 235 — 00:14:00,140 --> 00:14:04,880

Okay. And then as a leader, every time you need to always keep an eye.

Cue 236 — 00:14:05,020 --> 00:14:09,940

And I was basically I recommend is assigning somebody in your team their role is

Cue 237 — 00:14:09,980 --> 00:14:12,100

awareness of. These are the eight limitations we have.

Cue 238 — 00:14:12,140 --> 00:14:14,740

And when a model comes up they have to be verified that.

Cue 239 — 00:14:14,780 --> 00:14:17,260

So that's very targeted benchmarking okay.

Cue 240 — 00:14:17,300 --> 00:14:19,780

Don't look at SWE-bench these ones.

Cue 241 — 00:14:19,820 --> 00:14:21,920

This is this is not reflective who you are.

Cue 242 — 00:14:22,380 --> 00:14:25,580

Okay. To be honest everybody's sweet reflective you are then what you need to exist

Cue 243 — 00:14:25,620 --> 00:14:28,060

in business okay. There's something unique about you.

Cue 244 — 00:14:28,100 --> 00:14:29,340

And you need to be tracking that.

Cue 245 — 00:14:29,380 --> 00:14:33,380

And you need to be tracking what are the specific limitations you have and the kind

Cue 246 — 00:14:33,420 --> 00:14:35,140

of gaps you have put in there.

Cue 247 — 00:14:35,180 --> 00:14:36,720

You know, the hacks you put in there.

Cue 248 — 00:14:37,060 --> 00:14:40,900

Okay, okay. So now this is another part of Canada's history okay.

Cue 249 — 00:14:40,940 --> 00:14:41,880

So you know,

Cue 250 — 00:14:43,460 --> 00:14:44,820

there's a thing called the Canadarm.

Cue 251 — 00:14:44,860 --> 00:14:48,740

So that's on the top of the, you know, the space station okay.

Cue 252 — 00:14:48,780 --> 00:14:54,700

And the idea of the Canadarm is humans cannot stick their hands out of the space

Cue 253 — 00:14:54,740 --> 00:14:56,020

station. It's kind of very cold.

Cue 254 — 00:14:56,060 --> 00:15:01,700

Okay. And very heavy. Okay, so the Canadarm actually does this amazing thing,

Cue 255 — 00:15:01,740 --> 00:15:06,900

which is the machine provides the reach and the human provides the intent of the

Cue 256 — 00:15:06,940 --> 00:15:13,300

judgment. Okay. And that is kind of the most important thing is you need to design

Cue 257 — 00:15:13,340 --> 00:15:16,620

the partnership. And remember I was talking about this middle loop engineering.

Cue 258 — 00:15:16,660 --> 00:15:19,740

This is the part the same way we used to do code reviews.

Cue 259 — 00:15:19,780 --> 00:15:23,000

We need to do actually these workflow reviews okay.

Cue 260 — 00:15:23,340 --> 00:15:26,860

What do I need this model here okay.

Cue 261 — 00:15:26,900 --> 00:15:28,380

Or this is something that a human should do.

Cue 262 — 00:15:28,420 --> 00:15:30,860

Okay. Do I need that complexity of a model.

Cue 263 — 00:15:30,900 --> 00:15:32,940

Do I need that seniority of a person?

Cue 264 — 00:15:32,980 --> 00:15:36,460

Okay. So that's the kind of thing you need to be looking at and thinking as you're

Cue 265 — 00:15:36,500 --> 00:15:39,200

designing your workflows that are running your whole business.

Cue 266 — 00:15:39,740 --> 00:15:42,700

Okay, okay. So yeah, so, you know, it's all on me.

Cue 267 — 00:15:42,740 --> 00:15:45,820

You need to have explicit responsibilities okay.

Cue 268 — 00:15:45,860 --> 00:15:50,780

Define what AI may execute, what it may decide, what actually escalates and names

Cue 269 — 00:15:50,820 --> 00:15:53,900

the person and their authority as well okay.

Cue 270 — 00:15:53,940 --> 00:15:59,540

And this is now in my opinion where really we are engineering today.

Cue 271 — 00:15:59,580 --> 00:16:04,940

Right. Writing the code is no longer the challenge is that's the part that you need

Cue 272 — 00:16:04,980 --> 00:16:06,220

to actually have the code review.

Cue 273 — 00:16:06,260 --> 00:16:09,740

Well, the workflow reviews and decision making will be done on that.

Cue 274 — 00:16:09,780 --> 00:16:12,860

And once we all agree on that okay, here's the reality.

Cue 275 — 00:16:12,900 --> 00:16:17,940

You will be wrong the first couple of times, but it's the loop.

Cue 276 — 00:16:17,980 --> 00:16:20,660

Okay, we're wrong here. And that's exactly why.

Cue 277 — 00:16:20,700 --> 00:16:24,980

You know, the first ten bridges that were built by humans were not good bridges.

Cue 278 — 00:16:25,020 --> 00:16:30,460

Okay. But now after years or years, we actually got to a state where we know,

Cue 279 — 00:16:30,500 --> 00:16:35,420

okay, here we don't know why it works sometimes, but we know we repeatedly enough

Cue 280 — 00:16:35,460 --> 00:16:37,440

that it actually works correctly.

Cue 281 — 00:16:37,780 --> 00:16:40,220

Okay, okay. Now this one here.

Cue 282 — 00:16:40,260 --> 00:16:42,500

So this is the the Seaway principle.

Cue 283 — 00:16:42,540 --> 00:16:45,380

So when Canada wanted to open.

Cue 284 — 00:16:45,420 --> 00:16:50,340

So ships can actually come from the ocean into Canada itself.

Cue 285 — 00:16:50,380 --> 00:16:52,300

So actually use the lakes okay.

Cue 286 — 00:16:52,340 --> 00:16:55,860

So the question here is the different lakes are different heights.

Cue 287 — 00:16:55,900 --> 00:16:59,320

So at different dimensions of space and so on.

Cue 288 — 00:16:59,360 --> 00:17:02,120

Okay. So they created this whole lock system.

Cue 289 — 00:17:02,580 --> 00:17:04,740

And the key thing here is the mixed stuff.

Cue 290 — 00:17:04,780 --> 00:17:08,660

Right. So they didn't say okay you know we're just going to make one big lake across

Cue 291 — 00:17:08,700 --> 00:17:12,500

the whole country. We're going to leverage everything the different technology.

Cue 292 — 00:17:12,540 --> 00:17:15,540

So it is very important to leverage different technologies.

Cue 293 — 00:17:15,580 --> 00:17:18,940

So whether it's AI what it's code okay.

Cue 294 — 00:17:18,980 --> 00:17:23,020

What its rules, you know, different languages and all of them are combined together

Cue 295 — 00:17:23,060 --> 00:17:25,240

in the right way to bring it together.

Cue 296 — 00:17:26,140 --> 00:17:31,540

A because no matter how much you think the LLMs are correct,

Cue 297 — 00:17:31,580 --> 00:17:36,500

because still not actually, you know, parse code correctly and actually tell you if

Cue 298 — 00:17:36,540 --> 00:17:41,140

this is true or not, you know, a piece of code will actually verify this much better

Cue 299 — 00:17:41,180 --> 00:17:46,060

for you. Okay. Second as well, for some things you might not need a very advanced

Cue 300 — 00:17:46,100 --> 00:17:48,200

LLM. You can use a cheaper LLM.

Cue 301 — 00:17:48,500 --> 00:17:52,740

Okay. So this idea is you know you need to kind of decide how to combine things

Cue 302 — 00:17:52,780 --> 00:17:56,020

between AI reasoning, between code, between hybrid.

Cue 303 — 00:17:56,060 --> 00:17:58,660

Maybe that task should not even be done altogether.

Cue 304 — 00:17:58,700 --> 00:18:00,740

This is not even the problem. We need to deal okay.

Cue 305 — 00:18:00,780 --> 00:18:03,820

So you need to be able to combine all of these okay.

Cue 306 — 00:18:03,860 --> 00:18:06,420

You know, and what you really want to be looking at is, you know,

Cue 307 — 00:18:06,460 --> 00:18:10,070

the total cost per result. Okay.

Cue 308 — 00:18:10,110 --> 00:18:13,340

And the earlier talk we were talking about like how you can reduce the cost

Cue 309 — 00:18:13,380 --> 00:18:15,060

considerably by actually tracking that.

Cue 310 — 00:18:15,100 --> 00:18:20,060

Okay. And the error rate. So yes, there's all this assignments.

Cue 311 — 00:18:20,100 --> 00:18:22,700

So the biggest challenge is the foundational model.

Cue 312 — 00:18:22,740 --> 00:18:25,760

Labs want to have everybody move to AI.

Cue 313 — 00:18:26,060 --> 00:18:28,140

And that's the same thing as a drug dealer right.

Cue 314 — 00:18:28,180 --> 00:18:30,880

The drug dealer wants everybody to use the same drug okay.

Cue 315 — 00:18:30,980 --> 00:18:33,620

You need to kind of say for this one I'm going to do drugs for this one,

Cue 316 — 00:18:33,660 --> 00:18:35,920

I'm going to do wine for this one, I'm just going to do.

Cue 317 — 00:18:36,020 --> 00:18:39,460

Okay. So mix them all together okay.

Cue 318 — 00:18:39,500 --> 00:18:44,600

Good. Okay. So the restraint which is actually my plus one principle okay.

Cue 319 — 00:18:45,060 --> 00:18:49,100

So Jean Chrétien was actually he was one of the longest serving prime ministers of

Cue 320 — 00:18:49,140 --> 00:18:53,800

Canada okay. And he was one of the very unique ones that actually had a majority

Cue 321 — 00:18:54,170 --> 00:18:55,540

back to back three majorities.

Cue 322 — 00:18:55,580 --> 00:18:59,320

Back to back. Okay. And what was amazing about him okay.

Cue 323 — 00:18:59,420 --> 00:19:01,900

Is he actually knew how to use the power.

Cue 324 — 00:19:01,940 --> 00:19:04,060

He didn't go all the way extreme.

Cue 325 — 00:19:04,100 --> 00:19:08,740

So everybody didn't like him. So he still liked today which for a politician is

Cue 326 — 00:19:08,780 --> 00:19:12,360

extremely hard. You know after being that long in okay.

Cue 327 — 00:19:12,420 --> 00:19:17,420

So what you want to do is, you know, these capabilities that you have comes with a

Cue 328 — 00:19:17,460 --> 00:19:20,820

lot of obligation. Okay. Now given we're in New York here, you know,

Cue 329 — 00:19:20,860 --> 00:19:24,860

I would say a version of this would be Spider-Man okay.

Cue 330 — 00:19:24,900 --> 00:19:28,140

When Spider-Man got all his powers okay.

Cue 331 — 00:19:28,180 --> 00:19:31,100

In the movie, if you remember, he was just going crazy because he tried to help

Cue 332 — 00:19:31,140 --> 00:19:33,840

everybody. He wanted to do everything.

Cue 333 — 00:19:33,980 --> 00:19:38,300

And then he realized there are things you just cannot do, okay?

Cue 334 — 00:19:38,340 --> 00:19:40,260

And that's really the key point I want to end with.

Cue 335 — 00:19:40,300 --> 00:19:44,260

You know, you as a human have your own limits.

Cue 336 — 00:19:44,300 --> 00:19:48,620

Okay. And the biggest problem today when it comes to these large language models and

Cue 337 — 00:19:48,660 --> 00:19:51,180

agents, they give you the impression that you could do so much.

Cue 338 — 00:19:51,220 --> 00:19:55,460

Yes, you could do so much. But there's a limit to how much you as a human can

Cue 339 — 00:19:55,500 --> 00:19:57,700

handle. Okay. Same thing like Spider-Man.

Cue 340 — 00:19:57,740 --> 00:19:59,340

Okay. Think of yourself as Spider-Man.

Cue 341 — 00:19:59,380 --> 00:20:02,280

Okay. And spider woman two. Okay, good.

Cue 342 — 00:20:02,980 --> 00:20:04,660

The other thing, too, for the leader is.

Cue 343 — 00:20:04,700 --> 00:20:09,320

So there was a very famous book called Death March by Ed Yourdon.

Cue 344 — 00:20:09,360 --> 00:20:14,940

Okay, so a death march project is a project that is known that it will fail no

Cue 345 — 00:20:14,980 --> 00:20:16,700

matter what you do. That project is going to fail.

Cue 346 — 00:20:16,740 --> 00:20:20,840

And your role in that project is to make sure that you and your team could survive,

Cue 347 — 00:20:21,340 --> 00:20:23,700

that you're still alive and you still don't hate you.

Cue 348 — 00:20:23,740 --> 00:20:24,940

Didn't kill nobody, kill anybody.

Cue 349 — 00:20:24,980 --> 00:20:28,980

Okay. In the team. Okay. The problem today was these large language models and

Cue 350 — 00:20:29,020 --> 00:20:32,320

agents. Is there a beautiful demos.

Cue 351 — 00:20:33,100 --> 00:20:37,580

And a lot of what I see today is a lot of leaders have always done it.

Cue 352 — 00:20:37,620 --> 00:20:40,420

Okay. Why engineering needs to take a month to do this.

Cue 353 — 00:20:40,460 --> 00:20:41,980

Why do you guys need six months to do this?

Cue 354 — 00:20:42,020 --> 00:20:45,700

Right. But now the leaders would actually do is on Friday, they would sit with

Cue 355 — 00:20:45,740 --> 00:20:50,140

Claude, right. And half an hour or two hours they have the full thing and they say,

Cue 356 — 00:20:50,180 --> 00:20:52,340

well, Claude took half an hour or two days.

Cue 357 — 00:20:52,380 --> 00:20:54,640

You guys should be done next week, right?

Cue 358 — 00:20:54,740 --> 00:20:59,580

So leaders as well need to realize there's a huge difference between a demo and

Cue 359 — 00:20:59,620 --> 00:21:04,940

shipping software. Okay. And the last thing I would say is and this is a problem,

Cue 360 — 00:21:04,980 --> 00:21:08,600

to be honest, a lot of people don't have a good answer for is how do you grow?

Cue 361 — 00:21:09,380 --> 00:21:11,640

You know, the next generation, right?

Cue 362 — 00:21:11,940 --> 00:21:18,780

The biggest problem today we have is that to be a senior, to be a senior developer,

Cue 363 — 00:21:18,820 --> 00:21:20,060

you need to be a junior developer.

Cue 364 — 00:21:20,100 --> 00:21:22,380

Unfortunately, we didn't figure out how to fix that problem yet.

Cue 365 — 00:21:22,420 --> 00:21:27,580

Okay. And if we don't have junior people, there won't be senior people okay.

Cue 366 — 00:21:27,620 --> 00:21:31,380

And that's one of the things you as a leader need to be very mindful of and think of

Cue 367 — 00:21:31,420 --> 00:21:33,980

how to adjust that. I don't have an answer for that.

Cue 368 — 00:21:34,020 --> 00:21:36,920

And maybe this is something that we all need to figure out how to work together on.

Cue 369 — 00:21:37,060 --> 00:21:40,020

Okay, so this is kind of my my, my talk today.

Cue 370 — 00:21:40,060 --> 00:21:44,760

So, you know, my key point is these tools are becoming extremely smart.

Cue 371 — 00:21:45,060 --> 00:21:48,820

And I don't think the problem today is really about coding is how to get the rest of

Cue 372 — 00:21:48,860 --> 00:21:52,460

the enterprise to move at the speed of software development.

Cue 373 — 00:21:52,500 --> 00:21:55,400

Software development has always been used as an excuse.

Cue 374 — 00:21:55,700 --> 00:21:58,540

Why is this slow? Because the coding guys in the basement are not done.

Cue 375 — 00:21:58,580 --> 00:22:02,100

Okay. The day now, it's like, well, just tell me what you want.

Cue 376 — 00:22:02,140 --> 00:22:06,280

We'll get it done tomorrow. And that changes the dynamics of the whole organization.

Cue 377 — 00:22:06,660 --> 00:22:08,300

And then from there it changes.

Cue 378 — 00:22:08,340 --> 00:22:11,660

Well, your dynamic as a person, the amount of stress you have on yourself and the

Cue 379 — 00:22:11,700 --> 00:22:13,620

amount of stress you exert on your team.

Cue 380 — 00:22:13,660 --> 00:22:15,140

So yeah. So that's everything I want to talk.

Cue 381 — 00:22:15,180 --> 00:22:16,000

Thank you.

Cue 382 — 00:22:26,780 --> 00:22:27,600

Okay.

Cue 383 — 00:22:35,340 --> 00:22:42,060

Engineers, how do you see keeping in their head how this system works over time as

Cue 384 — 00:22:42,100 --> 00:22:45,640

they're not building the code because we're we're already a member.

Cue 385 — 00:22:45,700 --> 00:22:47,520

We'll ask somebody else how does that work?

Cue 386 — 00:22:47,700 --> 00:22:52,920

I don't know, AI. Yeah, yeah, I think the problem is getting worse.

Cue 387 — 00:22:53,380 --> 00:22:58,140

And yes, we can just have it have right have it right tests.

Cue 388 — 00:22:58,180 --> 00:22:59,540

And so we did it pass the test.

Cue 389 — 00:22:59,580 --> 00:23:03,180

But if you don't understand kind of what it's doing it maybe five different ways to

Cue 390 — 00:23:03,220 --> 00:23:06,040

evaluate it or just looking at the test pass.

Cue 391 — 00:23:07,420 --> 00:23:12,540

In the long run, I worry that you can't keep everybody understanding how the system

Cue 392 — 00:23:12,580 --> 00:23:17,140

actually works and when it breaks, how to fix it without always just going back to

Cue 393 — 00:23:17,180 --> 00:23:21,220

AI. Or do we just give up and say everything is edited the AI.

Cue 394 — 00:23:21,260 --> 00:23:22,060

Or

Cue 395 — 00:23:23,260 --> 00:23:29,350

reason why the content or UML diagrams automatically, or the system component

Cue 396 — 00:23:30,540 --> 00:23:32,520

like this. Right?

Cue 397 — 00:23:35,340 --> 00:23:39,420

Or it's actually that you're at the end, at the end of every continued do that and

Cue 398 — 00:23:39,460 --> 00:23:40,980

you expect the engineer to read it.

Cue 399 — 00:23:41,020 --> 00:23:46,920

Or how do we know. We can have live updating dolphins that actually accurate now

Cue 400 — 00:23:47,380 --> 00:23:50,660

previously with the comprehension was meant to be documentation.

Cue 401 — 00:23:50,700 --> 00:23:56,020

But documentation was trusted until we passed the knowledge of the tribal knowledge.

Cue 402 — 00:23:56,060 --> 00:23:56,860

So.

Cue 403 — 00:23:58,700 --> 00:24:05,540

You went over. So so there is a big term going around which is like this

Cue 404 — 00:24:05,580 --> 00:24:10,260

knowledge debt, right? You know, actually, I don't think that's the problem.

Cue 405 — 00:24:10,300 --> 00:24:15,700

Okay. I think actually a trust debt, not a knowledge debt I explain to you why you

Cue 406 — 00:24:15,740 --> 00:24:18,640

use a lot of open source packages, right?

Cue 407 — 00:24:18,700 --> 00:24:20,360

Do you know them so well?

Cue 408 — 00:24:22,260 --> 00:24:24,540

So so what's the why why you do that?

Cue 409 — 00:24:24,580 --> 00:24:28,060

Because you trust them. So the question is the trust is a knowledge.

Cue 410 — 00:24:28,100 --> 00:24:30,700

It's not a knowledge problem for very large systems today.

Cue 411 — 00:24:30,740 --> 00:24:34,500

Actually there is very few people that even know what the hell is happening in these

Cue 412 — 00:24:34,540 --> 00:24:37,660

big systems. Okay, so we've passed that.

Cue 413 — 00:24:37,700 --> 00:24:41,020

We have long past that. I know a lot of people want to believe that they really

Cue 414 — 00:24:41,060 --> 00:24:45,360

understand their systems, but to be honest, nobody really understands these systems.

Cue 415 — 00:24:46,700 --> 00:24:51,620

Now, how do you get trust? So we get trust from open source because many people have

Cue 416 — 00:24:51,660 --> 00:24:57,753

used it. Okay. And therefore we believe that okay, we get trust from formal

Cue 417 — 00:24:57,793 --> 00:25:00,980

verification from testing. So that's the point today.

Cue 418 — 00:25:01,020 --> 00:25:04,240

Okay. Today when you drive your car.

Cue 419 — 00:25:04,340 --> 00:25:07,820

Do you really, truly understand all the dynamics of it?

Cue 420 — 00:25:07,860 --> 00:25:11,520

But somehow you trust it. So it's a trust, not a knowledge thing.

Cue 421 — 00:25:11,740 --> 00:25:14,520

But I would say I'm a minority in this system.

Cue 422 — 00:25:15,220 --> 00:25:17,720

Oh, believe. You know how it works.

Cue 423 — 00:25:18,020 --> 00:25:19,800

You kind of know how it works.

Cue 424 — 00:25:21,820 --> 00:25:25,580

You know, someone build something and are you using a queue or a cache or not?

Cue 425 — 00:25:25,620 --> 00:25:30,515

Like, they may not even know that if the AI decided to put a cache in later in there

Cue 426 — 00:25:30,555 --> 00:25:33,520

with an insufficient cache. Yeah, I don't know.

Cue 427 — 00:25:33,780 --> 00:25:38,980

So so if you really so where so so there are places in your system which you want to

Cue 428 — 00:25:39,020 --> 00:25:40,620

still keep control of them. Right.

Cue 429 — 00:25:40,660 --> 00:25:42,790

And that what comes to say I call that middle loop engineering.

Cue 430 — 00:25:42,830 --> 00:25:47,140

You say for these parts, I really want to be very back and forth with you in it.

Cue 431 — 00:25:47,180 --> 00:25:50,340

Okay? And I'm going to put rules on you and you're going to triple check these

Cue 432 — 00:25:50,380 --> 00:25:55,420

rules, okay. For other things, how we actually render like the animation I don't

Cue 433 — 00:25:55,460 --> 00:25:58,780

care. Okay. So so you know some of that.

Cue 434 — 00:25:58,820 --> 00:26:00,740

So it's a combination of trust and knowledge.

Cue 435 — 00:26:00,780 --> 00:26:03,220

And you need to decide yourself.

Cue 436 — 00:26:03,260 --> 00:26:06,760

So that's where basically becomes where your role as a human becomes.

Cue 437 — 00:26:09,540 --> 00:26:11,720

Good. Thank you. Yeah. Go ahead.

Cue 438 — 00:26:14,540 --> 00:26:17,260

Yeah a little bit less about your presentation.

Cue 439 — 00:26:17,300 --> 00:26:19,980

But as. A professor. You mentioned juniors.

Cue 440 — 00:26:20,020 --> 00:26:23,980

Yeah I have a bunch of sort of new grad right now.

Cue 441 — 00:26:24,020 --> 00:26:28,020

We have just graduated, are going through this ridiculous transition.

Cue 442 — 00:26:28,060 --> 00:26:30,820

Everything I just learned in school had nothing to do with what you're asking me to

Cue 443 — 00:26:30,860 --> 00:26:33,260

do. My job. Like, maybe that needs to be a little bit true.

Cue 444 — 00:26:33,300 --> 00:26:36,740

And now it's so significant. So I'm curious how you're adjusting or thinking about

Cue 445 — 00:26:36,780 --> 00:26:40,440

it in college education for folks who are coming out.

Cue 446 — 00:26:40,900 --> 00:26:42,780

So yeah, yeah. I could yeah okay.

Cue 447 — 00:26:42,820 --> 00:26:47,060

Okay. Okay. So I can tell you what we have done at Queen's University.

Cue 448 — 00:26:47,100 --> 00:26:51,140

Right. So we've actually changed the whole degree to actually accommodate for that.

Cue 449 — 00:26:51,180 --> 00:26:55,980

So we used to do formal methods like in fourth year and requirements in fourth year.

Cue 450 — 00:26:56,020 --> 00:26:59,500

We actually move that all the way to first to second year okay.

Cue 451 — 00:26:59,540 --> 00:27:02,620

We actually don't have them coding in the first year anymore,

Cue 452 — 00:27:02,660 --> 00:27:06,260

because we actually know that one of the best ways to learn coding is using

Cue 453 — 00:27:06,300 --> 00:27:10,860

pseudocode, because you can just focus on the structure of thinking instead of being

Cue 454 — 00:27:10,900 --> 00:27:12,540

so frustrated with the compiler.

Cue 455 — 00:27:12,580 --> 00:27:18,320

Okay. And then in the second course without teach them how to judge AI.

Cue 456 — 00:27:18,540 --> 00:27:22,900

So do it yourself, do with AI, and we expect you to actually do that discussion.

Cue 457 — 00:27:22,940 --> 00:27:26,100

Okay. So that's some of the things we're trying to do.

Cue 458 — 00:27:26,140 --> 00:27:30,740

We as well added courses on like you know how to build these multi technology like

Cue 459 — 00:27:30,780 --> 00:27:33,140

code where AI where things together.

Cue 460 — 00:27:33,180 --> 00:27:35,340

So that's some of the things we're trying to do.

Cue 461 — 00:27:35,380 --> 00:27:37,780

But to be honest it's moving very fast.

Cue 462 — 00:27:37,820 --> 00:27:43,260

And the biggest problem is universities have a lot of rules to avoid like wild

Cue 463 — 00:27:43,300 --> 00:27:47,040

things. So they're not really used to like moving at the fast.

Cue 464 — 00:27:47,220 --> 00:27:50,300

Nobody's really used to moving at the speed right now, but these are some of the

Cue 465 — 00:27:50,340 --> 00:27:54,620

ideas we're working on. And if anybody has any ideas of what you think really,

Cue 466 — 00:27:54,660 --> 00:27:56,900

you know, undergrads need to learn, please tell us.

Cue 467 — 00:27:56,940 --> 00:27:59,320

Yes, please go ahead. He knows the answer.

Cue 468 — 00:27:59,380 --> 00:28:06,300

I just yesterday the presentation from guy after certain rules and he

Cue 469 — 00:28:06,340 --> 00:28:12,540

told a little bit opposite. In the first year you need to learn how to program you

Cue 470 — 00:28:12,580 --> 00:28:17,740

without the guy and then you are starting next three years, you're doing intensive

Cue 471 — 00:28:17,780 --> 00:28:22,900

projects and you're starting from the problem, and then you're you're under

Cue 472 — 00:28:22,940 --> 00:28:27,300

mentorship of some, like, more experience than people.

Cue 473 — 00:28:27,340 --> 00:28:31,580

You know, they are helping you to decompose the composer compose and you are making

Cue 474 — 00:28:31,620 --> 00:28:34,460

real to each direction with the.

Cue 475 — 00:28:34,740 --> 00:28:40,880

So the idea and I made one crazy experiment when my manager told it,

Cue 476 — 00:28:41,140 --> 00:28:47,252

I work in Microsoft, but my manager told me X manager told me that Rust is very

Cue 477 — 00:28:47,292 --> 00:28:53,940

difficult for me, and I asked if my 16 year old daughter, I thought I would give you

Cue 478 — 00:28:53,980 --> 00:29:00,680

$200 if you read this to pages book and you will develop if you achieve

Cue 479 — 00:29:01,620 --> 00:29:08,300

and convince the team anyway. So I'm just saying that then young student,

Cue 480 — 00:29:08,340 --> 00:29:13,920

16, 17 years old definitely should should start writing code for this company.

Cue 481 — 00:29:14,980 --> 00:29:16,860

So this is a big topic for debate.

Cue 482 — 00:29:16,900 --> 00:29:19,020

But I you know, there are different people on that.

Cue 483 — 00:29:19,060 --> 00:29:22,400

But I want to I want to mention something else that we actually added.

Cue 484 — 00:29:22,460 --> 00:29:25,300

We added a course for reading code.

Cue 485 — 00:29:25,340 --> 00:29:27,620

Okay, here's the reality. Let's think about it.

Cue 486 — 00:29:27,660 --> 00:29:28,860

You're going to be reading a lot of code.

Cue 487 — 00:29:28,900 --> 00:29:31,620

You know how many courses in undergrad teach people how to code?

Cue 488 — 00:29:31,660 --> 00:29:33,820

A large amount of code? Pretty much zero.

Cue 489 — 00:29:33,860 --> 00:29:38,580

Okay. That's one. Okay. Second, we actually have something called an ID integrated

Cue 490 — 00:29:38,620 --> 00:29:41,660

development environment okay. Today we're not developing.

Cue 491 — 00:29:41,700 --> 00:29:42,820

What we're doing is reviewing.

Cue 492 — 00:29:42,860 --> 00:29:47,700

We don't have an IRE. Okay. Actually think about how how crazy it is.

Cue 493 — 00:29:47,740 --> 00:29:52,540

Reviewing today is equivalent to printing code on a piece of paper and going with a

Cue 494 — 00:29:52,580 --> 00:29:58,340

red pen. This is how behind this is, you know, so there are so many things that need

Cue 495 — 00:29:58,380 --> 00:29:59,640

to be done, you know.

skills

talk-hassan-agentic-engineering

tile.json