Speaker:

You found the backup wrap up your go-to podcast for all things

Speaker:

backup recovery and cyber recovery.

Speaker:

In this episode, we'll explore the critical role that tabletop exercises

Speaker:

play when preparing for cyber incidents.

Speaker:

Our guest, Mike Sailor, CEO of Black Swan Security, shares his expertise

Speaker:

on how to effectively plan, execute, and learn from these activities.

Speaker:

We discussed the key components of a successful tabletop exercise,

Speaker:

common pitfalls, and why regular practice is essential for building

Speaker:

organizational resilience.

Speaker:

He also has a few great stories from exercises that he's conducted.

Speaker:

I think you'll find this episode quite useful.

Speaker:

I.

Speaker:

And enjoyable.

Speaker:

By the way, if you don't know who I am, I'm w Curtis Preston, AKA, Mr.

Speaker:

Backup, and I've been passionate about backup and recovery for over 30 years.

Speaker:

Ever since.

Speaker:

I had to tell my boss that we had no backups of the production

Speaker:

database that we just lost.

Speaker:

I don't want that to happen to you, and that's why I do this.

Speaker:

On this podcast, we turn unappreciated backup admins into Cyber Recovery Heroes.

Speaker:

This is the backup wrap up.

Speaker:

Welcome to the show.

Speaker:

If I could ask you to take just a quick second and press, subscribe

Speaker:

or follow so that you'll always get this content, that would be great.

Speaker:

I am w Curtis.

Speaker:

What?

Speaker:

Oh, yes,

Speaker:

us a comment.

Speaker:

yes.

Speaker:

Leave us a comment.

Speaker:

We love comments.

Speaker:

Um, I'm w Curtis Presson, AKA, Mr.

Speaker:

Backup with me, my vicarious movie watcher Prasanna Malaiyandi.

Speaker:

How's it going?

Speaker:

Prasanna.

Speaker:

I am good Curtis.

Speaker:

I, yeah, I would say I am a vicarious movie watcher, but sometimes I do

Speaker:

watch movies, but they're just like the Bollywood and Hollywood movies, not

Speaker:

Would, would, would you agree that you watch fewer movies than me?

Speaker:

Um, I think that's a statement for the entire world that would be factually

Speaker:

I.

Speaker:

Well, just because I watched three movies yesterday, two at two at the, uh,

Speaker:

at the theaters and, uh, one at home.

Speaker:

Uh, yeah, that's totally fine.

Speaker:

That's normal.

Speaker:

And because I watched Deadpool twice this weekend.

Speaker:

See, I have never met someone who falls asleep at movies so much

Speaker:

Okay, we're not talking about that.

Speaker:

We're not talking about that.

Speaker:

The fact that I had to go back to see Deadpool twice for two reasons.

Speaker:

One that I really enjoyed it the first time and second to figure out what I

Speaker:

missed when I dozed off in the middle.

Speaker:

Dosed off and you didn't even realize you dosed off either.

Speaker:

yeah, I didn't even realize I dozed off till I was watching it the second time

Speaker:

and going, uh, I don't remember this part.

Speaker:

Uh, it makes a lot more sense now.

Speaker:

Well, we should probably get to our actual topic here.

Speaker:

Uh, we once again have the CEO of Black Swan Security.

Speaker:

Mike Sailor.

Speaker:

How's it going, Mike?

Speaker:

It's going well guys.

Speaker:

How are.

Speaker:

Mike, I wanted to talk, uh, you know, we're, you know, in our continuing series

Speaker:

here on, uh, basically preparing for, you know, defeating ransomware, uh.

Speaker:

You know, being able to respond to it effectively.

Speaker:

And one of the topics that comes up a lot, it came up in our last recording, is

Speaker:

this idea of a, uh, a tabletop exercise.

Speaker:

And we, we talk a lot about that a lot, and I know that.

Speaker:

Back when, at my previous employer, when we started showing people what an

Speaker:

actual tabletop exercise looks like, they got really excited because I don't

Speaker:

think that a lot of people do this.

Speaker:

Um, I mean, when, when, when your company's brought in, I'm assuming that

Speaker:

these, well, well, lemme ask you this.

Speaker:

What percentage of the time are you brought in because there's

Speaker:

already been a cybersecurity event.

Speaker:

It is more often than people call us to do a tabletop.

Speaker:

Say that again.

Speaker:

We respond to incidents for

Speaker:

Right,

Speaker:

on their worst day,

Speaker:

right.

Speaker:

in helping them through tabletop exercises for their worst

Speaker:

Okay.

Speaker:

Right.

Speaker:

So you're normally, you're called for the worst day.

Speaker:

You, you wish you were called.

Speaker:

For the practice day.

Speaker:

Um,

Speaker:

Yeah.

Speaker:

and I, I, I wonder just Prasanna, what do you think, like, like what

Speaker:

percentage of companies actually do a, a tabletop exercise like this?

Speaker:

So I.

Speaker:

I am hoping, and I'm being gonna be, gonna be optimistic and say that

Speaker:

probably at least 70% of companies do a tabletop exercise in some part of their

Speaker:

organization, and it may not be a formal tabletop exercise doing everything end

Speaker:

to end, but they do some form of what could be considered a tabletop exercise.

Speaker:

But, okay.

Speaker:

So I should have specified a tabletop exercise for the

Speaker:

purposes of cybersecurity.

Speaker:

What do you think?

Speaker:

Yeah.

Speaker:

Yeah, I would probably say

Speaker:

Yeah, I think, I think you're being generous, but our listeners

Speaker:

are better than the average.

Speaker:

Our listeners are above average, and this is why they're listening to the show.

Speaker:

Uh, so, uh, let's just start from the beginning, Mike.

Speaker:

If somebody wanted to, they've, they've heard, they've heard that they should be

Speaker:

doing tabletop exercises for the purposes of being able to successfully respond to

Speaker:

a cybersecurity event, a ransomware event.

Speaker:

What's the first thing that they should be, uh, doing if they wanna do this?

Speaker:

What,

Speaker:

you get there,

Speaker:

yeah.

Speaker:

define what a tabletop exercise is?

Speaker:

Yeah.

Speaker:

Okay.

Speaker:

That sounds good.

Speaker:

Uh, so, so basically it's a, it's a prac, it's a practice run, right?

Speaker:

It's a practice run where you sit out there and you, you, you, well,

Speaker:

we're gonna define all the things that go into it, but basically you're

Speaker:

sitting around a table talking about.

Speaker:

This fake event that may happen to you at some point, and you basically

Speaker:

talk through, it's like, uh, you know what, um, to go back to movies.

Speaker:

It's like a table read, right?

Speaker:

Uh, you know, you're, you're film.

Speaker:

what a table read is

Speaker:

Oh, shut up.

Speaker:

Oh, come.

Speaker:

Okay.

Speaker:

All right.

Speaker:

A table read is where they get the script for the first time and they

Speaker:

all sit around a table and they just go through and read all the lines.

Speaker:

They don't, they don't act out anything.

Speaker:

They don't actually do the thing.

Speaker:

So it's like a table read, but for, um, yeah, I watch too much movies.

Speaker:

Um, so how, how, how's that for a, a definition, Mike?

Speaker:

It's pretty good.

Speaker:

And I think a good comparison would be, you know, uh, more of a simulation,

Speaker:

like a, a crisis or disaster simulation where there's, you got actors out in

Speaker:

the field and they've got the, the fake, you know, trauma, blood and makeup on,

Speaker:

and people are actually like physically interacting, going out and getting

Speaker:

victims and bringing back, triaging, wrapping 'em up, you know, assessing

Speaker:

them and, and that kind of thing.

Speaker:

That's more of a, a true simulation.

Speaker:

Right.

Speaker:

a tabletop to your, to your comparison to a, a a, a script review.

Speaker:

It's, it's, you're, you're reading from a, a manual, from a script, uh, in

Speaker:

the same room, uh, kind of stationary.

Speaker:

Right,

Speaker:

to apply some, some level of imagination, as you go through the script.

Speaker:

Um,

Speaker:

right.

Speaker:

but yeah, it's table tabletop because you, you, you're all at the

Speaker:

same table or, or virtually at the

Speaker:

hence the name.

Speaker:

Hence the name.

Speaker:

Uh, so good by the way.

Speaker:

Good job Prasanna.

Speaker:

I, I always,

Speaker:

That's why you keep me around.

Speaker:

I always forget to define stuff, so, all right.

Speaker:

So what, so back to my question before I was so rudely interrupted.

Speaker:

Um, what, so if, if we're thinking about doing this, what's the first

Speaker:

thing that we should be doing?

Speaker:

Well, in addition to understanding the, the difference between a tabletop

Speaker:

and a simulation, understanding the, the kind of categorically what are the

Speaker:

different parts of a tabletop, uh, and there's, there's really kind of five.

Speaker:

There's the, the.

Speaker:

Preparation, the planning, the execution, the review, and then the remediation.

Speaker:

and so the preparation part, you, you wanna make sure that

Speaker:

you've kind of got your ducks in a row before you go to the pond.

Speaker:

Uh, and so just jumping into a tabletop, let's do one tomorrow.

Speaker:

You wanna make the, it's not as, it's not gonna be as valuable as if you've done the

Speaker:

analysis of, are we ready for a tabletop?

Speaker:

And when you talk about cyber, cyber, cyber, tabletop exercises are related

Speaker:

to cyber incidents like ransomware or denial of service attacks, or the theft

Speaker:

of intellectual property or, uh, you know, employee misconduct type of thing.

Speaker:

All right, so what, what do we have in place?

Speaker:

As far as procedures and incident response plan, do we, do we know who the

Speaker:

key smart people effective people are?

Speaker:

Do we know management's expectations for communication and escalation?

Speaker:

Do we have management's blessing to have the authority to respond to this incident?

Speaker:

And who's gonna be in charge?

Speaker:

And so there's this, the litany of, are we even prepared to do a tabletop?

Speaker:

So that's the.

Speaker:

Yeah.

Speaker:

and for the prepared one too, Mike, I guess one of the things

Speaker:

is like doing a tabletop exercise.

Speaker:

You want it to be valuable, but it could potentially also be.

Speaker:

Expensive, quote, unquote, expensive, right?

Speaker:

Just because the number of people you're pulling in, who you're

Speaker:

pulling from their normal daily jobs, right, to do this exercise.

Speaker:

So you don't want it to just be like a waste of time for everyone.

Speaker:

Agreed.

Speaker:

Yeah, I, I, I, well, let me ask you this.

Speaker:

Let me, let me.

Speaker:

Let me argue with you and tell me why I'm wrong and that's okay.

Speaker:

Um, what if the purpose of this tabletop exercise is to show just

Speaker:

how badly we are prepared, uh, or poorly, just how poorly we are prepared

Speaker:

for, for a cybersecurity event.

Speaker:

Um, there could be some value in that.

Speaker:

It might be highly demoralizing and I agree that, that, you

Speaker:

know, Prasanna, it would be, um.

Speaker:

Expense.

Speaker:

There is a cost associated with it.

Speaker:

Uh, what, what do you think of that, Mike?

Speaker:

I've only seen that as, as a successful tactic one time in like 14 years.

Speaker:

Uh, and the reason for that is, you know, if, if you're the, the technology.

Speaker:

or the security executive, and your job is to protect the company and make sure

Speaker:

things can continue operation in the face or as a result of an incident or disaster.

Speaker:

let's say you've been asking for budget and resources for years and you're

Speaker:

not getting it for whatever reason.

Speaker:

So hey, let's do a tabletop to show the magnitude of deficiency

Speaker:

that we are are currently in

Speaker:

Right.

Speaker:

management can.

Speaker:

Can see that we, we need the help.

Speaker:

what that does then is it documents your deficiency.

Speaker:

Mm-Hmm.

Speaker:

now

Speaker:

to

Speaker:

discoverable, it's, it's also discoverable if you have an event and you get sued.

Speaker:

Um, but also politically, don't know of many, uh, many technology or security

Speaker:

executives that wanna put themselves in that position of documented failure.

Speaker:

and management is gonna see that as, oh, you're just trying to get leverage.

Speaker:

So it, politically it's a bad move.

Speaker:

I've only seen it, successful one time.

Speaker:

Um, and that was a pretty unique situation where the, the management

Speaker:

team was, was pretty collaborative and, uh, it wasn't for leverage.

Speaker:

It wasn't because they weren't getting the resources.

Speaker:

It was true learning experience for, for everybody.

Speaker:

And it was quite a while ago.

Speaker:

So that went really well.

Speaker:

E everybody went into it.

Speaker:

the same page with the same expectation of, of learning

Speaker:

and identifying weaknesses.

Speaker:

But today, in, in most of the environments that I experience, uh, or, or work

Speaker:

with, they, that wouldn't go over well.

Speaker:

Yeah, that's,

Speaker:

IT shop security guys,

Speaker:

that's,

Speaker:

they want, they want to, they wanna practice before they go to the game.

Speaker:

yeah, that, that's a really good point about the fact that you know that

Speaker:

it's discoverable and also that, um.

Speaker:

Politically, it, it is a, it is a difficulty, right?

Speaker:

It's one thing like, like I've done in, in, uh, you know, in my backup and

Speaker:

recovery days, I've documented, um, you know, I've basically demonstrated,

Speaker:

hey, we are unable to meet.

Speaker:

I.

Speaker:

The recovery time objective that you have specified.

Speaker:

Uh, and, and so that's kind of where, what I was thinking, but it's probably

Speaker:

a little bit different than here.

Speaker:

Um, and because in there what you're demonstrating is the deficiency

Speaker:

of the system that you had, you know, that, that you have not the

Speaker:

deficiency of the team itself.

Speaker:

Um.

Speaker:

in place.

Speaker:

Yeah, so it's okay.

Speaker:

So you're saying the first thing we do is we, so, so it sounds like we

Speaker:

need an incident response plan before we do, um, a tabletop exercise.

Speaker:

But you probably also need to figure out like what you're planning, like what

Speaker:

scenario you're planning to run, right?

Speaker:

So then you can make sure that you have those other steps, right?

Speaker:

Correct.

Speaker:

And, and there's hundreds of scenarios.

Speaker:

So one of the part of, part of that analysis, which scenarios do we

Speaker:

want to do, we want to base our, do we want to include on an instant

Speaker:

response plan, and then eventually te train on, in our tabletop, you need

Speaker:

to do an analysis of your business.

Speaker:

What, what's the most likely.

Speaker:

Threats and, and, and it could be any threat.

Speaker:

But then what, what impact would that have?

Speaker:

So you want the most likely, or the likely, but most impactful, uh,

Speaker:

threats then flesh out your playbook to then train on in your tabletop.

Speaker:

Is there a list of common scenarios somewhere?

Speaker:

I know it's gonna be unique for every company, but you like it's

Speaker:

one of those things where maybe you're not even thinking about

Speaker:

some of these scenarios, so I.

Speaker:

How

Speaker:

Be sure.

Speaker:

approach that?

Speaker:

Is that pulling in people like you who are experts at this and

Speaker:

can help them figure out what are

Speaker:

there's a.

Speaker:

scenarios?

Speaker:

Yeah.

Speaker:

a lot of different, uh, exercises and activities that can happen, uh, that lend

Speaker:

itself to, to good input to that exercise.

Speaker:

And one of those is a business impact analysis.

Speaker:

Go find out all the critical stuff in your business that helps your

Speaker:

business run and make money from that.

Speaker:

Then you, you, you often get those, um, those meantime to recovery type.

Speaker:

Metrics, like how long can this process be offline before we start

Speaker:

losing a lot of money, type of things.

Speaker:

So there's, that's great input.

Speaker:

Well then if, if you've got this list of critical things that if our

Speaker:

unavailable impact your financials or your operations or your reputation

Speaker:

or whatever it is, then from that you can then start to think, well, what

Speaker:

threats would impact that process?

Speaker:

And what are the common, what's, what, what are all the common themes

Speaker:

like, uh, internet access or email access, or our phone system or this

Speaker:

critical, you know, our, our ERP or financial system or, and then, and

Speaker:

then just keep working backwards.

Speaker:

Yeah.

Speaker:

Uh, and then

Speaker:

truly just more, most likely, statistically, most likely

Speaker:

threats that are out there.

Speaker:

Ransomware is huge, uh, in any environment where you've got end users that.

Speaker:

Interact directly with your production environment.

Speaker:

Uh, but ransomware has a couple of different flavors and one is delivered

Speaker:

via phishing emails and downloads, and the other one is delivered through.

Speaker:

Unauthorized access as a result of vulnerabilities or some other

Speaker:

weakness in your environment.

Speaker:

So again, what's the most likely scenario there?

Speaker:

Is it hacking into our network or are users clicking on

Speaker:

something they shouldn't?

Speaker:

And what controls do we have in place and what would the impact be?

Speaker:

And so I'm kind of going down that, that rabbit hole now, but.

Speaker:

Sitting back and, and thinking, for example, if, if we are a

Speaker:

company that develops new stuff.

Speaker:

So our intellectual property is very important to us.

Speaker:

The threat would be insider threat, stealing our intellectual property

Speaker:

when they go to a competitor or, uh, you know, nation state hacking us

Speaker:

to get our intellectual property.

Speaker:

Or we're transferring data, whether it's backup tapes or to a cloud, or to a, uh,

Speaker:

you know, we design the stuff, but we ship it off to a, a place to manufacture it.

Speaker:

And the process for doing that.

Speaker:

So that could be all be related to intellectual property theft.

Speaker:

Well, what's the impact?

Speaker:

Well, I'm sure there's financial impact.

Speaker:

There's market, market share impact.

Speaker:

There's legal impact, uh, reputation.

Speaker:

Um, and so is that more important than ransomware?

Speaker:

Shutting down our environment for two weeks or a

Speaker:

Yeah, that, that, that's a really good point.

Speaker:

You know, you, earlier you talked about, you know, what's highly likely

Speaker:

and what's impactful and that, um, you know, you, you need to do a balance.

Speaker:

Of course, there's nothing wrong with doing multiple tabletop exercises, right?

Speaker:

Um, do the, do the less likely but more impactful, the more likely, but less

Speaker:

impactful, um, what might be more likely.

Speaker:

more than one

Speaker:

Good.

Speaker:

exercise.

Speaker:

You know it, it sounds like this all day, all week thing.

Speaker:

Right,

Speaker:

Most tabletop exercises last maybe an hour or two.

Speaker:

And so if, if you've, if you've got the, the ability to allocate

Speaker:

resources to an entire day, you might be able to get two or three, uh,

Speaker:

right.

Speaker:

So we figure out, we figured out the.

Speaker:

You know how prepared we are and whether or not we're prepared to do this, we

Speaker:

have decided the scenario or scenarios that we're, uh, going to do what's next.

Speaker:

So now we need to determine, um, the format.

Speaker:

Is it, is it just the core team?

Speaker:

Uh, so.

Speaker:

The incident response lead, the subject matter experts, the stakeholders involved,

Speaker:

that, that would provide input and decision making, that kind of thing.

Speaker:

then there's the third parties, like external legal counsel and your

Speaker:

insurance company and law enforcement.

Speaker:

and then there's the observers, uh, other, other people in management or your board,

Speaker:

uh, or other employees that, uh, maybe.

Speaker:

be good to observe, uh, the intricacies of incident response and what's involved.

Speaker:

There's, there's a feedback on that's usually pretty good.

Speaker:

Like I had no idea it was that complicated.

Speaker:

and so that there, there might be value there, but most, most organizations that

Speaker:

are doing their first tabletop wanna kind of keep it tight in case they mess up.

Speaker:

They don't want everybody to know where they're.

Speaker:

Whether their deficiencies are, but that next stage after you've determined

Speaker:

the scenario is to, uh, identify or define who's gonna participate,

Speaker:

gonna run and moderate this.

Speaker:

Exercise, usually that's a third party.

Speaker:

Uh, have an objective, uh, you know, someone that's not been in the weeds every

Speaker:

day and doesn't know all the intricacies so they can, they can ask some good

Speaker:

questions and throw some good curve balls.

Speaker:

Uh, you know, just when your team knows what the all the plays are,

Speaker:

uh, the, the moderator can, can, uh, throw a monkey wrench in there and see

Speaker:

how, how, how, how the team reacts.

Speaker:

this start,

Speaker:

sure you have.

Speaker:

this starts to sound like d and DA little bit.

Speaker:

And I thought that's where you were gonna go earlier.

Speaker:

Uh, when you were gonna explain how a tabletop went.

Speaker:

It, it is very much like a, a role-based, uh, table game, uh, table based game.

Speaker:

And then, uh, make sure you've got a good scribe, somebody that can take good notes.

Speaker:

And one of the things that you wanna make sure you highlight

Speaker:

are what we call the aha moments.

Speaker:

Like, oh yes, you know, you can tell when there's an aha moment.

Speaker:

Those aha moments can be good.

Speaker:

Like, Hey, that's a great idea, or, I'm glad we did it that way.

Speaker:

And they could also be the, I didn't think of that.

Speaker:

and so we need to capture all the good and the bad and, and the, the curious.

Speaker:

Um, so you, you've gotta put that kind of planning into, um, into game day

Speaker:

So deciding, deciding who's deciding who's gonna be there

Speaker:

and who's gonna do what role.

Speaker:

Right.

Speaker:

And then, and then some, some ground rules.

Speaker:

Uh, so I always start with some ground rules and I make sure everybody that's

Speaker:

participating and agrees with those.

Speaker:

And, uh, one of those ground rules needs to be that this tabletop is a safe place.

Speaker:

We're here to, to talk and collaborate and, and, and, uh, go through this

Speaker:

exercise for the benefit of the company.

Speaker:

You know, there's no stupid questions.

Speaker:

No one's gonna be fired because you didn't know, or, or you, you challenge, uh.

Speaker:

Um, a decision or, or a comment, uh, it's meant to be

Speaker:

productive and, uh, constructive,

Speaker:

No blame

Speaker:

correct.

Speaker:

Yeah,

Speaker:

you actually

Speaker:

go ahead.

Speaker:

to execute or, so you've set, so you've found the people, you know

Speaker:

the scenario, you set the rules.

Speaker:

I'm guessing you just sort of play the game.

Speaker:

Right.

Speaker:

And so you, you start the tabletop with, uh, uh, and sometimes it's,

Speaker:

it's good to provide some statistics or maybe some background information

Speaker:

to support the, the magnitude or the gravity, uh, of the exercise.

Speaker:

So.

Speaker:

Maybe recent statistics on cyber or whatever that particular threat is.

Speaker:

Um, if you're gonna invite law enforcement, a lot of times they'll

Speaker:

bring those numbers and do a short presentation, uh, which has

Speaker:

always been good and interesting.

Speaker:

Uh, you lay out the ground rules, uh, you describe at a high level

Speaker:

what the scenario is gonna be.

Speaker:

Um, and then you start with step number one.

Speaker:

Uh, so and so observed this, or this event happened and it was

Speaker:

reported to whoever who then.

Speaker:

Uh, reviewed it, uh, categorized it, classified it as an incident

Speaker:

of whatever priority, and kicks off the, the incident response.

Speaker:

And then you hand it over to whoever that person is and say, so what do you do next?

Speaker:

I call Jim and this is what I do.

Speaker:

And then you go to Jim.

Speaker:

All right, Jim, you got the call.

Speaker:

What do you do next?

Speaker:

And you just, it, it's truly role playing.

Speaker:

Um, turn by turn and.

Speaker:

the list right of their playbook, if you will.

Speaker:

and there is a little bit of discussion.

Speaker:

All right, so why did you do that, Jim?

Speaker:

Or what do you think about that?

Speaker:

Or how do you think that could have gone differently?

Speaker:

Um, and so there is a little bit of interaction.

Speaker:

Uh.

Speaker:

In process, but for the most part, right?

Speaker:

Yeah.

Speaker:

Everybody's gonna talk about what their role and responsibility

Speaker:

and activities are, and, and we're gonna capture all that.

Speaker:

And if it, if it's lined up with the playbook that we

Speaker:

came to the game with, great.

Speaker:

But in many cases, I would say at least half.

Speaker:

got some action items that come out of this to make things better.

Speaker:

You know, one of the thing,

Speaker:

oh,

Speaker:

one of the things that I've seen from, um, common cyber events has been that it,

Speaker:

it doesn't start, the cyber event doesn't start with, you get this big message on

Speaker:

your screen, you've been attacked, right?

Speaker:

It starts with, you know, the.

Speaker:

West wing air conditioner unit is not working the way it's supposed to.

Speaker:

Right?

Speaker:

It's like you have this random, random thing.

Speaker:

It's like, oh, that's odd.

Speaker:

Why is that happening?

Speaker:

Uh, when, why it's happening is that you have an underlying security event, right?

Speaker:

That's happening.

Speaker:

Um, I, I wonder what, when you, when you do these, when you do a tabletop.

Speaker:

Is that the kind of thing you give them, or do you give them a little bit more

Speaker:

blatant, you know, um, you know, you, you've, you, you know it's happened.

Speaker:

So one of the, one of the good things about a moderator that's been through

Speaker:

a lot, uh, is that to your point, you know, this, this weird thing

Speaker:

happened and we want to address, we want to triage this, we wanna stop the

Speaker:

bleeding, stop the, stop the incident.

Speaker:

But at the same time, there's gotta be some people.

Speaker:

Tasked with determining root cause, worst patient, zero.

Speaker:

Uh, what were the things, the, the symptomatic things or the observable

Speaker:

things that could have been escalated prior to this bad thing really happening?

Speaker:

so to that point, and I think your analogy's a good one.

Speaker:

Is that we're not just addressing truly techno uh, technology based, uh, events

Speaker:

and metrics and observable things.

Speaker:

We also want to go back to the people, the eyes and the ears

Speaker:

see something, say something.

Speaker:

So do we have a good security awareness program?

Speaker:

did Bob or Sally see that air conditioning thing misbehaving some time ago?

Speaker:

Weeks, days, months.

Speaker:

is there a way to, is, is there even a mechanism for them to report that?

Speaker:

Because if they just make a comment to a coworker or a supervisor, well then

Speaker:

there's gotta be a way to communicate that to people that need to know.

Speaker:

So is, is there even a mechanism for that?

Speaker:

But to your point, right?

Speaker:

So we, we want to.

Speaker:

We want to expand the value, uh, of the tabletop as far as we can

Speaker:

without diluting the, the focus.

Speaker:

Um, but those observable, teachable, um, expandable moments, uh,

Speaker:

are, are definitely brought up.

Speaker:

Um, and so that's a good, I'm glad you brought that up.

Speaker:

'cause that's a absolutely, it's, it's the moderator's job.

Speaker:

Uh, to know how far outside the true storyline we can go, how

Speaker:

far off the path can we go and still add value to the exercise?

Speaker:

And so it looks like the moderator has a critical role to play in

Speaker:

the actual execution of the,

Speaker:

Mm-Hmm.

Speaker:

of the tabletop exercise.

Speaker:

And I know you mentioned sometimes a lot of this comes with experience.

Speaker:

How do you even find the right moderator?

Speaker:

Right.

Speaker:

Because like you mentioned, you probably don't want someone who's

Speaker:

internal who knows the details of the systems and the inner workings.

Speaker:

You want someone who's experienced in cyber instance incidences or

Speaker:

whatever else you're focused on.

Speaker:

But how do you, as a company, like I'm going out and seeking

Speaker:

out a moderator, how do I know?

Speaker:

Like what are the questions I would ask to be able to determine, is that a good

Speaker:

moderator for my tabletop exercise or not?

Speaker:

Usually there's, there's profiles for, for tabletop moderators.

Speaker:

They're also call 'em breach coaches.

Speaker:

Uh, and they, they run from the, kind of the gamut, from true cyber focused.

Speaker:

You know, former CISOs and, and people that have been in the trenches, uh,

Speaker:

that actually had to wear those shoes.

Speaker:

Uh, and then some other breach coaches are on more of the

Speaker:

advisory or even legal side.

Speaker:

Like one of my, one of my favorite breach coach collaborators is

Speaker:

an attorney and he's been a cyber attorney his whole career.

Speaker:

He is never spent a day in it.

Speaker:

Uh, but he's been involved in hundreds of breaches, so he's seen.

Speaker:

The battleground, and he is been through the game he's seen what,

Speaker:

what's worked and what's not.

Speaker:

And then based on all that experience, also giving some good advice on how

Speaker:

to, how to make them more resilient to, to future, uh, incidents.

Speaker:

So my advice would be, uh, and you can search, usually it's called,

Speaker:

you know, tabletop exercises.

Speaker:

You know, the, the, the service providers out there usually list it.

Speaker:

Like that.

Speaker:

and then for those that are providing the service from that company, you've

Speaker:

got a, a profile, usually like a resume that you can, you can review.

Speaker:

And it seems like the, the.

Speaker:

Actual experience with actual events would be a really big, because

Speaker:

like you said, they can draw on all of these different things that

Speaker:

have happened to them, um, both in terms of how the event got started.

Speaker:

And things that happen throughout the event, right?

Speaker:

It's like, okay, well now you just lost power or whatever,

Speaker:

whatever types of things that happened throughout a cyber event.

Speaker:

Um, you've got to have a lot of experience to be able to

Speaker:

draw on those kinds of things.

Speaker:

And, and I'll, I'll, I'll make an example that, that you

Speaker:

can probably truly relate to.

Speaker:

'cause that backup tape drive works the same every day and it works good.

Speaker:

And you know, you know the hiccups.

Speaker:

I guarantee you that does not work the same on the day.

Speaker:

You have an incident.

Speaker:

You've gotta restore something.

Speaker:

It's just, that's a Murphy's Law

Speaker:

Yeah.

Speaker:

someone.

Speaker:

Moderating your, your tabletop, that's familiar with how Murphy's Law works?

Speaker:

Yeah.

Speaker:

I.

Speaker:

I often, uh, say that the success rate of backups is inversely proportional to the

Speaker:

degree to which you need that data, right?

Speaker:

Absolutely.

Speaker:

Yeah.

Speaker:

Absolutely.

Speaker:

Yeah.

Speaker:

Um, all right, so we've, we've, so we've done our event, right?

Speaker:

Um, and we, you know, you had, you had a good scribe captured those aha moments.

Speaker:

Um, now what, and no one cried.

Speaker:

Maybe somebody cried.

Speaker:

Um.

Speaker:

I've,

Speaker:

But

Speaker:

happen.

Speaker:

I'm sure, I'm sure this is so hard.

Speaker:

Um, I could just see that.

Speaker:

Um,

Speaker:

Well one of the things, one of the things too, and before we get off the,

Speaker:

uh, off of the execution part, uh, I wanna stress the importance of, um.

Speaker:

Accountability.

Speaker:

So even though it's a safe place, we don't want to happen is walking

Speaker:

through a scenario and somebody go, well, let's just assume we do.

Speaker:

We do have that, and let's move on.

Speaker:

Let's just assume, don't we need to move, we need to work through this because we

Speaker:

need to know how it's gonna flesh out.

Speaker:

So I wanna stress that, that when you're playing this game, don't just

Speaker:

No, it's not.

Speaker:

right?

Speaker:

Uh, because.

Speaker:

And I've got a, a case study where we assumed, or I say we, it was the,

Speaker:

the response leader, let's assume we have that and let's move on.

Speaker:

And kind of, um, uh, not directly, but I tried to passively come back to

Speaker:

it multiple times during the tabletop and each time it was met with, let's

Speaker:

assume we have that and move on.

Speaker:

Not, not six weeks after the exercise.

Speaker:

They actually got hit with that, that particular incident in real life.

Speaker:

And that assumption, uh, really came back to bite him because they

Speaker:

assumed this in the tabletop, it was not captured as a remediation item.

Speaker:

Um, and that was one of the downfalls of their, of their incident response.

Speaker:

That,

Speaker:

was false.

Speaker:

Right.

Speaker:

that reminds me,

Speaker:

that is true.

Speaker:

Yeah, I like that.

Speaker:

And I, I can see that, I can see wanting to do that.

Speaker:

It's like, okay, we don't have that person here.

Speaker:

Let's just assume that we have the thing right.

Speaker:

Nope, he's not here.

Speaker:

What do we do if he's not here?

Speaker:

right.

Speaker:

He's

Speaker:

Yeah.

Speaker:

He gets hit by a bus.

Speaker:

Yep.

Speaker:

Yeah.

Speaker:

and I've done that too.

Speaker:

All right.

Speaker:

You're the incident response team leader.

Speaker:

Let's go through this.

Speaker:

And halfway into the incident response, I go, all right, you fell sick.

Speaker:

'cause that pizza you ate for lunch took you out.

Speaker:

And so who's, who's, who's, who's the assistant coach.

Speaker:

And we actually ran into a problem there.

Speaker:

'cause three people thought they were the assistant coach.

Speaker:

And so there's a

Speaker:

Uh.

Speaker:

of, you know, right.

Speaker:

Who's gonna take charge.

Speaker:

But then, sorry.

Speaker:

So after, after we finish the execution and we've got.

Speaker:

and good notes.

Speaker:

We, we wanna review, we want to debrief.

Speaker:

We wanna make sure that what we heard, what we collected, uh, what we documented,

Speaker:

uh, was, uh, concise and, and accurate.

Speaker:

And then naturally, as, as, you know, maybe, maybe I'm saying something, I'm

Speaker:

responding to something or I'm walking through my activity, my playbook and

Speaker:

my part's done, I hand it off to you and now I'm listening to your response.

Speaker:

Naturally as, as people with responsibility and instant response.

Speaker:

I'm gonna think about what you're saying and, well, what

Speaker:

could I have done different?

Speaker:

Or, or maybe I've got thoughts about what you're saying.

Speaker:

So the, the debrief gives an opportunity for the participants to add more comment

Speaker:

or thought or, you know, something came to mind or, you know, um, me

Speaker:

add to that or let me correct that.

Speaker:

And so the debrief is important.

Speaker:

Before everybody leaves, we want to capture all that before the end,

Speaker:

before people go back to their day job.

Speaker:

All right, well then the scribe and the moderator to over the, the coming days

Speaker:

to make sure that there aren't any un un untied strings or unle questions.

Speaker:

And we're gonna, you know, there's an opportunity to, to ping the,

Speaker:

the participants one more time, uh, because maybe they also made

Speaker:

reference to something and, all right.

Speaker:

Well.

Speaker:

Lemme know when you get back to your desk, you know, type of thing.

Speaker:

So we, we've, we've got a period of time to wrap this up, and then

Speaker:

we want to document this in a summary with detailed action items.

Speaker:

All right?

Speaker:

This is what came out of the, the tabletop.

Speaker:

Uh, we, we, we need to update this.

Speaker:

Uh, we need to find a resource when, when Bob doesn't show up, we need

Speaker:

to talk to our insurance company about having a, a good contact.

Speaker:

We need management's approval for, uh, when to involve law

Speaker:

enforcement, whatever it is.

Speaker:

We've

Speaker:

Yeah.

Speaker:

this action plan we need, we need that stuff to be addressed.

Speaker:

It came out of this incident response as things that we need

Speaker:

to do to be more effective.

Speaker:

It has to get done, and that is as important as conducting the exercise

Speaker:

because you now know where your weaknesses are where, where, where you need to

Speaker:

improve in order to be effective.

Speaker:

Without that stuff, you're going to fail the response to whatever that incident is

Speaker:

and more than likely back to Murphy's Law.

Speaker:

That particular incident that you just trained on that you didn't fix is

Speaker:

gonna happen sooner than it would've.

Speaker:

Yeah.

Speaker:

Uh, well, you know what, this brings brought up a thought for me.

Speaker:

You know, we talk a lot about doing disaster recovery testing, and,

Speaker:

um, so my question is, what is, is there a, is there a, is there a pass

Speaker:

or fail for a tabletop exercise?

Speaker:

You know, what's considered a success is something, is, you know, I, I would think.

Speaker:

I don't know.

Speaker:

I'll, I'll stop talking.

Speaker:

What would be considered a success and what be, what

Speaker:

would be considered a failure?

Speaker:

There is, and, and what what success is would depend on what the incident is.

Speaker:

So if like it was incident, if it was intellectual property theft, success

Speaker:

would be determining how it happened.

Speaker:

Having enough evidence to prosecute whoever did it

Speaker:

right, that would be success.

Speaker:

in, uh, ransomware success would be a hundred percent or majority.

Speaker:

Recoverability without having to pay a ransom while also figuring out

Speaker:

how the ransom infection happened.

Speaker:

That would be ideal success.

Speaker:

But there's, there's levels of success as well.

Speaker:

Uh, simply getting the, the company back up and running with minimal financial

Speaker:

impact, uh, would be considered success.

Speaker:

Uh, and so defining success is one of those criteria that you

Speaker:

definitely want to, uh, lay out at the beginning of an incident.

Speaker:

Uh, based on what's going on, here's what we're gonna focus on.

Speaker:

Mm-Hmm.

Speaker:

our target is, and that's collaboration with management.

Speaker:

That's not just it, you know, setting the, setting the bar and, and,

Speaker:

and shooting for that objective.

Speaker:

It needs to be collaborative.

Speaker:

and then absolutely there's failures.

Speaker:

I.

Speaker:

is not being prepared, not understanding the business, not, not having good,

Speaker:

not having identified the right resources that you need to be effective

Speaker:

in response, not getting along.

Speaker:

I've seen that several times in an incident response tabletop, people

Speaker:

just, I'm not working with you anymore.

Speaker:

I, I quit.

Speaker:

I haven't had it, and I quit.

Speaker:

But there's definitely people that, that have had some, some contentious

Speaker:

or, you know, some animosity and you put 'em in a room in a.

Speaker:

And you're, you're, you're pointing fingers, all right, you're next.

Speaker:

And they're like, yeah, I'm not playing anymore.

Speaker:

And, and I've seen that.

Speaker:

Wow.

Speaker:

Yeah, that would be a.

Speaker:

that brings, brings sli a uh, uh, a risk that needs to be addressed.

Speaker:

Maybe that person shouldn't have that responsibility.

Speaker:

And I think at least doing this exercise, right, so you've gone

Speaker:

through this entire process.

Speaker:

You figured out the remediation steps or the gaps that you have today.

Speaker:

think that's such a huge step forward for a company because now you can figure

Speaker:

out, okay, how do I address those?

Speaker:

What are the skillsets I need to bring in?

Speaker:

What are things I need to modify my processes in order to make

Speaker:

sure that I am able to recover from some of these incidents?

Speaker:

And it is really huge too in, in, in very well established environments

Speaker:

that have never been tested.

Speaker:

They're, they're so complacent with how everything's always worked.

Speaker:

Everything's fine.

Speaker:

Everything's worked well forever.

Speaker:

I.

Speaker:

I've been here for 20 years.

Speaker:

Well, that's great.

Speaker:

It's worked well from your perspective without any outside influence.

Speaker:

Let's add some of that.

Speaker:

Hmm.

Speaker:

Yeah.

Speaker:

perspective outside influence and see how things go.

Speaker:

Yeah, I, I, um, you know, talking about, you know, the way people interact, it,

Speaker:

it, it would seem, and while, while it is a safe space, you know, you're,

Speaker:

you're observing and you, you get to see how different people do under pressure.

Speaker:

Um, you know, I'm, I'm thinking back to, I used to work for this company

Speaker:

that used to u that used to ask.

Speaker:

Really bizarre interview questions.

Speaker:

Not as bizarre as the, like how to put an elephant in a refrigerator.

Speaker:

I dunno if you're familiar with that series of questions.

Speaker:

They were more like you're writing a shell script and instead of pound bank,

Speaker:

Bens h at the top, you put Pound bank, Ben Echo what would happen, right?

Speaker:

And it, and it was for, it had two purposes.

Speaker:

One was.

Speaker:

If you could successfully answer the question, um.

Speaker:

Then it showed that you had a really good knowledge of internals,

Speaker:

but if you couldn't answer the question, it was just as important

Speaker:

to see how you responded to that.

Speaker:

Right.

Speaker:

And if basically, and we had interviewers just walk out

Speaker:

like, this is a stupid question.

Speaker:

This is, no one would do that.

Speaker:

No one would put Ben Echo at the top of the script.

Speaker:

Shell script, this is stupid.

Speaker:

And they would just literally walk out.

Speaker:

Okay, you failed the interview.

Speaker:

Right.

Speaker:

And so I would, I would think that that's, that, you know, you talked about dynamics,

Speaker:

you talked about pe, people getting, uh, you know, animosity to each other.

Speaker:

And, and I'm sure that at some point there, even though we're not supposed

Speaker:

to, I'm sure there's been some yelling and a few tabletop exercises.

Speaker:

Would that be a fair assumption?

Speaker:

There has and, and, well, not yelling, but definitely raising the voice.

Speaker:

Yeah.

Speaker:

Yeah.

Speaker:

Um, yeah.

Speaker:

And, and.

Speaker:

So I think the only, the only truly failed tabletop exercise, in my opinion, would

Speaker:

be one that, that just, you just never do.

Speaker:

Right?

Speaker:

Um, and I think that that's what multiple people, I, I think that's what a majority

Speaker:

of people are doing or not doing, is that they're just not doing these for fear.

Speaker:

Of those things for fear of being exposed, for fear of whatever.

Speaker:

But the only thing I can say to them is, well, you know, um, it, you know,

Speaker:

it, it, it remind, have you seen, um, Glen Gary, Glen Ross, the movie?

Speaker:

Um, okay.

Speaker:

It, it.

Speaker:

If you watch nothing else, just watch the opening scene with, uh, Alec Baldwin.

Speaker:

And, uh, there's a li he's, he's, he's yelling and screaming at

Speaker:

these, um, at these salesmen.

Speaker:

And he basically, he said, one of the lines he says is, you, you, you

Speaker:

can't handle what I'm, what I'm, what I'm saying to you right now,

Speaker:

if you can't handle this, how are you gonna handle the abuse that you

Speaker:

get when you go out on a sales call?

Speaker:

Like if you can't handle a tabletop.

Speaker:

Imagine an actual cybersecurity event where you didn't do a tabletop and

Speaker:

you're, you're not prepared at all.

Speaker:

Um, which I think is the majority of situations.

Speaker:

Right.

Speaker:

Um.

Speaker:

And, but I think there's a misconception there in that tabletop is this

Speaker:

point in time thing, uh, that they don't, that they're afraid of.

Speaker:

'cause they're afraid that they're gonna fail.

Speaker:

But really the intent of doing a tabletop requires that you do

Speaker:

some planning ahead of game day.

Speaker:

So that.

Speaker:

Right.

Speaker:

better prepared to play the game and that that preparation is where

Speaker:

someone like me would really walk you through you need to be successful in a

Speaker:

tabletop and make sure that that's in place before we we go play the game.

Speaker:

Yeah.

Speaker:

Yeah.

Speaker:

And I think if you define the success of the tabletop is a successful

Speaker:

tabletop helps uncover, um, weaknesses that we can then go address.

Speaker:

Right.

Speaker:

That would be a successful tabletop.

Speaker:

Yeah.

Speaker:

It

Speaker:

And if, and

Speaker:

expected.

Speaker:

yeah.

Speaker:

tabletop I've ever done has had opportunity for improvement.

Speaker:

Yeah, it's just like when, uh, Pana, you know that I say this a lot that we,

Speaker:

when we used to do disaster recovery exercises, we define success as.

Speaker:

Because we would do a DR test where, uh, I was the one in charge of backups, but

Speaker:

I was not the one running the DR test.

Speaker:

And a, a, a success was they, they made it from A to to Z using

Speaker:

nothing but my documentation and never having to ask me a question.

Speaker:

Never once did we succeed by, by that standard, right?

Speaker:

Everyone has, uh, deficiencies.

Speaker:

In every part of it, in the job of doing this.

Speaker:

And I like, by the way, I like you talk, you said it, it, it's, a lot

Speaker:

of people see it as a point in time.

Speaker:

Another thing is that you don't just do one tabletop and then move on.

Speaker:

You do regular tabletops.

Speaker:

What, what do you think is a, is a, a good frequency for people to do that?

Speaker:

As often as possible, uh.

Speaker:

At, at a minimum once a year,

Speaker:

Uh.

Speaker:

you pick, because once a year is really as, as often as.

Speaker:

You know, collectively the business reassess itself.

Speaker:

You know, that's where we update our strategy, uh, both on the business

Speaker:

side and the technology side.

Speaker:

That's where we look at our, if, if we've got audit work or risk

Speaker:

assessments, we look at all those things.

Speaker:

So once a year is, is common.

Speaker:

Twice a year would be great.

Speaker:

Quarterly would be amazing.

Speaker:

And if you're doing 'em quarterly, you're really cutting this down to.

Speaker:

You know, a a, a well-oiled machine, you know, doing 'em once a year.

Speaker:

That's probably two hours on game day plus maybe an hour or two of,

Speaker:

of planning ahead of, and then all the logistics of, you know, people.

Speaker:

People's schedule and everything, if you do them quarterly, you can

Speaker:

break u Usually it's a smaller group.

Speaker:

you can really focus tactically on whatever the scenario is and just, you

Speaker:

know, just record it in a team session and you don't even have to have a, a scribe.

Speaker:

Um, and it becomes this, this, this, uh, scheduled event that, that you just,

Speaker:

know, it's, it's like going to practice

Speaker:

Yeah, and you're developing muscle memory.

Speaker:

Did, did you just say muscle memory

Speaker:

I did say

Speaker:

at the same time?

Speaker:

Look at that.

Speaker:

I love it.

Speaker:

I love it.

Speaker:

That's a great way to.

Speaker:

the other thing to consider with tabletops is, uh, it's actually a

Speaker:

benefit in, in a couple of ways.

Speaker:

You're, and especially if you expand the, the participation to

Speaker:

include your insurance company and law enforcement, some others.

Speaker:

improving the perceived effectiveness of your organization to people that want

Speaker:

to help you, you learn something too.

Speaker:

Like a lot of organizations think, I'm not gonna call my insurance

Speaker:

company until I fee, I think I'm gonna have a claim or, recover, so

Speaker:

I'm gonna have to pay the ransom.

Speaker:

So I gotta call my insurance company.

Speaker:

But if you ask the insurance company when, when should we call you?

Speaker:

They're gonna tell you as soon as you think you have a problem.

Speaker:

Yeah.

Speaker:

we've been through a lot of this stuff and we can also help guide you.

Speaker:

Right.

Speaker:

say Bob didn't come to work that day and he's on your incident response

Speaker:

team and he's your database expert.

Speaker:

what are we gonna do now?

Speaker:

Well, your insurance company probably has a vendor on their approved list that's

Speaker:

a database expert that can help you.

Speaker:

And there's, I mean, they're a great resource and a lot of, a lot

Speaker:

of organizations don't realize, or they're hesitant to involve.

Speaker:

Insurance company.

Speaker:

Their insurance company.

Speaker:

When, when something bad happens, they're afraid it's gonna, it's gonna ding them

Speaker:

like getting your windshield repaired.

Speaker:

Yeah.

Speaker:

they're, they're afraid it's gonna impact their, their

Speaker:

premium next year or whatever.

Speaker:

But really what it's doing is adding, it's adding value.

Speaker:

Um, and, and there's a perception there from your insurance company that you guys

Speaker:

are, what, you're being diligent, uh, ahead of, uh, a true incident happening.

Speaker:

All right.

Speaker:

Well, thank you.

Speaker:

Uh, thank you once again, Mike.

Speaker:

You are welcome.

Speaker:

All right, and thanks, Prasanna.

Speaker:

You enjoying this?

Speaker:

I am, I'm learning something new.

Speaker:

It's kind of

Speaker:

I, I love learning.

Speaker:

I love learning

Speaker:

whenever I think about tabletop exercises, for some reason I think about the, uh,

Speaker:

the game battleship for some reason.

Speaker:

you song.

Speaker:

My battleship.

Speaker:

I like it.

Speaker:

All right, well, thanks again to our listeners.

Speaker:

We love you.

Speaker:

Uh, you're why we do this.

Speaker:

Um, and uh, that is a wrap.

Speaker:

The backup wrap up is written, recorded, and produced by me w Curtis Preston.

Speaker:

If you need backup or Dr.

Speaker:

Consulting content generation or expert witness work,

Speaker:

check out backup central.com.

Speaker:

You can also find links from my O'Reilly Books on the same website.

Speaker:

Remember, this is an independent podcast and any opinions that

Speaker:

you hear are those of the speaker and not necessarily an employer.

Speaker:

Thanks for listening.