Speaker:

You found the backup wrap up your go-to podcast for all things

Speaker:

backup recovery and cyber recovery.

Speaker:

In this episode, we tackled the critical topic of incident response plans.

Speaker:

Once again, we've brought our resident cyber expert, Dr.

Speaker:

Mike Saylor from Black Swan Security, who starts by defining what an IR plan is and

Speaker:

how it's different from DR and BC plans.

Speaker:

We then talk about how you need different kind of response plans

Speaker:

for different kinds of incidents.

Speaker:

Like a cyber attack versus a failed RAID array.

Speaker:

We also delve into RACI diagrams and how they define who is

Speaker:

responsible, accountable, consulted and informed on any incidents.

Speaker:

Then we dig into where this plan should live and how you should make sure you

Speaker:

have access to it and the bad guys don't.

Speaker:

This is a packed episode I think you're gonna really like.

Speaker:

By the way, if you don't know who I am, I'm w Curtis Preston, AKA, Mr.

Speaker:

Backup, and I've been passionate about this topic for over 30 years.

Speaker:

Ever since I had to tell my boss that our production database was toast

Speaker:

and there were no backups of it.

Speaker:

I don't want that to happen to you or anybody, and that's why I do this.

Speaker:

On this podcast, we turn unappreciated backup admins into Cyber Recovery Heroes.

Speaker:

This is the backup wrap up.

Speaker:

Welcome to the show.

Speaker:

If I can ask you for just a quick second to go, press, subscribe or

Speaker:

follow so that you'll always be able to get our content, that would be great.

Speaker:

I am w Curtis Preston, AKA, Mr.

Speaker:

Backup, and I have with me a guy who keeps trying to get me to watch

Speaker:

this weird new version of the Lord of the Rings Prasanna Malaiyandi

Speaker:

ah, yes.

Speaker:

And you still have not seen it, although I did.

Speaker:

So my parents, so what I'm referring to is there's this new, it's not

Speaker:

even a Bollywood movie, I think it's technically a Telugu movie.

Speaker:

It's so tollywood, but it is called ky, A 2398 or something like that.

Speaker:

So it's supposed to be Yes, very.

Speaker:

Fantasy oriented.

Speaker:

Supposed to be really good shot in the modern day era or actually in the future.

Speaker:

And it has some pretty famous actors.

Speaker:

So from both the Telegu scene and the Thumb, and also from Hindi cinema.

Speaker:

So pretty much star in all star cast.

Speaker:

But I've been asking you, my parents actually went and saw it.

Speaker:

They said it was like three and a half hours and it was really long, but.

Speaker:

That might be like a.

Speaker:

couple naps.

Speaker:

Yeah, but it might be a couple naps.

Speaker:

for you, But it's only one episode or one movie.

Speaker:

I've been also trying to get you to watch Bahoo Bali one and two or the beginning

Speaker:

yeah.

Speaker:

That's the Lord of the Rings.

Speaker:

When I was talking about though, isn't it?

Speaker:

Oh, that's y.

Speaker:

Oh, you're right.

Speaker:

That is the Lord of the Rings

Speaker:

and that's like seven hours.

Speaker:

That's like seven hours long.

Speaker:

that's six hours.

Speaker:

But, uh, my wife and I, we did watch it y or over the weekend and so it's fine.

Speaker:

And it's really good though, Curtis, you should watch it.

Speaker:

You have until August 6th.

Speaker:

Uh, okay.

Speaker:

So as of this recording, I have one week to watch it.

Speaker:

Yes.

Speaker:

All right, well, we have with us again, our, um, can, can we call you our,

Speaker:

our resident cybersecurity expert?

Speaker:

Can

Speaker:

I feel like I've, I, I, I feel like I do reside here now.

Speaker:

I think so we've done enough episodes.

Speaker:

Um, so, uh, the CEO of Black Swan Security, Mike Sailor,

Speaker:

welcome to the show once again.

Speaker:

Thanks guys.

Speaker:

Great to be here.

Speaker:

So this week we want to talk about, we talk a lot about this.

Speaker:

It comes up a lot, uh, you know, in shows.

Speaker:

And everybody says you need a response plan, right?

Speaker:

And, uh, you know, an incident response plan.

Speaker:

And we talk, some people talk about a ransomware response plan, a cybersecurity

Speaker:

response plan, an incident response plan.

Speaker:

Can you just help?

Speaker:

Define all of those, like what, you know, do they, do they fit?

Speaker:

And, and of course I talk about a disaster recovery, uh, plan.

Speaker:

Where do all are, are these like Russian nesting dolls?

Speaker:

Well, and what's an incident response plan to start with?

Speaker:

Yeah.

Speaker:

are Russian nesting dolls.

Speaker:

Uh, so an incident response plan is what are you gonna do in the event that an

Speaker:

event, in the event that an event occurs?

Speaker:

you then classify as an incident.

Speaker:

And so first part of an incident response plan is, how do I do that?

Speaker:

You can't, you, you gotta define the difference then if

Speaker:

you're gonna use that event

Speaker:

That's where I'm, that's where I'm going.

Speaker:

Oh.

Speaker:

part is, the first part of, of your incident response plan is how do

Speaker:

I, how do I intake an event report?

Speaker:

Uh, could be smoke, it could be, uh, my computer's acting weird.

Speaker:

It could be.

Speaker:

Um, the website's down, uh, and then how do I classify that event as a type of

Speaker:

incident and then as a type of incident, what, what level of incident is it?

Speaker:

1, 2, 3, or, or however your organization classifies things.

Speaker:

And so the first part is that that analysis and categorization of an

Speaker:

event into, uh, an incident and, uh, incident type and criticality.

Speaker:

Right, and, and then

Speaker:

go ahead.

Speaker:

So then you have an incident, and based on what that incident type is, you

Speaker:

would have what's called a playbook.

Speaker:

So that playbook could be ransomware, that playbook could be denial of service,

Speaker:

the website's down, uh, operational, you know, uh, outage type of playbook.

Speaker:

Uh, or it could be, uh, misconduct, uh, you know, employee, employee misconduct

Speaker:

or trying to access stuff that shouldn't, unauthorized access type playbook.

Speaker:

Um, and you would.

Speaker:

You, you would do an analysis of your organization's most likely threats

Speaker:

and build playbooks based on those.

Speaker:

And then playbooks are like we've talked about in the past, just

Speaker:

sort of everything documented.

Speaker:

Hey, if this happens, here's all the people involved.

Speaker:

Here's all the steps that everyone takes.

Speaker:

Here's who's responsible for what actions, here's who I have to

Speaker:

talk to, and all the rest of that.

Speaker:

Right.

Speaker:

And here's who needs to be informed.

Speaker:

Right.

Speaker:

At least an outline.

Speaker:

Uh,

Speaker:

something's better than nothing.

Speaker:

And then, and then back to Curtis's question about disaster recovery.

Speaker:

And how does incident response plan it?

Speaker:

It is nested because an event becomes an incident and an incident

Speaker:

can then become a disaster.

Speaker:

'cause essentially a.

Speaker:

The, you know, you have a Dr.

Speaker:

Runbook, right?

Speaker:

Or a play, you know, you're saying playbook, playbook,

Speaker:

runbook, same thing to you.

Speaker:

Yeah.

Speaker:

It is.

Speaker:

So, um, it, it's a, I I think of it a, a bit like programming where Dr.

Speaker:

Runbook is, you know, is a function, is a library that can

Speaker:

be called by the bigger program.

Speaker:

Right.

Speaker:

So that, that to me is like the.

Speaker:

The, the deepest, nested part, right, because only after we've had an

Speaker:

incident, we've classified an incident.

Speaker:

We've classified it as a cybersecurity incident.

Speaker:

We've classified it as a, it's a ransomware event, and it's a

Speaker:

ransomware event that needs restore.

Speaker:

Right now we, you know, and then we have done our preparatory steps that

Speaker:

we need to do because, you know, I talk about a lot about this a lot,

Speaker:

and that is one of the big differences between a disaster recovery response

Speaker:

and a, a ransomware response is that almost always the disaster is over.

Speaker:

Right.

Speaker:

The flood has receded.

Speaker:

Um, because you, you can't start, you can't start your recovery

Speaker:

until the flood has receded.

Speaker:

The winds have stopped, the earthquake is over, the fire has

Speaker:

been put out, whatever the disaster was, it's over call the DR person.

Speaker:

The, the big difference with a cyber event is that the attack is ongoing

Speaker:

and you've got to put that fire out.

Speaker:

Uh, to, to use that analogy before you can ever call the DR person, and that's why

Speaker:

I'm saying it's sort of the most nested within, within the, the nesting dolls.

Speaker:

What do you think of that comment?

Speaker:

Completely agree.

Speaker:

And, and just to add a level of complexity with regard to backups,

Speaker:

uh, during your incident response.

Speaker:

If it's a ransomware where there's some compromise that happened

Speaker:

that led to the ransomware, then you've gotta make sure then also

Speaker:

that the backups you're restoring don't also include the compromise.

Speaker:

That you're trying to,

Speaker:

to tie off?

Speaker:

Correct.

Speaker:

lot more, a lot more attention to detail and, and analysis, uh, during

Speaker:

an incident than for sure, than, than, uh, cleaning up after a disaster.

Speaker:

So you have these, so you said you take the event, you identify it,

Speaker:

you put it into the right bucket of incidences, and then you.

Speaker:

Put a severity alongside it, and then you just sort of execute

Speaker:

your incident response plan.

Speaker:

Now, are these like, I am sure it's hard to cover every single incident

Speaker:

and severity or priority, right?

Speaker:

That goes alongside it.

Speaker:

So how do you sort of decide like, which ones am I actually going to

Speaker:

create an incident response plan for?

Speaker:

Which ones do I not need to?

Speaker:

Because it all comes down to.

Speaker:

Like resources in the company, right?

Speaker:

It does.

Speaker:

And, and that's where you're gonna start.

Speaker:

So in, in your incident response plan, and this, this goes.

Speaker:

Kind of back to the left a little bit in understanding the business

Speaker:

and the, the way it operates and how technology supports the business and,

Speaker:

and all the critical components of, uh, where, where the, the business

Speaker:

revenue and, and, um, focus is.

Speaker:

Uh.

Speaker:

Create an inventory of, of your, of your resources, both on the IT side.

Speaker:

We should already have that, especially from a disaster recovery perspective.

Speaker:

And I'll add this comment too.

Speaker:

If you have a mature disaster recovery plan, then a lot of

Speaker:

the work that you're gonna.

Speaker:

Put into creating your incident response plan should have already been done.

Speaker:

I've got an inventory of all our, our IT assets and where our data is

Speaker:

and the SLAs for, you know, if this machine's offline for an hour, we, we

Speaker:

lost a million dollars type of thing.

Speaker:

Well then, and the, and the, the resources we need to address those

Speaker:

disaster recovery activities.

Speaker:

Who's the sy?

Speaker:

Who owns that system?

Speaker:

Who's our network administrator?

Speaker:

Who's our active directory?

Speaker:

Who's who?

Speaker:

Who's our website?

Speaker:

You should, you should know who.

Speaker:

All those subject matter experts and stakeholders and owners are both on

Speaker:

the IT side and the business side.

Speaker:

Right?

Speaker:

So understanding that, um.

Speaker:

That environment of resources is critical to being successful in incident response.

Speaker:

All right, well then to your question about do we, you know, we can't possibly

Speaker:

have a playbook for everything, but what, what you'll learn, especially

Speaker:

after you, you do your first playbook and your first tabletop exercise,

Speaker:

is that there are very common

Speaker:

elements of every incident response.

Speaker:

You've got a leader.

Speaker:

That knows how to, that understands the environment and knows how to

Speaker:

categorize an event appropriately.

Speaker:

And then from that categorization of incident and priority can assemble

Speaker:

the right people from this inventory of resources to be effective

Speaker:

at responding to that incident.

Speaker:

You know, if it's ransomware, it's kind of an all hands on deck thing,

Speaker:

but if the website's down, I, I already know, I, I can look up who to call.

Speaker:

I need our

Speaker:

ISP, our host, our hosting site, the the person that wrote the website,

Speaker:

the person that knows all the backend systems that support the website.

Speaker:

I've got all that hammered out, and we'll get on a call and I've got their phone

Speaker:

number and their email and where they live and account numbers and all that stuff.

Speaker:

So you don't have to basically cry wolf every single time.

Speaker:

You don't, and you, and you should not.

Speaker:

Uh, so you know when, when an incident happens and, and or an event happens and

Speaker:

you're like, this is a true incident.

Speaker:

You don't go push the button.

Speaker:

You, you, you call the next person and get some, some, some feedback and

Speaker:

some collaboration, uh, and then you start to expand the team as necessary.

Speaker:

You don't, you don't call everybody to the table for every answer.

Speaker:

and, and I think you, I think you.

Speaker:

You mentioned this a little bit earlier, but I just want to, um, you know,

Speaker:

when you, when you said that a lot of the work would've already been done,

Speaker:

if you have a DR plan, that's great.

Speaker:

If you don't have one, uh, that's not good.

Speaker:

But, but I want to say that if this is the first time you're

Speaker:

doing any of this kind of work, the really key first thing is the BIA.

Speaker:

Right?

Speaker:

It's like.

Speaker:

Because, you know, as nerds as it people, we, we, we very often, we, we

Speaker:

focus immediately on the, you know, the cyber aspect or the recovery aspect

Speaker:

or the backup aspect and you know, how are we gonna get our network up?

Speaker:

Okay, okay.

Speaker:

We need to figure out what actually matters, right?

Speaker:

What makes the company money?

Speaker:

What's going to cost the company money when it's down?

Speaker:

Right.

Speaker:

What are things that we can do without and, and how long and

Speaker:

how long can we do without them?

Speaker:

Uh, how much money are we losing when this part of the company is down?

Speaker:

Right?

Speaker:

Um, and when this part of the company is down, is there something else that

Speaker:

the people that work on that part of the company can do to continue

Speaker:

to make money for the company?

Speaker:

Uh, or do we just send them home?

Speaker:

Um, you know, so they're not twiddling their thumbs.

Speaker:

and Curtis, when you said BIA, you meant business impact assessment, correct.

Speaker:

you.

Speaker:

Thank you.

Speaker:

What do you, what do you think, Mike?

Speaker:

Any, any additional.

Speaker:

Absolutely.

Speaker:

And so the BIA is valuable in so many ways.

Speaker:

BIA will help you on your insurance.

Speaker:

It helps you on your business continuity, your disaster recovery, your incident

Speaker:

response, all your risk assessments.

Speaker:

It's, it's very critical.

Speaker:

And any, any due diligence for like acquisitions and mergers and all

Speaker:

that stuff, it's, it's very critical.

Speaker:

It's also a good, uh, it's also a good tool for process.

Speaker:

Uh, improvement and overhead analysis.

Speaker:

Uh, it, it's, it's, it's really good.

Speaker:

Well then, uh, to touch on something you mentioned, uh, you know, if,

Speaker:

if this incident, or if this event happens and people can't do their

Speaker:

work and you send them home, or what else could they be doing?

Speaker:

Uh, that also touches on business continuity.

Speaker:

So how do we keep running the business without technology, which is really

Speaker:

what disaster recovery focuses on.

Speaker:

Business continuity is that.

Speaker:

that.

Speaker:

that contingency plan for, you know, I can't use the phone anymore or, or

Speaker:

that system's down and, and now we've gotta revert to pen and paper and,

Speaker:

uh, how do I, how do I keep taking orders or scheduling

Speaker:

repairs or whatever the case might

Speaker:

Somebody go find a big box of carbon paper.

Speaker:

Yeah, like Curtis's, uh, doctor's office or

Speaker:

that direct show that happened in the Midwest summer.

Speaker:

Remember that episode Curtis?

Speaker:

Yeah.

Speaker:

The derecho.

Speaker:

Yeah, that's a great episode.

Speaker:

We, we, we did have somebody on here who, who lived in a place,

Speaker:

um, and they experienced a derecho.

Speaker:

Have you ever even heard of a derecho?

Speaker:

I've heard the term, but I don't, I'm, I'm assuming It,

Speaker:

it's a,

Speaker:

it just means a, a hurricane that forms over land.

Speaker:

Um, don't have any idea why it's called what it's called,

Speaker:

but that's what it's called.

Speaker:

Um, so yeah, so we've done our, our business impact analysis.

Speaker:

We, you know, we, we, we know all the parts.

Speaker:

We know the.

Speaker:

We know where to focus our efforts.

Speaker:

And then we need to focus on the things that are likely to happen, the things that

Speaker:

are likely to give us the biggest impact.

Speaker:

And, you know, persona you talked about, you know, we can't do everything.

Speaker:

We talk a lot on here about good, better, best, right?

Speaker:

Good.

Speaker:

Is to have something, to have some kind of outline for anything.

Speaker:

If you have nothing, anything is better, is better than nothing.

Speaker:

On a back of an napkin is fine too.

Speaker:

Yeah.

Speaker:

Yeah.

Speaker:

Um, and the what if you've got nothing, once you've done the impact analysis and,

Speaker:

um, you've decided on, you know, we're gonna focus on, I, I think it wouldn't be,

Speaker:

it wouldn't be crazy to say we're gonna focus on a ransomware event that takes

Speaker:

out our, you know, priority one servers.

Speaker:

What would be your next step?

Speaker:

Well, I'll add some, I'll add some color to that scenario because part of

Speaker:

your analysis may, may indicate that in the event of an, of an incident like

Speaker:

that, you cannot reallocate people.

Speaker:

Those people have to keep doing whatever it is they're doing.

Speaker:

So your incident response plan should identify resources that you

Speaker:

can bring in to augment your staff.

Speaker:

And address the incident or vice versa.

Speaker:

Maybe it's your, your full-time, people addressing the incident, but

Speaker:

then you need to bring in staff, you know, some contractors to continue

Speaker:

daily operations or whatever that is.

Speaker:

Or that you've got zero capability of responding to that incident and

Speaker:

you've gotta bring in a third party, 100% to, to support and you're just

Speaker:

providing them guidance or oversight.

Speaker:

And I mean, it's, it's kind of like, uh.

Speaker:

The, the flood, the flood response, the blackman mooring or whoever it is

Speaker:

Yep.

Speaker:

where you've got a flood.

Speaker:

Nobody, I don't know how to clean up a flood or respond to a flood.

Speaker:

I know how to, I may know where the water shutoff valve is, but 100% of that

Speaker:

response is gonna be some third party.

Speaker:

And so that business impact analysis is gonna help you determine.

Speaker:

What proportion of inside, outside, you know, extra help you're gonna

Speaker:

need and who's gonna do what?

Speaker:

All right, so then, then the event happens, uh, and you're gonna, you're

Speaker:

gonna use that resource playbook depending on what that that event is,

Speaker:

um, to bring in the right, the right resources, the right people, and,

Speaker:

and start managing that response.

Speaker:

So.

Speaker:

If you'll have your playbook or your incident response

Speaker:

plan, you've executed on it.

Speaker:

You knew who the resources to pull in.

Speaker:

I'm sure along the way, as you're going through this actual event,

Speaker:

you probably see some gaps.

Speaker:

Maybe you're probably fine tuning, tweaking, adjusting, adding to

Speaker:

your incident response plan to update it so the next time it

Speaker:

happens, you're better prepared.

Speaker:

I guess the one question I have is.

Speaker:

Environments change.

Speaker:

We've always talked about it, right?

Speaker:

New systems come on board, new sites come up, new applications get deployed.

Speaker:

There are new threats out there.

Speaker:

What sort of frequency should people be thinking about going and revisiting

Speaker:

their incident response plans?

Speaker:

Because it's not helpful if, say, today, right?

Speaker:

You have an incident response plan for how to deal with telephone communications

Speaker:

from like 30 years ago, right?

Speaker:

So how do you make sure that your plans are also up to date as the

Speaker:

world changes, as your environment changes and as the people change too?

Speaker:

as a, as a good, as a good practice, good governance would be reviewing

Speaker:

all your policies, procedures, and plans at least once a year.

Speaker:

But I'll, I'll caveat that with any significant change to your personnel,

Speaker:

your environment, or the way your business operates should then dictate a

Speaker:

review of all the things that support.

Speaker:

And, uh, not only support all of those things, but also support the response

Speaker:

activity to any, any related incidents.

Speaker:

Uh, so as often as it makes sense, but at least once a year.

Speaker:

Okay.

Speaker:

And I'll, I'll add to that too, that there's often two types

Speaker:

of incident response plans.

Speaker:

There's the very technical one with the playbooks and the contact

Speaker:

information, the technical details.

Speaker:

That's for the.

Speaker:

The internal response team consumption.

Speaker:

And then there's kind of a general population incident response plan,

Speaker:

which is more like a guide to, well, how do I report stuff and what do

Speaker:

I expect?

Speaker:

And,

Speaker:

um, you know, some that, that same plan may also include a provision that says you

Speaker:

as an employee or contractor may be called upon as a subject matter expert to help.

Speaker:

Respond to an incident.

Speaker:

And

Speaker:

so putting all that, all that stuff out there as far as expectations

Speaker:

and guidance in a, in a, a shorter,

Speaker:

you know, kind of condensed manual,

Speaker:

similar disaster recovery, you know, there, there's like your evacuation plan

Speaker:

and then there's the tech, the, the, the true disaster recovery plan

Speaker:

that has a lot more detail on it.

Speaker:

I like the idea of, I, I think one of the most crucial elements, if not the very

Speaker:

first element that goes into an IR or DR plan, is the, the contact list, right?

Speaker:

Who do you call for?

Speaker:

What, who's responsible for what?

Speaker:

Um, what is Mike Sailor's cell phone number?

Speaker:

Um, you know, to, to call.

Speaker:

Because he's our guy to bring in, in the case of scenario, and again, you,

Speaker:

you, you have to update that information 'cause that stuff changes all the time.

Speaker:

Right.

Speaker:

Um, and

Speaker:

And, and don't.

Speaker:

Don't just Google Mike and his cell phone number and put it in your contact list.

Speaker:

Actually, you, you've gotta call these people and say

Speaker:

hello and

Speaker:

and you know, I'm, I'm, we need to, we need to establish a, a, a relationship or

Speaker:

a rapport so that you, you are, uh, you will answer the phone when I call you,

Speaker:

uh, and, and

Speaker:

know that it's important.

Speaker:

Yeah.

Speaker:

'cause I don't answer, I don't answer unknown, uh, phone numbers.

Speaker:

So, um, yeah.

Speaker:

Same.

Speaker:

Um, yeah, so we've got our contact list.

Speaker:

Uh, we've got our vendor list, right?

Speaker:

We've got our, um, all of tech, the technologies that are involved.

Speaker:

Um, and we've got an escalation list, right?

Speaker:

A list of what's go, who's going to be called when, and then also.

Speaker:

Who's going to be called when those people don't answer the phone?

Speaker:

Um, right, because I, I know that comes up in a, in a, um, like in a

Speaker:

tabletop, well, it comes up all the time.

Speaker:

Right.

Speaker:

Uh, Fred, who's the one that's responsible for A, B, C, uh, he's on vacation, right?

Speaker:

He, he's in Aruba.

Speaker:

Uh, good for Fred.

Speaker:

And he's taken an actual vacation and he is unplugged the cell phone.

Speaker:

And, uh, you know, and he's not taking our calls, so who's gonna take

Speaker:

Fred's call when Fred's not there?

Speaker:

That should be the case for every responsibility in the,

Speaker:

you know, in the company, right?

Speaker:

Uh, correct, and, and you should have a chart.

Speaker:

And, and if you remember from a previous episode, we call that a racy diagram.

Speaker:

That's right.

Speaker:

Yeah.

Speaker:

Uh, and spell that out again.

Speaker:

RACI,

Speaker:

responsible, accountable, consulted, and informed.

Speaker:

And so for everybody on your response team, you would, you would

Speaker:

indicate, and sometimes that changes based on what the playbook is.

Speaker:

Uh, but who's, who's, who are your primary responsible, uh, accountable

Speaker:

people for all the different types of incidents that you include, uh, in, in

Speaker:

your, in your, in your response plan.

Speaker:

Persona is the first person I call, uh, when I need to do something.

Speaker:

I don't know how to do, because I have this feeling that he

Speaker:

knows, he, he's watched a YouTube video about how to do it.

Speaker:

What does that seem, does that seem reasonable persona?

Speaker:

97% accurate, I would say.

Speaker:

he, he watches a lot of YouTube videos.

Speaker:

Um, all right.

Speaker:

So we have our, we have our, our list, our contact list, we have

Speaker:

the actual procedures, the actual runbooks that are, you know, the

Speaker:

different things that we're gonna do.

Speaker:

Uh, is there anything else that needs to go into response plan?

Speaker:

Yep.

Speaker:

So.

Speaker:

So at the, at the end of your response plan, you, you should

Speaker:

have as much reference material as you think is, uh, necessary.

Speaker:

So, you know, there's your, your instant response team contact list, but down at

Speaker:

the bottom, kind of to your point of, of third parties, but more than just

Speaker:

name and phone number, you may need an account number or a policy number

Speaker:

or, um, something specific, a pin.

Speaker:

Uh, you know, if there's, you know, multifactor, um, and then.

Speaker:

Something at the end.

Speaker:

Uh, towards the end, we have, I, I typically suggest appendices.

Speaker:

And so one of the escalation points of an incident is

Speaker:

whether or not it was a breach.

Speaker:

And the difference between incident and

Speaker:

breach can be significant

Speaker:

for a lot of different reasons.

Speaker:

What, you can get sued over a breach, right?

Speaker:

A breach might require that you, you

Speaker:

have, uh, reporting, reporting obligations to the state or.

Speaker:

What have you.

Speaker:

So then, so there's a, there's usually an appendix that helps you walk through

Speaker:

kind of a decision tree to determine if a, if an incident was a breach,

Speaker:

well then we've got all of this, you know, maybe, especially if you're a

Speaker:

publicly traded company, what are your reporting requirements, uh, by state,

Speaker:

by statute, and then some things that you want to pre, uh, pre-negotiate.

Speaker:

Is with, and this is with like management and legal or hr, how do

Speaker:

we communicate different types of incidents internally and externally?

Speaker:

And so having those predefined templates for emails or phone calls

Speaker:

already in your plan, so you're not on

Speaker:

the phone for an hour negotiating with internal audit or legal about,

Speaker:

all right, how are we gonna say this?

Speaker:

You've, you've got all that stuff outta the way.

Speaker:

So Mike.

Speaker:

So we have everything documented.

Speaker:

I think one thing we didn't cover is where does this document live?

Speaker:

Because right if, because if it's like on your normal internal systems

Speaker:

and you get hit with a ransomware attack, now your incident response

Speaker:

plans are also potentially gone.

Speaker:

If you get hit by a hurricane or a flood and you have it in

Speaker:

physical paper form in the site location, those are probably gone.

Speaker:

So.

Speaker:

How do people store these and make Sure.

Speaker:

it's still accessible?

Speaker:

I've seen a lot of variations of this.

Speaker:

I've seen the All right, who's, whose turn is it to take the metal

Speaker:

box home in the trunk of their car?

Speaker:

Uh, I've seen people store it with their tapes at Iron Mountain.

Speaker:

I've seen people, uh, uh, pay for a service where it's like a cloud-based

Speaker:

disaster recovery thing, where different stakeholders have the ability

Speaker:

to log in and update their stuff, and that's where the plan lives.

Speaker:

Uh, and then, uh, I've also seen some pretty creative, uh, approaches to this

Speaker:

with like $0 retainers with a, a law firm.

Speaker:

And so pre-negotiate, get all the paperwork outta the way.

Speaker:

And I would, I would suggest this with an instant response firm.

Speaker:

And, and even, uh, uh, you know, if, if, if your staff isn't capable of, of

Speaker:

quickly fixing or building or re-imaging stuff, then go find a, a firm that, that

Speaker:

can provide you those resources and, and get all the paperwork done today.

Speaker:

And, but to my point, uh, uh, or back to my point about the law firm.

Speaker:

So $0 retainer establishes and it gets all the deconfliction out of the way.

Speaker:

Uh, but send, give them your, your Dr and incident response plan.

Speaker:

And because you're gonna call them anyway,

Speaker:

uh, make sure that you've got their phone numbers, but you're, it's great.

Speaker:

Great point.

Speaker:

I've seen in a lot of cases where, you know, we're trying to, there's an

Speaker:

incident, we're trying to coordinate response and their networks, their

Speaker:

internet's down, their email's down and, and, you know, how do, how do we even

Speaker:

coordinate among their response team?

Speaker:

And so having a, having a relationship with someone that can.

Speaker:

That can provide you that, that communications medium, but also, uh, be

Speaker:

a, a good place to keep your, your plan.

Speaker:

Yeah, I, I, my personal preference is I like having an electronic version

Speaker:

because it's easier to maintain, but I also like having that paper version and

Speaker:

the way I like having the way I like.

Speaker:

Creating a paper version is in a loose leaf type of a notebook, so that allows

Speaker:

me, when I update a couple of pages, I can just rip out at those pages and

Speaker:

replace those pages so that I'm not printing an entire tree of documentation

Speaker:

every time I go to update the runbook.

Speaker:

Um, and I do like that idea of having it, having it stored somewhere else

Speaker:

other than the company, but close by.

Speaker:

Right.

Speaker:

If we're talking about actual paper.

Speaker:

It needs, you know, you talked about a law firm, you talked about an instant

Speaker:

response team somewhere that stuff is stored, that's accessible to us as a

Speaker:

company, but, uh, but not too accessible because it's in the data center that,

Speaker:

uh, that we're trying to recover.

Speaker:

Or at least a copy.

Speaker:

Right.

Speaker:

Store it somewhere

Speaker:

A copy.

Speaker:

Yeah.

Speaker:

Um, of course the more copies you have, the more trouble you

Speaker:

have maintaining those copies.

Speaker:

Right.

Speaker:

But the, the, um, the, uh, and I think the, the, the physical paper

Speaker:

issue is less of an issue during a cybersecurity event as it, than it is

Speaker:

in a, in a disaster where the, you know, the building blew up or was on fire.

Speaker:

But, I cannot overstate the value of, um, of a paper document, right?

Speaker:

In a, in an event that potentially takes out your, you know,

Speaker:

everything that you have, right?

Speaker:

I mean, I mean, I'm, you know, I'm a, I'm a huge fan of the

Speaker:

cloud putting stuff in the cloud.

Speaker:

Uh, what if you got no internet, right?

Speaker:

Cloud's, cloud's great, but you can't see the clouds anymore.

Speaker:

Yep.

Speaker:

Yep.

Speaker:

So off switching topics, so we have the cybersecurity incident

Speaker:

response plan, which for company documents, who all the people are,

Speaker:

how they respond, and all the rest.

Speaker:

I.

Speaker:

This is a goldmine for malicious actors, right?

Speaker:

So if they got their hands on this right, they know your entire playbook.

Speaker:

It's like if you got the military plans for like the nuclear weapons and

Speaker:

like how things will respond, right?

Speaker:

So how, like how should people go about protecting these from these bad actors?

Speaker:

So it should be considered or classified as a, a confidential or sensitive

Speaker:

document, so password protected, you know, make sure it's stored

Speaker:

appropriately with restricted access.

Speaker:

Uh, but you're right.

Speaker:

In fact, uh.

Speaker:

We did a tabletop exercise on ransomware for a, an engineering company.

Speaker:

Uh, and then shortly after the tabletop, they actually had a ransomware attack.

Speaker:

Uh, come to find out the threat actors had been in that environment for six months

Speaker:

or actually privy to the tabletop exercise and had access to their instant

Speaker:

response plan and their insurance

Speaker:

policies and all these other things, which then help them better

Speaker:

strategize and facilitate the attack.

Speaker:

And.

Speaker:

Uh, which, and they got paid, you know, they, they made several million

Speaker:

dollars off of that deal because they were, they were informed, uh, and

Speaker:

they knew what the capabilities were.

Speaker:

They knew that they were gonna be, um, ineffective at responding

Speaker:

to a ransomware attack, um,

Speaker:

Yeah.

Speaker:

sure that you, you fix all the problems identified in a tabletop exercise,

Speaker:

and this organization did not.

Speaker:

Well, I, I think that's a great question.

Speaker:

P and I think it goes back to the same thing that we advise for

Speaker:

backup systems segregation, right?

Speaker:

Making sure that it's just not on the same systems with the same usernames

Speaker:

and passwords protected by active directory and an admin and an active

Speaker:

directory admin password, right?

Speaker:

It's gotta be more than that.

Speaker:

And, and that's, and I think that's where SaaS providers can be very helpful.

Speaker:

Right.

Speaker:

Uh, I like this idea, you know, um, that you talked about Mike, of having

Speaker:

a, you know, basically services that will, that they probably have, I.

Speaker:

Templates and things that you can use for an incident response

Speaker:

plan and help build it out.

Speaker:

It makes making that easier.

Speaker:

And then also it's, it's stored in a different environment than yours.

Speaker:

Uh, of course you gotta vet all their security because persona, you are 100%

Speaker:

right, that that would be a gold mine.

Speaker:

Just like backup systems are a gold mine.

Speaker:

You get, you get in charge of the backup system and you have, you know,

Speaker:

why, why hack all the servers when I can just restore the data that I want?

Speaker:

Right?

Speaker:

Um, any final thoughts, Mike?

Speaker:

Any final things we need to say about creating an an incident response plan?

Speaker:

Yes, the design of that plan will drive its effectiveness.

Speaker:

And so, uh, from an audit perspective, um, well, even more fundamentally

Speaker:

controls perspective, an incident response plan or program would be considered

Speaker:

a control, uh, that helps drive the effectiveness of your organization.

Speaker:

I.

Speaker:

There's two parts of a control.

Speaker:

There's the design of the control, and then there's the operational

Speaker:

effectiveness of a control.

Speaker:

And so we can put this plan together.

Speaker:

We can have all these whiteboarding sessions and phone

Speaker:

calls about who's doing what.

Speaker:

And we put it all in this document.

Speaker:

We feel great about it, but it doesn't mean a thing if you don't walk through

Speaker:

it to see how effective that design is.

Speaker:

And that's, you have to do table, you have to do an exercise to test

Speaker:

the effectiveness of your plan.

Speaker:

'cause like Mike Tyson said.

Speaker:

Yeah, everybody has a plan until I hit 'em.

Speaker:

And so your response plan is, that's all it is, is a plan until, until you get hit.

Speaker:

And if you don't, if you haven't, if you haven't walked through

Speaker:

it, you're not gonna know how well you, uh, respond to that.

Speaker:

That hit.

Speaker:

Yeah, I really thought you were gonna rhyme earlier.

Speaker:

You know, you something.

Speaker:

I forgot what you said.

Speaker:

It's, uh, you don't got that thing or something.

Speaker:

I thought you were gonna rhyme there, but, you know, uh, but I, yeah, I,

Speaker:

I, I thought exactly about that.

Speaker:

That Mike, that Mike Tyson comment.

Speaker:

You know, everybody, everybody got play until they get hit in the face.

Speaker:

Absolutely.

Speaker:

All right, well thanks again, Mike for uh, walking us through

Speaker:

and thanks again for some great questions this time.

Speaker:

Persona,

Speaker:

I, I think I'm starting to think more like a bad actor, which is kind of.

Speaker:

Fun.

Speaker:

that's what you gotta do, right?

Speaker:

Gotta think like a bad actor.

Speaker:

Absolutely.

Speaker:

All right, and thanks to our listeners, we do this for you.

Speaker:

Uh, reach out to us, say hi.

Speaker:

Go to backup wrap up.com and put in a comment.

Speaker:

I love getting comments from people.

Speaker:

Um, and, uh, you know, rate us go.

Speaker:

You know, if you love us, rate us.

Speaker:

If you hate us, don't.

Speaker:

Anyway.

Speaker:

Uh, that is a wrap.

Speaker:

The backup wrap up is written, recorded and produced by me w Curtis Preston.

Speaker:

If you need backup or Dr.

Speaker:

Consulting content generation or expert witness work,

Speaker:

check out backup central.com.

Speaker:

You can also find links from my O'Reilly Books on the same website.

Speaker:

Remember, this is an independent podcast and any opinions that you

Speaker:

hear are those of the speaker.

Speaker:

And not necessarily an employer.

Speaker:

Thanks for listening.