Speaker:

You found the backup wrap up your go-to podcast for all things

Speaker:

backup recovery and cyber recovery.

Speaker:

In this episode, we explore how to get an actual return on your investment out of

Speaker:

your backups instead of just treating them as an expensive insurance policy that.

Speaker:

Sits around and waits for a disaster.

Speaker:

Ask yourself, what if your backup infrastructure could

Speaker:

actually pay dividends?

Speaker:

Make your company money.

Speaker:

Persona and I dig into practical ways to extract an ROA from your backups.

Speaker:

Through test environments, security monitoring, compliance, checking,

Speaker:

and even, and especially these days, AI powered analytics.

Speaker:

We'll show you how the shift from tape to disc opened up these possibilities that

Speaker:

were honestly simply impossible before.

Speaker:

If you've ever wondered whether there's more to backup than just crossing your

Speaker:

fingers and hoping that you'll never need to use them, well this episode's for you.

Speaker:

By the way, if you don't know who I am, I'm w Curtis Preston, AKA, Mr.

Speaker:

Backup.

Speaker:

And, uh, I've been doing, uh, backups for over 30 years.

Speaker:

Uh, basically ever since I had to tell my boss that there were no backups of the

Speaker:

production database that we had just lost.

Speaker:

I didn't want that to happen to me again, and I don't want that to happen to you.

Speaker:

That's why I do this.

Speaker:

On this podcast, we turn unappreciated backup admins into cyber recovery heroes.

Speaker:

This is the backup wrap up.

Speaker:

Welcome to the show.

Speaker:

Hi.

Speaker:

Welcome to Backup Central's, restore it All podcast.

Speaker:

I'm your host, w Curtis Preston.

Speaker:

And with me, as always is my fellow DIY enthusiast persona.

Speaker:

Molly Yondi.

Speaker:

Welcome to the Club Persona.

Speaker:

Thank you, Curtis.

Speaker:

Although, to be fair, this is not my first DIY,

Speaker:

No, it's not.

Speaker:

But I don't know.

Speaker:

I just feel like this was, this was something special.

Speaker:

but it's the first one where I've had to make multiple trips to Home

Speaker:

Depot in order to figure out, and it's funny, so to explain what's going on.

Speaker:

So over the weekend I had a water shutoff valve for our

Speaker:

sprinkler system that was leaking.

Speaker:

So I was like, okay, I should fix it because it's starting to get summertime

Speaker:

and it's probably best to do that.

Speaker:

So.

Speaker:

I was like, oh, let me try, and I, been delaying this, by

Speaker:

the way, for a year and a half,

Speaker:

Yeah,

Speaker:

like all of a sudden it started leaking.

Speaker:

Like I basically just turned it off because then it would stop leaking.

Speaker:

So it hasn't been working for a year and a half.

Speaker:

so no, no sprinkling.

Speaker:

Yeah, no sprinkle.

Speaker:

I literally would fill up, like, you know those, I dunno if you have

Speaker:

a Costco, but Costco sells like the mango juices and like those giant,

Speaker:

like half a gallon or one gallon

Speaker:

Mm-hmm.

Speaker:

the lingerers, I would fill that with water from the kitchen sink

Speaker:

and then go and water the plants.

Speaker:

So yes, so eventually I was like, okay, I should fix this.

Speaker:

So I was like, okay, it.

Speaker:

And I'm like, oh, it's one of those plastic shutoff valves that has a ball.

Speaker:

So I was like.

Speaker:

I know it's gonna be difficult if I have to replace it because you have

Speaker:

to like PVC, you gotta put glue, you gotta piece everything together.

Speaker:

I'm like, that's a huge project.

Speaker:

I was like, let me do the easy way first.

Speaker:

So I Googled on YouTube and they're like, Hey, there's

Speaker:

this O ring inside that leaks.

Speaker:

And so what you do is you just like pull off the handle and I pull out the

Speaker:

O ring and replace the O-ring and put it back together and you're all good to go.

Speaker:

So I was like, sweet.

Speaker:

So I started on that and process of removing the handle, I broke the handle.

Speaker:

Yeah.

Speaker:

And, uh, I went to like five different stores, bought five different valves

Speaker:

and took 'em apart to see if one of the handles, because I was like,

Speaker:

oh, lemme just replace the handle.

Speaker:

none of the handles would fit.

Speaker:

Nice.

Speaker:

I was like, oh man.

Speaker:

So now I was like, okay, I'm screwed.

Speaker:

then I was like, okay, I gotta bite the bullet.

Speaker:

What was going to hopefully be like a 30 minute project has now

Speaker:

gone on for an hour and a half.

Speaker:

Yeah.

Speaker:

been to the first store yet, so I went to the Home Depot and I met

Speaker:

this one really awesome guy who works there Eric shout out to you.

Speaker:

Uh, but he was like, Hey, this is exactly what you need.

Speaker:

And he's like, Hey, instead of doing what you're thinking of

Speaker:

doing, you just replace everything.

Speaker:

You'll be much happier.

Speaker:

And he like told me exactly what I needed.

Speaker:

He walked me through it,

Speaker:

Yeah.

Speaker:

bought everything, took it home, and then started putting it together.

Speaker:

Because remember at this point we don't have water in the house.

Speaker:

Right, right.

Speaker:

uh, so we started putting everything together, called Curtis a bunch

Speaker:

of times, put it together.

Speaker:

I was like, it dripped, it leaked.

Speaker:

I was like, Ugh.

Speaker:

So then slowly like tyd it and all the rest there's, and so at least

Speaker:

now I have water in the house.

Speaker:

I haven't finished the rest of the sprinkler stuff, there's

Speaker:

a slight, slight, slight drip.

Speaker:

So now I have to shut off the water and redo everything.

Speaker:

But it's, it was like four trips to

Speaker:

But

Speaker:

and.

Speaker:

Yeah.

Speaker:

Yeah, but, and you, and you know, and you know what you did wrong at this point.

Speaker:

You know what the, the problem is.

Speaker:

Yeah.

Speaker:

And I, uh, talked to my DIY expert, otherwise known as Mr. Backup, and,

Speaker:

uh, he was like, uh, send me a picture.

Speaker:

So I sent you a picture and you looked at it and you're like, uh,

Speaker:

you put the Teflon tape on backwards.

Speaker:

I was like, oh, ah.

Speaker:

Yeah.

Speaker:

Gotta put the Teflon tape in the direction of the threads.

Speaker:

Yeah,

Speaker:

Yeah, well, it's also one of those things because it was like it's

Speaker:

going in the opposite direction because it had double-sided thread.

Speaker:

So I was like, ah,

Speaker:

yeah.

Speaker:

so it's okay.

Speaker:

At least I know what I need to do, but now I gotta shut off

Speaker:

the water and then do that.

Speaker:

So,

Speaker:

Yeah, you got, you had a whole, but I mean, the thing that I saw there were a

Speaker:

whole bunch of threads because you got like, you got like the nipple plus the

Speaker:

adapter plus the, the shut up, you know?

Speaker:

Yeah.

Speaker:

Yeah.

Speaker:

You good?

Speaker:

And then the thing

Speaker:

Yeah.

Speaker:

and so, yeah.

Speaker:

But

Speaker:

Good times.

Speaker:

it's not too much longer and I won't need to go back to

Speaker:

Home Depot, but we shall see.

Speaker:

Oh, don't say things like that.

Speaker:

Hmm.

Speaker:

Um,

Speaker:

least

Speaker:

so, um, yeah, and we're, we're not even gonna talk about why

Speaker:

I'm mad at Home Depot right now.

Speaker:

So, um, let's just say for the first time ever I'm actually

Speaker:

hiring them to do something.

Speaker:

And it has not been a fun process, but

Speaker:

is the exact opposite.

Speaker:

'cause normally I'm not a fan of Home Depot 'cause I can

Speaker:

never find someone to help me.

Speaker:

yeah.

Speaker:

talked about

Speaker:

Yeah.

Speaker:

before and

Speaker:

Yeah.

Speaker:

Depot 'cause you're like, I know exactly what I need.

Speaker:

And now our like, uh, roles are reversed.

Speaker:

So

Speaker:

Yeah.

Speaker:

Weird, huh?

Speaker:

full moon.

Speaker:

It's um, well actually, you know what?

Speaker:

Today is the day we're recording it, it's Haley's Comet Day.

Speaker:

Oh,

Speaker:

Haley's comets.

Speaker:

They're, they're saying, yeah, it is saying tomorrow, but they're

Speaker:

saying tonight and tomorrow night we should get some real meteor

Speaker:

showers, um, from Haley's comment.

Speaker:

So anyway.

Speaker:

Well, we are gonna talk about some fun stuff today.

Speaker:

Um, you know, we talk about in backup a lot, one of the issues

Speaker:

that people have with backup is that it's just a money sink, right.

Speaker:

A money pit.

Speaker:

Right.

Speaker:

It's just, it doesn't ever, it never brings any value.

Speaker:

To the business unless,

Speaker:

need it.

Speaker:

until you really, really, really need it.

Speaker:

right?

Speaker:

It's like your car

Speaker:

Yeah,

Speaker:

your

Speaker:

yeah, exactly.

Speaker:

Right.

Speaker:

And, and yeah, and like, yeah, and like.

Speaker:

Most insurance, it adds no value to your life unless

Speaker:

really bad things happen, right?

Speaker:

And so this episode is about are there other things that we

Speaker:

could be doing with our backups that would potentially at least,

Speaker:

I don't know, add some incremental business value?

Speaker:

Uh, or whatever the appropriate term is in the, in the governmental world, right?

Speaker:

The incremental value to the organization that would help

Speaker:

minimize the pain of that, of that.

Speaker:

Check that by that, that dates me, doesn't it?

Speaker:

Yes.

Speaker:

the fact that I use the term check.

Speaker:

Um.

Speaker:

Bitcoins that you have to use are the

Speaker:

Yeah.

Speaker:

The, yeah, the Bitcoins.

Speaker:

Um, you know, I, I, I, again, I'll, I'll tell a story from the old days.

Speaker:

So I remember back when the, the, the organization that

Speaker:

I was, my very first job,

Speaker:

before

Speaker:

what.

Speaker:

you have to use the phrase, what phrase do you have to use when

Speaker:

Back.

Speaker:

Back in the day.

Speaker:

There you go.

Speaker:

in the day.

Speaker:

So back in the day, back in 1993 before my daughter was even born.

Speaker:

Um, that.

Speaker:

We ran out of ta, you know, the, the organization was growing in size.

Speaker:

It just logarithmically really from the time I joined to the time I left,

Speaker:

and which always means more backups and it means running out of tapes.

Speaker:

Back then it meant running out of tapes.

Speaker:

And, um, I remember going to my boss and basically saying, Hey,

Speaker:

you know, we we're out of tapes.

Speaker:

And, um, the, it was interesting because, um, I. Uh, purchases for over, like,

Speaker:

over a certain, uh, number was like considered a capital purchase, even though

Speaker:

this was really very much an expense.

Speaker:

So it was a very big deal that I was asking for.

Speaker:

Like I remember the number was like $16,000 in, in tapes

Speaker:

and is a lot of tapes, right?

Speaker:

But, but, but we needed a lot of tapes and I remember the boss, my boss,

Speaker:

saying to me, Susan saying to me.

Speaker:

Is there any other option

Speaker:

Mm.

Speaker:

than spending this $16,000?

Speaker:

And I said, yes.

Speaker:

She said, what is it?

Speaker:

I can, I can stop backing up stuff.

Speaker:

Or it should be like you should stop creating data.

Speaker:

Yeah.

Speaker:

Yeah, you could, you could stop making more stuff.

Speaker:

Um, so, uh, yeah, it, so backups have always been this, like money sink.

Speaker:

The, I'm sorry, why do I keep saying Money sink.

Speaker:

Money pit.

Speaker:

I will also say that there have been some changes in backup design

Speaker:

that are going to facilitate some of the things that we talk about when

Speaker:

we talk about, uh, bringing some business value out of the backup data.

Speaker:

The biggest of which is moving off of tape.

Speaker:

As the, as the primary backup mechanism because when, when backups were on

Speaker:

tape and, and you know, backups are still on tape, there's still many,

Speaker:

quite a bit of backups on tape.

Speaker:

Um, but when it was the primary and, and only place that you stored backup

Speaker:

data, getting any additional value out of that data was I, I mean, it,

Speaker:

it's just literally something that we never even discussed because

Speaker:

there, there was no way to do it.

Speaker:

Well, and I think it's also, at the time, I don't think people

Speaker:

thought about these other use cases

Speaker:

Hmm.

Speaker:

may not have existed back then.

Speaker:

I

Speaker:

Yeah.

Speaker:

modern arch software architecture and designs have allowed

Speaker:

for a lot more use cases

Speaker:

Mm-hmm.

Speaker:

they used to have in the past.

Speaker:

Yeah, I, but I would also say, even though, like when we look at

Speaker:

things like tests and dev, we had tests and dev, but I. The best you

Speaker:

could do was use your backups to restore production into something,

Speaker:

Yeah,

Speaker:

and it was still so challenging that most people just didn't even think about it.

Speaker:

Right.

Speaker:

They, they just didn't even consider that as an option.

Speaker:

Mm-hmm.

Speaker:

but I think this is also where if we look at storage systems

Speaker:

like NetApp at the time, right?

Speaker:

With snapshots where it's like, hey, in clones, right?

Speaker:

You can quickly take a clone of a volume, start using it for test and

Speaker:

dev and other purposes like that.

Speaker:

So I think that was like, oh yeah, we should be able to do more things with it.

Speaker:

And actually, maybe we should just jump into like some of

Speaker:

these use cases since we're

Speaker:

Well,

Speaker:

to it.

Speaker:

well actually, before, before we do that, uh, I, I think that it's

Speaker:

really important that you, you made an important point there, and that

Speaker:

is that when I said that there have been some changes in backup design.

Speaker:

There have been.

Speaker:

Sort of two really big changes.

Speaker:

One is just the use of disc in general

Speaker:

Mm-hmm.

Speaker:

in various forms, which includes just file system disc.

Speaker:

It includes object based storage, it includes filer based type

Speaker:

storage and, and ddu ddu storage.

Speaker:

All of that as as, it just, it's just much more flexible, even if we did

Speaker:

nothing else, that provides a lot of flexibility, but I do think that.

Speaker:

When I look back on things, I think NetApp gets a lot of credit here as

Speaker:

being a pioneer of not changing just.

Speaker:

That we're gonna use disc for backups, but also how we're gonna make those backups.

Speaker:

And for a really long time there was this, um, and, and I'll still stand by

Speaker:

the, the phrase if we, if we, if we, if we leave it just alone, and that

Speaker:

is that a snapshot isn't a backup.

Speaker:

Right.

Speaker:

If we go back 20 years, NetApp's at least 20 years old, right?

Speaker:

More than 20 years, I think

Speaker:

Yeah.

Speaker:

Okay.

Speaker:

So back when, back of NetApp was just NetApp and pre-snap mirror.

Speaker:

There was a time when there was no snap mirror.

Speaker:

Right.

Speaker:

Okay.

Speaker:

Um, so when it was just a box and it had, um, just snapshots, I

Speaker:

would've been alongside everyone else saying A snapshot is not a backup.

Speaker:

Right.

Speaker:

Um, unfortunately.

Speaker:

Well, because it's relying on the primary.

Speaker:

A, a, a traditional snapshot at that time.

Speaker:

Well, even a snapshot at this time relies on the primary.

Speaker:

It's literally, I used to make the phrase, a snapshot is as good of a

Speaker:

backup of your data as a snapshot of your house is when your house catches fire.

Speaker:

Right, right.

Speaker:

It relies on the primary in order to, to, to function.

Speaker:

But then once NetApp and other companies, uh, followed their, uh, example.

Speaker:

They started replicating these snapshots to other locations

Speaker:

and now we have both versioning.

Speaker:

The, what, that's what snapshots brought was versioning and also replication.

Speaker:

So we have another copy of the data in another location.

Speaker:

Um, but once they did that, because now we're storing backups in a

Speaker:

way that is immediately useful.

Speaker:

You don't have to restore, as I make quotes in the air, you

Speaker:

don't have to restore it per se.

Speaker:

You just need to make it available.

Speaker:

Yeah.

Speaker:

And then if we look at modern, um, systems

Speaker:

There are also backup vendors that have kind of led discharge as well,

Speaker:

where they're storing backups.

Speaker:

So traditionally, most backup vendors have stored their backups

Speaker:

in some sort of encapsulated format.

Speaker:

Tar, for example, with NetBackup, networker had

Speaker:

their, what did they call that?

Speaker:

Their open tape format?

Speaker:

Is that what they call it?

Speaker:

I don't remember.

Speaker:

It's been too

Speaker:

Well, anyway, yeah.

Speaker:

So they had their form.

Speaker:

Every backup vendor had their format, right?

Speaker:

great

Speaker:

Um,

Speaker:

and lock-in, but

Speaker:

yeah.

Speaker:

Yeah.

Speaker:

also, but

Speaker:

Yeah.

Speaker:

allows them to optimize what

Speaker:

Yeah, yeah,

Speaker:

done.

Speaker:

yeah.

Speaker:

So traditionally that's what they did.

Speaker:

When I look back on the first company that I remember really doing what

Speaker:

I'm thinking about here is Veeam,

Speaker:

Mm-hmm.

Speaker:

where they started storing their backups in a, in a native format.

Speaker:

Yeah.

Speaker:

So that, um, and, and originally I remember like when they were

Speaker:

kind of early, I remember.

Speaker:

Me not liking the fact that, that you couldn't search their backups,

Speaker:

Yeah.

Speaker:

They're like, you don't need to search it.

Speaker:

You just, you just mount, you just mount the VM from two days ago

Speaker:

and just go get whatever you want.

Speaker:

And at the time, I remember going, uh, I don't like that.

Speaker:

Right?

Speaker:

I, I wanna search my, you know, um, but this, this really, uh, it

Speaker:

was a new way of storing backups so that you could instantly.

Speaker:

Um, access that data.

Speaker:

And that led to this idea of things like instant restores,

Speaker:

Mm-hmm.

Speaker:

Uh, you wanna describe what an instant restore is,

Speaker:

Yeah.

Speaker:

An instant restore is before we get to Instant Restore.

Speaker:

So your typical restore is you have to first sort of copy the data out of the

Speaker:

system, right, to wherever it needs to go to the target system, and then

Speaker:

you could start the recovery process

Speaker:

right?

Speaker:

to be what?

Speaker:

Right.

Speaker:

Restore is, you don't need to do that copy.

Speaker:

You can instantly access the data from that backup system and start using it.

Speaker:

And then you could do things like, okay, if it's a virtual machine, I can

Speaker:

mount it and start running it off the backup storage system and then I can

Speaker:

move it or migrate it using storage vMotion or other technologies to the

Speaker:

production location without any downtime.

Speaker:

So it allows

Speaker:

Yeah.

Speaker:

reduce the RTO.

Speaker:

Yeah.

Speaker:

I.

Speaker:

to be able to start accessing your data.

Speaker:

Definitely reduces the RTO right?

Speaker:

Well, technically reduces the RTA, the recovery time.

Speaker:

Actual, yeah.

Speaker:

So it allows you to meet, I'm such a pedantic

Speaker:

I

Speaker:

jerk sometimes.

Speaker:

Uh, 'cause the RTO shouldn't change right?

Speaker:

Un unless we're like, Hey, we can, we can have a tighter RTO now.

Speaker:

Right?

Speaker:

So the, the objective could be made tighter.

Speaker:

Um, but the um, uh, and this.

Speaker:

I think that's the first one that I re really remember doing it like that.

Speaker:

There are other ways to do it.

Speaker:

Uh, there are other ways where if you don't put everything

Speaker:

inside encapsulated blobs, right?

Speaker:

Like tar, if you're storing everything as lots of little pieces, I. If you're

Speaker:

able to then put all those pieces together and just present them all

Speaker:

at the same time as an image, that's another way to do instant restore.

Speaker:

But the point is this, the, these newer ways of storing backups

Speaker:

have allowed this, this ability to access data in a random fashion

Speaker:

Mm-hmm.

Speaker:

without the massive.

Speaker:

Need to do a big restore right.

Speaker:

Before you can do anything

Speaker:

Yeah.

Speaker:

And I know that we're talking about sort of.

Speaker:

Instant restores, but I look at that as a technology.

Speaker:

And then there's the use cases on top of it,

Speaker:

e

Speaker:

right?

Speaker:

right.

Speaker:

Instant Restore is one use case.

Speaker:

The next one that also comes to mind is test and dev, which I think Veeam was one

Speaker:

of the first to sort of solidify this and actually lead the market in this space.

Speaker:

Yeah.

Speaker:

you have a backup, you want to verify, did things work right?

Speaker:

Right, and the problem is that you would need to create your own

Speaker:

sort of test environment, spin it up, right, configure it, copy the

Speaker:

data out, potentially all the rest.

Speaker:

And V made it very easy where you can almost create an isolated test

Speaker:

environment in VMware automatically.

Speaker:

Yep.

Speaker:

Restore your VM or spin up your VM there with new IP addresses so there's

Speaker:

no conflicts, everything else, access it, do whatever testing you need, and

Speaker:

then sort of tear down the system.

Speaker:

Yeah, and, and you can actually create, um, they, they call,

Speaker:

this is called Sure Backup and, and Veeam, and you could create.

Speaker:

Um, basically a, a recovery group and it will do all of this together, right?

Speaker:

And so you can test an entire environment together.

Speaker:

And that what that, that, what that's doing is it's, it's just adding a.

Speaker:

At least initially what we're talking about is just testing

Speaker:

the backup to make sure it works.

Speaker:

So what you're doing is you're increasing confidence

Speaker:

Yep.

Speaker:

in your, that your backup system can do what it needs to do,

Speaker:

when it needs to do it right?

Speaker:

But what that also does is when you have the ability to access data, um.

Speaker:

Like live like that, whether we're talking via the, like the, the snapshot way, the

Speaker:

the live backup way or the live restore way, or sorry, or instant recovery way,

Speaker:

and any method that allows you to directly mount the backup, um, read, write.

Speaker:

Now you, you need to do that in a way, by the way, that doesn't

Speaker:

impact the backup, right?

Speaker:

You, you need to create like a view, uh, to use a database term.

Speaker:

You need to create a view into that backup that allows you to 'cause,

Speaker:

in order to mount it and actually turn it on as a vm, you're, you're

Speaker:

gonna need to do read, write,

Speaker:

Yep.

Speaker:

uh, so you need to do that in a way that doesn't impact the original backup, right?

Speaker:

Yep.

Speaker:

Um, any of those methods that allow, that allow, I think these other

Speaker:

use cases that we're talking about, and the first one that you talked

Speaker:

about was, was test and dev, right?

Speaker:

So we've got, we are, um, a. You know, any type of shop that's doing

Speaker:

an agile development net, even if they're not using Agile development.

Speaker:

But it, I think, you know, many people are using Agile, right?

Speaker:

Um, is that you can use this to easily spin up whatever you want,

Speaker:

um, to be able to, um, to, to either develop against an act, you know,

Speaker:

essentially an active copy of the data.

Speaker:

So there, there's a process.

Speaker:

When you do this, there's a process that you can go through.

Speaker:

I, I've seen different terms for it.

Speaker:

Data de-identification, data anonymization, data sanitization.

Speaker:

Basically the, the only problem with taking.

Speaker:

A copy of production data and then doing development with it is you've

Speaker:

got production data and development.

Speaker:

Right?

Speaker:

And there's potential, there's PII there, what, it's a very American term, but

Speaker:

personal identification there that, um, that could, would, could be a problem if

Speaker:

you're using it in development, right?

Speaker:

So you could, again, you could automate this process of taking a production

Speaker:

copy and then anonymizing that data so that you can, you're using.

Speaker:

Production like data in your development.

Speaker:

And then also once you've done your development, you can test it against that.

Speaker:

In fact, you could actually, once it's true test, you could test it against

Speaker:

actual, you know, non anonymized data, uh, as long as you kept it

Speaker:

in, in an appropriate environment.

Speaker:

Yeah.

Speaker:

And a lot of the companies that were.

Speaker:

in this space, they also refer to it as copy data management.

Speaker:

So one of

Speaker:

Yeah.

Speaker:

that, uh, is very popular at the time was Actifio,

Speaker:

Yeah.

Speaker:

being able to spin off copies.

Speaker:

I think they were acquired by IBMI believe.

Speaker:

So things like that.

Speaker:

Where it is, you have all these copies, it's how do you manage 'em, how do

Speaker:

you make it simple to spin 'em up?

Speaker:

How do you also have the governance in place so people aren't

Speaker:

doing bad things with the data?

Speaker:

Yeah.

Speaker:

And, and so I think, yeah, and, and, and CDM copy data management, you know,

Speaker:

that was, I. I am saying was it's, I don't hear that too much anymore.

Speaker:

Um, you know, you heard it a lot when Actifio was a big brand, right?

Speaker:

Um, I think the concept is strong.

Speaker:

I think the, the challenge that most people had with it is, I.

Speaker:

They want, they wanted to boil the ocean with that, right?

Speaker:

They wanted to do all the copies, they wanted to have the backup

Speaker:

copies plus the, you know, you know, plus all yeah, everything, right?

Speaker:

And so I, I sort of like C-D-P-C-D P's an amazing concept until

Speaker:

you try to pay for it, right?

Speaker:

Um, and so you don't wanna do everything with CDP, you wanna just

Speaker:

do what you really need it for.

Speaker:

Um, the.

Speaker:

Uh, I think what you're seeing with a lot of these products that we're

Speaker:

starting to see is that you're starting to see people doing CDM, like.

Speaker:

Yeah.

Speaker:

Uh, use cases with backups.

Speaker:

And again, this is because so many of these products are storing backups in

Speaker:

a way that allow them to very easily, uh, either the way Veeam does it, or

Speaker:

I know, you know, you know, our former employer, Druva, the way they stored

Speaker:

the data, they could easily do like this, like, um, sort of virtual, like

Speaker:

a view representation of the, of the data, uh, you know, very quickly because

Speaker:

they're in the cloud and they can,

Speaker:

Mm-hmm.

Speaker:

you know.

Speaker:

Cloud is magic.

Speaker:

Um, so yeah, so that test and dev is, is a good example of 'em.

Speaker:

. So the next one we have is let's talk about security, uh, and

Speaker:

compliance applications here.

Speaker:

So what do you, what do you think are security applications with things

Speaker:

that we could do with backups that we couldn't do, I don't know, 10 years ago?

Speaker:

There's a, so the thing about backups is, is basically has all the data

Speaker:

from everywhere in the organization,

Speaker:

Mm-hmm.

Speaker:

right?

Speaker:

You could start to look for patterns.

Speaker:

You could look at accesses, who's accessing what data,

Speaker:

where copies are going.

Speaker:

Um, there's also things you could do, for instance, if you get hit by ransomware.

Speaker:

Okay?

Speaker:

I now understand the signature of the ransomware.

Speaker:

Where does that live in my environment?

Speaker:

So you now have a centralized location of all your data that you could

Speaker:

start searching for, to be able to identify some of these security issues?

Speaker:

You can do like, um, basically sim, sim sort type, uh, you know,

Speaker:

or, or XDR, basically all of these techniques, you could do them with a

Speaker:

sync, a centralized copy of the data.

Speaker:

Yeah.

Speaker:

and I, I do, I still, I still go back to I agree with what, what

Speaker:

I used to hear a lot at Druva, which was, um, if we're the reason.

Speaker:

That you know, that you have a ransomware attack.

Speaker:

This is a problem,

Speaker:

Yeah.

Speaker:

right?

Speaker:

Like, but it's still better to know than not, than to not know.

Speaker:

Right?

Speaker:

Um, yeah.

Speaker:

Hopefully you've got a, a, a number of different thing.

Speaker:

But this, this is the idea of defense in depth.

Speaker:

And you're right, it is a centralized place from which you can see a lot of

Speaker:

things that you can perhaps from that vantage point, see patterns that you.

Speaker:

Might not see, uh, otherwise.

Speaker:

And I, I, I gotta bring up, I gotta bring up an old story again from Bang Monday.

Speaker:

And, um, the, um,

Speaker:

um, we were implementing.

Speaker:

This is again, in my very first job in backups and we were going

Speaker:

to be implementing what we now think of as like HSM or something.

Speaker:

It wasn't HSM, it was just it, it was, it was like bad HSM, where basically we said

Speaker:

if you've had a file on your file system and you haven't, you haven't touched it

Speaker:

for 18 months, we're gonna delete it.

Speaker:

We got it on 57 backup tapes.

Speaker:

We keep our backup tapes for seven years.

Speaker:

If you really need to file, we can get, we can get it back

Speaker:

for you, but we need space.

Speaker:

And so we're gonna start deleting your crap.

Speaker:

And as the, as the, uh, it's a bit like, uh, you know, like with real id, with

Speaker:

the, with the, um, how that they kept delaying the implementation of real id.

Speaker:

It was the same thing.

Speaker:

We're like, as the date approached it, you know, people started getting,

Speaker:

and we started getting down to that date of like, okay, this is it.

Speaker:

This is the date.

Speaker:

And then one day.

Speaker:

Um, and, and mind you, it just, again, I just gotta just give you

Speaker:

like, like a, what do you call it, A frame of reference here.

Speaker:

Our biggest server was seven gigabytes.

Speaker:

Oh boy.

Speaker:

And what was happening was, and the, and the, the way we did the backups, we do

Speaker:

one full back, one weekly, full backup.

Speaker:

And we would, we didn't have enough tapes to do all the full backups in one day.

Speaker:

I'm sorry, tape drives to

Speaker:

Mm-hmm.

Speaker:

all the full backups in one day.

Speaker:

We would rotate those full backups across, across the week.

Speaker:

And, um, because again.

Speaker:

Backups have always been too expensive.

Speaker:

This is kind of what the point is, right?

Speaker:

And so, but one day, one of the servers, Zeus, I remember, um, it's incremental

Speaker:

backups were shooting through the roof.

Speaker:

They were taking forever, every single day.

Speaker:

Their backups were, were, shoot, you know, taking, they

Speaker:

weren't, they weren't finishing.

Speaker:

Hmm.

Speaker:

And we started looking.

Speaker:

And what we saw was that e every I. File in every home directory

Speaker:

was being changed every single day.

Speaker:

Does someone just have like a touch command or something to just.

Speaker:

Yeah, so what happened was somebody called in to the help desk and

Speaker:

they're like, how can we make sure that our stuff doesn't get deleted?

Speaker:

And they said, well put this command in your DOT profile.

Speaker:

Right?

Speaker:

Which for those that don't know, Unix was a thing that got

Speaker:

ran every time you logged in.

Speaker:

And it basically, it wasn't just a touch star, it was like a fine dot

Speaker:

pipe to, you know, so basically.

Speaker:

Touch, change the modification time on every single file in your, uh,

Speaker:

home directory every single time you logged in, which basically

Speaker:

meant every night became a full.

Speaker:

Yeah.

Speaker:

um, uh, we, we put a stop to that really quick and, and, you know,

Speaker:

we all referred to it as it was, it was the finance department, and

Speaker:

we said we, we caught the finance department, uh, touching themselves.

Speaker:

Um.

Speaker:

Oh, card ass.

Speaker:

Anyway, so, uh, where were we?

Speaker:

What, what were we talking about?

Speaker:

Something?

Speaker:

and compliance.

Speaker:

Yeah.

Speaker:

Yeah.

Speaker:

So there there is, there is a lot of centralized stuff.

Speaker:

You can look for things.

Speaker:

So we talked about the security ramifications.

Speaker:

We, we can look for things that are not compliant.

Speaker:

We can look for file types that are not compliant.

Speaker:

We are not a multimedia making company.

Speaker:

There shouldn't be video files.

Speaker:

Um, I can think all the way back.

Speaker:

To, um, my very first job, like after, this is my very first consulting job, so

Speaker:

it was my first job after that job and we.

Speaker:

Without going into details, we found the most inappropriate videos that you

Speaker:

could possibly find, uh, being stored on servers in our, uh, corporate data center.

Speaker:

Mm.

Speaker:

And you can look for videos, you can look for types of files.

Speaker:

Um, I remember, I do remember one, um, uh, uh, a restore that I got.

Speaker:

Resume.

Speaker:

I told you the Zum doc.

Speaker:

Yeah, yeah.

Speaker:

We, somebody says, Hey, I, I wanna do the Zum doc.

Speaker:

You can look for file names, you can look for file types and you can

Speaker:

look, you can use hashes, right?

Speaker:

You can look for, there are ways for data to be hidden, right?

Speaker:

You can, there are, there are, um.

Speaker:

There are mechanisms you can use to reveal what the real type of a file is,

Speaker:

even if the, the, the, you know, the extension or whatever doesn't say that.

Speaker:

And so you can do that.

Speaker:

You can also look for things like.

Speaker:

You can use regular expressions to look for things like a, again, I,

Speaker:

I can really only speak to the US Social security numbers should not be

Speaker:

in plain text in a spreadsheet, uh, you know, in a, in a document, right.

Speaker:

Um, other personal identifi.

Speaker:

So you can, you could do, uh, compliance.

Speaker:

Um, now of course you're gonna end up giving yourself more work, but you could

Speaker:

potentially save your company millions of dollars in the, in the long run.

Speaker:

yeah,

Speaker:

Yeah.

Speaker:

Uh, and then finally we have, uh, analytics and business intelligence.

Speaker:

And this is something that I think this has been somewhat of a pie

Speaker:

in the sky idea for a long time.

Speaker:

What do you think?

Speaker:

I would say at least decade.

Speaker:

At least a decade we've talked about it

Speaker:

Yep.

Speaker:

and, um, the idea that we're storing all this data.

Speaker:

It's randomly accessible.

Speaker:

Isn't there some way that we could look at this data and we can do

Speaker:

something, do something with it?

Speaker:

Again, you've got this centralized view from which we can view the organization,

Speaker:

not just like it's like three dimensional, but it's it's time as well as is now.

Speaker:

Right.

Speaker:

Yeah.

Speaker:

And I do think, and I think that, that that idea reached a fever pitch.

Speaker:

A couple of years ago with AI

Speaker:

Mm-hmm.

Speaker:

that we started seeing how, how long has, is Che GPT been a thing?

Speaker:

Because that's really when like AI just filled everyone's brain.

Speaker:

Has it been two years?

Speaker:

18 months maybe.

Speaker:

Yeah.

Speaker:

So like.

Speaker:

But even before that, 'cause I remember, 'cause I know I've been,

Speaker:

I've gone from Druva for a couple of years now, and before I left Druva,

Speaker:

Chatt really became a thing, right?

Speaker:

And we like, oh man, we gotta figure out a way to, you know, connect these things.

Speaker:

Right.

Speaker:

And fast forward to last week, right?

Speaker:

Well, two weeks ago now.

Speaker:

Yeah.

Speaker:

was at Veeam on, and you know, if, if you follow the show religiously and you

Speaker:

listened to a couple episodes ago, you would've seen my, my talk on this already.

Speaker:

But I got to see it like it, it was, it was just, it was really amazing where

Speaker:

they, they had a Veeam environment.

Speaker:

Now this was like, they made a point of saying.

Speaker:

When they demoed, they did, they demoed like 20 over 20 things and

Speaker:

they said some of the things you're gonna see are literally hours old.

Speaker:

They're like, we're coding them right now.

Speaker:

There's guys, you know,

Speaker:

Yeah.

Speaker:

thousand monkeys at the keyboard in the back, you know.

Speaker:

a live demo,

Speaker:

Nothing like a live demo and everything.

Speaker:

And by the way, they, they, they did all this, uh, preface, uh,

Speaker:

Anton Sev made all this things.

Speaker:

It was like, I hope it works.

Speaker:

I hope it, like it was like, uh, and, and everything worked flawlessly.

Speaker:

It really, it really did.

Speaker:

But what I saw was they, they had hooked up the, basically they are now announcing

Speaker:

that they're going to be doing this.

Speaker:

This connection between anthropic MCP and Veeam backups and.

Speaker:

I am not an expert in this space, but what I saw, I, I do

Speaker:

use Claude quite a bit, right?

Speaker:

Which is the anthropic tool.

Speaker:

What it looked like to me was they, they had two tabs.

Speaker:

One was they had a bunch of backups.

Speaker:

They, they just claimed that what they had was a bunch of

Speaker:

backups that were about weather.

Speaker:

Mm-hmm.

Speaker:

So they have one tab that was search where they could just search, you

Speaker:

know, what, what, what backups do you have that are about weather?

Speaker:

And it came up with like a Google like search.

Speaker:

That,

Speaker:

Mm-hmm.

Speaker:

that alone was cool, but then it was like, what can you tell me about the weather?

Speaker:

It had a different tab where it just looked like Claude to me, and it was like,

Speaker:

tell me what can you tell me about the weather based on the backups that we have?

Speaker:

mm.

Speaker:

And it was like, you know, and it basically wrote out a report and I

Speaker:

was like, oh, that is really cool.

Speaker:

Right.

Speaker:

And, and you know, I've been in software long enough to know

Speaker:

that, you know, I can all be total smoke and mirrors, but it was, but

Speaker:

You're like,

Speaker:

I watched it.

Speaker:

Right.

Speaker:

I, it was amazing.

Speaker:

And I, and I, again, it goes back to that it's made possible by the fact

Speaker:

that the backups are stored on disc

Speaker:

Mm-hmm.

Speaker:

stored in a, in a way that you can access them natively.

Speaker:

Yep.

Speaker:

And so I. It brings up lots of security and privacy questions.

Speaker:

And, and I had a, a really good chat with them about that.

Speaker:

And they, and they absolutely knew that they needed to come out with

Speaker:

their AI statement before this ever touched any customer data.

Speaker:

And he, he did verify to me that there wasn't any path between your

Speaker:

data and anthropic and you know, that, that they're not gonna be

Speaker:

using your data to train anything.

Speaker:

It's, it's a private instance.

Speaker:

Um, but that was just.

Speaker:

You know, it's like the first time you ever, um, it's like the first time I,

Speaker:

I, I don't know if you haven't at this point, gone and used AI in some fashion.

Speaker:

If you haven't done some of the amazing things you could do in ai.

Speaker:

Um.

Speaker:

I, you gotta, you gotta go try it out.

Speaker:

And it, that first time you do that, you're like, oh my goodness.

Speaker:

Right.

Speaker:

Yeah.

Speaker:

and it, it's so good at like summarizing things that, that's like, to me that's

Speaker:

like the best, like it's never gonna come up with anything new technically,

Speaker:

because, but you could also argue there's nothing new under the sun.

Speaker:

Right.

Speaker:

Um,

Speaker:

but it's

Speaker:

and that's that.

Speaker:

in different ways

Speaker:

It is able to make connections in different ways, right.

Speaker:

And, and, and suggest things.

Speaker:

And, um, you know, we use it all the time for this podcast.

Speaker:

We use it to help us come up with titles and, and to summarize the podcast.

Speaker:

Um, and the, the first time you see it do something like that is amazing.

Speaker:

We're not real.

Speaker:

we.

Speaker:

You remember the episode?

Speaker:

We actually made ai, we made our AI voices.

Speaker:

We actually had an episode where we had, we had, uh, 'cause the editor that

Speaker:

I use has an AI copy of our voices.

Speaker:

And I can fix, if I say words wrong, like I say the wrong word, I can actually

Speaker:

fix, uh, I can swap it out with my voice.

Speaker:

And that offends some people.

Speaker:

Sorry.

Speaker:

Um, but uh, yeah.

Speaker:

Anyway.

Speaker:

we talked about all these use cases, right?

Speaker:

I think the

Speaker:

Yeah.

Speaker:

that I think is important is a person focused on backup, your primary goal

Speaker:

going all the way back to the beginning is your insurance for the company.

Speaker:

You cannot fail that job.

Speaker:

Right.

Speaker:

The company looks at you for that last line of defense.

Speaker:

We're making sure everything works.

Speaker:

All these other things about doing more with backups are in addition

Speaker:

to that core foundational thing.

Speaker:

If you ever falter and sort of take away from that core foundation,

Speaker:

none of this other stuff matters.

Speaker:

I, I couldn't have said it about it myself.

Speaker:

That that's actually gr That's a great point.

Speaker:

Um, persona that you, you, that this is about bringing value to

Speaker:

the thing you're already doing.

Speaker:

You cannot stop the thing you're already doing.

Speaker:

And let me give you a perfect example of something that I have

Speaker:

talked to some people about.

Speaker:

Things I'd like to do with a backup where I'm like, no, no, no, no, no, no.

Speaker:

Okay.

Speaker:

And this is this idea of the right to be forgotten,

Speaker:

Mm-hmm.

Speaker:

right?

Speaker:

Where people have discussed the concept of surgically altering backups to

Speaker:

take your name out of the backup data.

Speaker:

And I'm like, I'm sorry.

Speaker:

That is just, that is, that is fundamentally against.

Speaker:

The backup, the design of all backups.

Speaker:

Known demand.

Speaker:

You cannot go.

Speaker:

You know, go and, and, and alter backups besides the fact that

Speaker:

just backups should be immutable.

Speaker:

Yep.

Speaker:

your backups are immutable.

Speaker:

They're probably not statistically speaking, but hopefully they are.

Speaker:

And if they're not, you should be looking at that.

Speaker:

Go read, you know, listen to our episodes about immutability and how

Speaker:

important that is and how easy it is actually to do that nowadays.

Speaker:

Right.

Speaker:

Um, versus bugging the, um, but you, you, you, you can't.

Speaker:

You can't go focusing on these to the, to the detriment of,

Speaker:

of the core function of backup.

Speaker:

Right.

Speaker:

It's gotta, it's gotta do that.

Speaker:

Um, because if you do ever actually need your backups, uh, they

Speaker:

need to actually do the thing.

Speaker:

Yep.

Speaker:

Yeah, that's a great point to end on.

Speaker:

Persona, thank you very much.

Speaker:

No, thank you Curtis.

Speaker:

And hopefully my DIY stuff goes okay.

Speaker:

Or I may be calling you and asking you to fly up to Santa Clara to help me

Speaker:

Yeah,

Speaker:

I break,

Speaker:

I think that would be a highly inefficient use of both of our time.

Speaker:

But I'll be happy to have FaceTime,

Speaker:

Yes, listen.

Speaker:

uh, wouldn't be the first time.

Speaker:

All right.

Speaker:

Well, uh, thank you to our listeners.

Speaker:

You know, you're why we're here.

Speaker:

And, uh, that is a wrap.

Speaker:

The backup wrap up is written, recorded, and produced by me w Curtis Preston.

Speaker:

If you need backup or Dr. Consulting content generation or expert witness

Speaker:

work, check out backup central.com.

Speaker:

You can also find links from my O'Reilly Books on the same website.

Speaker:

Remember, this is an independent podcast and any opinions that

Speaker:

you hear are those of the speaker and not necessarily an employer.

Speaker:

Thanks for listening.