You found the backup wrap up your go-to podcast for all things
Speaker:backup recovery and cyber recovery.
Speaker:In this episode, we explore how to get an actual return on your investment out of
Speaker:your backups instead of just treating them as an expensive insurance policy that.
Speaker:Sits around and waits for a disaster.
Speaker:Ask yourself, what if your backup infrastructure could
Speaker:actually pay dividends?
Speaker:Make your company money.
Speaker:Persona and I dig into practical ways to extract an ROA from your backups.
Speaker:Through test environments, security monitoring, compliance, checking,
Speaker:and even, and especially these days, AI powered analytics.
Speaker:We'll show you how the shift from tape to disc opened up these possibilities that
Speaker:were honestly simply impossible before.
Speaker:If you've ever wondered whether there's more to backup than just crossing your
Speaker:fingers and hoping that you'll never need to use them, well this episode's for you.
Speaker:By the way, if you don't know who I am, I'm w Curtis Preston, AKA, Mr.
Speaker:Backup.
Speaker:And, uh, I've been doing, uh, backups for over 30 years.
Speaker:Uh, basically ever since I had to tell my boss that there were no backups of the
Speaker:production database that we had just lost.
Speaker:I didn't want that to happen to me again, and I don't want that to happen to you.
Speaker:That's why I do this.
Speaker:On this podcast, we turn unappreciated backup admins into cyber recovery heroes.
Speaker:This is the backup wrap up.
Speaker:Welcome to the show.
Speaker:Hi.
Speaker:Welcome to Backup Central's, restore it All podcast.
Speaker:I'm your host, w Curtis Preston.
Speaker:And with me, as always is my fellow DIY enthusiast persona.
Speaker:Molly Yondi.
Speaker:Welcome to the Club Persona.
Speaker:Thank you, Curtis.
Speaker:Although, to be fair, this is not my first DIY,
Speaker:No, it's not.
Speaker:But I don't know.
Speaker:I just feel like this was, this was something special.
Speaker:but it's the first one where I've had to make multiple trips to Home
Speaker:Depot in order to figure out, and it's funny, so to explain what's going on.
Speaker:So over the weekend I had a water shutoff valve for our
Speaker:sprinkler system that was leaking.
Speaker:So I was like, okay, I should fix it because it's starting to get summertime
Speaker:and it's probably best to do that.
Speaker:So.
Speaker:I was like, oh, let me try, and I, been delaying this, by
Speaker:the way, for a year and a half,
Speaker:Yeah,
Speaker:like all of a sudden it started leaking.
Speaker:Like I basically just turned it off because then it would stop leaking.
Speaker:So it hasn't been working for a year and a half.
Speaker:so no, no sprinkling.
Speaker:Yeah, no sprinkle.
Speaker:I literally would fill up, like, you know those, I dunno if you have
Speaker:a Costco, but Costco sells like the mango juices and like those giant,
Speaker:like half a gallon or one gallon
Speaker:Mm-hmm.
Speaker:the lingerers, I would fill that with water from the kitchen sink
Speaker:and then go and water the plants.
Speaker:So yes, so eventually I was like, okay, I should fix this.
Speaker:So I was like, okay, it.
Speaker:And I'm like, oh, it's one of those plastic shutoff valves that has a ball.
Speaker:So I was like.
Speaker:I know it's gonna be difficult if I have to replace it because you have
Speaker:to like PVC, you gotta put glue, you gotta piece everything together.
Speaker:I'm like, that's a huge project.
Speaker:I was like, let me do the easy way first.
Speaker:So I Googled on YouTube and they're like, Hey, there's
Speaker:this O ring inside that leaks.
Speaker:And so what you do is you just like pull off the handle and I pull out the
Speaker:O ring and replace the O-ring and put it back together and you're all good to go.
Speaker:So I was like, sweet.
Speaker:So I started on that and process of removing the handle, I broke the handle.
Speaker:Yeah.
Speaker:And, uh, I went to like five different stores, bought five different valves
Speaker:and took 'em apart to see if one of the handles, because I was like,
Speaker:oh, lemme just replace the handle.
Speaker:none of the handles would fit.
Speaker:Nice.
Speaker:I was like, oh man.
Speaker:So now I was like, okay, I'm screwed.
Speaker:then I was like, okay, I gotta bite the bullet.
Speaker:What was going to hopefully be like a 30 minute project has now
Speaker:gone on for an hour and a half.
Speaker:Yeah.
Speaker:been to the first store yet, so I went to the Home Depot and I met
Speaker:this one really awesome guy who works there Eric shout out to you.
Speaker:Uh, but he was like, Hey, this is exactly what you need.
Speaker:And he's like, Hey, instead of doing what you're thinking of
Speaker:doing, you just replace everything.
Speaker:You'll be much happier.
Speaker:And he like told me exactly what I needed.
Speaker:He walked me through it,
Speaker:Yeah.
Speaker:bought everything, took it home, and then started putting it together.
Speaker:Because remember at this point we don't have water in the house.
Speaker:Right, right.
Speaker:uh, so we started putting everything together, called Curtis a bunch
Speaker:of times, put it together.
Speaker:I was like, it dripped, it leaked.
Speaker:I was like, Ugh.
Speaker:So then slowly like tyd it and all the rest there's, and so at least
Speaker:now I have water in the house.
Speaker:I haven't finished the rest of the sprinkler stuff, there's
Speaker:a slight, slight, slight drip.
Speaker:So now I have to shut off the water and redo everything.
Speaker:But it's, it was like four trips to
Speaker:But
Speaker:and.
Speaker:Yeah.
Speaker:Yeah, but, and you, and you know, and you know what you did wrong at this point.
Speaker:You know what the, the problem is.
Speaker:Yeah.
Speaker:And I, uh, talked to my DIY expert, otherwise known as Mr. Backup, and,
Speaker:uh, he was like, uh, send me a picture.
Speaker:So I sent you a picture and you looked at it and you're like, uh,
Speaker:you put the Teflon tape on backwards.
Speaker:I was like, oh, ah.
Speaker:Yeah.
Speaker:Gotta put the Teflon tape in the direction of the threads.
Speaker:Yeah,
Speaker:Yeah, well, it's also one of those things because it was like it's
Speaker:going in the opposite direction because it had double-sided thread.
Speaker:So I was like, ah,
Speaker:yeah.
Speaker:so it's okay.
Speaker:At least I know what I need to do, but now I gotta shut off
Speaker:the water and then do that.
Speaker:So,
Speaker:Yeah, you got, you had a whole, but I mean, the thing that I saw there were a
Speaker:whole bunch of threads because you got like, you got like the nipple plus the
Speaker:adapter plus the, the shut up, you know?
Speaker:Yeah.
Speaker:Yeah.
Speaker:You good?
Speaker:And then the thing
Speaker:Yeah.
Speaker:and so, yeah.
Speaker:But
Speaker:Good times.
Speaker:it's not too much longer and I won't need to go back to
Speaker:Home Depot, but we shall see.
Speaker:Oh, don't say things like that.
Speaker:Hmm.
Speaker:Um,
Speaker:least
Speaker:so, um, yeah, and we're, we're not even gonna talk about why
Speaker:I'm mad at Home Depot right now.
Speaker:So, um, let's just say for the first time ever I'm actually
Speaker:hiring them to do something.
Speaker:And it has not been a fun process, but
Speaker:is the exact opposite.
Speaker:'cause normally I'm not a fan of Home Depot 'cause I can
Speaker:never find someone to help me.
Speaker:yeah.
Speaker:talked about
Speaker:Yeah.
Speaker:before and
Speaker:Yeah.
Speaker:Depot 'cause you're like, I know exactly what I need.
Speaker:And now our like, uh, roles are reversed.
Speaker:So
Speaker:Yeah.
Speaker:Weird, huh?
Speaker:full moon.
Speaker:It's um, well actually, you know what?
Speaker:Today is the day we're recording it, it's Haley's Comet Day.
Speaker:Oh,
Speaker:Haley's comets.
Speaker:They're, they're saying, yeah, it is saying tomorrow, but they're
Speaker:saying tonight and tomorrow night we should get some real meteor
Speaker:showers, um, from Haley's comment.
Speaker:So anyway.
Speaker:Well, we are gonna talk about some fun stuff today.
Speaker:Um, you know, we talk about in backup a lot, one of the issues
Speaker:that people have with backup is that it's just a money sink, right.
Speaker:A money pit.
Speaker:Right.
Speaker:It's just, it doesn't ever, it never brings any value.
Speaker:To the business unless,
Speaker:need it.
Speaker:until you really, really, really need it.
Speaker:right?
Speaker:It's like your car
Speaker:Yeah,
Speaker:your
Speaker:yeah, exactly.
Speaker:Right.
Speaker:And, and yeah, and like, yeah, and like.
Speaker:Most insurance, it adds no value to your life unless
Speaker:really bad things happen, right?
Speaker:And so this episode is about are there other things that we
Speaker:could be doing with our backups that would potentially at least,
Speaker:I don't know, add some incremental business value?
Speaker:Uh, or whatever the appropriate term is in the, in the governmental world, right?
Speaker:The incremental value to the organization that would help
Speaker:minimize the pain of that, of that.
Speaker:Check that by that, that dates me, doesn't it?
Speaker:Yes.
Speaker:the fact that I use the term check.
Speaker:Um.
Speaker:Bitcoins that you have to use are the
Speaker:Yeah.
Speaker:The, yeah, the Bitcoins.
Speaker:Um, you know, I, I, I, again, I'll, I'll tell a story from the old days.
Speaker:So I remember back when the, the, the organization that
Speaker:I was, my very first job,
Speaker:before
Speaker:what.
Speaker:you have to use the phrase, what phrase do you have to use when
Speaker:Back.
Speaker:Back in the day.
Speaker:There you go.
Speaker:in the day.
Speaker:So back in the day, back in 1993 before my daughter was even born.
Speaker:Um, that.
Speaker:We ran out of ta, you know, the, the organization was growing in size.
Speaker:It just logarithmically really from the time I joined to the time I left,
Speaker:and which always means more backups and it means running out of tapes.
Speaker:Back then it meant running out of tapes.
Speaker:And, um, I remember going to my boss and basically saying, Hey,
Speaker:you know, we we're out of tapes.
Speaker:And, um, the, it was interesting because, um, I. Uh, purchases for over, like,
Speaker:over a certain, uh, number was like considered a capital purchase, even though
Speaker:this was really very much an expense.
Speaker:So it was a very big deal that I was asking for.
Speaker:Like I remember the number was like $16,000 in, in tapes
Speaker:and is a lot of tapes, right?
Speaker:But, but, but we needed a lot of tapes and I remember the boss, my boss,
Speaker:saying to me, Susan saying to me.
Speaker:Is there any other option
Speaker:Mm.
Speaker:than spending this $16,000?
Speaker:And I said, yes.
Speaker:She said, what is it?
Speaker:I can, I can stop backing up stuff.
Speaker:Or it should be like you should stop creating data.
Speaker:Yeah.
Speaker:Yeah, you could, you could stop making more stuff.
Speaker:Um, so, uh, yeah, it, so backups have always been this, like money sink.
Speaker:The, I'm sorry, why do I keep saying Money sink.
Speaker:Money pit.
Speaker:I will also say that there have been some changes in backup design
Speaker:that are going to facilitate some of the things that we talk about when
Speaker:we talk about, uh, bringing some business value out of the backup data.
Speaker:The biggest of which is moving off of tape.
Speaker:As the, as the primary backup mechanism because when, when backups were on
Speaker:tape and, and you know, backups are still on tape, there's still many,
Speaker:quite a bit of backups on tape.
Speaker:Um, but when it was the primary and, and only place that you stored backup
Speaker:data, getting any additional value out of that data was I, I mean, it,
Speaker:it's just literally something that we never even discussed because
Speaker:there, there was no way to do it.
Speaker:Well, and I think it's also, at the time, I don't think people
Speaker:thought about these other use cases
Speaker:Hmm.
Speaker:may not have existed back then.
Speaker:I
Speaker:Yeah.
Speaker:modern arch software architecture and designs have allowed
Speaker:for a lot more use cases
Speaker:Mm-hmm.
Speaker:they used to have in the past.
Speaker:Yeah, I, but I would also say, even though, like when we look at
Speaker:things like tests and dev, we had tests and dev, but I. The best you
Speaker:could do was use your backups to restore production into something,
Speaker:Yeah,
Speaker:and it was still so challenging that most people just didn't even think about it.
Speaker:Right.
Speaker:They, they just didn't even consider that as an option.
Speaker:Mm-hmm.
Speaker:but I think this is also where if we look at storage systems
Speaker:like NetApp at the time, right?
Speaker:With snapshots where it's like, hey, in clones, right?
Speaker:You can quickly take a clone of a volume, start using it for test and
Speaker:dev and other purposes like that.
Speaker:So I think that was like, oh yeah, we should be able to do more things with it.
Speaker:And actually, maybe we should just jump into like some of
Speaker:these use cases since we're
Speaker:Well,
Speaker:to it.
Speaker:well actually, before, before we do that, uh, I, I think that it's
Speaker:really important that you, you made an important point there, and that
Speaker:is that when I said that there have been some changes in backup design.
Speaker:There have been.
Speaker:Sort of two really big changes.
Speaker:One is just the use of disc in general
Speaker:Mm-hmm.
Speaker:in various forms, which includes just file system disc.
Speaker:It includes object based storage, it includes filer based type
Speaker:storage and, and ddu ddu storage.
Speaker:All of that as as, it just, it's just much more flexible, even if we did
Speaker:nothing else, that provides a lot of flexibility, but I do think that.
Speaker:When I look back on things, I think NetApp gets a lot of credit here as
Speaker:being a pioneer of not changing just.
Speaker:That we're gonna use disc for backups, but also how we're gonna make those backups.
Speaker:And for a really long time there was this, um, and, and I'll still stand by
Speaker:the, the phrase if we, if we, if we, if we leave it just alone, and that
Speaker:is that a snapshot isn't a backup.
Speaker:Right.
Speaker:If we go back 20 years, NetApp's at least 20 years old, right?
Speaker:More than 20 years, I think
Speaker:Yeah.
Speaker:Okay.
Speaker:So back when, back of NetApp was just NetApp and pre-snap mirror.
Speaker:There was a time when there was no snap mirror.
Speaker:Right.
Speaker:Okay.
Speaker:Um, so when it was just a box and it had, um, just snapshots, I
Speaker:would've been alongside everyone else saying A snapshot is not a backup.
Speaker:Right.
Speaker:Um, unfortunately.
Speaker:Well, because it's relying on the primary.
Speaker:A, a, a traditional snapshot at that time.
Speaker:Well, even a snapshot at this time relies on the primary.
Speaker:It's literally, I used to make the phrase, a snapshot is as good of a
Speaker:backup of your data as a snapshot of your house is when your house catches fire.
Speaker:Right, right.
Speaker:It relies on the primary in order to, to, to function.
Speaker:But then once NetApp and other companies, uh, followed their, uh, example.
Speaker:They started replicating these snapshots to other locations
Speaker:and now we have both versioning.
Speaker:The, what, that's what snapshots brought was versioning and also replication.
Speaker:So we have another copy of the data in another location.
Speaker:Um, but once they did that, because now we're storing backups in a
Speaker:way that is immediately useful.
Speaker:You don't have to restore, as I make quotes in the air, you
Speaker:don't have to restore it per se.
Speaker:You just need to make it available.
Speaker:Yeah.
Speaker:And then if we look at modern, um, systems
Speaker:There are also backup vendors that have kind of led discharge as well,
Speaker:where they're storing backups.
Speaker:So traditionally, most backup vendors have stored their backups
Speaker:in some sort of encapsulated format.
Speaker:Tar, for example, with NetBackup, networker had
Speaker:their, what did they call that?
Speaker:Their open tape format?
Speaker:Is that what they call it?
Speaker:I don't remember.
Speaker:It's been too
Speaker:Well, anyway, yeah.
Speaker:So they had their form.
Speaker:Every backup vendor had their format, right?
Speaker:great
Speaker:Um,
Speaker:and lock-in, but
Speaker:yeah.
Speaker:Yeah.
Speaker:also, but
Speaker:Yeah.
Speaker:allows them to optimize what
Speaker:Yeah, yeah,
Speaker:done.
Speaker:yeah.
Speaker:So traditionally that's what they did.
Speaker:When I look back on the first company that I remember really doing what
Speaker:I'm thinking about here is Veeam,
Speaker:Mm-hmm.
Speaker:where they started storing their backups in a, in a native format.
Speaker:Yeah.
Speaker:So that, um, and, and originally I remember like when they were
Speaker:kind of early, I remember.
Speaker:Me not liking the fact that, that you couldn't search their backups,
Speaker:Yeah.
Speaker:They're like, you don't need to search it.
Speaker:You just, you just mount, you just mount the VM from two days ago
Speaker:and just go get whatever you want.
Speaker:And at the time, I remember going, uh, I don't like that.
Speaker:Right?
Speaker:I, I wanna search my, you know, um, but this, this really, uh, it
Speaker:was a new way of storing backups so that you could instantly.
Speaker:Um, access that data.
Speaker:And that led to this idea of things like instant restores,
Speaker:Mm-hmm.
Speaker:Uh, you wanna describe what an instant restore is,
Speaker:Yeah.
Speaker:An instant restore is before we get to Instant Restore.
Speaker:So your typical restore is you have to first sort of copy the data out of the
Speaker:system, right, to wherever it needs to go to the target system, and then
Speaker:you could start the recovery process
Speaker:right?
Speaker:to be what?
Speaker:Right.
Speaker:Restore is, you don't need to do that copy.
Speaker:You can instantly access the data from that backup system and start using it.
Speaker:And then you could do things like, okay, if it's a virtual machine, I can
Speaker:mount it and start running it off the backup storage system and then I can
Speaker:move it or migrate it using storage vMotion or other technologies to the
Speaker:production location without any downtime.
Speaker:So it allows
Speaker:Yeah.
Speaker:reduce the RTO.
Speaker:Yeah.
Speaker:I.
Speaker:to be able to start accessing your data.
Speaker:Definitely reduces the RTO right?
Speaker:Well, technically reduces the RTA, the recovery time.
Speaker:Actual, yeah.
Speaker:So it allows you to meet, I'm such a pedantic
Speaker:I
Speaker:jerk sometimes.
Speaker:Uh, 'cause the RTO shouldn't change right?
Speaker:Un unless we're like, Hey, we can, we can have a tighter RTO now.
Speaker:Right?
Speaker:So the, the objective could be made tighter.
Speaker:Um, but the um, uh, and this.
Speaker:I think that's the first one that I re really remember doing it like that.
Speaker:There are other ways to do it.
Speaker:Uh, there are other ways where if you don't put everything
Speaker:inside encapsulated blobs, right?
Speaker:Like tar, if you're storing everything as lots of little pieces, I. If you're
Speaker:able to then put all those pieces together and just present them all
Speaker:at the same time as an image, that's another way to do instant restore.
Speaker:But the point is this, the, these newer ways of storing backups
Speaker:have allowed this, this ability to access data in a random fashion
Speaker:Mm-hmm.
Speaker:without the massive.
Speaker:Need to do a big restore right.
Speaker:Before you can do anything
Speaker:Yeah.
Speaker:And I know that we're talking about sort of.
Speaker:Instant restores, but I look at that as a technology.
Speaker:And then there's the use cases on top of it,
Speaker:e
Speaker:right?
Speaker:right.
Speaker:Instant Restore is one use case.
Speaker:The next one that also comes to mind is test and dev, which I think Veeam was one
Speaker:of the first to sort of solidify this and actually lead the market in this space.
Speaker:Yeah.
Speaker:you have a backup, you want to verify, did things work right?
Speaker:Right, and the problem is that you would need to create your own
Speaker:sort of test environment, spin it up, right, configure it, copy the
Speaker:data out, potentially all the rest.
Speaker:And V made it very easy where you can almost create an isolated test
Speaker:environment in VMware automatically.
Speaker:Yep.
Speaker:Restore your VM or spin up your VM there with new IP addresses so there's
Speaker:no conflicts, everything else, access it, do whatever testing you need, and
Speaker:then sort of tear down the system.
Speaker:Yeah, and, and you can actually create, um, they, they call,
Speaker:this is called Sure Backup and, and Veeam, and you could create.
Speaker:Um, basically a, a recovery group and it will do all of this together, right?
Speaker:And so you can test an entire environment together.
Speaker:And that what that, that, what that's doing is it's, it's just adding a.
Speaker:At least initially what we're talking about is just testing
Speaker:the backup to make sure it works.
Speaker:So what you're doing is you're increasing confidence
Speaker:Yep.
Speaker:in your, that your backup system can do what it needs to do,
Speaker:when it needs to do it right?
Speaker:But what that also does is when you have the ability to access data, um.
Speaker:Like live like that, whether we're talking via the, like the, the snapshot way, the
Speaker:the live backup way or the live restore way, or sorry, or instant recovery way,
Speaker:and any method that allows you to directly mount the backup, um, read, write.
Speaker:Now you, you need to do that in a way, by the way, that doesn't
Speaker:impact the backup, right?
Speaker:You, you need to create like a view, uh, to use a database term.
Speaker:You need to create a view into that backup that allows you to 'cause,
Speaker:in order to mount it and actually turn it on as a vm, you're, you're
Speaker:gonna need to do read, write,
Speaker:Yep.
Speaker:uh, so you need to do that in a way that doesn't impact the original backup, right?
Speaker:Yep.
Speaker:Um, any of those methods that allow, that allow, I think these other
Speaker:use cases that we're talking about, and the first one that you talked
Speaker:about was, was test and dev, right?
Speaker:So we've got, we are, um, a. You know, any type of shop that's doing
Speaker:an agile development net, even if they're not using Agile development.
Speaker:But it, I think, you know, many people are using Agile, right?
Speaker:Um, is that you can use this to easily spin up whatever you want,
Speaker:um, to be able to, um, to, to either develop against an act, you know,
Speaker:essentially an active copy of the data.
Speaker:So there, there's a process.
Speaker:When you do this, there's a process that you can go through.
Speaker:I, I've seen different terms for it.
Speaker:Data de-identification, data anonymization, data sanitization.
Speaker:Basically the, the only problem with taking.
Speaker:A copy of production data and then doing development with it is you've
Speaker:got production data and development.
Speaker:Right?
Speaker:And there's potential, there's PII there, what, it's a very American term, but
Speaker:personal identification there that, um, that could, would, could be a problem if
Speaker:you're using it in development, right?
Speaker:So you could, again, you could automate this process of taking a production
Speaker:copy and then anonymizing that data so that you can, you're using.
Speaker:Production like data in your development.
Speaker:And then also once you've done your development, you can test it against that.
Speaker:In fact, you could actually, once it's true test, you could test it against
Speaker:actual, you know, non anonymized data, uh, as long as you kept it
Speaker:in, in an appropriate environment.
Speaker:Yeah.
Speaker:And a lot of the companies that were.
Speaker:in this space, they also refer to it as copy data management.
Speaker:So one of
Speaker:Yeah.
Speaker:that, uh, is very popular at the time was Actifio,
Speaker:Yeah.
Speaker:being able to spin off copies.
Speaker:I think they were acquired by IBMI believe.
Speaker:So things like that.
Speaker:Where it is, you have all these copies, it's how do you manage 'em, how do
Speaker:you make it simple to spin 'em up?
Speaker:How do you also have the governance in place so people aren't
Speaker:doing bad things with the data?
Speaker:Yeah.
Speaker:And, and so I think, yeah, and, and, and CDM copy data management, you know,
Speaker:that was, I. I am saying was it's, I don't hear that too much anymore.
Speaker:Um, you know, you heard it a lot when Actifio was a big brand, right?
Speaker:Um, I think the concept is strong.
Speaker:I think the, the challenge that most people had with it is, I.
Speaker:They want, they wanted to boil the ocean with that, right?
Speaker:They wanted to do all the copies, they wanted to have the backup
Speaker:copies plus the, you know, you know, plus all yeah, everything, right?
Speaker:And so I, I sort of like C-D-P-C-D P's an amazing concept until
Speaker:you try to pay for it, right?
Speaker:Um, and so you don't wanna do everything with CDP, you wanna just
Speaker:do what you really need it for.
Speaker:Um, the.
Speaker:Uh, I think what you're seeing with a lot of these products that we're
Speaker:starting to see is that you're starting to see people doing CDM, like.
Speaker:Yeah.
Speaker:Uh, use cases with backups.
Speaker:And again, this is because so many of these products are storing backups in
Speaker:a way that allow them to very easily, uh, either the way Veeam does it, or
Speaker:I know, you know, you know, our former employer, Druva, the way they stored
Speaker:the data, they could easily do like this, like, um, sort of virtual, like
Speaker:a view representation of the, of the data, uh, you know, very quickly because
Speaker:they're in the cloud and they can,
Speaker:Mm-hmm.
Speaker:you know.
Speaker:Cloud is magic.
Speaker:Um, so yeah, so that test and dev is, is a good example of 'em.
Speaker:. So the next one we have is let's talk about security, uh, and
Speaker:compliance applications here.
Speaker:So what do you, what do you think are security applications with things
Speaker:that we could do with backups that we couldn't do, I don't know, 10 years ago?
Speaker:There's a, so the thing about backups is, is basically has all the data
Speaker:from everywhere in the organization,
Speaker:Mm-hmm.
Speaker:right?
Speaker:You could start to look for patterns.
Speaker:You could look at accesses, who's accessing what data,
Speaker:where copies are going.
Speaker:Um, there's also things you could do, for instance, if you get hit by ransomware.
Speaker:Okay?
Speaker:I now understand the signature of the ransomware.
Speaker:Where does that live in my environment?
Speaker:So you now have a centralized location of all your data that you could
Speaker:start searching for, to be able to identify some of these security issues?
Speaker:You can do like, um, basically sim, sim sort type, uh, you know,
Speaker:or, or XDR, basically all of these techniques, you could do them with a
Speaker:sync, a centralized copy of the data.
Speaker:Yeah.
Speaker:and I, I do, I still, I still go back to I agree with what, what
Speaker:I used to hear a lot at Druva, which was, um, if we're the reason.
Speaker:That you know, that you have a ransomware attack.
Speaker:This is a problem,
Speaker:Yeah.
Speaker:right?
Speaker:Like, but it's still better to know than not, than to not know.
Speaker:Right?
Speaker:Um, yeah.
Speaker:Hopefully you've got a, a, a number of different thing.
Speaker:But this, this is the idea of defense in depth.
Speaker:And you're right, it is a centralized place from which you can see a lot of
Speaker:things that you can perhaps from that vantage point, see patterns that you.
Speaker:Might not see, uh, otherwise.
Speaker:And I, I, I gotta bring up, I gotta bring up an old story again from Bang Monday.
Speaker:And, um, the, um,
Speaker:um, we were implementing.
Speaker:This is again, in my very first job in backups and we were going
Speaker:to be implementing what we now think of as like HSM or something.
Speaker:It wasn't HSM, it was just it, it was, it was like bad HSM, where basically we said
Speaker:if you've had a file on your file system and you haven't, you haven't touched it
Speaker:for 18 months, we're gonna delete it.
Speaker:We got it on 57 backup tapes.
Speaker:We keep our backup tapes for seven years.
Speaker:If you really need to file, we can get, we can get it back
Speaker:for you, but we need space.
Speaker:And so we're gonna start deleting your crap.
Speaker:And as the, as the, uh, it's a bit like, uh, you know, like with real id, with
Speaker:the, with the, um, how that they kept delaying the implementation of real id.
Speaker:It was the same thing.
Speaker:We're like, as the date approached it, you know, people started getting,
Speaker:and we started getting down to that date of like, okay, this is it.
Speaker:This is the date.
Speaker:And then one day.
Speaker:Um, and, and mind you, it just, again, I just gotta just give you
Speaker:like, like a, what do you call it, A frame of reference here.
Speaker:Our biggest server was seven gigabytes.
Speaker:Oh boy.
Speaker:And what was happening was, and the, and the, the way we did the backups, we do
Speaker:one full back, one weekly, full backup.
Speaker:And we would, we didn't have enough tapes to do all the full backups in one day.
Speaker:I'm sorry, tape drives to
Speaker:Mm-hmm.
Speaker:all the full backups in one day.
Speaker:We would rotate those full backups across, across the week.
Speaker:And, um, because again.
Speaker:Backups have always been too expensive.
Speaker:This is kind of what the point is, right?
Speaker:And so, but one day, one of the servers, Zeus, I remember, um, it's incremental
Speaker:backups were shooting through the roof.
Speaker:They were taking forever, every single day.
Speaker:Their backups were, were, shoot, you know, taking, they
Speaker:weren't, they weren't finishing.
Speaker:Hmm.
Speaker:And we started looking.
Speaker:And what we saw was that e every I. File in every home directory
Speaker:was being changed every single day.
Speaker:Does someone just have like a touch command or something to just.
Speaker:Yeah, so what happened was somebody called in to the help desk and
Speaker:they're like, how can we make sure that our stuff doesn't get deleted?
Speaker:And they said, well put this command in your DOT profile.
Speaker:Right?
Speaker:Which for those that don't know, Unix was a thing that got
Speaker:ran every time you logged in.
Speaker:And it basically, it wasn't just a touch star, it was like a fine dot
Speaker:pipe to, you know, so basically.
Speaker:Touch, change the modification time on every single file in your, uh,
Speaker:home directory every single time you logged in, which basically
Speaker:meant every night became a full.
Speaker:Yeah.
Speaker:um, uh, we, we put a stop to that really quick and, and, you know,
Speaker:we all referred to it as it was, it was the finance department, and
Speaker:we said we, we caught the finance department, uh, touching themselves.
Speaker:Um.
Speaker:Oh, card ass.
Speaker:Anyway, so, uh, where were we?
Speaker:What, what were we talking about?
Speaker:Something?
Speaker:and compliance.
Speaker:Yeah.
Speaker:Yeah.
Speaker:So there there is, there is a lot of centralized stuff.
Speaker:You can look for things.
Speaker:So we talked about the security ramifications.
Speaker:We, we can look for things that are not compliant.
Speaker:We can look for file types that are not compliant.
Speaker:We are not a multimedia making company.
Speaker:There shouldn't be video files.
Speaker:Um, I can think all the way back.
Speaker:To, um, my very first job, like after, this is my very first consulting job, so
Speaker:it was my first job after that job and we.
Speaker:Without going into details, we found the most inappropriate videos that you
Speaker:could possibly find, uh, being stored on servers in our, uh, corporate data center.
Speaker:Mm.
Speaker:And you can look for videos, you can look for types of files.
Speaker:Um, I remember, I do remember one, um, uh, uh, a restore that I got.
Speaker:Resume.
Speaker:I told you the Zum doc.
Speaker:Yeah, yeah.
Speaker:We, somebody says, Hey, I, I wanna do the Zum doc.
Speaker:You can look for file names, you can look for file types and you can
Speaker:look, you can use hashes, right?
Speaker:You can look for, there are ways for data to be hidden, right?
Speaker:You can, there are, there are, um.
Speaker:There are mechanisms you can use to reveal what the real type of a file is,
Speaker:even if the, the, the, you know, the extension or whatever doesn't say that.
Speaker:And so you can do that.
Speaker:You can also look for things like.
Speaker:You can use regular expressions to look for things like a, again, I,
Speaker:I can really only speak to the US Social security numbers should not be
Speaker:in plain text in a spreadsheet, uh, you know, in a, in a document, right.
Speaker:Um, other personal identifi.
Speaker:So you can, you could do, uh, compliance.
Speaker:Um, now of course you're gonna end up giving yourself more work, but you could
Speaker:potentially save your company millions of dollars in the, in the long run.
Speaker:yeah,
Speaker:Yeah.
Speaker:Uh, and then finally we have, uh, analytics and business intelligence.
Speaker:And this is something that I think this has been somewhat of a pie
Speaker:in the sky idea for a long time.
Speaker:What do you think?
Speaker:I would say at least decade.
Speaker:At least a decade we've talked about it
Speaker:Yep.
Speaker:and, um, the idea that we're storing all this data.
Speaker:It's randomly accessible.
Speaker:Isn't there some way that we could look at this data and we can do
Speaker:something, do something with it?
Speaker:Again, you've got this centralized view from which we can view the organization,
Speaker:not just like it's like three dimensional, but it's it's time as well as is now.
Speaker:Right.
Speaker:Yeah.
Speaker:And I do think, and I think that, that that idea reached a fever pitch.
Speaker:A couple of years ago with AI
Speaker:Mm-hmm.
Speaker:that we started seeing how, how long has, is Che GPT been a thing?
Speaker:Because that's really when like AI just filled everyone's brain.
Speaker:Has it been two years?
Speaker:18 months maybe.
Speaker:Yeah.
Speaker:So like.
Speaker:But even before that, 'cause I remember, 'cause I know I've been,
Speaker:I've gone from Druva for a couple of years now, and before I left Druva,
Speaker:Chatt really became a thing, right?
Speaker:And we like, oh man, we gotta figure out a way to, you know, connect these things.
Speaker:Right.
Speaker:And fast forward to last week, right?
Speaker:Well, two weeks ago now.
Speaker:Yeah.
Speaker:was at Veeam on, and you know, if, if you follow the show religiously and you
Speaker:listened to a couple episodes ago, you would've seen my, my talk on this already.
Speaker:But I got to see it like it, it was, it was just, it was really amazing where
Speaker:they, they had a Veeam environment.
Speaker:Now this was like, they made a point of saying.
Speaker:When they demoed, they did, they demoed like 20 over 20 things and
Speaker:they said some of the things you're gonna see are literally hours old.
Speaker:They're like, we're coding them right now.
Speaker:There's guys, you know,
Speaker:Yeah.
Speaker:thousand monkeys at the keyboard in the back, you know.
Speaker:a live demo,
Speaker:Nothing like a live demo and everything.
Speaker:And by the way, they, they, they did all this, uh, preface, uh,
Speaker:Anton Sev made all this things.
Speaker:It was like, I hope it works.
Speaker:I hope it, like it was like, uh, and, and everything worked flawlessly.
Speaker:It really, it really did.
Speaker:But what I saw was they, they had hooked up the, basically they are now announcing
Speaker:that they're going to be doing this.
Speaker:This connection between anthropic MCP and Veeam backups and.
Speaker:I am not an expert in this space, but what I saw, I, I do
Speaker:use Claude quite a bit, right?
Speaker:Which is the anthropic tool.
Speaker:What it looked like to me was they, they had two tabs.
Speaker:One was they had a bunch of backups.
Speaker:They, they just claimed that what they had was a bunch of
Speaker:backups that were about weather.
Speaker:Mm-hmm.
Speaker:So they have one tab that was search where they could just search, you
Speaker:know, what, what, what backups do you have that are about weather?
Speaker:And it came up with like a Google like search.
Speaker:That,
Speaker:Mm-hmm.
Speaker:that alone was cool, but then it was like, what can you tell me about the weather?
Speaker:It had a different tab where it just looked like Claude to me, and it was like,
Speaker:tell me what can you tell me about the weather based on the backups that we have?
Speaker:mm.
Speaker:And it was like, you know, and it basically wrote out a report and I
Speaker:was like, oh, that is really cool.
Speaker:Right.
Speaker:And, and you know, I've been in software long enough to know
Speaker:that, you know, I can all be total smoke and mirrors, but it was, but
Speaker:You're like,
Speaker:I watched it.
Speaker:Right.
Speaker:I, it was amazing.
Speaker:And I, and I, again, it goes back to that it's made possible by the fact
Speaker:that the backups are stored on disc
Speaker:Mm-hmm.
Speaker:stored in a, in a way that you can access them natively.
Speaker:Yep.
Speaker:And so I. It brings up lots of security and privacy questions.
Speaker:And, and I had a, a really good chat with them about that.
Speaker:And they, and they absolutely knew that they needed to come out with
Speaker:their AI statement before this ever touched any customer data.
Speaker:And he, he did verify to me that there wasn't any path between your
Speaker:data and anthropic and you know, that, that they're not gonna be
Speaker:using your data to train anything.
Speaker:It's, it's a private instance.
Speaker:Um, but that was just.
Speaker:You know, it's like the first time you ever, um, it's like the first time I,
Speaker:I, I don't know if you haven't at this point, gone and used AI in some fashion.
Speaker:If you haven't done some of the amazing things you could do in ai.
Speaker:Um.
Speaker:I, you gotta, you gotta go try it out.
Speaker:And it, that first time you do that, you're like, oh my goodness.
Speaker:Right.
Speaker:Yeah.
Speaker:and it, it's so good at like summarizing things that, that's like, to me that's
Speaker:like the best, like it's never gonna come up with anything new technically,
Speaker:because, but you could also argue there's nothing new under the sun.
Speaker:Right.
Speaker:Um,
Speaker:but it's
Speaker:and that's that.
Speaker:in different ways
Speaker:It is able to make connections in different ways, right.
Speaker:And, and, and suggest things.
Speaker:And, um, you know, we use it all the time for this podcast.
Speaker:We use it to help us come up with titles and, and to summarize the podcast.
Speaker:Um, and the, the first time you see it do something like that is amazing.
Speaker:We're not real.
Speaker:we.
Speaker:You remember the episode?
Speaker:We actually made ai, we made our AI voices.
Speaker:We actually had an episode where we had, we had, uh, 'cause the editor that
Speaker:I use has an AI copy of our voices.
Speaker:And I can fix, if I say words wrong, like I say the wrong word, I can actually
Speaker:fix, uh, I can swap it out with my voice.
Speaker:And that offends some people.
Speaker:Sorry.
Speaker:Um, but uh, yeah.
Speaker:Anyway.
Speaker:we talked about all these use cases, right?
Speaker:I think the
Speaker:Yeah.
Speaker:that I think is important is a person focused on backup, your primary goal
Speaker:going all the way back to the beginning is your insurance for the company.
Speaker:You cannot fail that job.
Speaker:Right.
Speaker:The company looks at you for that last line of defense.
Speaker:We're making sure everything works.
Speaker:All these other things about doing more with backups are in addition
Speaker:to that core foundational thing.
Speaker:If you ever falter and sort of take away from that core foundation,
Speaker:none of this other stuff matters.
Speaker:I, I couldn't have said it about it myself.
Speaker:That that's actually gr That's a great point.
Speaker:Um, persona that you, you, that this is about bringing value to
Speaker:the thing you're already doing.
Speaker:You cannot stop the thing you're already doing.
Speaker:And let me give you a perfect example of something that I have
Speaker:talked to some people about.
Speaker:Things I'd like to do with a backup where I'm like, no, no, no, no, no, no.
Speaker:Okay.
Speaker:And this is this idea of the right to be forgotten,
Speaker:Mm-hmm.
Speaker:right?
Speaker:Where people have discussed the concept of surgically altering backups to
Speaker:take your name out of the backup data.
Speaker:And I'm like, I'm sorry.
Speaker:That is just, that is, that is fundamentally against.
Speaker:The backup, the design of all backups.
Speaker:Known demand.
Speaker:You cannot go.
Speaker:You know, go and, and, and alter backups besides the fact that
Speaker:just backups should be immutable.
Speaker:Yep.
Speaker:your backups are immutable.
Speaker:They're probably not statistically speaking, but hopefully they are.
Speaker:And if they're not, you should be looking at that.
Speaker:Go read, you know, listen to our episodes about immutability and how
Speaker:important that is and how easy it is actually to do that nowadays.
Speaker:Right.
Speaker:Um, versus bugging the, um, but you, you, you, you can't.
Speaker:You can't go focusing on these to the, to the detriment of,
Speaker:of the core function of backup.
Speaker:Right.
Speaker:It's gotta, it's gotta do that.
Speaker:Um, because if you do ever actually need your backups, uh, they
Speaker:need to actually do the thing.
Speaker:Yep.
Speaker:Yeah, that's a great point to end on.
Speaker:Persona, thank you very much.
Speaker:No, thank you Curtis.
Speaker:And hopefully my DIY stuff goes okay.
Speaker:Or I may be calling you and asking you to fly up to Santa Clara to help me
Speaker:Yeah,
Speaker:I break,
Speaker:I think that would be a highly inefficient use of both of our time.
Speaker:But I'll be happy to have FaceTime,
Speaker:Yes, listen.
Speaker:uh, wouldn't be the first time.
Speaker:All right.
Speaker:Well, uh, thank you to our listeners.
Speaker:You know, you're why we're here.
Speaker:And, uh, that is a wrap.
Speaker:The backup wrap up is written, recorded, and produced by me w Curtis Preston.
Speaker:If you need backup or Dr. Consulting content generation or expert witness
Speaker:work, check out backup central.com.
Speaker:You can also find links from my O'Reilly Books on the same website.
Speaker:Remember, this is an independent podcast and any opinions that
Speaker:you hear are those of the speaker and not necessarily an employer.
Speaker:Thanks for listening.