When to back up

What I really want is for my online backup systems to be smart. If I’m off of my home networks, I should be allowed to say, “Don’t back up again until I get home,” rather than having to look at the three services I now use and say, “Pause for N minutes.” I forgot this until just now, and I’ve been soaking the meager transfer capacity of the Cafe 153 network with my backups.

Why three services? I’m turning my knowledge of backups into a micro-business, and that means that I need to test all of the big players. Fun times.

How I Backup My Macs: December 2013

Oh no, not this shit again.

DAMN RIGHT I’M GOING HERE AGAIN.  Why?

  1. Backups have saved my bacon yet again.
  2. I have something new in the system.
  3. You got new stuff for Christmas, and now is the time to start backing it up so you can quit worrying about it.
  4. A pretty young woman and I had a conversation about this at the Apple Store earlier today, and she wanted to know more about it. This is published because of that conversation; I’ve been hacking away at it for a while now.

So hi, nice young lady whose name I didn’t get!  I feel like an idiot right now.

Let me get a little bit of this out of the way: I have written about backups in 2009 and 2011.  In the first one, I talk about a belt-and-suspenders approach; in the second, I talk about belt-and-suspenders supported by close air support.  Now I have belt, suspenders, close air support, and Navy SEALs.  Or something — I don’t know, I’m an Air Force brat, and we don’t know crap about the real military.  [Sorry, Dad.]

I have also written about backups saving by bacon many times.  There’s the time in 2011 when my 24″ iMac needed a new logic board and I needed to be getting ready to start a new job.  There’s the time this past October when my 27″ iMac started doing Bad Things(TM) and had volumes failing; the resolution for that one comes today that 1) my Time Machine volume was just fine after all and 2) Repair Disk worked on the boot volume when booted into Recovery Mode (Cmd-R during start, if you don’t know.  And then there’s the time this December I had to format my MacBook Air’s boot volume from my booted clone.  All three of these problems would’ve wiped me out for quite some time, and there was a significant risk of data loss to my original data.  Did I lose data?  Nope.

Oh, and then there was the time that I was sitting in the floor of my downstairs bathroom on April 27th, 2011.  With tornadoes all around me, I said aloud, “Hey, at least my data is in a data center far from Huntsville.”  All of my data would be safe: photos, music, you have it.  I could rebuild my computers from the last known safe state.  It would’ve worked: the cavalry would’ve come over the hill.

So, back up your shit.  Here’s how.

I use what’s called a 4-2-2 system: 4 copies of my data, 2 of which are local, 2 of which are offsite.

  1. SuperDuper!The first local copy is a cloned backup of my boot volume via Shirt Pocket’s SuperDuper!  This gets me something that I can boot from at any time.  This was prominently featured in 2011 and December 2013.
  2. Look at all those classes that I've taken in the last six semesters!
    Look at all those classes that I’ve taken in the last six semesters!
    The second local copy is Time Machine.  I’ve written before that Time Machine Just Works, but that’s really not true.  Time Machine has lots of problems, and I wouldn’t trust it by itself.  But for A) a second local copy that I don’t have to be primarily reliant upon and B) the value that it provides in being incremental backup for file retrieval, etc., it has value.
  3. CrashPlanOne of the offsite copies is with CrashPlan+.  CrashPlan has an article on 3-2-1 systems and how CrashPlan can be a part of that.  I have been using this since 2011, and it very nearly saved my bacon when lightning struck my house.  I’m very thankful that my uninterruptible power supplies were able to handle the surge.  This would’ve also been handy during the April 27th outbreak.
  4. ArqI’ve added Amazon Glacier-powered backups that are managed by Arq.  The Haystack Software team has a fun blog post about coming up with a good backup strategy, and I suggest that you read it in addition to what I have presented here.  Why Amazon Glacier?  CrashPlan is definitely aimed at the consumer market and is priced and provisioned accordingly.  Amazon Glacier is professional grade.  Also, I trust two providers over one provider.

Seeding an online backup with either one of those services is going to take a long time.  Backing up 28GB off of my Macbook Air took the better part of a week.  It took a couple of weeks for the main boot volume on my iMac to seed, and I was uploading the first (of three) Drobo volumes when my iMac started thrashing around on the floor like an angry toddler.

Since I mentioned the Air, I want to make a point: I use Time Machine (to a Time Capsule on my network, a replacement for one that got zapped a while back) for incremental backups as well as CrashPlan and now Arq.  For some time, I said that I didn’t need cloned backup of the Air.  For one, it’s a problem on my end, because I would have to dock a hard drive1 to make it work.  SuperDuper! will backup-on-mount, meaning that it will work … when I remember to connect the drive.  I am the weak link there, because I forget to back up even though I know that I should.  However, I have a reminder in my GTD setup2 that gets me a record of when I’ve last backed up as well as a nudge to do so. I’ve generally stayed current, but not always.

So what do I recommend?

  1. First off, I recommend all four backup solutions. The two local backup solutions have different features and restoration times; the two offline backup solutions are both good, and I’ll leave it to you to pick. But I really do recommend having one local and one offsite at a minimum, and if you’re going to pick three, have both local copies. Restoring from an online backup is very time-intensive, especially if you live in a bandwidth backwater like North Alabama.3
  2. I recognize that not everyone had the resources that I had to bring to bear when I got started with this.  I recommend a cloned drive that is automated or well-maintained (but preferably the former).  You do not want to be thinking the following when you have a computer emergency: “So when was the last time that I backed up to this drive?”
  3. For desktops, you have no excuse to not have a clone attached at all times.  For laptops, you do, but consider this as well: don’t carry your clone with you everywhere.  Leave it at home.  A solid scenario for using that clone is, “Someone stole my laptop and I need to get back up and running with this replacement laptop paid for with insurance money!”  Do you feel smarter?  You should.
  4. If you have just two backups, I recommend a clone over Time Machine.  TM is convenient but can be flaky.  If I’m concerned with backup first, I’m going offsite.  Also, if you’re going to have just two copies of your data, one of them should be off-site.
  5. I recommend CrashPlan over Glacier, because most of you aren’t going to need/want something in Glacier’s sphere.  Those who do were probably criticizing me for this choice, but they probably weren’t reading this in the first place other than purely to criticize me.  Quit trying to be John Siracusa.  You are probably not John Siracusa; if you are, John, this is crazy: here’s my number4, call me maybe?

I’ve got the comment box below for comments. I’ll also be posting this to Facebook and Twitter per uzhe, so if you comment there, I’ll see it, too. You can also email me at gfmorris@gfmorris.net, and John, my number is in that footnote.5


  1. I have a spare on the floor in my office waiting for this to happen.  It’s been there for a few months. 

  2. I will write about that at some point, I promise. 

  3. Seriously, we put men on the moon and then get treated like this? “Come on!” —GOB 

  4. 256-527-8152 

  5. Seriously, my number is so easy to find. 

Six Years Later, LOLTrek Still Amuses Me

About this time six years ago, I got a matter-of-fact email from Stephen:

Geof,
Ten minutes ago, I posted a lolcat version of The Trouble With
Tribbles.
Just now, I got a link from boingboing.
Stephen

wehastrouble02

My only response was: “I’m doubling your [hosting] fees.”  Four minutes later, Stephen told me that Misty might be in labor.  It was a bit of a day.

I was mainly excited that my friends would be bringing another awesome kid into the world (and Liza is indeed awesome), but I was also worried about my server going into massive heat death.  Single server, four CPUs, moderate amount of RAM, SCSI hard drives, Web and SQL stored on the same drives.  You can imagine how that went.

I only came across this anniversary the other day when one of my choir kids posted the following:

389085_184703098349230_548082145_n

I responded with a link to LOLTrek, and when I did so, I noticed the date stamp.  I thought I’d bring it up, because it still makes me laugh.  The funniest thing for me are the commercials.

My friend Stephen is funny, smart, loving, and supporting.  But mostly funny.  I was happy to nod to LOLTrek with a Whiskerino shot that, disappointingly, no one seemed to care about.

Go enjoy LOLTrek if you’ve never seen it, and remember that, six years ago, lolcats were a new thing on the Internets.  [Note: I’m really glad that Stephen has held firm to never trying to take another bite at the apple.]

Driverless Cars and Routing Around Damage

Dan talks a lot about his technological assumptions.  I generally agree, but:

Take, for instance, a self-driving car. One of the assumptions we have is that allowing computers to drive cars will allow a lot more cars to be on the road, since computers are better drivers than humans (a fact I don’t want to dispute). But imagine we do fit 30% more cars on the road. Imagine a traffic disruption. There will surely be far fewer traffic disruptions because computers are better drivers than humans. But when they do occur, they will cause massively more congestion than now, because the system will have been optimised that much further.

A driverless car will be best implemented when it communicates with its peers in a networked way that mimics the old CB network band: “Get off at Exit 351 and take US 31 north; I-65 is a parking lot.”  But there’s fragility, of course: not all cars will have humans out of the loop, not everyone will have a car that communicates in the same way, there will be network outages, etc.  That’s why peer-to-peer on open technologies will make that work.

See, my technological bias is showing.  But I will also admit my own bias against driverless cars: I’d rather drive, and if not, I’d rather take mass transit to have it be worthwhile.

‘Cause Waking Up Is Hard to Do

This is a nerdy post. I’m telling you that before you get sucked in. In short, I use my computer, which resides in my office, to send a continuous alarm to a set of speakers in my bedroom. I do this with a couple of AppleScripts and a cronjob. If what I said made you wonder if I was speaking a second language, this is not the post for you. However, as some of you have expressed a little bit of wonder at my Rube Goldberg alarm clock, I decided that I’d write it up. Here goes!

Why All the Trouble?

I’m a night owl. My most productive hours are 2200-0200, as shown by the timestamp on this post. I sleep better in the morning after the sun has come up than I do most of the time at night. My best sleep hours start at 0400. I have more than a year’s worth of data to prove this, as I’ve been tracking my sleep with Sleep Cycle alarm clock for more than two years. My ideal work schedule would be 1200-2100, as I could sleep in until 1030 or so.

The world does not live on my schedule.

My mother can tell you that waking me up is not easy. [I told her about this setup and she laughed for like 10 seconds. “Does it work? I bet it doesn’t work.” THANKS, MOM.] When I am at their house, she will stand at the door and repeat my name for a minute or two before I sleepily wonder just what in tarnation is going on. My MSMS roommates will tell you that I can get out of bed, walk across the room, turn the alarm off, get back in bed, and go right back to sleep. I can tell you that I’ve moved my alarm clock any number of times. I used to re-arrange my bedroom furniture every sixth months to fight this.

Yet what I’m doing right now is working. I explained it a couple of weeks ago on Facebook, and they were stunned to see the process. As such, I feel that I owe you an explanation.

What’s Happening Here?

I am piping audio around my house. This is starting to come into vogue with hardware and software solutions that replace things like Sonus systems, setups that run into the high hundreds and low thousands of dollars. This isn’t necessary anymore, especially if you use a Mac.

Equipment needed:

  • Any old Mac
  • Airport Express (AE)
  • Stereo speakers, self-powered, that accept 1/8″ input.

To make this work, connect the speakers to the AE. The AE serves as an AirPlay point that can be used for all sorts of things, including this alarm system. I pipe all sorts of audio to my bedroom, mainly a Web stream of BBC World Service and radio captured on my radioSHARK. [I’ll talk about these later, especially if there’s interest. The AppleScript that I have for the BBCWS stream is kinda fun.]

Software needed

Airfoil has a Windows version, too, but it’s still aimed at AirPlay. You’ll have to figure out how to automate Windows on your own, though.

Let’s Go, Baby

Here’s the chain of events:

  1. The night before, I use Audacity record an M4A of what I want to hear the next morning when I am waking up. I Export this file to ~/Documents/Alarms/. I name the file YYYYMMDD of the date I’ll be waking up. I found out tonight that using the same datestamp twice will cause the next step to fail.
  2. I fire off meridian-alarms.scpt using Launchbar. [If you’re trying to do this and haven’t been using Launchbar or Quicksilver: WTF, yo.] This 1) quits Meridian then 2) moves the file from ~/Documents/Alarms/ to ~/Library/Sounds/ and 3) re-activates Meridian. The quit/restart option is required for Meridian to know that the new alarm exists. [I’d like to thank the dev for telling me how to do this.] The only hitch is that you do have to click on a dialog box to quit.
  3. Go into the preferences for the Alarm and set the new wakeup sound to the file that you’ve just made. Failure to do this gets you the previous day’s alarm. Make sure that the Continuous option is checked, or you’ll hear yourself for 12 seconds and nevermore.
  4. Set up a fire-off time with Cronnix to run meridian-pipe.scpt. This will set you up for piped audio from Meridian to those speakers at alarm time.
  5. Go the fuck to sleep.
  6. Come wakey time, your cronjob will fire. Airfoil will be routing sound from Meridian to your bedroom speakers. Once your alarm fires, you’ll be hearing yourself from the night before.

Here are some screenshots that may help you understand what’s happening:

You click the highlighted line to get the alarm preference set.
Use the Play a Sound: drop-down to move to your new alarm sound.
Make sure to set times in Cronnix that correspond with the times that Meridian is set to send an alarm.

To kill the alarm, you’re going to have to get out of bed, walk out of your bedroom, find the computer in whatever room you keep, sit down, and turn the alarm off. I find that the combination of a) hearing why I need to be awake and b) having to do a lot of work to stay asleep makes things work for me.

How to Make This Work for You

I generalized the scripts, which have things like YOUR_HD, YOUR_USERNAME, and YOUR_AE in them. Please change those values to appropriate ones for you. Spaces are okay: my HDD is “HAL 9000”, which plays a part in the weird world of how I name my computers and attached hardware. [That naming system is now out of date.]

Is this overly nerdy? You bet. If one person uses this craziness, I’ll be happy.

The Great CD Preservation Project, c. 2012

In one form or another, I’ve had an eye towards preserving my CD collection long term since 2003.1 Back then, my process was pretty complicated; now, it’s fairly simple. The principle is pretty simple: get the music off of the CDs while preserving their package and state. I’m okay with CDs only being played a handful of times, as I’m more interested in the packaging and getting all the bits.

Here’s the process:

  1. Scan the release into Delicious Library. This works for purchased CDs only, of course. Concert recordings don’t go in here, as I didn’t pay to take ownership of them. I put things into DL so I can loan them out and know who has what. Also, I have this as a record for insurance purposes.
  2. Check MusicBrainz for the release. Every so often, I have to go and add the release, but I’m an auto-editor.
  3. Rip the CD in Apple Lossless. I’d use FLAC for maximum interoperability, but Apple only uses their lossless format for iTunes, and as I use iTunes Match to move music onto my iDevices, I knuckle under and use their format. I don’t see it going away anytime soon, so I don’t feel like I’m investing time ripping into a format that I won’t use. When I compare this to the 3-4 different lossy encodings I used from 2003-2011, it’s not a big concern.2 Now that I have two large HDD arrays, I really don’t worry about storage space.
  4. Run the rip/encode through MusicBrainz’s Picard tagger.
  5. Add in the highest-quality cover art I can find. I really should be making my own with the scanner I have, but I’m lame.

I’d put in lyrics—and I care about that in a theoretical way—but there’s little practical value in doing so.

That’s where I’m at these days. I don’t see this methodology changing much given that I’m using a stable lossless codec.


  1. Why am I writing this update? I referenced something the other day that referenced the original post. Holy nine years, Batman. 

  2. That I kept moving the target was a big part of the problem. 

Giving Music Away Is Great; Now Let’s Tackle Findability

Derek Webb wrote on Wednesday of the benefits of giving music away. He is one of the principals at NoiseTrade, a service that does just that, so you would expect that he believes in the concept. Here is a choice quote from the link, which you really should read if you care about the business of music:

If someone buys my music on iTunes, Amazon, or in a record store (remember those?), let alone streams it on Spotify, it’s all short-term money. That might be the last interaction I have with that particular fan. But if I give that fan the same record for free in exchange for a connection (an e-mail and a zip code), I can make that same money, if not double or triple that amount, over time. And “over time” is key, since the ultimate career success is sustainability. Longevity. See, the reality is that out of a $10 iTunes album sale, I probably net around a dollar. So if I give that record away, and as a result am able to get that fan out to a concert (I can use their zip code to specifically promote my shows in their area), I make approximately $10 back, and twice that if they visit the merch table. I can sell them an older/newer album and make approximately $10 back. The point is, if I can find some organic way to creatively engage them in a paid follow-up transaction, I increase my revenue 10 times on any one of these interactions.

Continue reading Giving Music Away Is Great; Now Let’s Tackle Findability

How to Hang Mpix Standouts

I’m a fan of Mpix‘s photographic products. I’ve gotten good results with every single order from them, and the prices are within what I would expect to pay. For display purposes, I really like the standout: your photographic print mounted on gatorfoam, banded as you like, ready to hang.

I clumsily knocked one of my standouts off the wall the other day, ripping the hanger out from the wall in the process. I’ve got to re-hang it, so it made me think of what it takes to hang them. I’ve learned this by trial and error, but you don’t have to do that. Here are the steps you’ll want to use:

  1. Measure the standout. In my experience, all of the standouts are short in both dimensions, just like dimensional lumber. The 11″x14″ shown above is short by 1/8″ in both directions. This will let you set up an envelope.
  2. Regardless of size, the edges of the hangar holes are 2″ in from the corner. Note that this is not the hole center but the tangential edges of the hole.
  3. The hangar holes are 0.5″ in diameter. You can do the math and say, “So that makes the hole center 2.25″ in from each edge, right?” Indeed it does: circle gets the square!
  4. From there, it’s like any other picture-hanging extravaganza: find a level, determine your placement, mark a level line, mark your holes.
  5. When it comes to hanging, don’t use a traditional nail or picture hanger. I’ve had the best success using push pins. Standouts are really light, even both of the 24″x30″ ones I’ve bought and hung. Four push pins are going to do a great job. You can also do some tweaks to get the fit that you want by skewing them toward or away the corners of the standout. Because the head of a push pin is closer to 0.25″ in diameter, there is some play in the placement.

Hopefully this helps you. If you’re really generous and/or like Andrew Osenga, help a brother out and buy an 11″x14″ standout like what you see above.

Further Machine Naming Foofiness

This time last year, I admitted to the goofy naming scheme related to my iMac. Two things have changed since then: I don’t have a Macbook anymore after buying an iPad, and I don’t have three volumes on my Drobo anymore. I was having issues with the Drobo getting ejected at random, so I dropped the number of volumes to two in the hopes of fixing it. It didn’t, but the issue was a bad FireWire device in the chain.

I had the iPad a while before I named it anything, and I gave it the name Europa. In mythology, Europa was a Phoenician woman abducted by Zeus. The continent is purportedly named after her. Given that the iPad encourages travel and freedom, this made sense.

I hadn’t named any iPhone I had since the original. I ended up naming the phone after Callisto, the last of the four Gallilean moons I hadn’t used. Callisto was a nymph turned into a bear and set among the stars. It’s only just now that I thought that it might be CALListo.

The newest named device is a 2nd-generation AppleTV. I owned the first, and it was very clunky. Enough people I trust had spoken well of it, so I used the Apple giftcard my TBE colleagues got me when I left and bought one. I’m so taken with it that I’m very close to canceling cable and going with streaming and downloaded media. As such, it deserved naming. It’s Amalthea, which would be AppleTV if you were drunk and squinting. Amalthea was also the most oft-mentioned foster mother of Zeus. If my entire data structure here in these two computers and the attached devices is Zeus, then Amalthea should be a good mother.

Speaking of the entire data store: I’ve had all this storage hardware since early 2009. I’ve had two drives fail, one in each Drobo. In both cases, I had audible warnings, and in one, I had a ready spare. I’m still very much growing into the data, and I don’t think I’ll need to think about bigger drives until mid-2012. It’s great to be able to have all this data. Still, back your shit up.

On Proper Context for Links

I believe that links in hypertext should be done in a way that provides proper context for the link. The use of “click here” is abominable to me, because you’re getting zero context for the link. If you need proof of this, Google “click here”. At the time of this posting, the top results are two links for free players from Adobe, a digital marketing agency with the domain clickhere.com, the download page for Apple’s QuickTime application, and an opt-out page for the Network Advising Initiative.

Stop using “click here”. Use real language to provide context. Your readers are not mindless idiots.

Tonight, I came across an excellent post from Anil Dash about Apple’s secrecy. I like the piece largely because he gives credit where due when previously giving grief. I don’t see many people making these kinds of follow-up posts.

I did not like the use of context in the fourth paragraph:

Apple has published an industry-leading supplier responsibility document, offering insights into the environment at Foxconn and expressing a commitment to ensuring humane and healthy conditions. And this document was clearly in progress before the publication of Joel Johnson‘s excellent Wired cover story about the topic (though admittedly, after significant coverage from outlets such as the New York Times), so it seems the company has been proactive about the issue even before receiving its most pointed media criticism.

When I came across that first link, I was expecting it to be some third-party organization [JD Power, maybe] praising the document, comparing it to both suppliers of other consumer electronic devices and possibly to other fields. [My experiences as an aerospace contractor, specifically one that was a Silver-level Boeing Approved Vendor, inform this idea.]] If the link had instead been “Apple has published an industry-leading supplier responsibility document,” I would have had better context for the link.

I’d like to look at the other two links in that paragraph. The Joel Johnson one is canonical and spot-on, as a reader unfamiliar with Joel would perhaps want to know a bit about him to assign some level of credibility to the piece he wrote. The link “Wired cover story” works in the context of the paragraph: you know “about this topic”, but I think Anil has to be writing as much for Google as for his readers. I would have written it as “excellent Wired cover story about Apple’s PR problems with outsourced manufacturing“, or something close to that. [Yes, I italicized Wired. I even debated it being WIRED. I’m also the same person that calls it “Yahoo!” and “Wal*mart”, although the latter has changed.]

I would write “Apple SVP Phil Schiller’s on-the-record email to John Gruber about app store rejections“, rather than just “email to John Gruber”. I would also write “Apple offered clear, publicly-accessible published guidelines by which applications are evaluated for inclusion in the App Store.” In this last case, I’d really hope that someone is keeping a track on the shifts in these guidelines over time. They’re not all bad, but they’re not all good, either.

Anil Dash is certainly not the only person with whom I’d quibble over the context I’d like to see in links, but I do believe him to be the thoughtful sort of fellow who would see such a post as constructive criticism. I hope that he’ll see this and have a chance to consider it. I’d certainly welcome his response for why he wrote as he did if he thinks I’m way off base. I hope that he’ll find time to do so considering that he is a new father and probably isn’t sleeping much.

[Addendum: WordPress 3.1 appears to have broken WP-Footnotes. You are once again stuck with my mental asides in posts. I am striving to not have as many of these, but I am not yet ready to give them up. I did not give writing footnotes for Lent.]