thinking sysadmin

• Your Usable Capacity May Vary – Chuck conducts a thought deployment comparing EMC, HP and NetApp usable space for a 120 disk Exchange deployment. And while he glosses over a couple perhaps non-minor issues (RAID-5 vs RAID-DP and whether EMC’s snapshots are adequately performant), he does hit one of NetApp’s weak spots dead on: Usable capacity, particularly on LUNs if you follow the 100% space reservation recommendation. (Being a NetApp admin these days, I can’t really comment on what he writes about HP – it’s been a long time since I’ve touched that StorageWorks stuff – and I can only repeat what I’ve heard others say about EMC.) More Chuck on this here.
• How to License Windows VMs in a Non Microsoft Virtual Environment: Why Windows Server 2008 Datacenter Edition may be the best choice. (Seen at blog.scottlowe.org.)
• Welcome – My friend, NetApp’s Vaughan Stewart: Chad Sakac highlights some flaws in NetApp’s TR-3697 (“Performance Report: Multiprotocol Performance Test of VMware® ESX 3.5 on NetApp Storage Systems”):
  

  What’s the scoop with:

  * 4K/8K IO size only
  * 2Gbps FC
  * You guys have “throughput/IOPs” shown only in relative, not in absolute.
  * 84 144GB drives with 16 VMs driving the IOMeter workloads with * 10GB of data each on them = 1.3% utilization (rounding up!).

• Performance Report: Multiprotocol Performance Test of VMware® ESX 3.5 on NetApp Storage Systems: A complementary whitepaper to VMware’s own work comparing Fibre Channel, iSCSI and NFS as storage protocols for VMware ESX. (Seen at blog.scottlowe.org.)

So I returned from a little five-day weekend to sunny Lake Chelan and the Columbia River to an RSS reader bursting at the seams with new posts. By far the best post was one later deleted:

• Amazon Elastic Block Store goes live! (Yeah, that link’s dead – like I said, it was later deleted.) The RightScale folks appear to have inadvertently published a draft (on 8/8, the day after I left town) of their blog post designed to coincide with the release of Amazon’s Elastic Block Store for EC2. They later deleted it, but Google Reader kindly cached the post for me. I won’t repeat anything in the post, nor would I bank on anything written there – would you gamble anything important on a retracted post about a not-yet-released product? I will add one comment: Will EBS attract attention of the lawsuit kind from NetApp? (I mean that comment only partially in jest – and you’d probably have to have seen the original post to know what I’m talking about.)

It’s summer, apparently everyone is on vacation, but, quietly:

• NetApp releases Data ONTAP 7.3 GA!!! Note that it’s a GA, not GD release; release notes are on NOW. (Seen at blog.scottlowe.org.)

Update: For ONTAP 7.3.1 and later, this post is now out-of-date.

It’s been a while since I posted about my unhappiness with NetApp’s FAS2020. And while we’ve replaced our 2020 with a 2050, I still get a lot of traffic to those pages, and a few emailed questions from prospective or new 2020 owners asking about the so-called 8TB limit. Here’s a summary of what I know:
Read the rest of this entry »

• Flash Forward – Jay Kidd, CTO of NetApp blogs that “NetApp is in the process of certifying enterprise-grade SSDs that you can use in our existing storage shelves.” No dates or pricing announced yet, of course, but he does make an excellent point about SSDs in storage arrays: “For the next few years, you won’t be using a lot of flash capacity in your systems, not just because of the costs. At 10x or more the IOP rate of hard disks, it only takes a small number of SSDs in disk slots to saturate the performance of the array controller. It’s like trying to fly a model airplane in your living room – you’ll run into a system performance wall long before you hit capacity limits. This is another reason that flash as cache is economically efficient – it puts the necessarily small amount of very fast storage at a point in the architecture where you can best exploit the performance.” Not unlike how Sun suggests using SSDs with ZFS. (Seen at Blocks and Files.)

There’s nothing like a long summer weekend followed by an on-site consultant to keep you from updating your blog. But on the bright side, I didn’t have to link to the notebook SSDs are dead – no they’re not kerfluffle.

• NetApp finds NAS could mean ‘never accessed storage’ – “According to a USENIX presentation, 90% of data on NetApp’s networked storage systems was untouched over a 3-month period, raising the issue of whether it would be better placed on cheaper storage.” I would find some irony in that cheaper storage being tape.
• zfs un-benchmarking – “Our rationale for testing was to finally get some numbers that we can provide to users/customers about real zfs performance. There is a huge amount of (largely uncontested) information (emanating mainly from Sun and its agents) that zfs is a very fast file system. We want to test this, on real, live hardware, and report. Well, we can’t do the latter due to Sun’s licensing, but we did do the former. Paraphrasing Mark Twain: ‘Rumors of zfs’s performance have been greatly exaggerated.’” When Joe Landman blogs about performance, I take what he has to say seriously, but given the stability problems he notes, I wonder if – as he suggests – that driver issues are a factor here, and we’re not seeing a generic ZFS issue. (Seen at InsideHPC.)
• Self-protecting archive for SharePoint – “A new archiving product from BridgeHead Software automatically moves older, infrequently-accessed SharePoint items to cheaper archive media and cuts down the SharePoint backup burden.” HSM for SharePoint, apparently? Sounds interesting.
• Since NFSv4 is Stateful It Must Be Less Robust, Right? – “The short answer is no.” Interesting summary of how locking works under NFSv4; although I haven’t used NFSv4, this sounds like a massive improvement over previous versions – can I get the time that I spent debugging locking problems on Linux NFS servers back now?
• Storage Opens Up – Sun releases new JBODs and upgrades Thumper’s hardware. Given that I heard rumors of the Thumper expansion shelves (J4500) maybe a year ago, I’m surprised it took them so long to come out. And is it just me, or do the J4200 and J4400 look a little like someone else’s boxes rebranded?

• The Hitz report – Robin Harris at StorageMojo on the Sun-NetApp lawsuit:
  

  NetApp’s biggest misperception is that WAFL is somehow central to the success they are enjoying today. That was true about 10 years ago. Guys, your average F500 CIO today could care less about WAFL.

  NetApp is growing because they offer a compelling value proposition of quality products, relevant services and worldwide support. WAFL certainly supports that, but as NetApp execs note much of their recent success is due to the integration software that NetApp now offers.

  WAFL is a small piece of the picture. Sun could copy it line for line and still not have a quarter of what NetApp offers.

  NetApp faces challenges. Storage commoditization threatens all vendors traditional 60% gross margins. The GX integration is problematic and the bottom line benefit uncertain. EMC’s move into cloud file services is a clever flanking strategy.

  An interesting opinion summed up nicely, I think.

• Saving and Restoring ZFS Snapshots to and from Amazon S3 – A ZFS to S3 workaround for the lack of persistent storage on EC2.

• Red Hat adopts KVM: what happens to Xen now? – I work in a VMware ESX shop right now (other than all those Solaris Zones and FreeBSD Jails and OpenVZ VEs, that is) – no Xen or KVM. However, given the serious pain in the butt that timekeeping is in Linux guests on ESX, I’ve been sorely tempted to look at running Xen for some Linux virtuals under CentOS 5, in the hopes that this isn’t a problem there. Guess I’ll hold off on that now. (Yeah, I’ve read all the docs, and Linux time sync generally sorta kinda usually works until it doesn’t – it just shouldn’t be that much of a flail.)
• 10 Gigabit Ethernet and VMware – A Match Made in Heaven – Lengthy and interesting article on 10GbE, VMware, consolidation and datacenter Ethernet – dismissive of Infiniband’s chances of becoming the One True Network Fabric.
• Blocks and Files: Between a server or storage array place – More commentary on Chuck’s commentary on HP’s flash announcement. Quote: “Another aspect of this is that a flash SSD cache for a servers needs to plug in to the server’s bus and the supplier doesn’t have to worry about getting a Fibre Channel interface onto flash SSDs which is needed to plug them into existing Fibre Channel slots in a storage array. STEC has an effective monopoly on this (with EMC having its own mini-monopoly because of its exclusivity deal with STEC which ends in a few months) until Emulex’ SSD-tweaked SATA-to-FC bridge chip becomes available at the end of the year. ” Which is probably why NetApp recently announced this instead of flash drives.

There’s been a lot of noise from the storage industry about flash recently – in particular, noise from EMC and Sun, both of whom recently announced storage products using flash, EMC in January and Sun earlier this month. Below are my thoughts on what EMC and Sun are doing, as well as what NetApp might do. Since I see a fair amount of visitors from all three companies here, if I’ve got something about your employer wrong, please correct me in the comments.
Read the rest of this entry »