NAS Performance - SPEC SFS 2014

Evaluation of the system as a storage node on the network can be done using multiple approaches. As a simple NAS accessed from a single client, Intel NASPT would work very well. There are other artificial benchmarking programs such as IOMeter and IOZone (all of which are used in our dedicated NAS reviews). However, when it comes to file servers used in business scenarios, business metrics make more sense. For example, a database administrator might wonder how many simultaneous databases could be sustained on a given machine? An administrator in a software company might want to know how many simultaneous software builds could be processed on the machine if it were to be used as a storage node. SPEC SFS 2014 allows us to evaluate systems based on such business metrics.

Prior to discussing about the various business scenarios, let us take a look at the test setup (including details of the testbed and how the file server itself was configured.

Solution Under Test Bill of Materials

  • ASRock Rack C2750D4I in a U-NAS NSC-800 (8GB RAM)
  • AnandTech NAS Testbed (64GB RAM, 1GB to each member VM
  • Netgear GSM7352S Ethernet Switch

Component Software

  • ASRock Rack C2750D4I system running Windows Storage Server 2012 R2
  • Load generators running on AnandTech NAS Testbed (10x Windows 7 VMs in a Windows Server 2008 R2 Hyper-V Installation)

Storage and File-Systems

  • ASRock Rack C2750D4I - 8x OCZ Vector 128GB SSDs : Storage Spaces with Parity Space
  • AnandTech NAS Testbed - NTFS partitions created at OS install time on OCZ Vertex 4 64GB SSDs

Transport Configuration

  • ASRock Rack C2750D4I - 2x 1GbE LAN Ports in 802.11ad LACP to Netgear GSM7352S
  • AnandTech NAS Testbed - 11x 1GbE LAN Ports to Netgear GSM7352S (1x management, 1x to each of 10 VMs)
  • All SMB benchmark traffic flowed through the Netgear GSM7352S network switch

The four business metrics that we will be looking at today include:

  • Database
  • Software Build
  • Video Data Acquisition (VDA)
  • Virtual Desktop Infrastructure (VDI)

The database and software build categories are self-explanatory. The VDA profile refers to usage of a storage node as a recording target for streaming video (usually from IP cameras). The VDI profile refers to the number of virtual desktops / virtual machines that can be supported using the file server as a storage node for the virtualization infrastructure.

Database

The following graphs show the requested and achieved op rates for the database workload. Note that beyond four databases, the gap between them is more than 10% - this automatically means that the storage system is unable to support more than four databases concurrently. In all the workloads, it is the latency which decides the suitability and not the bandwidth available.

Database Workload - Op Rates

Database Workload - Latency and Bandwidth

The SPEC SFS 2014 benchmark also provides a summary file for each workload which contains data additional to whatever is graphed above. The summary for the database workload is available here

Software Build

A similar analysis for the software build benchmark profile shows that the system is able to support up to 10 builds without any problems.

Software Build Workload - Op Rates

Software Build Workload - Latency and Bandwidth

The report summary for the software build workload is available here

Video Data Acquisition

Video data acquisition for up to 10 streams is easily handled by our DIY solution.

VDA Workload - Op Rates

VDA Workload - Latency and Bandwidth

The report summary for the VDA workload is available here

Virtual Desktop Infrastructure

VDI presents a very sorry story. The op rate achieved is not even close to the required rate, and the solution seems incapable of supporting any virtualization infrastructure.

VDI Workload - Op Rates

VDI Workload - Latency and Bandwidth

The report summary for the VDI workload is available here

Performance Metrics - Storage Subsystem Miscellaneous Aspects and Concluding Remarks
Comments Locked

48 Comments

View All Comments

  • ethebubbeth - Monday, August 10, 2015 - link

    Your proposed setup does not support ECC memory, which is essential for any sort of software RAID style configuration. The system in the article does. I would not want to run a NAS without ECC memory unless I were using a hardware RAID card with cache battery backup.
  • brbubba - Monday, August 10, 2015 - link

    This system is quite capable of running Plex transcoding, check the cpu benchmark scores. If you want even more power grab a E3C226D2I and throw in an i7.
  • HideOut - Monday, August 10, 2015 - link

    All this power an d still USB 2.0 ?
  • DanNeely - Monday, August 10, 2015 - link

    It's a 2013 SoC, so no native support on Intel's support. I'm not sure if ASRock deliberately decided not to support it; or just ran out of PCIe lanes. It looks like they should have a few still available but I might be missing something. The SoC has 16 total; 8 go to the PCIe slot, 2 go to sata controllers, 3 to lan controllers, the GPU is a single lane PCIe model. That leaves 2 lanes unaccounted for...
  • DanNeely - Monday, August 10, 2015 - link

    Also, it was never intended for use in consumer systems. USB3 primarily matters for backing a NAS to an external HD (or pulling files off of one); Avonton was intended for higher end business class NASes, that whether rackmount or standalone would be primarily accessed over the network.
  • brbubba - Monday, August 10, 2015 - link

    Glad to see more mainstream sites posting these types of reviews. I was seriously considering the U-NAS boxes, but they aren't exactly what I call mainstream and I have yet to see any US retailers stocking their products.
  • DanNeely - Monday, August 10, 2015 - link

    It appears you can order their cases direct from the manufacturer and pay in USD, so the lack of 3rd party resellers is not a major problem. For my location in the US northeast, they wanted $16.66 to ship the 4bay case. No indication of shipping time was given; so if they don't have a US distribution point they're either shipping slowboat or eating the cost of airmail.
  • Paul357 - Monday, August 10, 2015 - link

    A great system for a NAS/Plex Media server. Still though, I'd wait to see what Denverton brings to the table. If it even is announced this year....
  • bobbozzo - Monday, August 10, 2015 - link

    Hi,

    1. would like to have seen more discussion about the power supply quality and other possible choices; will most 1U PSUs work, or is cabling going to be a problem? Would an SFX PSU fit?

    2. I didn't notice any mention of noise levels.

    3. any idea why the VDI performance was poor?

    thanks!
  • mdw9604 - Tuesday, August 11, 2015 - link

    Would like to see an option for redundant power supplies, even it means a bigger chassis.

    I have a couple of Synology DS1813+ and like them, but my next NAS will need to be beefier and will want some enterprise features, so looking at ZFS, redundant power supplies & possibly an iLO/Drac /Remote Console Card, as it will be located in a data center.

    This one doesn't quite make the cut.

Log in

Don't have an account? Sign up now