Jan 13, 2020

Notes from the field: Implementing Storage Spaces Direct (S2D) 2019 + Lenovo + WSLab: 1.Hardware consideration

Hardware consideration:

I am deploying a disaggregated S2D scenario, consisting of 3x clusters each with 3 nodes.
  • 2x Compute Clusters (one with a lot of CPU cores the other with high-frequency CPU), each node:
    • ThinkSystem SR630 2.5" Chassis with 8 Bays
    • 2x Intel Xeon Gold 6244 8C 150W 3.6GHz Processor/
    • 24x ThinkSystem 64GB TruDDR4 2933MHz (2Rx4 1.2V) RDIMM
    • 1x ThinkSystem M.2 with Mirroring Enablement Kit
    • 2x ThinkSystem M.2 5100 240GB SATA 6Gbps Non-Hot Swap SSD
    • 2x Mellanox ConnectX-4 Lx 10/25GbE SFP28 2-port PCIe Ethernet Adapter
    • 2x ThinkSystem 750W (230/115V) Platinum Hot-Swap Power Supply
    • 1x ThinkSystem 1Gb 2-port RJ45 LOM
    • 1x ThinkSystem XClarity Controller Standard to Enterprise Upgrade
  • 1x S2D Cluster, each node
    • ThinkAgile MX Certified Node - All Flash
    • 2x Intel Xeon Silver 4210 10C 85W 2.2GHz Processor
    • 12x ThinkSystem 32GB TruDDR4 2666 MHz (2Rx4 1.2V) RDIMM
    • 3x ThinkSystem 430-8i SAS/SATA 12Gb HBA
    • 16x ThinkSystem 2.5" Intel S4510 3.84TB Entry SATA 6Gb Hot Swap SSD
    • 4x ThinkSystem U.2 Intel P4610 1.6TB Mainstream NVMe PCIe3.0 x4 Hot Swap SSD
    • 1x Mellanox ConnectX-4 Lx 10/25GbE SFP28 2-port PCIe Ethernet Adapter
    • 1x ThinkSystem 1Gb 2-port RJ45 LOM
    • 2x ThinkSystem 1100W (230V/115V) Platinum Hot-Swap Power Supply
    • 1x ThinkSystem M.2 with Mirroring Enablement Kit
    • 2x ThinkSystem M.2 5100 480GB SATA 6Gbps Non-Hot Swap SSD
    • 1x ThinkSystem XClarity Controller Standard to Enterprise Upgrade
  • Networking
    • 2x Lenovo NE2572, each:
      • 48x SFP28/SFP+ ports (25Gbit/s)
      • 6x QSFP28/QSFP+ ports (100Gbit/s)
  • Service Server
    • ThinkSystem SR630 2.5" Chassis with 8 Bays
    • 1x Intel Xeon Silver 4208 8C 85W 2.1GHz Processor
    • 4x ThinkSystem 32GB TruDDR4 2933MHz (2Rx4 1.2V) RDIMM
    • 1x ThinkSystem RAID 930-8i 2GB Flash PCIe 12Gb Adapter
    • 2x ThinkSystem 2.5" 5200 1.92TB Mainstream SATA 6Gb Hot Swap SSD
    • ThinkSystem M.2 with Mirroring Enablement Kit
    • 2x ThinkSystem M.2 5100 240GB SATA 6Gbps Non-Hot Swap SSD
    • ThinkSystem 1Gb 4-port RJ45 LOM
    • 2x ThinkSystem 750W (230/115V) Platinum Hot-Swap Power Supply
Notes:


Notes from the field: Implementing Storage Spaces Direct (S2D) 2019 + Lenovo + WSLab

As you may or may not already know the documentation for Storage Spaces Direct is just sad. While one may argue it's simple so that everyone can do that, it's missing so many details so in fact there is a high probability that if you follow it you will implement it wrong :-)

In the following blog posts, I will try to sum up the experience of deploying disaggregated Hyper-V/S2D cluster. Most of the scripts and information are taken from the https://github.com/microsoft/WSLab project which is just an amazing collection of information for S2D deployments.

  1. Hardware consideration
  2. Setting up BMC/IMM
  3. Bare-metal deployment with XClarity Administrator and Virtual Machine Manager 2019 
  4. Networking
  5. Performance testing