Revision 9a66024627a028e6d7c22d8f84d10f2b092edf3c

R630 TrueNAS Build.md · 4.7 KiB · Markdown Raw

# Summary I have a Dell R630 with 128G RAM from David and 8x 4TB NVMe from Taylor. What does it take to turn this into a killer TrueNAS Server? This is referring to `SRV-55` inventory. # Goal - U.2 Expansion Kit to support 4x U.2 2.5" Drives - Uses 1 of the x16 PCIE slots and connects to existing backplane allowing 4x slots to be U.2 compatible - Can get M.2 to U.2 2.5" adapters to use my M.2 drives instead of expensive U.2 drives - Support for 8x M.2 NVMe Drives - 4x M.2 NVMe drives converted to U.2 2.5" Drives - 4x M.2 NVMe drives on a single PCIE bifurcated card - 8x 4TB drives in RAID10=16TB or RAID6=24TB or RAID5=28TB - 12Gbps External SAS HBA for External Disk Shelves - Use existing 6Gbps MD1220 shelf for 24x 2.5" Drives - New 12Gbps MD1420 shelf for 24x 2.5" Drives - Total of 48x 2.5" drives in external Daisy Chained shelves! - 25Gbps Network Daughter Card - Replace the 10G network daughter card with the 25G cards I already own # Concerns - Main concern is there will be no Intel Optane drives for a SLOG for the slower spindle disks - This means that the spinner pool should use ASYNC mode to prevent double writes - I will have to move data around in the new pools to ensure critical data is on NVMe with SYNC and non critical data is on spinners with ASYNC # PCI Slots The R630 10 drive edition has 3 PCIe 3.0 slots and requires both CPUs to be installed. 2x slots support full x16 speeds, and one slot supports x8 speeds. - Use the x8 slot for the External HBA - Use the x16 slot for the U.2 Expansion Kit - Use the x16 slot fo the M.2 4x NVMe card for 4x4x4x4x bifurcation support # Perc This `SRV-55` has the Perc H730 Mini which is ALREADY capable of HBA mode, so no IT mode cross flash is required! **Enable HBA Mode** 1. Turn on the server and press **F2** when prompted to enter System Setup. 2. Navigate to **Device Settings** and select your **Dell PERC H730 Mini**. 3. Go to **Controller Management** and verify your current mode is RAID. 4. Select **Advanced Controller Management**, then choose **Switch to HBA Mode**. 5. Confirm your selection, click OK, and reboot the server. # External SAS The older R620 TrueNAS server has a 6Gbps External SAS [[Production/Inventory/Components/LSI Logic 9200-8e SFF-8088/README]] which was flashed to IT mode. This card could work in the new R630, however if you want the newer 12gbps card that can be flashed to IT mode you would want this For your Dell PowerEdge R630, if you need an external 12Gbps SAS HBA for connecting to a disk shelf or tape drive, look for the **Dell 12Gbps External SAS HBA** (often called the Dell H830 or the OEM equivalent of the LSI 9300-8e). These cards run in IT/HBA mode natively out of the box and are a direct plug-and-play fit. Instead of trying to cross-flash a standard LSI 9300-8e, the easiest route is to use the dedicated **Dell 12Gbps SAS HBA (External)**. **Official Dell Part Numbers:** Look for PNs like `0T93GD`, `405-AAES` **Chipset:** Built on the robust **LSI SAS3008** controller. LSI's "IT Mode" (Initiator Target) and Dell's "HBA Mode" effectively accomplish the exact same goal! # U.2 Expansion Kit The R630 is capable of running 4x 2.5" U.2 NVME Drives in the last 4 drive bays, but you must buy the expansion kit which includes a PCIE card and the cabling. The backplane already has the 4 connectors on it ready for this expansion kit. This card does NOT require any IT mode flashing, as it still uses the Perc H730 Mini as the controller, which already works in HBA Mode (same as IT mode). To upgrade your Dell PowerEdge R630 to support U.2 NVMe drives, you need a specific hardware kit. It includes a PCIe extender/riser card and dedicated cables. This setup enables U.2 support on specific slots (usually up to 4 drives) in the server's 10-bay SFF chassis. Example: https://www.ebay.com/itm/173174252228 **PCIe Extender/Bridge Card:** Dell Part Number **GY1TD** (or 0GY1TD). **Cable Kit:** Dell Part Number **K9TVP** (also known as 1PDFM), which bridges the PCIe connection between the riser card and the drive backplane. # M.2 to U.2 Converstion You can also buy adapter card that allow you to use your M.2 NVMe sticks in the 2.5" U.2 form factor, like https://www.startech.com/en-us/hdd/u2m2e125 So I would buy 4x of these adapters, then use 4x M.2 NVMe drives as 2.5" drives! So combine 4x M.2 NVMe in U.2 bays + 4x M.2 on PCIe card gives 8x M.2 NVMe Drives total! # M.2 NVMe Drives Along with the 4x U.2 drives, you can add low profile PCIE cards that hold either 2x or 4x NVMe drives with bifurcation support. The 4x low profile cards that fit in the R630 are rare, but found this - https://www.reddit.com/r/homelab/comments/gfi4sk/adding_m2_to_a_dell_r630/ - https://www.gigabyte.com/Enterprise/Accessory/CMT4034-rev-1x-2x#ov

Summary

I have a Dell R630 with 128G RAM from David and 8x 4TB NVMe from Taylor. What does it take to turn this into a killer TrueNAS Server? This is referring to SRV-55 inventory.

Goal

U.2 Expansion Kit to support 4x U.2 2.5" Drives
- Uses 1 of the x16 PCIE slots and connects to existing backplane allowing 4x slots to be U.2 compatible
- Can get M.2 to U.2 2.5" adapters to use my M.2 drives instead of expensive U.2 drives
Support for 8x M.2 NVMe Drives
- 4x M.2 NVMe drives converted to U.2 2.5" Drives
- 4x M.2 NVMe drives on a single PCIE bifurcated card
- 8x 4TB drives in RAID10=16TB or RAID6=24TB or RAID5=28TB
12Gbps External SAS HBA for External Disk Shelves
- Use existing 6Gbps MD1220 shelf for 24x 2.5" Drives
- New 12Gbps MD1420 shelf for 24x 2.5" Drives
- Total of 48x 2.5" drives in external Daisy Chained shelves!
25Gbps Network Daughter Card
- Replace the 10G network daughter card with the 25G cards I already own

Concerns

Main concern is there will be no Intel Optane drives for a SLOG for the slower spindle disks
- This means that the spinner pool should use ASYNC mode to prevent double writes
- I will have to move data around in the new pools to ensure critical data is on NVMe with SYNC and non critical data is on spinners with ASYNC

PCI Slots

The R630 10 drive edition has 3 PCIe 3.0 slots and requires both CPUs to be installed. 2x slots support full x16 speeds, and one slot supports x8 speeds.

Use the x8 slot for the External HBA
Use the x16 slot for the U.2 Expansion Kit
Use the x16 slot fo the M.2 4x NVMe card for 4x4x4x4x bifurcation support

Perc

This SRV-55 has the Perc H730 Mini which is ALREADY capable of HBA mode, so no IT mode cross flash is required!

Enable HBA Mode

Turn on the server and press F2 when prompted to enter System Setup.
Navigate to Device Settings and select your Dell PERC H730 Mini.
Go to Controller Management and verify your current mode is RAID.
Select Advanced Controller Management, then choose Switch to HBA Mode.
Confirm your selection, click OK, and reboot the server.

External SAS

The older R620 TrueNAS server has a 6Gbps External SAS [[Production/Inventory/Components/LSI Logic 9200-8e SFF-8088/README]] which was flashed to IT mode. This card could work in the new R630, however if you want the newer 12gbps card that can be flashed to IT mode you would want this

For your Dell PowerEdge R630, if you need an external 12Gbps SAS HBA for connecting to a disk shelf or tape drive, look for the Dell 12Gbps External SAS HBA (often called the Dell H830 or the OEM equivalent of the LSI 9300-8e). These cards run in IT/HBA mode natively out of the box and are a direct plug-and-play fit.

Instead of trying to cross-flash a standard LSI 9300-8e, the easiest route is to use the dedicated Dell 12Gbps SAS HBA (External).

Official Dell Part Numbers: Look for PNs like 0T93GD, 405-AAES

Chipset: Built on the robust LSI SAS3008 controller.

LSI's "IT Mode" (Initiator Target) and Dell's "HBA Mode" effectively accomplish the exact same goal!

U.2 Expansion Kit

The R630 is capable of running 4x 2.5" U.2 NVME Drives in the last 4 drive bays, but you must buy the expansion kit which includes a PCIE card and the cabling. The backplane already has the 4 connectors on it ready for this expansion kit. This card does NOT require any IT mode flashing, as it still uses the Perc H730 Mini as the controller, which already works in HBA Mode (same as IT mode).

To upgrade your Dell PowerEdge R630 to support U.2 NVMe drives, you need a specific hardware kit. It includes a PCIe extender/riser card and dedicated cables. This setup enables U.2 support on specific slots (usually up to 4 drives) in the server's 10-bay SFF chassis. Example: https://www.ebay.com/itm/173174252228

PCIe Extender/Bridge Card: Dell Part Number GY1TD (or 0GY1TD).

Cable Kit: Dell Part Number K9TVP (also known as 1PDFM), which bridges the PCIe connection between the riser card and the drive backplane.

M.2 to U.2 Converstion

You can also buy adapter card that allow you to use your M.2 NVMe sticks in the 2.5" U.2 form factor, like https://www.startech.com/en-us/hdd/u2m2e125

So I would buy 4x of these adapters, then use 4x M.2 NVMe drives as 2.5" drives!

So combine 4x M.2 NVMe in U.2 bays + 4x M.2 on PCIe card gives 8x M.2 NVMe Drives total!

M.2 NVMe Drives

Along with the 4x U.2 drives, you can add low profile PCIE cards that hold either 2x or 4x NVMe drives with bifurcation support.

The 4x low profile cards that fit in the R630 are rare, but found this