Supermicro SuperServer SYS-610U-TNR Manual de Usario

Supermicro servidor SuperServer SYS-610U-TNR

Lee a continuación 📖 el manual en español para Supermicro SuperServer SYS-610U-TNR (131 páginas) en la categoría servidor. Esta guía fue útil para 6 personas y fue valorada con 4.5 estrellas en promedio por 2 usuarios

Página 1/131
USER’S MANUAL
Revision 1.0d
SuperServer®
SYS-610U-TNR
The information in this User’s Manual has been carefully reviewed and is believed to be accurate. The vendor assumes
no responsibility for any inaccuracies that may be contained in this document, and makes no commitment to update
or to keep current the information in this manual, or to notify any person or organization of the updates. Please Note:
For the most up-to-date version of this manual, please see our website at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product described in this manual
at any time and without notice. This product, including software and documentation, is the property of Supermicro and/
or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except
as expressly permitted by the terms of said license.
IN NO EVENT WILL Super Micro Computer, Inc. BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT
OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER
MICRO COMPUTER, INC. SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED
OR USED WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING,
INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the
State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution
of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class A or Class B digital
device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against
harmful interference when the equipment is operated in industrial environment for Class A device or in residential
environment for Class B device. This equipment generates, uses, and can radiate radio frequency energy and, if not
installed and used in accordance with the manufacturer’s instruction manual, may cause harmful interference with
radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in
which case you will be required to correct the interference at your own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only
to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate Material-special handling may apply.
See ”.www.dtsc.ca.gov/hazardouswaste/perchlorate
WARNING: This product can expose you to chemicals including
lead, known to the State of California to cause cancer and birth
defects or other reproductive harm. For more information, go
to www.P65Warnings.ca.gov.
!
The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment,
nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical
systems whose failure to perform be reasonably expected to result in signicant injury or loss of life or catastrophic
property damage. Accordingly, Supermicro disclaims any and all liability, and should buyer use or sell such products
for use in such ultra-hazardous applications, it does so entirely at its own risk. Furthermore, buyer agrees to fully
indemnify, defend and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and
proceedings of any kind arising out of or related to such ultra-hazardous use or sale.
Manual Revision 1.0d
Release Date: December 30, 2022 mk
Unless you request and receive written permission from Super Micro Computer, Inc., you may not copy any part of this
document. Information in this document is subject to change without notice. Other products and companies referred
to herein are trademarks or registered trademarks of their respective companies or mark holders.
Copyright © 2022 by Super Micro Computer, Inc.
All rights reserved.
Printed in the United States of America
3
Preface
Preface
About this Manual
This manual is written for professional system integrators and PC technicians. It provides
information for the installation and use of the server. Installation and maintenance should be
performed by experienced technicians only.
Please refer to the SYS-610U-TNR server specications page on our website for updates on
supported memory, processors and operating systems (http://www.supermicro.com).
Notes
For your system to work properly, please follow the links below to download all necessary
drivers/utilities and the user’s manual for your server.
Supermicro product manuals: http://www.supermicro.com/support/manuals/
Product drivers and utilities: https://www.supermicro.com/wdl
Product safety info: http://www.supermicro.com/about/policies/safety_information.cfm
If you have any questions, please contact our support team at:
support@supermicro.com
This manual may be periodically updated without notice. Please check the Supermicro website
for possible updates to the manual revision level.
Secure Data Deletion
A secure data deletion tool designed to fully erase all data from storage devices can be found
on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/
Lot9_Secure_Data_Deletion_Utility/
Warnings
Special attention should be given to the following symbols used in this manual.
Warning! Indicates high voltage may be encountered when performing a procedure.
Warning! Indicates important information given to prevent equipment/property damage
or personal injury.
4
Contents
Contents
Chapter 1 Introduction
1.1 Overview ...............................................................................................................................9
Conguration Options........................................................................................................10
Ultra Riser Cards ...........................................................................................................10
Storage Protocols .........................................................................................................10
Power Supply Options ...................................................................................................10
1.2 System Features ................................................................................................................11
Front View .........................................................................................................................11
Drive Carrier Indicators ..................................................................................................11
Control Panel .................................................................................................................12
Rear View ..........................................................................................................................13
Expansion Slots and Riser Cards ................................................................................13
LAN Speed Indicator .....................................................................................................14
Power Supply Indicator ..................................................................................................14
Top View ............................................................................................................................15
1.3 System Architecture ...........................................................................................................16
Main Components .............................................................................................................16
System Block Diagram ......................................................................................................17
1.4 Motherboard Layout ..........................................................................................................18
Quick Reference ...............................................................................................................19
Motherboard Block Diagram .............................................................................................20
Chapter 2 Server Installation
2.1 Overview .............................................................................................................................21
2.2 Unpacking the System .......................................................................................................21
2.3 Preparing for Setup ............................................................................................................21
Choosing a Setup Location ...............................................................................................21
Rack Precautions ..............................................................................................................22
Server Precautions ............................................................................................................22
Rack Mounting Considerations .........................................................................................22
2.4 Installing the Rails ..............................................................................................................24
Identifying the Rails ...........................................................................................................24
Installing the Outer Rails onto the Rack ...........................................................................25
5
Contents
2.5 Installing the Chassis into a Rack ......................................................................................26
Removing the Chassis from the Rack ..............................................................................27
Chapter 3 Maintenance and Component Installation
3.1 Removing Power ...............................................................................................................28
3.2 Accessing the System ........................................................................................................29
3.3 Processor and Heatsink Installation ...................................................................................30
The Processor Carrier Assembly ......................................................................................31
The Processor Heatsink Module (PHM) ...........................................................................33
Installing the PHM into the CPU Socket ...........................................................................34
Removing the PHM from the CPU Socket .......................................................................37
Removing the Processor Carrier Assembly from the PHM ..............................................38
Removing the Processor from the Carrier Assembly........................................................39
3.4 Memory ...............................................................................................................................40
Memory Support ................................................................................................................40
Guidelines Regarding Mixing DIMMs ............................................................................41
DDR4 Memory Population Guidelines ..............................................................................42
Optane PMem 200 Series .................................................................................................43
PMem Notes ..................................................................................................................44
Installing Memory ..............................................................................................................45
3.5 Motherboard Battery ...........................................................................................................46
3.6 Storage Drives ....................................................................................................................47
Installing Drives .................................................................................................................47
Checking the Temperature of an NVMe Drive ..................................................................49
Hot-Swap for NVMe Drives ...............................................................................................50
3.7 System Cooling ..................................................................................................................51
Fans ..................................................................................................................................51
System Fan Replacement .............................................................................................52
Air Shrouds .......................................................................................................................53
3.8 Power Supply .....................................................................................................................54
Power Supply LEDs ..........................................................................................................54
3.9. PCI Expansion Slots .........................................................................................................55
Riser Cards .......................................................................................................................55
Internal Expansion Card....................................................................................................58
Removing the Ultra Riser Card .........................................................................................58
6
Contents
3.10 Cable Routing Diagram .....................................................................................................59
NVMe Storage Cable Routing ...........................................................................................60
SAS/SATA Storage Cable Routing ....................................................................................60
Part Numbers ....................................................................................................................62
Chapter 4 Motherboard Connections
4.1 Power Connections ............................................................................................................63
4.2 Headers and Connectors ...................................................................................................64
Control Panel ....................................................................................................................67
4.3 Input/Output Ports ..............................................................................................................70
4.4 Jumpers ..............................................................................................................................71
4.5 LED Indicators ....................................................................................................................72
4.6 Storage Ports .....................................................................................................................73
Chapter 5 Software
5.1 Microsoft Windows OS Installation .....................................................................................74
5.2 Driver Installation ................................................................................................................76
5.3 SuperDoctor® 5 ...................................................................................................................77
5.4 BMC ....................................................................................................................................78
BMC ADMIN User Password ...........................................................................................78
Chapter 6 Optional Components
6.1 Storage Protocols Supported .............................................................................................79
6.2 Power Supply Modules .......................................................................................................79
6.3 Cable Management Arm.....................................................................................................80
6.4 TPM Security Module .........................................................................................................82
6.5 Intel Virtual RAID on CPU (VROC) ....................................................................................83
Requirements and Restrictions .........................................................................................83
Supported SSDs and Operating Sytems ..........................................................................83
Additional Information .......................................................................................................84
Hardware Key ...................................................................................................................84
Conguring Intel VMD .......................................................................................................85
Conguring VMD Manually ............................................................................................85
Creating NVMe RAID Congurations ................................................................................90
Status Indications ..............................................................................................................91
Hot Swap Drives ...............................................................................................................91
Hot-unplug .....................................................................................................................91
Hot-plug .........................................................................................................................91
7
Contents
Related Information Links .................................................................................................91
6.6 GPUs ..................................................................................................................................92
Chapter 7 Troubleshooting and Support
7.1 Information Resources ........................................................................................................93
Website .............................................................................................................................93
Direct Links for the SYS-610U-TNR System .................................................................93
Direct Links for General Support and Information .......................................................93
7.2 BMC Interface .....................................................................................................................94
7.3 Troubleshooting Procedures .............................................................................................95
General Technique ............................................................................................................95
No Power ..........................................................................................................................95
No Video ...........................................................................................................................95
System Boot Failure .........................................................................................................96
Memory Errors ..................................................................................................................96
Losing the System Setup Conguration ...........................................................................96
When the System Becomes Unstable ..............................................................................96
7.4 POST Codes ......................................................................................................................98
7.5 Crash Dump Using the BMC Dashboard ............................................................................98
7.6 UEFI BIOS Recovery .........................................................................................................99
Overview ...........................................................................................................................99
Recovering the UEFI BIOS Image ....................................................................................99
Recovering the Main BIOS Block with a USB Device ......................................................99
7.7 CMOS Clear .....................................................................................................................104
7.8 BMC Reset .......................................................................................................................104
7.9 Where to Get Replacement Components ........................................................................105
7.10 Reporting an Issue ..........................................................................................................105
Technical Support Procedures ........................................................................................105
Returning Merchandise for Service .................................................................................105
Vendor Support Filing System ........................................................................................106
7.11 Feedback .........................................................................................................................106
7.12 Contacting Supermicro ....................................................................................................107
Appendix A Standardized Warning Statements for AC Systems
Appendix B System Specications
BSMI/RoHS
8
Contents
Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
Tel: +1 (408) 503-8000
Fax: +1 (408) 503-8008
Email: marketing@supermicro.com (General Information)
Sales-USA@supermicro.com (Sales Inquiries)
Government_Sales-USA@supermicro.com (Gov. Sales Inquiries)
support@supermicro.com (Technical Support)
RMA@supermicro.com (RMA Support)
Webmaster@supermicro.com (Webmaster)
Website: www.supermicro.com
Europe
Address: Super Micro Computer B.V.
Het Sterrenbeeld 28, 5215 ML
's-Hertogenbosch, The Netherlands
Tel: +31 (0) 73-6400390
Fax: +31 (0) 73-6416525
Email: Sales_Europe@supermicro.com (Sales Inquiries)
Support_Europe@supermicro.com (Technical Support)
RMA_Europe@supermicro.com (RMA Support)
Website: www.supermicro.nl
Asia-Pacic
Address: Super Micro Computer, Inc.
3F, No. 150, Jian 1st Rd.
Zhonghe Dist., New Taipei City 235
Taiwan (R.O.C)
Tel: +886-(2) 8226-3990
Fax: +886-(2) 8226-3992
Email: Sales-Asia@supermicro.com.tw (Sales Inquiries)
Support@supermicro.com.tw (Technical Support)
RMA@supermicro.com.tw (RMA Support)
Website: www.supermicro.com.tw
9
Chapter 1: Introduction
Chapter 1
Introduction
1.1 Overview
This chapter provides a brief outline of the functions and features of the SuperServer
SYS-610U-TNR. The following provides an overview of the specications and capabilities.
System Overview
Motherboard X12DPU-6
Chassis 819U3TS-R1K22P-T
Processor
Support Dual P+ (LGA4189) sockets 3rd Gen Intel Xeon Scalable
Memory
32 DIMM slots, DDR4 RDIMM/LRDIMM or Intel Optane PMem 200 Series*
(up to 8TB for DDR4, or up to 8TB of PMem and 4TB DDR4)
Up to 3200MHz; size up to 256GB
* Note: PMem 200 Series are supported on 3rd gen Intel Xeon Scalable Platinum, Gold
and selected Silver processors.
Drive Support Four hot-swap 3.5" SATA/SAS/NVMe hybrid drive bays
Two SuperDOM (disk on modules)
Expansion Slots
Two PCIe 4.0 x16 (FH, 10.5” L)
One PCIe 4.0 x16 (LP)
One PCIe 4.0 x16 (LP, internal)
I/O Ports
LAN ports depend on Ultra Riser option
One VGA ports (rear)
One serial port (rear)
Three USB 3.0 ports (2 rear, 1 front)
System Cooling Eight double counter-rotating fans with Optimal Fan Speed Control
Air Shrouds
Power
Two Redundant Power Supplies, 80Plus Titanium level
Default: 1200W
Optional: 1600W/2000W
Form Factor 1U; (WxHxD) 17.2” x 1.7” x 29.1” (437x43x739 mm)
A link to the Quick Reference Guide can be found on the product page of the Supermicro
website.
The following safety models associated with the SYS-610U-TNR have been certied as compliant
with UL and CSA: 819U-12, 819U-16, 819U-20, 819U-13D, 819UT-R12X12, 819UT-R16X12,
819UT-R20X12, 819UT-R13DX12
10
Chapter 1: Introduction
Conguration Options
Ultra Riser Cards
Ultra Riser cards provide network connections and other capabilities. The customer must
choose one when purchasing the system.
Ultra Riser Networking Options
LAN Ports Part Number Description
No NIC PCIe 4.0 x16 (Internal), four NVMe portsAOC-URG4N4
Two 10GBaseT AOC-URG4N4-i2XT Two RJ45, Intel X710-AT2,
PCIe 4.0 x16 (Internal), four NVMe ports
Four 10GBaseT
(two SFP+) AOC-URG4N4-i4XTS Two RJ45 and two SFP+, Intel X710-TM4,
PCIe 4.0 x16 (Internal), four NVMe ports
Two 25GbE AOC-URG4N4-m2TS Two SFP28, Mellanox ConnectX-6,
PCIe 4.0 x16 (Internal), four NVMe ports
Storage Protocols
The storage drive bays can support SATA, SAS, and NVMe in any combination. To enable
SAS and NVMe, additional hardware is required. Once the supporting hardware is installed
for a selection of bays, drives of any storage protocol type can be inserted.
SATA The default conguration supports up to four SATA drives.
SAS – An add-on controller card and cables can support up to four SAS drives.
NVMe The motherboard supports up to four NVMe drives. Additional cables are required.
Power Supply Options
Power Supply Module Options
Watts Part Number 80Plus Level
1200 TitaniumPWS-1K22A-1R (default)
1600 PWS-1K62A-1R Titanium
2000 PWS-2K08A-1R Titanium
1300 DC Not applicablePWS-1K30D-1R
11
Chapter 1: Introduction
1.2 System Features
The following views of the system display the main features. Refer to Appendix B for additional
specications.
Front View
Figure 1-1. Front View
Logical Storage Drive Numbers
Item Description
0-1 3.5" hot-swap SATA/SAS3*/NVMe* drive bays (NVMe from CPU1)
2-3 3.5" hot-swap SATA/SAS3*/NVMe* drive bays (NVMe from CPU2)
* SAS3 and NVMe support requires additional parts
Drive Carrier Indicators
Each drive carrier has two LED indicators: an activity indicator and a status indicator. For RAID
congurations using a controller, the meaning of the status indicator is described in the table
below. For OS RAID or non-RAID congurations, some LED indications are not supported,
such as hot spare. For VROC congurations, refer to the VROC section in this manual.
Drive Carrier LED Indicators
Color Blinking Pattern Behavior for Device
Activity
LED
Blue Solid On Idle SAS or NVMe drive installed
Blue Blinking I/O activity
O Idle SATA or no drive
Status
LED
Red Solid On Failure of drive with RSTe support
Red Blinking at 1 Hz Rebuild drive with RSTe support
Red Blinking at 4 Hz Identify drive with RSTe support
Red Blinking with two blinks
and one stop at 1 Hz
Hot spare for drive with RSTe support
Red On for ve seconds,
then o
Power on for drive with RSTe support
Amber Blinking Safe to remove NVMe drive
Green Solid on Ejecting an NVMe drive
Control Panel
Service/Asset Tag
with BMC Password
1 2 30
12
Chapter 1: Introduction
Control Panel Features
Feature Description
UID button/LED
BMC reset
The unit identication (UID) button turns on or o the blue light function of the Information
LED and a blue LED on the rear of the chassis.
This button can also be used to reset the BMC.
Information LED Alerts operator to several states, as noted in the table below.
NIC LED Indicates network activity on LANs when ashing.
HDD Indicates activity on the storage drives when ashing.
Power LED
Steady on Power on
Blinking at 4Hz Checking BIOS/BMC integrity
Blinking at 4Hz and "i" LED is blue BIOS rmware updating
Two blinks at 4Hz, one pause 2hz and "i" LED blue BMC rmware updating
Blinking at 1Hz and "i" LED red Fault detected
Reset Reboot the system
Power button The main power switch applies or removes primary power from the power supply to the server
but maintains standby power. Hold for four seconds to force a shut-down.
Information LED
Color, Status Description
Red, solid An overheat condition has occurred.
Red, blinking at 1Hz Fan failure, check for an inoperative fan.
Red, blinking at 0.25Hz Power failure, check for a non-operational power
supply.
Red, solid, with Power LED blinking
green Fault detected
Blue and red, blinking at 10 Hz Recovery mode
Blue, solid UID has been activated locally to locate the
server in a rack environment.
Blue, blinking at 1Hz UID has been activated using the BMC to locate
the server in a rack environment.
Blue, blinking at 2Hz BMC is resetting
Blue, blinking at 4Hz BMC is setting factory defaults
Blue, blinking at 10Hz with Power LED
blinking green BMC/BIOS rmware is updating
Control Panel
Figure 1-2. Control Panel
Power
Power LED
Information LED
UID Button/LED
BMC Reset
HDD
NIC LED
Reset
13
Chapter 1: Introduction
Rear View
Figure 1-3. System: Rear View
System Features: Rear
Feature Description
Power Supplies Two redundant power supply modules, PWS1 on the left, PWS2 on the right
0LAN ports; specications depend on your Ultra riser card option
1 to 4Expansion card slots; see below for details
USB Two USB 3.0 ports
BMC LAN BMC LAN port; for indicator details, see BMC LAN LEDs
UID Button/
BMC Reset UID button and BMC reset button (similar to Control Panel button on previous page)
COM Serial port
VGA Video port
Expansion Slots and Riser Cards
This system include riser cards that provide PCIe capabilities—one Ultra Riser card (described
in Section 1.1), one right-facing WIO riser card, and one left-facing WIO riser card.
PCIe Slots per Riser Card
Riser Card Part Number Description (all PCIe 4.0)Slot
Ultra Riser card
AOC-URG4N4
AOC-URG4N4-i2XT
AOC-URG4N4-i4XTS
AOC-URG4N4-m2TS
1 x16 Internal LP, 75W (CPU2)
Right-facing RSC-WR-6 2 x16 low prole, 75W (CPU1)
Left-facing RSC-W-66G4 3
4
x16 FH, 10.5”L, 75W (CPU2)
x16 FH, 10.5”L, 75W (CPU1)
One riser card slot may be used for a controller card that supports SAS.
Power Supplies
USB Ports
BMC LAN
VGA
COM
UID Button/BMC Reset
1 2
4
3
0
14
Chapter 1: Introduction
LAN Speed Indicator
LAN ports are provided by the . One LED indicates the network speed. Ultra Riser cards
LAN LED (Speed Indicator)
Color 10GbE 25GbE
Green 10 Gb/s 25 Gb/s
Amber 1 Gb/s 10 Gb/s
Power Supply Indicator
LEDs on the power supplies indicate the status of the module.
Power Supply Indicator
LED Color and State Power Supply Condition
Solid Green Indicates that the power supply is on
Blinking Green Indicates that the power supply is plugged in and turned o by the system.
Blinking Amber Indicates that the power supply has a warning condition and continues to operate.
Solid Amber Indicates that the power supply is plugged in, and is in an abnormal state. The
system might need service. Please contact Supermicro technical support.
O No AC power to modules
15
Chapter 1: Introduction
Top View
Figure 1-4. System: Top View
System Features: Top
Feature Description
Power Supply Dual redundant modules; see options on a previous page
SATADOM ports Two Disk-on-Module ports allows for ash cards to be mounted directly on the
motherboard
DIMM slots 32 memory slots
Processors Dual Intel Xeon Scalable Processors with heatsinks, SNK-P0077P
System fans Eight 4-cm dual counter-rotating PWM fans, FAN-0201L4
DIMM Slots
SATADOM Ports
System Fans
Dual Processors
Power Supply Modules
16
Chapter 1: Introduction
1.3 System Architecture
This section shows the locations of the system electrical components, and a block diagram
of the overall system.
Main Components
Figure 1-5. Main Component Locations
Storage Backplane
BPN-SAS3-815TQ-N4
Ultra Riser Card;
( ) options
Motherboard
X12DPU-6
Riser Card,
Left-facing
Riser Card,
Right-facing
17
Chapter 1: Introduction
Figure 1-6. System Block Diagram
System Block Diagram
The block diagram below shows the connections and relationships between the subsystems
and major components of the overall system.
PCI-E x16
4 3.5” NVMe/ S3/SATA3 Backpl eSA an
- 4 NVME/SAS/ TA Drive BaysSA
PCI-E x32
Failover (NC-SI)
WIO ser rdRi Ca
- 1 PCI-E 4.0 p17-x16 Slot (CPU1)
PCI-E x16
UPI x3
WIO ser S tRH Ri lo
( PCI-E s)16 Lane
16 DIMM S tsDDR4 lo16 DIMM S tsDDR4 lo
PCI-E x16
Intel ®X neo ®
Scal leab
Pr soroces
( 1)CPU
Intel®X neo ®
Scal leab
Pr s roce so
( 2)CPU
Opti s o tra ser Cardon f Ul Ri
- 1 PCI-E 4.0 p17-x16 Internal Slot (CPU2)
- 2 x8 SLIM Connector (CPU2)SAS
- NIC Options of (No NIC/10GBase-
T/10GbaseT+ GSF / GbE) (CPU1)10 P+ 25
2 NVME
Only use p17-x8
PCI-E
PCI-E x8
PCI-E x16
Ul Ri lotra ser S t
( PCI-E s)40 Lane
WIO ser S tLH Ri lo
( PCI-E s)32 Lane
PCI-E x24
2 NVME
Only use p17-x8
PCI-E
WIO ser rdRi Ca
- 1 PCI-E 4.0 p17-x16 Slot (CPU1)
- 1 PCI-E 4.0 p17-x16 Slot (CPU2)
12 SATA
Ports BMC AST 0260
2 SuperDOM
SATA Ports
Intel
®
C A621
2 USB 3.0
(2 rear)
DMI
O y nl
use 4
SATA
BMC LAN
18
Chapter 1: Introduction
Figure 1-7. Motherboard Layout
1.4 Motherboard Layout
Below is a layout of the X12DPU-6 motherboard with jumper, connector and LED locations
shown. See the table on the following page for descriptions. For detailed descriptions, pinout
information and jumper settings, refer to Chapter 4 Motherboard Manual. or the
FP1
CPU2
REV:1.02
FAN2
NVME4
NVME5
NVME6
NVME9
NVME1
SXB3_3
SXB2
JTPM1
JNCSI1
BT1
FAN7
FAN6
FAN5
FAN4
FAN3
FAN2
T-SGPIO3
JPW2 JPW1
JGPW1
JGPW2
JRK1
JLAN1
JBT1
JUIDB
JUSB3
SXB3_1
SXB1_1
SXB1_3
PSU1
SXB3_2
SXB1_2
JS2JS1 JS3
JIPMB1
JSD2
LEDM1
BMC
PSU2
PCH
LE2
PW Supply2 PW Supply1
JF1
FP CTRL
JL1
JF2
C3
F3
FAN8
NVME3
NVME10
FAN1
JNVI2C4
JVGA2
Front VGA
FFC Connector
PWR_On LED
P1_NVMe3
P1_NVMe4
TPM
SXB1A
SXB1B
P1_NVMe1
CPU2_PORT2C
SXB1C
CPU1_PORT1A
CPU2_PORT2A
CPU1_PORT1C
P1_NVMe6
VGA
CPU1_PORT0A
USB3/4(3.0)
S-S A0~3AT
CPU1
I-S A0~3AT
P1_NVMe5
I-S A4~7AT
COM1
S-S A4AT
BMC_LAN
S-S A5AT
USB0/1(3.0)
VROC
BATTERY
SXB3BSXB3A SXB3C CPU2_PORT0C
CPU2_PORT1A
CPU2_PORT1C
CPU2_PORT0A
CPU1_PORT2A
P2_NVMe7
P2-DIMMF2
P2-DIMMF1
P2-DIMMH1
P2-DIMME2
P2-DIMME1
P2-DIMMG1
P2-DIMMH2
P2-DIMMG2
P2-DIMMC1
P2-DIMMC2
P2-DIMMD2
P2-DIMMD1
P2-DIMMB2
P2_NVMe10
P2-DIMMA1
P2-DIMMA2
P2-DIMMB1
P2_NVMe9
BP PWR2
BP PWR3
BP PWR4
NVME7
P1-DIMMC2
P1-DIMMD2
P1-DIMMC1
P1-DIMMD1
P1-DIMMA2
P1-DIMMA1
P1-DIMMB2
P1-DIMMB1
P1-DIMMF1
P1-DIMMF2
P1-DIMME1
P1-DIMME2
P1-DIMMH1
P1-DIMMH2
P1-DIMMG1
P1-DIMMG2
JPW4
BP PWR1
JPW3
JUID
NVME8
P2_NVMe8
JGPW3
JSD1
JGPW4
GPU PWR3
GPU PWR1
GPU PWR2
GPU PWR4
JCOM1
JVGA1
BMC CODE
BAR CODE
SATA4 SATA5
JF4
BIOS
LICENSE
BMC FW1
BIOS1
BIOS2
BMC FW2
BMC
X12DPU-6
LED1
JPW4
JPW3
P2-DIMME2
P2-DIMME1
P2-DIMMF2
P2-DIMMF1
P2-DIMMA2
P2-DIMMA1
P2-DIMMB2
P2-DIMMB1
P2-DIMMC2
P2-DIMMC1
P2-DIMMD2
P2-DIMMD1
T-SGPIO3
JGPW1
JGPW2
LEDM1 (BMC HB LED) BMC_LAN
USB0/1(3.0)
COM1
VGA
FAN7
FAN8
S-SATA4
JNCSI
JUIDB (UID/BMC Reset SW)
S-SATA0-3
SXB2
USB3/4 (3.0)
BIOS1
JTPM1
I-SATA0-3
I-SATA4-7
S-SATA5
P1-NVMe0/1
P1-DIMMG2
JPW2
JIPMB1
SXB1_A
SXB1_B
SXB1_C
GPU3PW3
BIOS2
BIOSFW2
BIOSFW1
P1-DIMMG1
P1-DIMMH2
P1-DIMMH1
JF1
JL1
JF2
JF3
P1-DIMME2
P1-DIMME1
P1-DIMMF2
P1-DIMMF1
P1-NVMe4 FAN6 P1-NVMe6
FAN5
FAN4
P2-NVME8 FAN3
P2-NVME10
FAN2FAN1 JPW1
P1-DIMMC2
P1-DIMMC1
P1-DIMMD2
P1-DIMMD1 P1-DIMMB1
P1-DIMMB2
P1-DIMMA1
P1-DIMMA2
PSU1
PSU2
JSD2
JBT1
Battery
JSD1
VROC (JRK1)
SXB3C
SXB3B
SXB3A
Front VGA (Optional)
JNVI2C4
GPU3PW4
FP1
JNVI2C3
P1-NVMe3 P1-NVMe5 P2-NVME7
P2-NVME9
P2-DIMMG2
P2-DIMMG1
P2-DIMMH2
P2-DIMMH1
PWR-On LED (LE2)
JF4
LED1 (Rear UID LED)
JUID (UID Jumper)
19
Chapter 1: Introduction
Quick Reference
Jumper Description Default Setting
JBT1 Clear CMOS Open (Normal)
JUID UID Enable/System Reset Jumper Pins 1-2 (UID Enabled)
Connector Description
BT1 Onboard CMOS battery
COM1 Backplane COM port
FAN1 ~ FAN8 CPU/System fan headers
FP1 FFC (Flat Flexible Cable) connector
BMC_LAN Dedicated BMC LAN port (JLAN1)
I-SATA 0~3, I-SATA 4~7 Intel® PCH SATA 3.0 ports
S-SATA 0~3, S-SATA 4/S-SATA 5 S-SATA 0~3, S-SATA 4/S-SATA 5 supported by Intel PCH (S-SATA 4/5: Powered SATA
connectors (with power pins built-in to be used of SuperDOM devices)
JF1 Front Control Panel header
JF3 Front Panel sensor
JF4 BMC I 2C Signal for 24 NVMe BPN (Backplane)
JIPMB1 4-pin BMC external I 2C header (for an BMC card)
JL1 Chassis intrusion header
JNCSI NC-SI (Network Controller Sideband Interface) connector
JNVI2C3/JNVI2C4 NVMe I2C headers (JNVI 2C3: for VPP#1/JNVI 2C4: for VPP#2)
JGPW1/JGPW2/JGPW3/JGPW4 GPU 8-pin power connectors (power connectors for GPU use)
JPW1/JPW2/JPW3/JPW4 Backplane 8-pin power connectors (for backplane devices)
JUIDB UID LED/BMC Reset switch
JVGA2 Front accessible VGA connection header (optional)
PSU1/PSU2 Power Supply Unit #1/Power Supply Unit #2 for system use
JSD1/JSD2 SATA DOM (Disk_On_Module) power connectors
JTPM1 Trusted Platform Module connector
P1-NVMe1/3/4/5/6 PCIe 4.0 p19-x8 NVME ports
P2-NVMe7/8/9/10 PCIe 4.0 p19-x8 NVME ports
SXB1A/SXB1B/SXB1C PCIe 4.0 (x16 + x16) Left riser card slot supported by CPU1/CPU2
SXB2 PCIe 4.0 x16 slot supported by CPU1
SXB3A/SXB3B/SXB3C PCIe 4.0 (x16 + x16 + x8) Ultra riser slot supported by CPU2
T-SGPIO3 Serial_Link General-Purpose I/O connection header (for S-SATA 4/5 SuperDOM support)
USB0/1 (3.0) Rear I/O USB 3.0 ports
USB3/4 (3.0) Front accessible USB header with two USB 3.0 connections
VGA Backplane VGA port
VROC (JRK1) Intel VROC Key Header for NVMe RAID
LED Description State: Status
JF2 LAN LED Ethernet LAN LED Indicators (Blink: Active)
LE2 Power_on LED System Power LED: (On: System Power on)
20
Chapter 1: Introduction
LED Description State: Status
LEDM1 BMC Heartbeat LED Blinking Green: BMC Normal
LED1 Rear UID (Unit Identier) LED Solid Blue: Unit Identied
Figure 1-8. Motherboard Block Diagram
Motherboard Block Diagram
PE1
64GB/s
64GB/s
PE2
#3
#2
DDR4 DIMM
#3
#2
DDR4 DIMM
#3
#2
DDR4 DIMM
#3
#2
DDR4 DIMM
PE3
SATA Gen [0..3]3
JS2
UPI1
NVMe On Board
UPI1
OC inkuL
x4
4x4
OC inkuL
x4
OC inkuL
x4
OC inkuL
x4
SocketID 01
OC inkuL
x4
4x4
CPU 2
DMI
OC inkuL
x4
OC inkuL
x4
OC inkuL
x4
PE3
Socket ID00
CPU 1
Polarity Inversion
10.4G/11.2G T/s
UPI
S-SA 0~3TA
I-SA 0~3TA
I-SA 4~7TA
PE0 UPI2
Polarity Inversion
10.4G/11.2G T/s
DDR4 DIMM
#1
#2
DDR4 DIMM
#1
#2
DDR4 DIMM
#1
#2
DDR4 DIMM
#1
#2
DDR4 DIMM
#2
#1
DDR4 DIMM
#2
#1
DDR4 DIMM
DDR4
#2
#1
VGA
UART
DDR4 DIMM
#2
#1
64GB/s
PCH
SATA Gen [4..7]3
S-SATA5
S-SATA4
sSATA Gen3 [0..3]
JS1
JS3
sSATA Gen3 [4, 5]
DMI
USB3.0 [0,1, ,4] 3
SPI
LPC/eSPI
TPM
Header
HWM
USBSPI
MUX
LPC/eSPI
PE
PE[5]
SPI FLASH
32MB BMC
SPI FLASH
32MB BIOS
BMC LAN
RJ45
COM1
PHY
RTL F8211
VGA
NCSI
DDR4
SPI
BMC
AST2600
VCCP2
7+1 PH EAS
X12DPU-6
VR13HC
VCCP2 2v 1
7+1 PH EAS
VCCP1
VR13HC
VCCP1 2v 1
64GB/s
64GB/s
10.4G/11.2G T/s
P2HP2E P2C P2D
#1#1
#2
DDR4 DIMM
#1
#2
DDR4 DIMM
#2
DDR4 DIMM
#2
DDR4 DIMM
#1
P1GP1HE1PF1P P1A
NCSI Port C
Port A
0~7
Port B
8~15
5bit
Port C
11~15
x8
Port B
0~7
Port BPort A
x8 it3b
Port C
NIC
Ultra IO
Port C
0~10
Port B
8GB/s
x8 (0-7)
x8
64GB/s
64GB/s
REAR
port 3,4
port 0,1
FRONT
64GB/s
Lower
x16
LowerUpper
Upper
WIO
x16
x16
x8
OC inkuL
x8
x8 (8-15)
x4
x4
NVMe On Board
UPI3
x8
x8
UPI0 PE1PE2 PE0 UPI2
UPI3 UPI0
P1B P2F P2G P2A P2BP1C P1D
LAN
21
Chapter 2: Server Installation
Chapter 2
Server Installation
2.1 Overview
This chapter provides advice and instructions for mounting your system in a server rack.
If your system is not already fully integrated with processors, system memory etc., refer to
Chapter 3 for details on installing those specic components.
Caution: Electrostatic Discharge (ESD) can damage electronic components. To prevent such
damage to PCBs (printed circuit boards), it is important to use a grounded wrist strap, handle
all PCBs by their edges and keep them in anti-static bags when not in use.
2.2 Unpacking the System
Inspect the box in which the system was shipped, and note if it was damaged. If any equipment
appears damaged, le a claim with the carrier.
Decide on a suitable location for the rack unit that will hold the server. It should be situated
in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and
electromagnetic elds are generated. It will also require a grounded AC power outlet nearby.
Be sure to read the precautions and considerations noted in Appendix A.
2.3 Preparing for Setup
The box in which the system was shipped should include the rackmount hardware needed to
install it into the rack. Please read this section in its entirety before you begin the installation.
Choosing a Setup Location
The system should be situated in a clean, dust-free area that is well ventilated. Avoid areas
where heat, electrical noise and electromagnetic elds are generated.
Leave enough clearance in front of the rack so that you can open the front door completely
(~25 inches) and approximately 30 inches of clearance in the back of the rack to allow
sucient space for airow and access when servicing.
This product should be installed only in a Restricted Access Location (dedicated equipment
rooms, service closets, etc.).
22
Chapter 2: Server Installation
This product is not suitable for use with visual display workplace devices according to §2
of the German Ordinance for Work with Visual Display Units.
Rack Precautions
Ensure that the leveling jacks on the bottom of the rack are extended to the oor so that
the full weight of the rack rests on them.
In single rack installations, stabilizers should be attached to the rack. In multiple rack in-
stallations, the racks should be coupled together.
Always make sure the rack is stable before extending a server or other component from
the rack.
You should extend only one server or component at a time - extending two or more simul-
taneously may cause the rack to become unstable.
Server Precautions
Review the electrical and general safety precautions in Appendix A.
Determine the placement of each component in the rack you install the rails.before
Install the heaviest server components at the bottom of the rack rst and then work your
way up.
Use a regulating uninterruptible power supply (UPS) to protect the server from power
surges and voltage spikes and to keep your system operating in case of a power failure.
Allow any drives and power supply modules to cool before touching them.
When not servicing, always keep the front door of the rack and all covers/panels on the
servers closed to maintain proper cooling.
Rack Mounting Considerations
Ambient Operating Temperature
If installed in a closed or multi-unit rack assembly, the ambient operating temperature of
the rack environment may be greater than the room's ambient temperature. Therefore,
consideration should be given to installing the equipment in an environment compatible with
the manufacturers maximum rated ambient temperature (TMRA).
23
Chapter 2: Server Installation
Airow
Equipment should be mounted into a rack so that the amount of airow required for safe
operation is not compromised.
Mechanical Loading
Equipment should be mounted into a rack so that a hazardous condition does not arise due
to uneven mechanical loading.
Circuit Overloading
Consideration should be given to the connection of the equipment to the power supply circuitry
and the eect that any possible overloading of circuits might have on overcurrent protection
and power supply wiring. Appropriate consideration of equipment nameplate ratings should
be used when addressing this concern.
Reliable Ground
A reliable ground must be maintained at all times. To ensure this, the rack itself should be
grounded. Particular attention should be given to power supply connections other than the
direct connections to the branch circuit (i.e. the use of power strips, etc.).
To prevent bodily injury when mounting or servicing this unit in a rack, you must take
special precautions to ensure that the system remains stable. The following guidelines
are provided to ensure your safety:
This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
When mounting this unit in a partially lled rack, load the rack from the bottom to the top
with the heaviest component at the bottom of the rack.
If the rack is provided with stabilizing devices, install the stabilizers before mounting or
servicing the unit in the rack.
Slide rail mounted equipment is not to be used as a shelf or a work space.
24
Chapter 2: Server Installation
2.4 Installing the Rails
There are a variety of rack units on the market, which may require a slightly dierent assembly
procedure. This rail set ts a rack between 25.6" and 33" deep.
The following is a basic guideline for installing the system into a rack with the rack mounting
hardware provided. You should also refer to the installation instructions that came with the
specic rack you are using.
Identifying the Rails
The chassis comes with two sets of rack rails, one set for the right side of the chassis and
one for the left. Each set consists of an inner rail that is to the chassis, an outer pre-attached
rail that attaches to the rack, and a middle rail that slides forward in the outer rail.
Figure 2-1. Identifying the Sections of the Rack Rails
Middle Rail (not shown)--
slides forward from the
outer rail
Inner rail--
pre-attached to
the chassis
Outer rail, front
and rear brackets
25
Chapter 2: Server Installation
Bracket with
square pegs
Figure 2-2. Installing the Outer Rails to the Rack
Installing the Outer Rails onto the Rack
Each end of the assembled outer rail includes a bracket with square pegs to t into your rack
holes. If you have an older rack with round holes, these brackets must be removed, and you
must use screws to secure the rail to the rack.
Outer Rail Installation
1. Align the square pegs on the front end of the rail with the square holes on the front of
the rack (C). Push the rail into the rack until the quick release bracket snaps into place,
securing the rail to the rack. Keep the rail horizontal.
2. Adjust the rail to reach just past the full depth of your rack.
3. Align the square pegs on the rear end of the rail to the holes on the rack (D) and push
the rail into the rack until the quick release bracket snaps into place, securing the rail to
the rack.
Note: The gure above is for illustrative purposes only. Always install servers at the bottom
of the rack rst.
Stability hazard. The rack stabilizing mechanism must be in place, or the rack must
be bolted to the oor before you slide the unit out for servicing. Failure to stabilize the
rack can cause the rack to tip over.
D
C
26
Chapter 2: Server Installation
2.5 Installing the Chassis into a Rack
Once rails are attached to the chassis and the rack, you can install the server.
1. Pull the middle rail out of the front of the outer rail and make sure that the ball bearing
shuttle is locked at the front of the middle rail.
2. Align the rear of the chassis rails with the middle rails and then push evenly on both
sides of the chassis until it clicks into the fully extended position.
3. Depress the locking tabs on both sides of the chassis and push the it fully into the rack.
The locking tabs should "click".
4. Thumb screws may be used to secure the front of the chassis to the rack.
Figure 2-3. Installing the Server into the Rack
Notes: Keep the ball bearing shuttle locked at the front of the middle rail during installation.
Figure is for illustrative purposes only. Always install servers to the bottom of a rack rst.
27
Chapter 2: Server Installation
Figure 2-4. Removing the Chassis From the Rack
Removing the Chassis from the Rack
Caution! It is dangerous for a single person to o-load the heavy chassis from the rack without
assistance. Be sure to have sucient assistance supporting the chassis when removing it
from the rack. Use a lift.
1. If necessary, loosen the thumb screws on the front of the chassis that hold it in the rack.
2. Pull the chassis forward out the front of the rack until it stops.
3. Press the release latches on each of the inner rails downward simultaneously and
continue to pull the chassis forward and out of the rack.
Inner rail
latch
Outer Rail
Latch
28
Chapter 3: Maintenance and Component Installation
Chapter 3
Maintenance and Component Installation
This chapter provides instructions on installing and replacing main system components. To
prevent compatibility issues, only use components that match the specications and/or part
numbers given.
Installation or replacement of most components require that power rst be removed from the
system. Please follow the procedures given in each section.
3.1 Removing Power
Use the following procedure to ensure that power has been removed from the system. This
step is necessary when removing or installing non hot-swap components or when replacing
a non-redundant power supply.
1. Use the operating system to power down the system.
2. After the system has completely shut-down, disconnect the AC power cord(s) from the
power strip or outlet. (If your system has more than one power supply, remove the AC
power cords from all power supply modules.)
3. Disconnect the power cord(s) from the power supply module(s).
29
Chapter 3: Maintenance and Component Installation
Figure 3-1. Removing the Chassis Cover
3.2 Accessing the System
The chassis features a removable top cover, which allows access to the inside of the chassis.
Removing the Top Cover
1. Press the two release buttons and slide the cover toward the rear.
2. Lift the top cover up.
Check that all ventilation openings on the top cover and the top of the chassis are clear and
unobstructed.
Caution: Except for short periods of time, do not operate the server without the cover in place.
The chassis cover must be in place to allow for proper airow and to prevent overheating.
Release Buttons
30
Chapter 3: Maintenance and Component Installation
3.3 Processor and Heatsink Installation
The processor (CPU) and processor carrier should be assembled together rst to form
the processor carrier assembly. This will be attached to the heatsink to form the processor
heatsink module (PHM) before being installed onto the CPU socket.
Notes:
Use ESD protection.
Unplug the AC power cord from all power supplies.
Check that the plastic protective cover is on the CPU socket and that none of the socket
pins are bent. If they are, contact your retailer.
When handling the processor, avoid touching or placing direct pressure on the land grid
array (gold contacts).
Improper installation or socket misalignment can cause serious damage to the processor
or the socket and may require manufacturer repairs.
Thermal grease is pre-applied on new heatsinks. No additional thermal grease is needed.
Refer to the for updates on processor support.Supermicro website
Graphics in this manual are for illustration only. Your components may look di󰀨erent.
31
Chapter 3: Maintenance and Component Installation
The Processor Carrier Assembly
The processor carrier assembly is comprised of the processor and the processor carrier.
1. Hold the processor with the land grid array (LGA, gold contacts) facing down. Locate the
gold triangle at the corner of the processor and the corresponding hollowed triangle on
the processor carrier as shown below. These triangles indicate the location of pin 1.
Latch
Latch
Processor (Reverse Side Up)
Carrier (Top Side Up)
CPU Key
CPU Key
Latch
Latch
Pin 1
Processor
Pin 1
Carrier
2. Turn the processor over (with the gold LGA up). Locate the CPU keys on the processor
and the four latches on the carrier as shown below.
32
Chapter 3: Maintenance and Component Installation
1
2A
B Latch
Latch
a
CPU Key (on the
processor)
CPU Key (on the
carrier)
CPU Key (on the
processor)
CPU Key (on
the carrier) b
5. Carefully place one end of the processor under latch 1 on the carrier, and then press the
other end down until it snaps into latch 2 and is properly seated on the carrier.
Processor Carrier Assembly
(Top View)
Processor Carrier Assembly
(Underside view)
3. Locate the lever on the carrier and, if necessary, press it down as shown below.
4. Align the CPU keys on the processor (A & B) with those on the carrier (a & b) as shown
below.
Lever
33
Chapter 3: Maintenance and Component Installation
Processor Carrier Assembly
The Processor Heatsink Module (PHM)
After creating the processor carrier assembly, mount the heatsink onto the carrier assembly
to form the processor heatsink module (PHM).
Note: If this is a new heatsink, the thermal grease has been pre-applied. Otherwise, apply
the proper amount of thermal grease to the underside of the heatsink.
1. Turn the heatsink over with the thermal grease facing up. Note the two triangle cutouts
(A, B) located at the diagonal corners of the heatsink as shown in the drawing below.
2. On the processor carrier assembly, nd pin 1, as noted by the triangles. Hold the
processor carrier assembly over so that the gold LGA is facing up.
3. Align clip "a" (pin 1) on the carrier assembly with the triangular cutout A on the heatsink
and b, c, d on the carrier assembly with B, C, D on the heatsink.
4. Push the carrier assembly onto the heatsink, making sure that all four clips on each
corner are properly secured.
Heatsink
b
d
a
cPin1
A
C
D
B
34
Chapter 3: Maintenance and Component Installation
Installing the PHM into the CPU Socket
1. Remove the plastic protective cover from the CPU socket. Gently squeeze the grip tabs
then pull the cover o󰀨.
CPU Socket with Plastic Protective Cover
Grip Tabs
35
Chapter 3: Maintenance and Component Installation
Peek Nut
Rotating Wire Side View
Top View
Unlatched State
a
b
c
d
(a, b, c, d: Threaded Fasteners) CPU Socket Pin1
Threaded FastenerCPU Socket
2. Locate four threaded fasteners (a, b, c, d) on the CPU socket.
3. Locate four PEEK nuts (A, B, C, D) and four rotating wires (1, 2, 3, 4) on the heatsink
as shown below.
4. Check that the rotating wires (1, 2, 3, 4) are in the unlatched position as shown.
Heatsink
A, B, C, D: Peek Nut
1, 2, 3, 4: Rotating Wire
a, b, c, d: Threaded Fastener
Peek Nut
(Unlatched) (latched)
Rotating Wire
B
D
Rotating Wire2
Rotating Wire 4
Rotating Wire 3
Peek Nut
A
C
Rotating Wire 1
CPU Socket
36
Chapter 3: Maintenance and Component Installation
5. Align nut A (next to the triangles and pin 1) on the heatsink with threaded fastener "a"
on the CPU socket. Also align nuts B, C, D on the heatsink with threaded fasteners b, c,
d on the CPU socket.
6. Gently place the heatsink on the CPU socket, making sure that each nut is properly
aligned with its corresponding threaded fastener.
Latched State
Top View
7. Press all four rotating wires outward to latch the PHM onto the CPU socket.
8. With a t30-bit screwdriver, tighten all PEEK nuts in the sequence of A, B, C, and D with
even pressure not greater than 12 lbf-in.
a, b, c, d:
Threaded Fastener on the CPU socket
A
B
C
D
a
b
c
d
A, B, C, D: Peek Nut on the Heatsink
Rotating Wire
Rotating Wire
37
Chapter 3: Maintenance and Component Installation
Peek Nut
Rotating Wire Side View
Unlatched State
Removing the PHM from the CPU Socket
Be sure the system is shut down and all AC power cords are unplugged.
1. Use a t30-bit screwdriver to loosen the four PEEK nuts on the heatsink in the sequence
of A, B, C, and D.
2. Press the four rotating wires inward to unlatch the PHM as shown below.
3. Gently lift the PHM upward to remove it from the CPU socket.
A
B
C
D
Peek Nut
38
Chapter 3: Maintenance and Component Installation
Removing the Processor Carrier Assembly from the PHM
Detach the four plastic clips (a, b, c, d) on the processor carrier assembly from the four corners
of the heatsink (A, B, C, D) as shown below, and lift o󰀨 the processor carrier assembly.
Processor Carrier Assembly
Heatsink
c
a
b
d
A
C
D
B
Pin 1
Pin 1
39
Chapter 3: Maintenance and Component Installation
Removing the Processor from the Carrier Assembly
Unlock the lever from its locked position and push it upwards to disengage the processor from
the carrier as shown below right. Carefully remove the processor from the carrier.
Processor Carrier Assembly Lever
Note: Handle the processor with care to avoid damage.
40
Chapter 3: Maintenance and Component Installation
3.4 Memory
Memory Support
The X12DPU-6 motherboard has 32 DIMM slots. It supports up to
8TB (DDR4 only): 3DS Load Reduced DIMM (3DS LRDIMM), 3DS Registered DIMM (3DS
RDIMM), or Non-Volatile DIMMs (NV-DIMM) ECC memory with speeds of up to 3200 MHz.
12TB (PMem + DDR4): 8TB of Intel Optane PMem 200 series (on Platinum, Gold and
selected Silver processors only) plus 4TB of DDR4.
For validated memory, use our Product Resources page.
DDR4 Memory Support for 83xx/63xx/53xx/43xx Processors
Type Ranks Per
DIMM and
Data Width
DIMM Capacity (GB) Speed (MT/s) and Voltage
DRAM Density One DIMM
per Channel Two DIMMs
per Channel
8Gb 16Gb 1.2V 1.2V
RDIMM
SRx8 8GB 16GB
3200* 3200*
SRx4 16GB 32GB
DRx8 16GB 32GB
DRx4 32GB 64GB
RDIMM 3Ds (4R/8R) x4 2H-64GB
4H-128GB
2H-128GB
4H-256GB
LRDIMM QRx4 64GB 128GB
LRDIMM 3Ds (4R/8R) x4 4H-128GB 2H-128GB
4H-256GB
*Only the 83xx and 63xx series support 3200MT/s; for other processors, memory speed as supported by the CPU.
Figure 3-2. Memory Slots
CPU2
CPU1
P2-DIMMF2
P2-DIMMF1
P2-DIMMH1
P2-DIMME2
P2-DIMME1
P2-DIMMG1
P2-DIMMH2
P2-DIMMG2
P2-DIMMC1
P2-DIMMC2
P2-DIMMD2
P2-DIMMD1
P2-DIMMB2
P2-DIMMA1
P2-DIMMA2
P2-DIMMB1
P1-DIMMC2
P1-DIMMD2
P1-DIMMC1
P1-DIMMD1
P1-DIMMA2
P1-DIMMA1
P1-DIMMB2
P1-DIMMB1
P1-DIMMF1
P1-DIMMF2
P1-DIMME1
P1-DIMME2
P1-DIMMH1
P1-DIMMH2
P1-DIMMG1
P1-DIMMG2
41
Chapter 3: Maintenance and Component Installation
Guidelines Regarding Mixing DIMMs
All DIMMs must be DDR4 or a mixture of PMem and DDR4.
x4 and x8 DIMMs can be mixed in the same channel.
Mixing of LRDIMMs and RDIMMs is not allowed in the same channel, across di󰀨erent
channels, and across di󰀨erent sockets.
Mixing of non-3DS and 3DS LRDIMM is not allowed in the same channel, across di󰀨erent
channels, and across di󰀨erent sockets.
Mixing of PMem modules and RDIMMs is supported
Mixing DDR4 and PMem memory operating frequencies is not validated within a socket or
across sockets. If DIMMs of di󰀨erent frequencies are mixed in the same channel, all DIMs
will run at the highest common frequency.
Always populate the DIMM with the higher electrical loading on a channel in DIMMx1
(farther from CPU) followed by DIMMx2.
42
Chapter 3: Maintenance and Component Installation
DDR4 Memory Population Guidelines
The following memory population table was created based on guidelines provided by Intel to
support Supermicro motherboards.
Memory Population for DDR4-only Congurations, 32 DIMM Slots
CPUs/DIMMs DIMM Slots
2 CPUs & 2 DIMMs* CPU1: A1
CPU2: A1
2 CPUs & 4 DIMMs* CPU1: A1, E1
CPU2: A1, E1
2 CPUs & 6 DIMMs CPU1: A1, C1, E1, G1
CPU2: A1, E1
2 CPUs & 8 DIMMs* CPU1: A1, C1, E1, G1
CPU2: A1, C1, E1, G1
2 CPUs & 10 DIMMs CPU1: A1, B1, C1, E1, F1, G1
CPU2: A1, C1, E1, G1
2 CPUs & 12 DIMMs* CPU1: A1, B1, C1, E1, F1, G1
CPU2: A1, B1, C1, E1, F1, G1
2 CPUs & 14 DIMMs CPU1: A1, B1, C1, D1, E1, F1, G1, H1
CPU2: A1, B1, C1, E1, F1, G1
2 CPUs & 16 DIMMs* CPU1: A1, B1, C1, D1, E1, F1, G1, H1
CPU2: A1, B1, C1, D1, E1, F1, G1, H1
2 CPUs & 18 DIMMs CPU1: A1, A2, B1, C1, C2, D1, E1, E2, F1, G1, G2, H1
CPU2: A1, B1, C1, E1, F1, G1
2 CPUs & 20 DIMMs CPU1: A1, A2, B1, C1, C2, D1, E1, E2, F1, G1, G2, H1
CPU2: A1, B1, C1, D1, E1, F1, G1, H1
2 CPUs & 22 DIMMs CPU1: A1, A2, B1, B2, C1, C2, D1, D2, E1, E2, F1, F2, G1, G2, H1, H2
CPU2: A1, B1, C1, E1, F1, G1
2 CPUs & 24 DIMMs* CPU1: A1, A2, B1, B2, C1, C2, D1, D2, E1, E2, F1, F2, G1, G2, H1, H2
CPU2: A1, B1, C1, D1, E1, F1, G1, H1
2 CPUs & 28 DIMMs CPU1: A1, A2, B1, B2, C1, C2, D1, D2, E1, E2, F1, F2, G1, G2, H1, H2
CPU2: A1, A2, B1, C1, C2, D1, E1, E2, F1, G1, G2, H1
2 CPUs & 32 DIMMs* CPU1: A1, A2, B1, B2, C1, C2, D1, D2, E1, E2, F1, F2, G1, G2, H1, H2
CPU2: A1, A2, B1, B2, C1, C2, D1, D2, E1, E2, F1, F2, G1, G2, H1, H2
* recommended for optimal performance
Other Intel validated memory congurations are supported, although they may not provide
optimal performance. See Intel documentation for more information.
Must have at least one DIMM per CPU.
43
Chapter 3: Maintenance and Component Installation
Optane PMem 200 Series
For 3rd Gen Intel Xeon Scalable Platinum, Gold and selected Silver processors
Symmetric Population for Each CPU with PMem + DDR4
DDR4 &
PMem Modes
AD
interl-
leve
DIMM
F1* F2 E1 E2 H1 H2 G1 G2 C2 C1 D2 D1 A2 A1 B2 B1
4 DDR4
4 PMem
AD
MM
1 - x4 PM PM PM PM- DDR4 - - DDR4 DDR4- - - - DDR4 -
1 - x4 DDR4 DDR4 DDR4 DDR4- PM - - PM - - PM - - PM -
6 DDR4
1 PMem AD One
- x1
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- - - - - - - PM - -
- - - - - - - - -DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 PM
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- - PM - - - - - - -
PM - DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- - - - - - - -
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- - - - - - PM - - -
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- - - - - - - - PM -
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- - - PM - - - - - -
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- PM - - - - - - - -
8 DDR4
1 PMem AD One
- x1
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- - - - - - PM -
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- - - - PM - - -
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- PM - - - - - -
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- - - PM - - - -
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- - - - - PM - -
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- - - - - - - PM
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4PM -------
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- - PM - - - - -
8 DDR4
4 PMem
AD
MM
1 - x4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- PM -PM PM -PM -
2 - x2 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4- PM PM - - PM PM -
1 - x4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4PM -PM PM --PM
2 - x2 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4PM -PM - - PM -PM
8 DDR4
8 PMem
AD
MM
One
- x8 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4PM PM PM PM PM PM PM PM
12 DDR4
2 PMem AD One
- x2
PM PM- DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 -
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4PM - - PM
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4PM - - PM
DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4PM --PM
AD: App Direct, MM: Memory Mode, PM: PMem
* PMem devices cannot be installed in the CPU1 DIMM F1 socket due to interference with the air shroud in 1U Ultra
SuperServers. Use an alternate population conguration from the table.
Validation Matrix (DDR4 DIMMs Validated with PMem 200 Series)
DIMM Type
(up to 3200)
Ranks Per DIMM
& Data Width
(Stack)
DIMM Capacity (GB)
DRAM Density
8Gb 16Gb
RDIMM
1Rx8 N/A N/A
1Rx4 16GB 32GB
2Rx8 16GB 32GB
2Rx4 32GB 64GB
RDIMM 3DS 4Rx4 (2H) N/A 128GB
8Rx4 (4H) NA 256GB
LRDIMM 4Rx4 64GB 128GB
LRDIMM 3DS 4Rx4 (2H) N/A N/A
8Rx4 (4H) 128GB 256GB
44
Chapter 3: Maintenance and Component Installation
PMem Notes
PMem 200 Series are supported on 3rd gen Intel Xeon Scalable Platinum, Gold and se-
lected Silver processors.
Do not mix PMem and NVDIMMs within the platform.
For MM, NM/FM ratio is between 1:4 and 1:16. The capacity not used for FM can be used
for AD. (NM = Near Memory; FM = Far Memory).
Matrix targets congs for optimized PMem to DRAM cache ratio in MM and MM + AD
modes.
For each individual population, di󰀨erent PMem rearrangements among channels are
permitted so long as the conguration does not break X12 DP Memory population rules.
Ensure the same DDR4 DIMM type and capacity are used for each DDR4 + PMem popu-
lation.
If the system detects an unvalidated cong, then the system issues a BIOS warning. The
CLI functionality is limited in non-POR congurations, and select commands will not be
supported.
x4 and x8 DDR4 DIMMs cannot be mixed in the same channel in PMem congurations.
46
Chapter 3: Maintenance and Component Installation
Warning: There is a danger of explosion if the onboard battery is installed upside down (which
reverses its polarities). This battery must be replaced only with the same or an equivalent type
recommended by the manufacturer (CR2032).
Figure 3-3. Installing the Onboard Battery
3.5 Motherboard Battery
The motherboard uses non-volatile memory to retain system information when system power
is removed. This memory is powered by a lithium battery residing on the motherboard.
Replacing the Battery
Begin by from the system.removing power
1. Push aside the small clamp that covers the edge of the battery. When the battery is
released, lift it out of the holder.
2. To insert a new battery, slide one edge under the lip of the holder with the positive (+)
side facing up. Then push the other side down until the clamp snaps over it.
Note: Handle used batteries carefully. Do not damage the battery in any way; a damaged
battery may release hazardous materials into the environment. Do not discard a used battery
in the garbage or a public landll. Please comply with the regulations set up by your local
hazardous waste management agency to dispose of your used battery properly.
47
Chapter 3: Maintenance and Component Installation
Figure 3-5. Removing a Drive Carrier
Installing Drives
Figure 3-4. Logical Drive Numbers
3.6 Storage Drives
The system supports four hot-swap 3.5" storage drives in hybrid bays. SATA support is default.
SAS support can be aorded with an optional controller card and cables. NVMe support also
requires additional cables. For compatible storage drives, see the X12DPU-6 motherboard
page. Note: In systems using a CPU with greater than 205W TDP or GPU cards, HDDs may
experience reduced performance. SSD drives are recommended for these congurations.
The drives are mounted in tool-less drive carriers that simplify their removal from the chassis.
These carriers also help promote proper airow.
Note: Enterprise level hard disk drives are recommended. For information on recommended
drives, visit the Supermicro website product pages at https://www.supermicro.com/products/
nfo/Ultra.cfm.
Removing a Hot-Swap Drive Carrier from the Chassis
1. Press the release button on the drive carrier, which will extend the drive carrier handle.
2. Use the drive carrier handle to pull the drive out of the chassis.
1
2
1 2 30
48
Chapter 3: Maintenance and Component Installation
3
Insert this side rst
Post
Post
Figure 3-6. Installing a 3.5" Drive into a Carrier
Installing a 3.5" Drive
1. Remove the dummy drive, which comes pre-installed in the drive carrier. Pull out the two
locking clasps on the right outside of the carrier and lift out the dummy drive.
2. Position the drive above the carrier with the PCB side facing down and the connector
end toward the rear of the carrier.
3. Tilt the drive to insert it onto the two posts on the left inside of the carrier.
4. Push the right side of the drive fully into the carrier and allow the two spring locking
clasps to secure the drive.
5. Insert the drive carrier into its bay, keeping the release button on the right. When the
carrier reaches the rear of the bay, the release handle will retract.
6. Push the handle in until it clicks into its locked position
49
Chapter 3: Maintenance and Component Installation
Insert this side second
4
Figure 3-7. Installing a 3.5" Drive into a Carrier
Checking the Temperature of an NVMe Drive
There are two ways to check using the BMC Dashboard.
Checking a Drive
BMC Dashboard > Server Health > NVMe SSD Shows the temperatures of all NVMe
drives.
BMC Dashboard > Server Health > Sensor Reading > NVME_SSD Shows the single
highest temperature among all the NVMe drives.
50
Chapter 3: Maintenance and Component Installation
Replacing the Drive
1. Insert the replacement drive.
2. BMC Dashboard > Server Health > NVMe SSD
3. Select Device, Group and slot and click Insert. The drive Status LED indicator ashes
red, then turns o. The Activity LED turns blue.
Figure 3-8. BMC Dashboard Screenshot
Hot-Swap for NVMe Drives
Supermicro Ultra servers support NVMe surprise hot-swap. For even better data security,
NVMe orderly hot-swap is recommended. NVMe drives can be ejected and replaced remotely
using the BMC Dashboard.
Note: If you are using VROC, see the in this manual instead.VROC section
Ejecting a Drive
1. BMC Dashboard > Server Health > NVMe SSD
2. . Select Device, Group and Slot, and click Eject After ejecting, the drive Status LED
indicator turns green.
3. Remove the drive.
Note that and are categorized by the CPLD design architecture. Device Group
Slot is the slot number on which the NVMe drives are mounted.
52
Chapter 3: Maintenance and Component Installation
System Fan Replacement
Fan speed is controlled by the BMC depending on the system temperature. If a fan fails, the
remaining fans will ramp up to full speed. The system can continue to run with a failed fan.
Replace any failed fan at your earliest convenience with the same model. Failed fans can be
identied through the BIOS. The fan numbers are printed on the oor of the chassis.
Changing a System Fan
1. If necessary, open the chassis while the system is running to determine which fan has
failed. Never run the server for an extended period of time with the chassis cover open.
2. Power down the system, as described in Section 3.1.
3. Unplug the fan cable from the motherboard and remove the failed fan from the chassis.
4. Replace the failed fan with an identical 4-cm fan, available from Supermicro.
5. Push the new fan into the vacant space in the housing while making sure the arrows on
the top of the fan (indicating air direction) point in the same direction as the arrows on
the other fans.
6. Reposition the fan housing back over the two mounting posts in the system, then
reconnect the fan wires to the same fan headers on the motherboard.
7. Power up the system and check that the fan is working properly and that the LED on the
control panel has turned o. Finish by replacing the chassis cover.
3-10. Fans in Housing
53
Chapter 3: Maintenance and Component Installation
Figure 3-11. Installing the Air Shrouds
Air Shrouds
Air shrouds concentrate airow to maximize fan eciency. The air shroud does not require
screws to install.
Installing an Air Shroud
1. Position the air shroud in the chassis as illustrated below.
2. Align the notch on the air shroud with the pin on the expansion card bracket.
3. Slide the pin into the back of the notch.
4. Lower the front of the air shroud over the fan tray, sliding the front notches over the pins
on the fan tray.
Note: Take care that the shroud does not interfere with other components, such as a DIMM
latch before re-installing the chassis cover.
Air Shrouds
54
Chapter 3: Maintenance and Component Installation
3.8 Power Supply
The chassis features redundant power supplies. The system will continue to operate if one
module fails. It should be replaced as soon as convenient. The power supply modules are
hot-swappable, meaning they can be changed without powering down the system. New units
can be ordered directly from Supermicro or authorized distributors.
These power supplies are auto-switching capable. This feature enables them to automatically
sense the input voltage and operate at a 100-120v or 180-240v.
Power Supply LEDs
On the rear of the power supply module, an LED displays the status.
Solid Green: When illuminated, indicates that the power supply is on.
Blinking Green: When blinking, indicates that the power supply is plugged in and turned
o by the system.
Blinking Amber: When blinking, indicates that the power supply has a warning condition
and continues to operate.
Solid Amber: When illuminated, indicates that the power supply is plugged in, and is in
an abnormal state. The system might need service. Please contact Supermicro technical
support.
Changing the Power Supply Module:
1. Unplug the AC cord from the module to be replaced.
2. On the back of the module, push the release tab sideways, as illustrated.
3. Pull the module out using the handle.
4. Push the new power supply module into the power bay until it clicks. Replace with the
same model.
5. Plug the AC power cord back into the module.
Figure 3-12. Replacing the Power Supply
Release Tab
PWS1 PWS2
55
Chapter 3: Maintenance and Component Installation
3.9. PCI Expansion Slots
This system includes riser cards that allow for expansion cards.
Figure 3-13. Expansion Card Chassis Slots
1 2
4
3
Riser Cards
This system include riser cards that provide PCIe capabilities—one Ultra Riser card (described
in Section 1.1), one right-facing WIO riser card, and one left-facing WIO card.
PCIe Slots per Riser Card
Riser Card Part Number Description (all PCIe 4.0)Slot
Ultra Riser card
AOC-URG4N4
AOC-URG4N4-i2XT
AOC-URG4N4-i4XTS
AOC-URG4N4-m2TS
1 x16 Internal LP, 75W (CPU2)
Right-facing RSC-WR-6 2 x16 low prole, 75W (CPU1)
Left-facing RSC-W-66G4 3
4
x16 FH, 10.5”L, 75W (CPU2)
x16 FH, 10.5”L, 75W (CPU1)
Full-height = 4.2", Low-prole = 2.5", Full-length = 10.5", Half-length = 6.6"
One riser card slot may be used for a controller card that supports SAS.
The x16 slots can be enabled as , and can support up to 75W. Power greater high power
than 75W must be supplied by an auxiliary power source.
56
Chapter 3: Maintenance and Component Installation
Installing a Full-Height Expansion Card
1. Power down the system as described in section 3.1 and remove the cover.
2. Pull out the bracket and sections of the chassis in the rear.
Figure 3-14. Riser Card Bracket and Expansion Slots
3. If necessary, attach the riser card to the riser card bracket using screws.
4. Insert the expansion card into a slot on the riser card while aligning the expansion card
backplate with the open slot in the rear of the chassis.
5. Re-install the riser card bracket, inserting the riser card into the motherboard expansion
slot while aligning the riser card bracket with the rear of the chassis.
6. For GPUs, if necessary, connect the GPU power cables to one of the 8-pin power
connectors on the motherboard.
57
Chapter 3: Maintenance and Component Installation
Figure 3-15. Expansion Cards Installed
Expansion Cards
Internal Expansion Card
59
Chapter 3: Maintenance and Component Installation
Figure 3-17. Cable Routing Diagram
3.10 Cable Routing Diagram
Use this section to route or reroute cables. Proper routing is important to maintain airow
through the system.
Online Cable Matrix
Front Panel Control Cable
CBL-CDAT-0667
Figure 3-18. Storage Backplane BPN-SAS3-815TQ-N4
60
Chapter 3: Maintenance and Component Installation
NVMe Storage Cable Routing
SAS/SATA Storage Cable Routing
610U- -- connectionTNR > NVMe
MB/RSC side BPN side
Cable # Connector Type Connector TypePort Port Length
1 P1_NVME3 OCuLinkSlimlineLP x4 RA x4 STR NVMe 0 17
2 P1_NVME6 OCuLinkSlimlineLP x4 RA x4 STR NVMe 1 25
3 P2_NVME7SlimlineLP x4 RA OCuLink x4 STR NVMe 2 17
4 P2_NVME10SlimlineLP x4 RA OCuLink x4 STR NVMe 3 25
NVMe Cables
NVMe Cables With VPP and I2C SignalBMC
610U-TNR > BPN Power connection--
610U- --TNR > SAS/SATA connection
MB/RSC side BPN side
Cable # Connector Type Connector Type LengthPort Port
5 JPW3 47,622x4 GPU STR 2x 1x4 GPU JPW3, JPW4STR
MB/RSC side BPN side
Cable # Connector Type Connector Type LengthPort Port
6 S- -3SlimSAS x4 RE SATA 0 4x SATA STR
SAS #0, SAS #1,
SAS #2, SAS #3
56,46,
46,56
Power Cables
SAS/SATA Cables
61
Chapter 3: Maintenance and Component Installation
610U-TNR --> 3816/3916 cable connection
On slot #1 On slot #2
MB/RSC side BPN side
Cable # Connector Type Connector TypePort Port Length
7 SlimSAS x8 STR (3816/3916)
CN0 4x SATA STR
SAS #0, SAS #1,
SAS #2, SAS #3
60,50,
50,60
610U-TNR --> 3808/3908 cable connection
On slot #1 On slot #2
MB/RSC side BPN side
Cable # Connector Type Connector TypePort Port Length
7 SlimSAS x8 STR (3816/3916)
CN0 4x SATA STR
SAS #0, SAS #1,
SAS #2, SAS #3
60,50,
50,60
63
Chapter 4: Motherboard Connections
Chapter 4
Motherboard Connections
This section describes the connections on the motherboard and provides pinout denitions.
Note that depending on how the system is congured, not all connections are required. The
LEDs on the motherboard are also described here. A motherboard layout indicating component
locations may be found in . More detail can be found in the Chapter 1 Motherboard Manual
Please review the Safety Precautions in Appendix A before installing or removing components.
4.1 Power Connections
Two power connectors supply the motherboard and several more supply onboard devices.
Main Power Connectors
Two proprietary main power headers are located at PSU1 and PSU2. Connect appropriate
power supply units to these two headers to provide adequate power to your system.
Backplane Power Connectors & GPU Power Connectors
In addition to the main power headers, eight 8-pin DC power connectors are also located on
the motherboard. Four GPU Power Connectors, JGPW1–4, are used for GPU devices, while
JPW1–4 are used for four backplane devices. Use the appropriate power cable to make a
connection between these connectors and the storage disk backplane and high-powered
GPU cards (if installed).
To provide adequate power supply to your entire system, connect both main power supply units
(PSU1/PSU2) and all 8-pin PWR connectors (JPW1–4 and JGPW1–4) on the motherboard
to the power supplies. Failure to do so may void the manufacturer warranty on your power
supply and motherboard.
GPU 8-pin Power
JGPW1–4
Pin Denitions
Pin# Denition
1 - 4 Ground
5 - 8 +12 V
Backplane 8-pin Power
JPW1–4
Pin Denitions
Pin# Denition
1 - 4 Ground
5 - 6 +12V
7 - 8 +5V
64
Chapter 4: Motherboard Connections
4.2 Headers and Connectors
Fan Headers
There are eight fan headers on the motherboard, (FAN1-8). These are 4-pin fan headers,
although pins 1-3 are backward compatible with traditional 3-pin fans. Four-pin fans allow
fan speeds to be controlled by Thermal Management in the BMC. When using the Thermal
Management setting, use all 3-pin fans or all 4-pin fans.
Fan Header
Pin Denitions
Pin# Denition
1 Ground (Black)
2 +12V (Red)
3 Tachometer
4 PWM Control
SGPIO Header
A Serial General Purpose Input/Output header (T-SGPIO3) is used to communicate with the
enclosure management chip on the backplane.
SGPIO Header
Pin Denitions
Pin# Pin#Denition Denition
1 2NC NC
3 4Ground DATA Out
5 6Load Ground
7 8Clock NC
NC = No Connection
Disk-On-Module Power Connector
Two power connectors for SATA DOM (Disk-On-Module) devices are located at JSD1 and
JSD2. Connect appropriate cables here to provide power support for your Serial Link DOM
devices.
DOM Power
Pin Denitions
Pin# Denition
1 5V
2 Ground
3 Ground
65
Chapter 4: Motherboard Connections
TPM Header
The JTPM1 header is used to connect a Trusted Platform Module (TPM), which is available
from Supermicro. A TPM connector is a security device that supports encryption and
authentication in hard drives. It allows the motherboard to deny access if the TPM associated
with the storage drive is not installed in the system. For more information on the TPM: http://
www.supermicro.com/manuals/other/TPM.pdf.
Trusted Platform Module Header
Pin Denitions
Pin# Pin#Denition Denition
1 2P3V3 SPI_TPM_CS_N
3 4PCIe_RESET_N# SPI_PCH_MISO
5 6SPI_PCH_CLK# Ground
7 8SPI_PCH_MOSI N/A
9 JTPM1_P3V3A 10 IRQ_TPM_SPIN_N
NVMe SMBus Headers
NVMe SMBus (I2C) headers (JNVI2C3/4), used for PCIe SMBus clock and data connections,
provide hot-plug support through a dedicated SMBus interface. This feature is only available
for a Supermicro complete system with a proprietary NVMe add-on card and cable installed.
NVMe SMBus Header
Pin Denitions
Pin# Denition
1 Data
2 Ground
3 Clock
4 VCCIO
NCSI Connector
Use the Network Controller SideBand Interface (NCSI) connector, JNSCI, to connect a
Network Interface Controller (NIC) to the motherboard.
66
Chapter 4: Motherboard Connections
RAID Key Header
An Intel VROC RAID Key header is located at JRK1. It supports VMD used in creating optional
advanced NVMe RAID congurations.
RAID Key Header
Pin Denitions
Pin# Denition
1 Ground
2 RAID_KEY_PU
3 Ground
4 PCH_RAID_KEY
VROC Key
Header (JRK1)
Note: This drawing is
for illustration only. Your
motherboard may look
di󰀨erent.
4-pin BMC External I2C Header
A System Management Bus header for the BMC is located at JIPMB1. Connect a cable to
this header to use the IPMB I2C connection on your system.
External I2C Header
Pin Denitions
Pin# Denition
1 Data
2 Ground
3 Clock
4 No Connection
Chassis Intrusion
A Chassis Intrusion header is located at JL1 on the motherboard. Attach the appropriate cable
from the chassis to the header to inform you when the chassis is opened.
Chassis Intrusion
Pin Denitions
Pins Denition
1 Intrusion Input
2 Ground
67
Chapter 4: Motherboard Connections
Figure 4-1. JF1 Control Panel Pins
Control Panel
JF1 contains header pins for various control panel connections. See the gure below for the
pin locations and denitions of the control panel buttons and LED indicators.
All JF1 wires have been bundled into a single cable to simplify this connection. Make sure
the red wire plugs into pin 1 as marked on the motherboard. The other end connects to the
control panel PCB board.
Power Button
The Power Button connection is located on pins 1 and 2 of JF1. Momentarily contacting both
pins will power on/o󰀨 the system. This button can also be congured to function as a suspend
button with a setting in the UEFI BIOS. To turn o󰀨 the power when the system is in suspend
mode, press the button for 4 seconds or longer.
Power Button
Pin Denitions (JF1)
Pin# Denition
1 Signal
2 Ground
Reset Button
The Reset Button connection is located on pins 3 and 4 of JF1. Attach it to a hardware reset
switch on the computer case.
Reset Button
Pin Denitions (JF1)
Pin# Denition
3 Reset
4 Ground
Power Button
(Blue LED_Cathode_UID)
NIC1 (Activity) LED
Reset Button
HDD LED
FP PWR LED
ID_UID/3.3V Stby
Ground
19
Ground
20
1 2
Ground
Power Fail (for LED6)
NIC2 (Link) LED
NMI
3.3V
(Red OH/Fan Fail/PWR Fail for LED5/Blue UID LED)
3.3V
Red+ Blue+
NIC2 (Activity) LED
NIC1 (Link) LED
Key Key
68
Chapter 4: Motherboard Connections
Power Fail LED
The Power Fail LED connection is located on pins 5 and 6 of JF1.
Power Fail LED
Pin Denitions (JF1)
Pin# Denition
5 3.3V
6 PWR Supply Fail
OH/Fan Fail Indicator
Status
Status Denition
O󰀨 Normal
On Overheat
Flashing Fan Fail
Overheat (OH)/Fan Fail
Connect an LED cable to pins 7 and 8 of JF1 to use the Overheat/Fan Fail LED connections.
The LED on pin 8 provides warnings of overheat or fan failure.
OH/Fan Fail LED
Pin Denitions (JF1)
Pin# Denition
7 Blue LED
8 OH/Fan Fail LED
NIC1/NIC2 (LAN1/LAN2)
The NIC (Network Interface Controller) LED connection for LAN port 1 is located on pins 11
and 12 of JF1, and the LED connection for LAN port 2 is on pins 9 and 10. Attach the NIC
LED cables here to display network activity.
LAN1/LAN2 LED
Pin Denitions (JF1)
Pin# Denition
9 NIC2 Activity LED
10 NIC2 Link LED
11 NIC1 Activity LED
12 NIC1 Link LED
HDD LED/UID Switch
The HDD LED/UID Switch connection is located on pins 13 and 14 of JF1. Attach a cable to
Pin 14 to show hard drive activity status. Attach a cable to pin 13 to use UID switch. Refer
to the table below for pin denitions.
HDD LED
Pin Denitions (JF1)
Pin# Denition
13 3.3V Standby/UID Switch
14 HDD Active
69
Chapter 4: Motherboard Connections
Power LED
The Power LED connection is located on pins 15 and 16 of JF1.
Power LED
Pin Denitions (JF1)
Pin# Denition
15 3.3V
16 Power LED
NMI Button
The non-maskable interrupt button header is located on pins 19 and 20 of JF1.
NMI Button
Pin Denitions (JF1)
Pin# Denition
19 Control
20 Ground
72
Chapter 4: Motherboard Connections
Unit ID LED
A rear unit identier (UID) indicator at LED1 is located near the UID switch on the I/O back
panel. It provides easy identication of a unit that may need service.
Onboard Power LED
The Onboard Power LED is LE2. When this LED is on, the system power is on.
BMC Heartbeat LED
LEDM1 is the BMC heartbeat LED. When the LED is blinking green, BMC is functioning
normally.
4.5 LED Indicators
Network LAN LEDs
The Ethernet ports each have two LEDs. One LED indicates activity when ashing green.
The other may be green, amber or o󰀨 to indicate the speed of the connection. Speeds are
noted in Chapter 1.
BMC Dedicated LAN LEDs
A dedicated BMC LAN port is also included on the motherboard. The amber LED on the right
of the BMC LAN port indicates activity, while the LED color on the left indicates the speed
of the connection.
BMC Link LED
Color Denition
O󰀨 No Connection
Green 100 Mb/s
Amber 1 Gb/s
Link LED
(speed)
Activity LED
73
Chapter 4: Motherboard Connections
4.6 Storage Ports
I-SATA 3.0 and S-SATA 3.0 Ports
The motherboard has eight I-SATA 3.0 ports (I-SATA 0-3, I-SATA 4-7) and six S-SATA
(S-SATA 0-3, S-SATA 4, S-SATA 5) on the motherboard. These SATA ports are supported by
the Intel PCH C621 chipset. S-SATA 4/S-SATA 5 can be used with Supermicro SuperDOMs
which are orange SATA DOM connectors with power pins built in, and do not require external
power cables. Supermicro SuperDOMs are compatible with regular SATA HDDs or SATA
DOMs that need external power cables.
NVMe Connectors
The motherboard o󰀨ers the following NVMe headers.
P1-NVMe0/1 (one) Supports two NVMe backplane ports
P1-NVMe3,4,5,6 (four) Each supports one NVMe backplane port
P2-NVMe7,8,9,10 (four) Each supports one NVMe backplane port
The P1 headers are supported by CPU1; the P2 headers are supported by CPU2.
The Ultra Riser card may o󰀨er two additional NVMe headers so that all twelve drives can
be NMVe.
Note: Connect P1_NVMe0/1 rst for your system to work properly.
74
Chapter 5: Software
Chapter 5
Software
After the hardware has been installed, you can install the Operating System (OS), congure
RAID settings and install the drivers.
5.1 Microsoft Windows OS Installation
If you will be using RAID, you must congure RAID settings before installing the Windows
OS and the RAID driver. Refer to the RAID Conguration User Guides posted on our website
at www.supermicro.com/support/manuals.
Installing the OS
1. Create a method to access the MS Windows installation ISO le. That might be a DVD,
perhaps using an external USB/SATA DVD drive, or a USB ash drive, or the BMC KVM
console.
2. Retrieve the proper RST/RSTe driver. Go to the Supermicro web page for your
motherboard and click on "Download the Latest Drivers and Utilities", select the proper
driver, and copy it to a USB ash drive.
3. Boot from a bootable device with Windows OS installation. You can see a bootable
device list by pressing during the system startup.F11
Figure 5-1. Select Boot Device
75
Chapter 5: Software
4. During Windows Setup, continue to the dialog where you select the drives on which to
install Windows. If the disk you want to use is not listed, click on “Load driver” link at the
bottom left corner.
Figure 5-2. Load Driver Link
To load the driver, browse the USB ash drive for the proper driver les.
For RAID, choose the SATA/sSATA RAID driver indicated then choose the storage drive
on which you want to install it.
For non-RAID, choose the SATA/sSATA AHCI driver indicated then choose the storage
drive on which you want to install it.
5. Once all devices are specied, continue with the installation.
6. After the Windows OS installation has completed, the system will automatically reboot
multiple times.
76
Chapter 5: Software
5.2 Driver Installation
The Supermicro website contains drivers and utilities for your system at https://www.
supermicro.com/wdl/driver. Some of these must be installed, such as the chipset driver.
After accessing the website, go into the CDR_Images (in the parent directory of the above
link) and locate the ISO le for your motherboard. Download this le to to a USB ash drive
or a DVD. (You may also use a utility to extract the ISO le if preferred.)
Another option is to go to the Supermicro website at http://www.supermicro.com/products/.
Find the product page for your motherboard, and "Download the Latest Drivers and Utilities".
Insert the ash drive or disk and the screenshot shown below should appear.
Figure 5-3. Driver & Tool Installation Screen
Note: Click the icons showing a hand writing on paper to view the readme les for each
item. Click the computer icons to the right of these items to install each item (from top to the
bottom) one at a time. After installing each item, you must re-boot the system before
moving on to the next item on the list. The bottom icon with a CD on it allows you to view
the entire contents.
77
Chapter 5: Software
5.3 SuperDoctor ® 5
The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based
interface for Windows and Linux operating systems. The program monitors such system health
information as CPU temperature, system voltages, system power consumption, fan speed,
and provides alerts via email or Simple Network Management Protocol (SNMP).
SuperDoctor 5 comes in local and remote management versions and can be used with Nagios
to maximize your system monitoring needs. With SuperDoctor 5 Management Server (SSM
Server), you can remotely control power on/oand reset chassis intrusion for multiple systems
with SuperDoctor 5 or the BMC. SuperDoctor 5 Management Server monitors HTTP, FTP,
and SMTP services to optimize the eciency of your operation.
SuperDoctor ® Manual and Resources
Figure 5-4. SuperDoctor 5 Interface Display Screen (Health Information)
78
Chapter 5: Software
5.4 BMC
The motherboard provides remote access, monitoring and management through the
baseboard management controller (BMC) and other management controllers distributed
among dierent system modules. There are several BIOS settings that are related to BMC.
For general documentation and information on BMC, visit our website at:
www.supermicro.com/en/solutions/management-software/bmc-resources
BMC ADMIN User Password
For security, each system is assigned a unique default BMC password for the ADMIN user.
This can be found on a sticker on the chassis and a sticker on the motherboard. The sticker
also displays the BMC MAC address. If necessary, the password can be reset using the
Supermicro IPMICFG tool.
Figure 5-5. BMC Password Label
The sticker can be found on the pull-out service tag at the front of the chassis. See Chapter
1 for the location.
79
Chapter 6: Optional Components
Chapter 6
Optional Components
This chapter describes alternate congurations and optional system components.
Optional Parts
Storage drive options
Power options
Cable Management Arm
TPM security module
Intel VROC RAID Key
6.1 Storage Protocols Supported
The storage drive bays can support SATA, SAS, and NVMe in any combination. To enable
SAS and NVMe, additional hardware is required. Once the supporting hardware is installed
for a selection of bays, drives of any storage protocol type can be inserted.
SATA The default conguration supports up to four SATA drives.
SAS – An add-on controller card and cables can support up to four SAS drives.
NVMe The motherboard supports up to four NVMe drives. Additional cables are required.
6.2 Power Supply Modules
Power Supply Module Options
Watts Part Number 80Plus Level
1200 TitaniumPWS-1K22A-1R (default)
1600 PWS-1K62A-1R Titanium
2000 PWS-2K08A-1R Titanium
1300 DC Not applicablePWS-1K30D-1R
82
Chapter 6: Optional Components
6.4 TPM Security Module
SPI capable TPM 2.0 (or 1.2) with Inneon 9670 controller, vertical form factor
The JTPM1 header is used to connect a Trusted Platform Module (TPM). A TPM is a security
device that supports encryption and authentication in hard drives. It enables the motherboard
to deny access if the TPM associated with the hard drive is not installed in the system.
Details and installation procedures are at:
http://www.supermicro.com/manuals/other/TPM.pdf.
AOM-TPM-9670V
AOM-TPM-9671V

Especificaciones del producto

Marca: Supermicro
Categoría: servidor
Modelo: SuperServer SYS-610U-TNR

¿Necesitas ayuda?

Si necesitas ayuda con Supermicro SuperServer SYS-610U-TNR haz una pregunta a continuación y otros usuarios te responderán




servidor Supermicro Manuales

servidor Manuales

Últimos servidor Manuales