hit counter script
IBM 3500 Hardware Planning And Installation Manual
  1. Manuals
  2. Brands
  3. IBM Manuals
  4. Storage
  5. Netfinity 3500
  6. Hardware planning and installation manual
IBM 3500 Hardware Planning And Installation Manual

IBM 3500 Hardware Planning And Installation Manual

Storage scale system
Hide thumbs Also See for 3500:
Table of Contents

Advertisement

Quick Links

Download this manual
IBM Storage Scale System 3500
6.1.9
Hardware Planning and Installation
Guide
IBM
SC28-3460-02

Advertisement

Table of Contents
loading

Related Manuals for IBM 3500

Summary of Contents for IBM 3500

  • Page 1 IBM Storage Scale System 3500 6.1.9 Hardware Planning and Installation Guide SC28-3460-02...
  • Page 2 IBM welcomes your comments; see the topic “How to submit your comments” on page xv. When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you.

  • Page 3: Table Of Contents

    Russia Notice............................15 Taiwan Notice............................15 United States Federal Communications Commission (FCC) Notice........... 15 Chapter 2. Technical overview................17 System overview............................17 IBM Storage Scale System 3500 Solution configurations..............22 Drives................................22 Drive slots............................. 22 Power modules............................23 SSR access port............................23 Hardware specification sheets........................23 EMS node specifications........................
  • Page 4 Installing the EMS server in a rack.......................42 Unpacking IBM Storage Scale System 3500 (IBM SSR task)..............42 Installing support rails for the IBM Storage Scale System 3500 system (IBM SSR task)....43 Installing enclosures (IBM SSR task)....................47 Installing cable management assembly (IBM SSR task)..............50 Chapter 5. Monitoring the system using LEDs............55...
  • Page 5 Accessibility features..........................85 Keyboard navigation..........................85 IBM and accessibility..........................85 Glossary......................87 Index........................95   v...
  • Page 6 vi  ...

  • Page 7: Figures

    4. Network topology............................20 5. IBM Storage Scale System 3500 high-level architecture and topology............ 21 6. Performance configuration......................... 22 7. Front view of IBM Storage Scale System 3500 with drives installed............22 8. Power module..............................23 9. SSR access port............................23 10.
  • Page 8 40. Installing CMA body connector (E) on the left CMA body rail..............52 41. System status LEDs on an IBM Storage Scale System 3500 enclosure..........55 42. Displaying system status LEDs on an IBM Storage Scale System 3500 enclosure........ 55 43. Drive status LEDs on an IBM Storage Scale System 3500 drive carrier..........57 44.
  • Page 9 49. Slot placement summary..........................63 50. 2-port HDR 100 Gb InfiniBand ConnectX-7 adapter (FC AJQS)..............65 51. 5149-N64 switch ports..........................67 52. 5149-N64 switch power........................... 67 53. Port view of the 5149-N64 switch ......................68 54. Power side view............................68 55. Chassis labels............................69 56. Switch labels............................. 70 57.
  • Page 10 74. Releasing latch while pulling the handle....................83 75. Extracting a fan module..........................84 x  ...

  • Page 11: Tables

    4. Power cord feature codes........................... 26 5. Power planning reference information for Power9..................27 6. Power planning reference information for IBM Storage Scale System Utility Node ........ 28 7. System maximum measured power specifications................... 31 8. Power rating specifications per power module..................32 9.
  • Page 12 24. IBM Storage Scale System 3500 Ethernet port status LEDs..............60 25. Behavior of IBM Storage Scale System 3500 server canister status LEDs ..........61 26. ConnectX-7 cable matrix.......................... 66 27. IBM MTM and NVIDIA system model.......................67 xii  ...

  • Page 13: About This Information

    This information is intended for administrators of IBM Elastic Storage System (ESS) that includes IBM Storage Scale RAID. IBM Elastic Storage System information units IBM Storage Scale System 3500 documentation consists of the following information units. Information unit Type of information Intended users...

  • Page 14: Conventions Used In This Information

    • IBM POWER9 servers, see https://www.ibm.com/docs/en/ess/6.1.9_ent?topic=guide-5105-22e- reference-information. For the latest support information about IBM Storage Scale RAID, see the IBM Storage Scale RAID FAQ in IBM Documentation. Conventions used in this information Table 1 on page xiv describes the typographic conventions used in this information. UNIX file name conventions are used throughout this information.

  • Page 15: How To Submit Your Comments

    In the left margin of the document, vertical lines indicate technical changes to the information. How to submit your comments To contact the IBM Storage Scale development organization, send your comments to the following email address: scale@us.ibm.com About this information  xv...
  • Page 16 Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 17: Chapter 1. Notices

    This information was developed for products and services offered in the US. This material might be available from IBM in other languages. However, you may be required to own a copy of the product or product version in that language in order to access it.

  • Page 18: Trademarks

    International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the web at Copyright and trademark information at www.ibm.com/legal/copytrade.shtml.

  • Page 19: Homologation Statement

    DANGER: A danger notice indicates the presence of a hazard that has the potential of causing death or serious personal injury. (D002) 2. Locate the IBM Systems Safety Notices with the user publications that were provided with your system hardware.
  • Page 20 Electrical voltage and current from power, telephone, and communication cables are hazardous. To avoid a shock hazard: If IBM supplied the power cord(s), connect power to this unit only with the IBM provided power cord. Do not use the IBM provided power cord for any other product. Do not open or service any power supply assembly.
  • Page 21 plate. For racks with a DC power distribution panel (PDP), connect the customer’s DC power source to the PDP. Ensure that the proper polarity is used when attaching the DC power and DC power return wiring. • Connect any equipment that will be attached to this product to properly wired outlets. •...
  • Page 22 • Access covers are intended only for occasional removal. • Follow documented procedures when opening during live or temporary service. • When service is complete, promptly reinstall all covers, lids, and/or doors for correct operation. (L031) 6  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...
  • Page 23 CAUTION: CAUTION regarding IBM provided VENDOR LIFT TOOL: • Operation of LIFT TOOL by authorized personnel only • LIFT TOOL intended for use to assist, lift, install, remove units (load) up into rack elevations. It is not to be used loaded transporting over major ramps nor as a replacement for such designated tools like pallet jacks, walkies, fork trucks and such related relocation practices.
  • Page 24 • If the rack cabinet you are relocating is part of a suite of rack cabinets, detach the rack cabinet from the suite. • If the rack cabinet you are relocating was supplied with removable outriggers they must be reinstalled before the cabinet is relocated. 8  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 25: Special Caution And Safety Notices

    • Exchange only with the approved part. Recycle or discard the battery as instructed by local regulations. In the United States, IBM has a process for the collection of this battery. For information, call 1-800-426-4333. Have the IBM part number for the battery unit available when you call. (C003) Special caution and safety notices This information describes special safety notices that apply to the system.
  • Page 26 Important: Good judgment must also be used to identify potential safety hazards due to the attachment of non-IBM features or options that are not covered by this inspection guide. If any unsafe conditions are present, you must determine how serious the apparent hazard might be and whether you can continue without first correcting the problem.
  • Page 27 To conduct the internal device check, use the following steps. 1. Check for any non-IBM changes that were made to the device. 2. Check the condition of the inside of the device for any metal or other contaminants, or any indications of water, other fluid, fire, or smoke damage.

  • Page 28: Environmental Notices

    IBM Storage Scale System 3500 meets all regulatory EMC compliance requirements as offered, including auxiliary equipment and cables that may be ordered from IBM to be used in conjunction with IBM Storage Scale System 3500.

  • Page 29: Japan Electronics And Information Technology Industries Association (Jeita) Notice

    Um dieses sicherzustellen, sind die Geräte wie in den Handbüchern beschrieben zu installieren und zu betreiben. Des Weiteren dürfen auch nur von der IBM empfohlene Kabel angeschlossen werden. IBM übernimmt keine Verantwortung für die Einhaltung der Schutzanforderungen, wenn das Produkt ohne Zustimmung von IBM verändert bzw.

  • Page 30: Japan Voluntary Control Council For Interference (Vcci) Notice

    This statement applies to products greater than 20 A per phase, three-phase. Japan Voluntary Control Council for Interference (VCCI) Notice Korea Notice People's Republic of China Notice 14  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 31: Russia Notice

    Properly shielded, grounded, and approved cables and connectors must be used in order to meet FCC emission limits. IBM is not responsible for any radio or television interference caused by using other than approved cables and connectors, or by unauthorized changes or modifications to this equipment.
  • Page 32 Armonk, NY 10504 Contact for FCC compliance information only: fccinfo@us.ibm.com 16  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 33: Chapter 2. Technical Overview

    SSD drives to provide significant performance improvements as compared to SAS-attached flash drives. IBM Storage Scale System 3500 can contain up to 24 NVMe-attached SSD drives. You can either use 12 drives in a half-populated configuration or 24 drives in a fully populated configuration. These drives are accessible from the front of IBM Storage Scale System 3500, as shown in the following figure.
  • Page 34 System 3500 unit The major key characteristics of the IBM Storage Scale System 3500 system are as follows: • IBM Storage Scale software with enclosure-based, all-inclusive software feature licensing. • NVMe transport protocol for high performance of 2.5-inch (SFF) NVMe-attached SSD drives and flash drive: –...

  • Page 35: Ibm Storage Scale System 3500 Networking

    • AJZN: CX-6 DX in PCIe form factor (Ethernet - 100 GbE) You can configure IBM Storage Scale System 3500 in a mixed cluster where other IBM Storage Scale System products are used. The following figure shows the IBM Storage Scale System network topology of a mixed IBM Storage Scale System cluster that contains ESS 5000, IBM Storage Scale System 3500, ESS 3200, and ESS 3000 systems.
  • Page 36 • The NVMe transport protocol supports industry standard NVMe flash drives. Enterprise-level software and support IBM Storage Scale System 3500 consists of two server canisters that run theIBM Storage Scale software, ® which is a part of the IBM Spectrum family.

  • Page 37: Ibm Storage Scale System 3500 High-Level Architecture And Topology

    You need a minimum of one EMS node as a part of your IBM Storage Scale System cluster. When IBM Storage Scale System 3500 is added to an existing IBM Storage Scale System cluster that has a POWER9 EMS node, the same POWER9 EMS node can also be used to manage IBM Storage Scale System 3500.

  • Page 38: Ibm Storage Scale System 3500 Solution Configurations

    IBM Storage Scale System 3500 supports 12 and 24 drive configurations. All drives must be identical in an IBM Storage Scale System 3500 enclosure. In a 12 drive configuration, drives must be installed in slots 1 - 6 and 13 - 18.

  • Page 39: Power Modules

    Hardware specification sheets EMS node specifications IBM Storage Scale System 3500 uses one EMS node in the basic configuration. The EMS node acts as the management server and provides infrastructure for hardware monitoring and hosts GUI. The EMS server has the following roles: •...
  • Page 40 • Call home server For more information about the POWER9 EMS (FC ESZX) node, see Model 5105-22E server specifications. For more information about the IBM Storage Scale System Utility Node, see Model 5149-23E server specifications. 24  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 41: Chapter 3. Planning For Hardware

    For detailed rack specification information on the 7965-S42 rack, see: Planning for the 7965-S42 rack. If you do not have a 7965-S42 rack and want to install the system into a non-IBM rack, see “ IBM Storage Scale System 3500 requirements” on page 29. Ensure that the physical environment meet the specified requirements, such as rack space, power, and environmental conditions.

  • Page 42: Reviewing Ibm Storage Scale System 3500 Location Guidelines

    IBM Storage Scale System 3500 contains two server canisters. Each IBM Storage Scale System 3500 cluster consists of the following components: • One or more IBM Storage Scale System 3500 systems – each system requires 2U (standard rack units) in a rack.
  • Page 43 C13/C20 6458 Power Cord 4.3 m (14 ft), Drawer to IBM PDU (250V/10A) C13/C14 6671 Power Cord 2.7 m (9 ft), Drawer to IBM PDU (250V/ 10A) C13/C14 6672 Power Cord 2M (6.5 ft), Drawer to IBM PDU, 250V/10A C13/C14 END0 Power Cord 2M (6.5 ft), Drawer to IBM PDU,...

  • Page 44: Physical Installation Planning

    Power cord routing and retention https://www.ibm.com/docs/en/power9?topic=cm- power-cord-routing-retention-8 System calculators https://www.ibm.com/docs/en/power9?topic=ps- system-calculators-8 Table 6. Power planning reference information for IBM Storage Scale System Utility Node For this information... Go to... https://www.ibm.com/docs/en/sssun? topic=overview-power-supply-units-psus EMS node specifications https://www.ibm.com/docs/en/sssun? topic=sheets-ems-node-specifications Model 7965-S42 rack specifications https://www.ibm.com/docs/en/sssun?topic=rack-...

  • Page 45: Operating Environment

    Supported hosts IBM Storage Scale needs to be installed on the host server before it is connected to IBM Storage Scale System 3500. IBM Storage Scale provides the high-performance scale-out clustering capabilities. For a list of supported host type and OS, see IBM Storage Scale Frequently Asked Questions.
  • Page 46 • Multiple power cords. The product might be equipped with multiple AC power cords or multiple DC power cables. To remove all hazardous voltages, disconnect all power cords and power cables. (L003) 30  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...
  • Page 47 If there is less airflow, additional mechanisms are required to cool the enclosure. An appropriate IBM rack configuration would be the 7965-S42 IBM Rack Model S42, with standard rear door and feature code 6069 Front Door For 2.0 Meter Rack (High Perforation).
  • Page 48 Measurements that are obtained in other operating environments might vary. Conduct your own testing to determine specific measurements for your environment. Each IBM Storage Scale System 3500 enclosure contains two power modules for redundancy. The total power consumption values represent the total power that is drawn by both power modules when operating together or a single power module when operating in a maintenance or failure mode.
  • Page 49 The weight of this part or unit is more than 29.3 kg (64.7 lb). It takes two persons to safely lift this part or unit. The following table shows the rack space requirements for IBM Storage Scale System 3500 in tabular form.

  • Page 50: Service Envelope Illustration (Dimensions In Millimeters)

    The service clearance area is the area around the rack which is needed for the authorized service representatives to service the enclosure as shown in the sample illustration in the following figure. 34  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...
  • Page 51 Figure 12. Sample illustration to show space around the rack For IBM Storage Scale System 3500, use the recommended measurements that are given in the following table. Table 12. Service clearance requirements Front Back 915 mm (36 in.) 915 mm (36 in.) Storage racks require larger service clearances in the front of the rack.

  • Page 52: Acoustical Declaration With Noise Hazard Notice

    Supported drives The following table provides drive specifications for your IBM Storage Scale System 3500 system. Table 14. Drive specifications Model and type 2.5-inch drives IBM Storage Scale System 3500 with 24 2.5-inch 12/24 dual port NVMe drives drive slots For more information about the feature codes of the NVMe drives, see Table 3 on page 18.

  • Page 53: Ip Address Allocation And Usage

    IBM Storage Scale System 3500 uses 100GbE/200GbE/100Gb EDR/200Gb HDR network for cluster communication and data transport. For IP port usage requirement, see IBM Storage Scale Documentation. For configuration and management, you must allocate an IP address to the system. This IP address is referred to as the management IP address.

  • Page 54: Planning Your Network And Storage Network

    Care must be taken to note the orientation of each utility node so that the interconnect cables are properly connected. The following figure shows the ports on the utility node. Figure 14. Orientation of ports on the utility node 38  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...
  • Page 55 Table 18. Ports on the utility node Item number Feature Description Power supply unit Provides power supply to the system VGA port Provides a video connection to the BMC SSR port Provides one RJ45 10 GbE port for SSR connection Management port Provides one RJ-45 10 GbE port for management/campus...

  • Page 56: Planning For Adapters

    Each utility node server has two PCIe interface slots to support extra adapters. Supported environment Refer to the IBM support website for up-to-date information about the supported environment for your system. Environmental topics can include updates about the following items: •...

  • Page 57: Chapter 4. Installing

    Note: An IBM intranet connection is required to access this content. Note: Much of the information in this section is intended only for IBM authorized service providers. Customers need to consult the terms of their warranty to determine the extent to which they must attempt any IBM Storage Scale System maintenance.

  • Page 58: Installing The Ems Server In A Rack

    6. Remove the four corner reinforcement pieces from the carton. 7. Using the box knife, carefully cut the four corners of the carton from top to bottom. 8. Fold the sides and back of the carton down to uncover the rear of the IBM Storage Scale System 3500 system.

  • Page 59: Installing Support Rails For The Ibm Storage Scale System 3500 System (Ibm Ssr Task)

    Installing support rails for the IBM Storage Scale System 3500 system (IBM SSR task) Before you install the IBM Storage Scale System 3500 system, you must first install the support rails for it. To install the support rails for the IBM Storage Scale System 3500 system, complete the following steps: 1.

  • Page 60: Installation Of Round Post Screw

    6. Install the left outer rail on the rack post as follows: a) Align the left rear bracket mounting screws with the appropriate rear rack post holes as shown in the following figure. 44  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 61: Installation Of Left Rear Bracket

    Before After Release Catch Figure 20. Installation of left rear bracket b) Press and hold the release catch and push the bracket into place so that the mounting screws can be installed securely into the rack post holes. c) Release the catch to secure the rail to the post once the screws are fully inserted. d) Align the left front bracket mounting screws with the appropriate rack post holes in the front left rack post.

  • Page 62: Installation Of The Front Bracket

    Slide the rail toward the back of the enclosure to secure the standoff on the smaller section of the keyhole to lock the rail in place, which is accompanied by an audible click. See the following figure. 46  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 63: Installing Enclosures (Ibm Ssr Task)

    Following your enclosure location plan, install the IBM Storage Scale System 3500 system. CAUTION: • To lift an IBM Storage Scale System 3500 system requires at least two people. To reduce the enclosure weight to permit one person to safely lift the enclosure, you must temporarily remove the server canisters, power modules, and all drives from the enclosure.
  • Page 64 Figure 30. Replacing left ear cap b) Install the two screws on the rear side of the left bezel ear cap as shown in the following figure. 48  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...
  • Page 65 Figure 31. Displaying left ear cap front view c) Repeat the above steps to install the right bezel ear cap on the right side of the enclosure. Figure 32. Replacing right ear cap 5. Push the enclosure into the rack while pulling the outer rail until the outer and the inner rails lock into the serviceable position.

  • Page 66: Installing Cable Management Assembly (Ibm Ssr Task)

    Figure 34. Securing the enclosure At this point, the rails and IBM Storage Scale System 3500 enclosure are installed. The enclosure is mounted on the rail with all the components that were removed, reinserted into the slots. Installing cable management assembly (IBM SSR task) The cable management assembly (CMA) aids in better routing and securing of the system’s cabling.
  • Page 67  A  - Inner CMA arm connector  B  - Inner rail connector  C  - Outer CMA arm connector  D  - Outer rail connector  E  - CMA body connector  F  - CMA body rail connector Figure 36. Cable management assembly installation 2. To change the direction of the arm for use on the opposite side of the enclosure, press the release buttons on the outside of the CMA elbow and rotate the arm 180 degrees.
  • Page 68 5. Slide the CMA body connector (E) onto the lower left CMA body rail (F) as shown in the following figure. Figure 40. Installing CMA body connector (E) on the left CMA body rail 52  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...
  • Page 69 6. Connect the cables to the appropriate ports on the server canister operator panels and the jacks for the power modules. Do not connect the power cords to a power module now. 7. Starting with the thickest gauge cable first, run each cable through the loops on the CMA. 8.
  • Page 70 54  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 71: Chapter 5. Monitoring The System Using Leds

    The following figure shows system status LEDs on an IBM Storage Scale System 3500 enclosure: Figure 41. System status LEDs on an IBM Storage Scale System 3500 enclosure The following figure shows the location of each LED available on an IBM Storage Scale System 3500 enclosure from left to right: Figure 42.

  • Page 72: Drive Carrier Assembly Leds

    Drive carrier assembly LEDs Each drive carrier assembly of IBM Storage Scale System 3500 includes a set of LEDs that are visible from the bottom of the drive carrier. On system startup, the green LED illuminates automatically.

  • Page 73: Fan Module Leds

    The SSD does not have any power. Fan module LEDs The IBM Storage Scale System 3500 includes three LEDs with each of the six fan modules. The available LEDs are of blue, amber, and green color. These LEDs are used to monitor fan modules.

  • Page 74: Power Module Leds

    Power module LEDs These LEDs are used to monitor power modules of the IBM Storage Scale System 3500. The power module status LEDs are visible from the rear of the enclosure. The following figure provides a close view of the power module status LED.

  • Page 75: Server Canister Leds

    Server canister LEDs The IBM Storage Scale System 3500 server canister consists three status LEDs on the bottom of the server canister operator panel. In addition, two Ethernet port LEDs per Ethernet port (four LEDs) are located to the right of the server canister status LEDs. These LEDs are used to monitor the status of server canister and Ethernet ports.

  • Page 76: Ethernet Port Leds

    Table 24 on page 60. A close up view of Ethernet port LEDs is shown in the following figure. Figure 48. Close up view of IBM Storage Scale System 3500 Ethernet port LEDs The following table describes the behavior of Ethernet port LEDs.

  • Page 77: Server Canister Status Leds

    Server canister status LEDs The following table describes the possible behavior of server canister status LEDs. Table 25. Behavior of IBM Storage Scale System 3500 server canister status LEDs Canister status OK Canister identify (Blue) Canister fault (Amber) Behavior (Green)
  • Page 78 62  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 79: Appendix A. Ibm Storage Scale System 5141-Fn2 - Slot Placement Summary

    Appendix A. IBM Storage Scale System 5141-FN2 - Slot placement summary Each slot number and its usage, as well as VM usage when setup, are explained in the slot placement summary. The following table and the illustration represent each slot and its usage: Figure 49.
  • Page 80 64  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 81: Appendix B. Pcie5 X16 2-Port Ndr 200 Gb Infiniband Connectx-7 Capi Capable Adapter (Fc Ajqs)

    Figure 50. 2-port HDR 100 Gb InfiniBand ConnectX-7 adapter (FC AJQS) Specifications Item Description Adapter FRU number 01LL984 I/O bus architecture The adapter is Gen 5 cable and running on Gen 4 PCIe X16 IBM Storage Scale System 3500 system. © Copyright IBM Corp. 2022, 2023...
  • Page 82 Slot requirement For more information about slot priorities, maximums, and placement rules, see IBM Storage Scale System 3500 adapter concurrent MES upgrade topic in the IBM Storage Scale System 3500: Service Guide. Thermal requirement If you have a 5105-22E system, you might be required to set the thermal mode of the system to a setting other than the default setting, depending on your system, adapter, and cable type.

  • Page 83: Appendix C. The 5149-N64 Switch

    Appendix C. The 5149-N64 switch This topic describes the key features and specifications of the NVIDIA/Mellanox NDR switch, IBM MTM 5149-N64. The 5149-N64 switch introduction The NVIDIA/Mellanox NDR switch, IBM MTM 5149-N64 switch, is a managed 64-port switch that provides 400 Gb/s InfiniBand bandwidth per port in a 1U standard chassis design. The MTM 5149-N64 switch is the next generation after MTM 8831-H40, and can be installed in the same rack as the ESS solution, similar way as other supported high-speed data switches.

  • Page 84: The Ibm Mtm 5149-N64 Switch Views

    Port numbers are printed on the switch between the top and bottom ports. Figure 53. Port view of the 5149-N64 switch The following image highlights features on the power side of the 5149-N64 switch: Figure 54. Power side view 68  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 85: Labels Of The 5149-N64 Switch

    Labels of the 5149-N64 switch The details of the 5149-N64 switch labels are provided in this section. Chassis label The chassis label is affixed to a pull out tab on the left of the system on the power side. The chassis label contains the part number, serial number, and GUID of the 5149-N64 switch.

  • Page 86: Specifications Of The 5149-N64 Switch

    Air temperature Air flows from the power side of the switch to the port side (power-to-connector (P2C) air flow configuration). Temperature requirements for the switch are listed in the following table: 70  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 87: Warranty And Service

    Frequency 200-240 VAC 50/60 Hz Warranty and service IBM warranty information The standard warranty period for these solutions is a 1-year, 9x5 warranty, with options available for the expanded IBM Expert Care. Warranty type Duration Coverage Service level Standard 1 year 9x5 next business day •...

  • Page 88: Service Indicators

    CRU whether the defective CRU must be returned to IBM. When a return is required, return instructions are shipped with the replacement CRU. The customer might be charged for the replacement CRU if IBM does not receive the defective CRU within 15 days of receipt of the replacement.

  • Page 89: Leds On The Port

    For example, corrupted shows amber five minutes firmware or an overheated after starting the system, system. unplug the system and call your IBM support for assistance. Power supply units Solid green All plugged (one or two) status LED power supplies are running normally.

  • Page 90: Fan Leds

    Figure 59. Power supply unit LEDs State Description Action required Solid green All PSUs are connected and running normally. Flashing green Only 12VSB on (PSU off), PSU is in Contact IBM support. Smart-on state. 74  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 91: Port Leds

    • Determine why power was lost in the electrical outlet that the PSU is plugged into. PSU failure (including voltage out of Check voltage. If OK, contact IBM range and power cord disconnected). support. Flashing amber Power supply warning events where Contact IBM support.

  • Page 92: The 5149-N64 Switch Installation

    Customers must complete a Technical and Delivery Assessment (TDA) that the assigned SSR then reviews with them. In conjunction with the TDA, planning information is available in IBM Docs. The SSR and the customer must also review and complete all of the planning information in IBM Docs. Before scheduling the trip onsite to perform the installation, the SSR should attend meetings with the customer to perform planning tasks.

  • Page 93: The 5149-N64 Switch And Rails Alignment

    Includes system rails that attach to the switch, and rack rails that attach to the rack. • Four power cables Type C14 to C15 • Two PSU cable retainers • 32 dust caps • One environmental notice user guide • One repair identification tag Installing the 5149-N64 switch Complete this procedure to install the 5149-N64 switch.

  • Page 94: A Rack Rail That Is Inserted Into The Back Of The Rack

    Insert the rail latches into the rack slots. The following figure shows that the latch is fully inserted. A correctly secured rack rail is shown in the following figure: 78  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...
  • Page 95 Figure 66. Fully inserted latch into the rack slots 3. Mount the 5149-N64 switch. a) Slide the switch into the channel on the rack rails. Push the switch until you hear the locking mechanism click on both sides. Figure 67. Sliding the switch into the channel b) Tighten the two captive screws at the front of the mounted switch.

  • Page 96: The 5149-N64 Switch Service

    • Under the standard warranty – If an IBM representative installs a Tier 1 CRU at the customer’s request, the customer is charged for the installation. – If an IBM representative installs a Tier 1 CRU at IBM Support's request, the customer is not charged for the installation.

  • Page 97: Replacing A Switch

    • Obtain the required tools for the replacement procedure. • Inspect the replacement part. If any of the parts are incorrect, missing, or visibly damaged, they should contact the provider of the part or IBM support. The replacement best practices are as follows: •...
  • Page 98 Release the metal latches and slide the rails to move the system pins out of the smaller oval hole. The rail can then be removed from the system. The following figure shows the system pin and rail holes aligned so that the rail can be removed. 82  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 99: Replacing A Power Supply Unit

    Figure 72. Releasing the metal latches b) Press the lock button, and pull the rail outside of the rack assembly. Figure 73. Pressing the lock button 3. Install the switch. For more information about installation, see “Installation overview” on page 76. Replacing a power supply unit The 5149-N64 switch has two replaceable power supply units (PSUs) in a redundant configuration.

  • Page 100: Replacing A Fan Module

    For more information about the 5149-N64 switch, refer the NVIDIA documentation. • NVIDIA QM79xx User Guide (https://docs.nvidia.com/networking/display/qm97x0pub). • NVIDIA QM79xx Installation instructions (https://docs.nvidia.com/networking/display/qm97x0pub/ installation). • NVIDIA QM9700/QM9790 Datasheet (https://nvdam.widen.net/s/k8sqcr6gzb/infiniband-quantum-2- qm9700-series-datasheet-us-nvidia-1751454-r8-web). 84  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 101: Accessibility Features For The System

    IBM Documentation, and its related publications, are accessibility-enabled. Keyboard navigation This product uses standard Microsoft Windows navigation keys. IBM and accessibility See the IBM Human Ability and Accessibility Center (www.ibm.com/able) for more information about the commitment that IBM has to accessibility. © Copyright IBM Corp. 2022, 2023...
  • Page 102 86  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 103: Glossary

    • See refers you from a non-preferred term to the preferred term or from an abbreviation to the spelled- out form. • See also refers you to a related or contrasting term. For other terms and definitions, see the IBM Terminology website (opens in new window): http://www.ibm.com/software/globalization/terminology building block A pair of servers with shared disk enclosures attached.
  • Page 104 A data structure containing key information about a file system. This information includes the disks assigned to the file system (stripe group), the current state of the file system, and pointers to key files such as quota files and log files. 88  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...
  • Page 105 Hardware Management Console (HMC) Standard interface for configuring and operating partitioned (LPAR) and SMP systems. See Hardware Management Console (HMC). IBM Security Key Lifecycle Manager (ISKLM) For GPFS encryption, the ISKLM is used as an RKM server to store MEKs. independent fileset A fileset that has its own inode space.
  • Page 106 From a system management perspective, it is the central coordinator of the cluster. It also serves as a client node in an ESS building block. master encryption key (MEK) A key that is used to encrypt other keys. See also encryption key. 90  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...
  • Page 107 maximum transmission unit (MTU) The largest packet or frame, specified in octets (eight-bit bytes), that can be sent in a packet- or frame-based network, such as the Internet. The TCP uses the MTU to determine the maximum size of each packet in any transmission. See master encryption key (MEK).
  • Page 108 A network protocol that ensures a loop-free topology for any bridged Ethernet local-area network. The basic function of STP is to prevent bridge loops and the broadcast radiation that results from them. 92  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...
  • Page 109 See secure shell (SSH). See Spanning Tree Protocol (STP). symmetric multiprocessing (SMP) A computer architecture that provides fast performance by making multiple processors available to complete individual processes simultaneously. See Transmission Control Protocol (TCP). Transmission Control Protocol (TCP) A core protocol of the Internet Protocol Suite that provides reliable, ordered, and error-checked delivery of a stream of octets between applications running on hosts communicating over an IP network.
  • Page 110 94  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...

  • Page 111: Index

    33 safety notices 12 enclosures space requirements acoustic output 37 IBM Storage Scale System 3500 35 humidity without redundant AC power 32 specifications power requirements for each power module 31 shock 37 weight and dimensions 33...
  • Page 112 37 documentation xiii resources xiii 96  IBM Storage Scale System 3500: Hardware Planning and Installation Guide...
  • Page 114 IBM® Product Number: 5765-DME   5765-DAE SC28-3460-02...

Table of Contents