hit counter script
IBM SAN768B-2 User Manual
  1. Manuals
  2. Brands
  3. IBM Manuals
  4. Storage
  5. SAN768B-2
  6. User manual
IBM SAN768B-2 User Manual

IBM SAN768B-2 User Manual

Hide thumbs Also See for SAN768B-2:
Table of Contents

Advertisement

Quick Links

Download this manual
IBM System Storage SAN768B-2
Installation, Service, and User Guide
Service information: 2499-816
GA32-0893-06

Advertisement

Table of Contents
loading

Related Manuals for IBM SAN768B-2

Summary of Contents for IBM SAN768B-2

  • Page 1 IBM System Storage SAN768B-2 Installation, Service, and User Guide Service information: 2499-816 GA32-0893-06...
  • Page 3 IBM System Storage SAN768B-2 Installation, Service, and User Guide Service information: 2499-816 GA32-0893-06...
  • Page 4 © Copyright IBM Corporation 2011, 2014. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract...

  • Page 5: Table Of Contents

    Removing and installing transceivers . 108 Chapter 3. Starting and configuring the Removing and replacing inter-chassis link (QSFP) SAN768B-2 ... . . 35 cables . . 113 Providing power to the SAN768B-2 .
  • Page 6 Boot . 161 Index ....193 Diagnostics . . 161 General troubleshooting . . 161 Link troubleshooting . . 163 SAN768B-2 Installation, Service, and User Guide...

  • Page 7: Figures

    QSFP cable and transceiver . . 114 hardware on the door . . 28 QSFP cable connections for a SAN768B-2 and Cable design for the mSFP patch cables for the a SAN384B-2 chassis (sample configuration) . 116 FC8-64 high density port blade .
  • Page 8 SAN768B-2 Installation, Service, and User Guide...

  • Page 9: Tables

    Tables Brocade and IBM product and model Sample cable routing table for SAN768B-2 number matrix . . xxiv Cable routing table for SAN768B-2 (64 ports Blades available for the SAN768B-2 . shown). . 129 Installation tasks, time, and items required General specifications .
  • Page 10 SAN768B-2 Installation, Service, and User Guide...

  • Page 11: Read This First

    Read this first Summary of changes This is the seventh edition of the IBM System Storage SAN768B-2 Installation, Service, and User Guide. The content changes since the last edition of this publication are noted by a vertical line placed in the left margin beside each change. Minor edits are not identified by this mark.

  • Page 12: Getting Help

    For redbooks associated with this product, enter search terms on the website: http://www.redbooks.ibm.com/. For support information for this and other IBM products, see the IBM Support Portal, http://www.ibm.com/supportportal. Search for the product Machine type or product name.

  • Page 13: How To Send Your Comments

    Your feedback is important in helping us provide the most accurate and high-quality information. If you have comments or suggestions for improving this document, send us your comments by email to http://starpubs@us.ibm.com. Be sure to include the following information: v Exact publication title...
  • Page 14 SAN768B-2 Installation, Service, and User Guide...

  • Page 15: Safety Notices

    Safety Notices publication that is shipped with this product. The following notices and statements are used in IBM documents. They are listed below in order of increasing severity of potential hazards. Follow the links for more detailed descriptions and examples of the danger, caution, and attention notices in the sections that follow.
  • Page 16 (D004) A general electrical danger notice provides instructions on how to avoid shock hazards when servicing equipment. Unless instructed otherwise, follow the procedures in this danger notice. SAN768B-2 Installation, Service, and User Guide...
  • Page 17 Electrical voltage and current from power, telephone, and communication cables are hazardous. To avoid a shock hazard: v Connect power to this unit only with the IBM provided power cord. Do not use the IBM provided power cord for any other product.

  • Page 18: Caution Notices

    Delivery and subsequent transportation of the equipment The customer should prepare his environment to accept the new product based on the installation planning information provided, with assistance from an IBM Installation Planning Representative (IPR) or IBM authorized service provider. In...
  • Page 19 Read and comply with the following caution notices before installing or servicing this device. CAUTION: Energy hazard present. Shorting may result in system outage and possible physical injury. Remove all metallic jewelry before servicing. (C001) CAUTION: The weight of this part or unit is more than 55 kg (121.2 lb). It takes specially trained persons, a lifting device, or both to safely lift this 55 kg ( 121.2 lbs) part or unit.

  • Page 20: Safety Labels

    CAUTION: For CA residents only: IBM recommends installing this product in a room size of 62 cubic meters (2190 cubic feet) or larger at 0.4 ACH ventilation rate to reduce the concentrations of any chemicals emitted by the product. Safety labels As an added precaution, safety labels are often installed directly on products or product components to warn of potential hazards.

  • Page 21: Attention Notices

    Attention: Many of the field replaceable units (FRUs) are sensitive to electrostatic discharge (ESD), and can potentially be damaged by improper handling. Wear a wrist grounding strap that is connected to chassis ground (if the SAN768B-2 is plugged in) or a bench ground. Store all ESD-sensitive components in antistatic packaging.

  • Page 22: Rack Safety

    Attempting to move the drawer partially or completely out of the rack might cause the rack to become unstable or cause the drawer to fall out of the rack. (R001 part 2 of 2) SAN768B-2 Installation, Service, and User Guide...

  • Page 23: Safety Inspections

    Rack relocation (19" rack) CAUTION: Removing components from the upper positions in the rack cabinet improves rack stability during relocation. Follow these general guidelines whenever you relocate a populated rack cabinet within a room or building: v Reduce the weight of the rack cabinet by removing equipment starting at the top of the rack cabinet.

  • Page 24: Product Recycling And Disposal

    Internal machine checks Perform these internal machine checks: 1. Check for any non-IBM changes that might have been made to the machine. If any are present, obtain the “Non-IBM Alteration Attachment Survey” form, number R009, from the IBM branch office. Complete the form and return it to the branch office.

  • Page 25: About This Document

    These listed documents contain information related to this product. The documentation may be printed material, on the documentation CD that is shipped with the product, or available on the web through the IBM Support Portal or IBM Publications Center. v IBM System Storage SAN768B-2 Installation, Service, and User Guide, GA32-0893...

  • Page 26: Accessibility Features For San768B-2

    (FOS) publications, you will notice that the model numbers reflect the corresponding Brocade products. Table 1 provides a product matrix for you to use to correlate the Brocade products and models to the IBM product names and machine types and model numbers. Products withdrawn from marketing are not listed.
  • Page 27 The list includes the major accessibility features in the SAN768B-2 either directly or through external devices or interfaces: v Keyboard-only operation v Interfaces that are commonly used by screen readers v Keys that are discernible by touch but do not activate just by touching them...
  • Page 28 SAN768B-2 Installation, Service, and User Guide...

  • Page 29: Chapter 1. Introduction

    This chapter introduces the features and components of the IBM System Storage SAN768B-2 fabric backbone. Throughout the remainder of this document, the product will be referred to as the SAN768B-2, or more generically as system, device, or chassis, where appropriate. This chapter contains the following information: v “Overview of the SAN768B-2”...

  • Page 30: Hardware Components

    Two slots for control processor blades (CP8): – A single active CP8 blade can control all 512 ports in the chassis. – The standby CP8 blade assumes control of the SAN768B-2 if the active CP fails. v Two slots for core switch blades (CR16-8): –...

  • Page 31: Port Side Of The San768B-2

    Note: Airflow in the SAN768B-2 is from the non-port (non-cable) side to the port (cable) side and out the exhaust vent. Figure 1 shows a sample configuration of the port side of the SAN768B-2, with the chassis door removed. Figure 1. Port side of the SAN768B-2 (sample configuration)

  • Page 32: Blower (Non-Port) Side Of The San768B-2 (Sample Configuration )

    Figure 2 shows a sample configuration of the non-port side of the SAN768B-2 with 4 power supplies. Figure 2. Blower (non-port) side of the SAN768B-2 (sample configuration ) WWN bezel (WWN cards are behind Blower assembly bezel) Power supply SAN768B-2 Installation, Service, and User Guide...

  • Page 33: San768B-2 Blades

    SAN768B-2 blades Table 2 summarizes the port, application, control processor, and core switch blades that are available for the SAN768B-2. Table 2. Blades available for the SAN768B-2 Description Feature Code Name Function Control processor The CP8 blade blade contains the control plane for the chassis.
  • Page 34 Table 2. Blades available for the SAN768B-2 (continued) Description Feature Code Name Function 32-port 16-Gbps port FC3632 FC16-32 A 32-port port blade blade supporting 2, 4, 8, 10, and 16-Gbps Fibre Channel port speeds. The blade also supports port-based in-flight encryption /...
  • Page 35 Table 2. Blades available for the SAN768B-2 (continued) Description Feature Code Name Function 32-port 8-Gbps port FC3633 FC8-32E A 32-port port blade blade supporting 2, 4, and 8 Gbps Fibre Channel port speeds. This port blade is compatible with the SAN384B-2 and SAN768B-2.

  • Page 36: High Availability

    SAN384B-2, SAN768B, and SAN384B High availability The following features contribute to the SAN768B-2 high-availability design: v Redundant, hot-swappable FRUs, including blades, power supplies, blowers, WWN cards v Enhanced data integrity on all data paths v Fabric Shortest Path First (FSPF) rerouting around failed links...

  • Page 37: Reliability

    Reliability The SAN768B-2 uses the following error detection and correction mechanisms to ensure reliability of data: v Error Detection and Correction over main control processor memory...

  • Page 38: Software Features

    CUP Activation (optional feature), providing in-band management of the supported SAN b-type switch and director products by system automation for z/OS from IBM System z10 EC, z10 BC, z9 EC, z9 BC, zSeries 990, 900, 890, and 880 servers.
  • Page 39 Search by title or publication form number on either site. Network Manageability The SAN768B-2 has a single domain and is managed as a single element with Network Advisor. The SAN768B-2 responds to its own IP address and appears as a separate entity to the Telnet protocol and SNMP.
  • Page 40 SAN768B-2 Installation, Service, and User Guide...

  • Page 41: Chapter 2. Installing A San768B-2 In A Cabinet

    Switch Cabinet C36. This SAN768B-2 is to be installed and serviced only by qualified IBM service representatives. The SAN768B-2 can be ordered pre-installed in the cabinet, or the SAN768B-2 can be added to an existing C36 cabinet. The cabinet is designed to support a total of two SAN256Bs or SAN768B-2s. The SAN384B chassis can also be installed in the C36 cabinet.
  • Page 42 – Safety notices Ordering the lift tool The lift tool is required only when you install an additional SAN768B-2 or when you install or remove the SAN768B-2 from the cabinet. The ordering procedures for the lift tool vary depending on your location. You should direct questions about these procedures to your regional representative.

  • Page 43: Installation Guidelines

    24-inch load plate. Do not use the 18–inch load plate. You must use the 24–inch load plate when you install the SAN768B-2 to be able to safely install this product. The 24-inch load plate includes a platform with a middle section that can slide out to extend across the gap between the lift tool and the mounting position inside the C36 cabinet.

  • Page 44: Installing A San768B-2 In A Cabinet

    159.2 kg (351 lb) and requires the specified lift tool to install it. Installing a SAN768B-2 in a cabinet This section describes how to install the SAN768B-2 in the Model C36 cabinet. These procedures use parts that are included in the 14U rack mount kit. Time required Allow approximately 4 hours to complete this procedure.

  • Page 45: Installation Tasks, Time, And Items Required

    Note: Assembly instructions for the lift tool are in the shipping container. Tools required You will require the following items to install the SAN768B-2 in the cabinet: v Torque wrench with #2 Phillips screwdriver tip v Flathead screwdriver v Lift tool Chapter 2.

  • Page 46: Unpacking The San768B-2

    Rack mount kit parts list The following parts list refers to items illustrated in Figure 3 on page 19. These parts are used to install the SAN768B-2 into the C36 cabinet. Table 4. Items supplied with the 14U rack mount kit...
  • Page 47 20) in the 14U rack mount kit. These brackets are adjustable to allow for different cabinet depths. 2. Loosen the adjusting screws on both brackets enough to allow the brackets to slide easily to adjust the length. Chapter 2. Installing a SAN768B-2 in a cabinet...

  • Page 48: Left And Right Shelf Brackets Installed On The Cabinet Rails

    See Figure 7 on page 23 for approximate positions. Note: Do not align the clip or retainer nuts with the top or bottom holes of the SAN768B-2 mounting brackets because the door will interfere with the screw SAN768B-2 Installation, Service, and User Guide...

  • Page 49: Removing The Chassis Door And Cable Management Comb

    Note: Reinstall the chassis door once the chassis is installed and all cabling and configuration is complete. The chassis door must be installed to ensure the SAN768B-2 meets EMI and other regulatory certifications. Chapter 2. Installing a SAN768B-2 in a cabinet...

  • Page 50: Using The Lift Tool, The 24-Inch Load Plate, And The Bridge Tool

    Steps 1 through 9 describe how to use the lift tool (PN 09P2481) and the 24–inch load plate (PN 11P4369) to install a SAN768B-2 in the cabinet. Steps 10 through 23 describe how to install the bridge tool (PN 18P5855) in the cabinet for the lower SAN768B-2 or the upper SAN768B-2.

  • Page 51: Chassis Installation From Rear (Exhaust Aisle Side) Of The Cabinet

    SAN768B-2 to reduce the weight. This can reduce the weight by up to 27 kg (60 lb). 4. Move the lift tool next to the pallet that contains the SAN768B-2. a. Adjust the load platform to the same height.
  • Page 52 Raise the platform to allow enough room to attach the anti-tip bracket. d. Secure the anti-tip bars by using the anti-tip bracket and bolt. 10. If you are installing the lower SAN768B-2, go to step 11. If you are installing the upper SAN768B-2, go to step 12.

  • Page 53: Locking The Shelf Into Position

    14. Set the wheel brake and place the wheel chocks around the wheels. 15. Remove the retention straps. 16. Slide the SAN768B-2 into the cabinet until it rests securely on the shelf brackets. 17. Remove the wheel chocks, release the wheel brake, and move the lift tool away from the cabinet.

  • Page 54: Attaching The Port Side Of The Chassis To The Cabinet Rails

    37 cm-kg (32 in-lb). See Figure 9 for the approximate location of the screws. Note: Do not use the top or bottom holes of the SAN768B-2 mounting brackets because the screw heads will interfere with the chassis door.

  • Page 55: Aligning The Chassis Door With The Ball Studs On The Chassis

    Figure 10. Aligning the chassis door with the ball studs on the chassis Chapter 2. Installing a SAN768B-2 in a cabinet...

  • Page 56: Port Numbering

    Note: For turning on the power and for the configuration instructions, see Chapter 3, “Starting and configuring the SAN768B-2,” on page 35. Attention: Do not connect the SAN768B-2 to the network until the IP addresses are correctly set. Port numbering Table 5 has a list of available port blades for the SAN768B-2.
  • Page 57 8 through 15 from bottom within the same QSFP port to top on the right set of cannot form a trunk. A trunk ports has to comprise of individual FC ports from different QSFP ports. Chapter 2. Installing a SAN768B-2 in a cabinet...

  • Page 58: Chassis Slots

    Slots are numbered 1–12, from left to right when facing the port side of the SAN768B-2. Control processor blades (CP8) can be installed only in slots 6 and 7. Core switch blades (CR16-8) can be installed only in slots 5 and 8. Port or application blades can be installed in slots 1–4 and 9–12.

  • Page 59: Cable Management

    FC8-64 port blade. Narrower OM-3 LC cables are used to connect the FC8-64. These cables are offered by several major manufacturers. Contact your IBM representative for options regarding different cable and patch panel configurations to simplify cable management with higher density FC8-64 port blades.

  • Page 60: Removing A San768B-2 From The Cabinet

    Removing a SAN768B-2 from the cabinet If you need to remove a SAN768B-2 chassis from a cabinet to move it to a new location, follow the instructions below to remove the chassis, and then follow the installation instructions (“Installing a SAN768B-2 in a cabinet”...
  • Page 61 A pinch point exists between the load plate and the bridge tool. P/N 18P5850-B SJ000752 14. Slide the SAN768B-2 from the cabinet onto the 24–inch load plate. Center the SAN768B-2 on the platform. 15. Install the retention straps. 16. Remove the wheel chocks, release the wheel brake, and move the lift tool away from the cabinet.
  • Page 62 17. Lower the load platform to its lowest position. 18. Remove the bridge tool. SAN768B-2 Installation, Service, and User Guide...

  • Page 63: Chapter 3. Starting And Configuring The San768B-2

    Select the appropriate release note link to download the release note PDF file. The SAN768B-2 must be configured before it is connected to the fabric, and all of the configuration commands must be entered through the active CP blade. The...

  • Page 64: Flow Of Basic Configuration Tasks

    2. Specify a switch name. See “Customize a switch name” on page 40. 3. Specify a domain ID for the SAN768B-2. See “Setting the Domain ID” on page 4. Set the date and time. See “Setting the date and time” on page 41.

  • Page 65: Providing Power To The San768B-2

    Establishing a serial connection and logging on to the SAN768B-2 To establish a serial connection and log on to the SAN768B-2: 1. Verify that the SAN768B-2 is powered on and that POST is complete by verifying that all power LED indicators on the port, control processor, and core switch blades display a steady green light.

  • Page 66: Logging In To The Serial Console Port

    To log in to the SAN768B-2 through the serial connection, follow these steps. 1. Log in to the SAN768B-2 as admin. The default password is "password." At the initial login, you are prompted to change the default passwords. Record the new passwords and keep this information in a secure location.
  • Page 67 Attention: Resetting an IP address while the SAN768B-2 has active IP traffic such as Fabric Manager, Fabric Watch, SNMP, or other applications can cause traffic to be interrupted or stopped. Complete the following steps to set the IP addresses for the SAN768B-2.

  • Page 68: Establishing An Ethernet Connection

    Customize a switch name The switch name of the SAN768B-2 can be up to 30 characters long; can include letters, numbers, and underscore characters; and must begin with a letter. Note: Changing the name causes a domain address format RSCN to be issued.

  • Page 69: Setting The Domain Id

    Setting the date To set the date, follow these steps. 1. If necessary, log on to the SAN768B-2 by Telnet, using the admin account. The default password is password. 2. Enter the date command, using the following syntax:date "mmddHHMMyy" Where: v mm is the month;...

  • Page 70: Setting The Time Zone

    NTP server. The others will be stored as backup servers that can take over if the active NTP server fails. The principal or primary FCS switch synchronizes its time with the NTP server every 64 seconds. SAN768B-2 Installation, Service, and User Guide...

  • Page 71: Verifying The Persistent Pid Feature

    The 1 indicates that the WWN-based persistent PID feature is enabled. The default value is 0 for disabled. Determining installed software licenses Certain licenses may be factory installed on the SAN768B-2. To determine which licenses are currently enabled, use the licenseShow command. swDir:admin> licenseshow...

  • Page 72: Installing Transceivers And Attaching Cables

    Follow the first set of steps to install SFP+s and mSFPs (FC8-64 port blade only) and cables in the SAN768B-2 (for more details, see “Removing and installing transceivers” on page 108). Follow the second set of steps to install the QSFP transceivers and cables in the FC16-64 and core blades for inter-chassis link connections (see “Removing and replacing inter-chassis link (QSFP) cables”...
  • Page 73 The example below is from a SAN384B-2 with a core blade installed in slot 3. Some details for the SAN768B-2 will be different (such as the slot numbers), but the reported information for the QSFPs will be similar. Note that the State reported for an unconnected QSFP (shown QSFP 0 and Ports 0-3 Chapter 3.

  • Page 74: Managing Cables

    Attention: The minimum bend radius should be no smaller than 10x the cable radius. The minimum bend radius for a 50 micron cable is 5 cm (2 in.) under full tensile load and 3 cm (1.2 in.) with no tensile load. SAN768B-2 Installation, Service, and User Guide...

  • Page 75: Planning For Encryption (Optional)

    (QSFP) cables” on page 113. Planning for encryption (optional) Encryption is an optional feature available on the SAN768B-2 through the installation and use of the FS8-18 encryption blade. Advance planning is essential to achieve a successful implementation of encryption.
  • Page 76 Avoid dual encryption (Fabric encryption and device encryption). While this should not cause any encryption errors, it will degrade performance. v There is no support of Cisco switches at this time by IBM. The section in the Fabric OS Encryption Administrator’s Guide Supporting Tivoli Key Lifecycle Manager (TKLM) Environments related to Cisco Fabric connectivity does not currently apply.

  • Page 77: Configuring For Encryption (Optional)

    RSA environments Key Vault high availability handling Configure cluster interconnect Encryption group configuration Crypto target container configuration Encryption group level Crypto LUN (disk) configuration Crypto tape configuration Other configuration Figure 14. Encryption configuration Chapter 3. Starting and configuring the SAN768B-2...

  • Page 78: Verifying Correct Operation And Backing Up The Configuration

    3. Verify the correct operation of the system by entering the switchShow command from the workstation. This command provides information about switch and port status. 4. Verify the correct operation of the SAN768B-2 in the fabric by entering the fabricShow command from the workstation. This command provides general information about the fabric.

  • Page 79: Powering Off The San768B-2

    In the displayed product list, select your product. v On the displayed product page, click the IBM SAN b-type Firmware Version 7.x Release Notes link. v On the displayed page, click the appropriate release notes link for your version, and then read the release notes before downloading the firmware.
  • Page 80 2. Power off the chassis by flipping the AC power switches on the power supplies to "O". The LEDs inside AC power switches should turn off. To maintain the ground connections, leave the power cords connected to the power supplies and to the electrical outlets. SAN768B-2 Installation, Service, and User Guide...

  • Page 81: Chapter 4. Monitoring System Components

    SAN768B-2. These commands are switchShow and chassisShow. Examples of these commands are shown below. Note in the switchShow command that "switchType" for the SAN768B-2 as well as the 16-Gbps speed identification for capable ports are displayed. The output has been truncated to reduce information duplication.
  • Page 82 No_Light FC 78a180 No_Module FC 78a280 No_Module FC 78a380 No_Module FC 78a480 No_Module FC 78a580 No_Module FC 78a680 No_Module FC 78a780 No_Module FC 782080 No_Light FC 782180 No_Module FC 782280 No_Module FC 782380 No_Light FC SAN768B-2 Installation, Service, and User Guide...
  • Page 83 782480 No_Module FC 782580 No_Module FC 782680 No_Module FC 782780 No_Light FC 782880 No_Module FC 782980 No_Module FC 782a80 No_Module FC 782b80 No_Module FC 782c80 No_Module FC 782d80 No_Module FC 782e80 No_Module FC 782f80 No_Module FC 783000 No_Light FC 783100 No_Light FC 783200 No_Light FC...
  • Page 84 No_Module FC <output truncated> SAN768B-2_8 :root> Note with the chassisShow command, the Chassis Family designation for the SAN768B-2 along with specific information about every field-replaceable unit in the chassis is also displayed. SAN768B-2_8:root> chassisshow Chassis Family: SAN768B-2 Chassis Backplane Revision: 0...
  • Page 85 Manufacture: Day: 12 Month: 7 Year: 2011 Update: Day: 27 Month: 9 Year: 2011 Time Alive: 45 days Time Awake: 0 days SW BLADE Slot: 3 Header Version: 2 Power Consume Factor: -130 Factory Part Num: 60-0000071-07 Factory Serial Num: BAH0344E01G Manufacture: Day: 2 Month: 11 Year: 2010 Update: Day: 7 Month: 4 Year: 2011 Time Alive: 280 days...
  • Page 86 Manufacture: Day: 29 Month: 12 Year: 2010 Update: Day: 28 Month: 3 Year: 2011 Time Alive: 319 days Time Awake: 0 days FAN Unit: 3 Header Version: 2 Power Consume Factor: -126 Factory Part Num: 60-1000384-09 SAN768B-2 Installation, Service, and User Guide...

  • Page 87: Port, Application, Or Encryption Blade Status

    Factory Serial Num: AGB0652E0H8 Manufacture: Day: 29 Month: 12 Year: 2010 Update: Day: 28 Month: 3 Year: 2011 Time Alive: 319 days Time Awake: 0 days WWN Unit: 1 Header Version: 2 Power Consume Factor: -1 Factory Part Num: 60-1000491-05 Factory Serial Num: AFX0602F001 Manufacture: Day: 29 Month: 12 Year: 2010 Update: Day: 28 Month: 3 Year: 2011...

  • Page 88: Fc16-32 Port Blade

    For information about how to interpret the LED patterns, see Table 7 on page 68. 2. Check the blade status by entering the slotShow command. Figure 15. FC16-32 port blade Power LED Fibre Channel port Status LED Port status LED SAN768B-2 Installation, Service, and User Guide...

  • Page 89: Fc16-48 Port Blade

    Figure 16. FC16-48 port blade Power LED Fibre Channel port Status LED Port status LED Chapter 4. Monitoring system components...
  • Page 90 Figure 17. FC16-64 port blade | | | | | Blade power LED Port status LED for FC port 36 | | | | Blade status LED QSFP port 9; FC ports 36-39 (bottom to up) SAN768B-2 Installation, Service, and User Guide...
  • Page 91 Figure 18. FC8-32E port blade Power LED Fibre Channel port Status LED Port status LED Chapter 4. Monitoring system components...

  • Page 92: Fc18-48E Port Blade

    Figure 19. FC18-48E port blade Power LED Fibre Channel port Status LED Port status LED SAN768B-2 Installation, Service, and User Guide...

  • Page 93: Fc8-64 Port Blade

    Figure 20. FC8-64 port blade Status LED Fibre Channel port Power LED Port status LED Note: The FC8-64 port blade requires narrower OM-3 LC cables. Chapter 4. Monitoring system components...

  • Page 94: Fs8-18 Encryption Blade

    Figure 21. FS8-18 encryption blade Power LED Fibre Channel port Status LED Port status LED SAN768B-2 Installation, Service, and User Guide...
  • Page 95 Figure 22. FX8-24 extension blade Power LED GbE port 6 LED Port map Status LED 10 GbE port 0 GbE port 6 10 GbE port 0 LED See Table 6 on page 29 for information about trunking groups on this blade. Chapter 4.

  • Page 96: Fcoe10-24 Application Blade

    No light (LED is off) Blade is not powered on. Ensure that the blade is firmly seated and either the thumbscrew is fully engaged or the slider is pushed up and the ejectors are fully engaged. SAN768B-2 Installation, Service, and User Guide...
  • Page 97 Slow-flashing green (on 1 Port is online but segmented, Verify that the correct device is second, then off 1 second) indicating a loopback plug or attached to the SAN768B-2. cable or an incompatible switch. Fast-flashing green (on 1/4 Port is in internal loopback No action required.

  • Page 98: Control Processor Blade (Cp8) Status

    LED patterns, see Table 8 on page 71. 2. Check the blade status by typing slotShow and haShow. Figure 24 on page 71 identifies the control processor blade (CP8) and its components. SAN768B-2 Installation, Service, and User Guide...

  • Page 99: Control Processor Blade (Cp8) Components

    Figure 24. Control processor blade (CP8) components Blade power LED Console port (10101) Blade status LED Ethernet port (MGMT IP) USB LED Ethernet port (SERVICE IP) USB port Active CP LED Table 8. CP8 blade LED descriptions Recommended LED purpose Color Status Action...

  • Page 100: Core Switch Blade (Cr16-8) Status

    1. Check the LED indicators on the core switch blade (Figure 25 on page 73). The LED patterns may temporarily change during POST and other diagnostic tests; for information about how to interpret the LED patterns, see Table 9 on page SAN768B-2 Installation, Service, and User Guide...

  • Page 101: Core Switch Blade (Cr16-8), Leds And Qsfp Connectors

    2. Check the core switch blade status by entering the slotShow and haShow commands. Figure 25 identifies the core switch blade and its components Figure 25. Core switch blade (CR16-8), LEDs and QSFP connectors Power LED QSFP connectors Status LED QSFP connector status LEDs QSFP port map and trunking diagram...

  • Page 102: Power Supply Status

    2. Check the power supply status by entering psShow. The power supply status displays OK, Absent, or Faulty. If a power supply displays absent or faulty, contact IBM. Both physically absent or faulty could also be the result of the power supply not being properly seated or being turned off.

  • Page 103: Blower Assembly Status

    If a blower assembly is absent or faulty, contact IBM. Both physically absent or faulty could also be the result of the blower assembly not being properly seated or being turned off.

  • Page 104: Blower Assembly Leds

    Status action Power No Light (LED is off) Blower assembly Ensure that the does not have power. blower assembly is firmly seated and has power. Steady green Blower assembly has No action required. power. SAN768B-2 Installation, Service, and User Guide...

  • Page 105: Wwn Bezel And Wwn Card Status

    Table 11. Blower assembly LED descriptions (continued) Recommended LED purpose Color Status action Fault No Light (LED is off) Blower assembly is Ensure that the either healthy or blower assembly has does not have power. power. Steady amber Blower assembly has Replace the blower a failure (full or assembly.

  • Page 106: Wwn Led Patterns

    Note: If a blade slot has a filler panel installed, the corresponding LEDs on the WWN card do not light up Note: If a status LED on the WWN bezel flashes, the power LED on the WWN bezel also flashes, for increased visibility. SAN768B-2 Installation, Service, and User Guide...

  • Page 107: Leds On The Wwn Card And Bezel

    Figure 28. LEDs on the WWN card and bezel CP blade Status (above) and Power Port blade Status (above) and (below) LEDs Power (below) LEDs CR blade Status (above) and Power Slot numbers (below) LEDs Chapter 4. Monitoring system components...
  • Page 108 SAN768B-2 Installation, Service, and User Guide...

  • Page 109: Chapter 5. Removing And Installing Components

    Attention: Read the safety notices before servicing (see “Safety notices and labels” on page xiii). The field replaceable units (FRUs) in the SAN768B-2 can be removed and installed without special tools. The SAN768B-2 can continue operating during many of the FRU replacements if the conditions specified in the procedure are followed.

  • Page 110: Removing And Installing A Cable Management Comb

    See Figure 29. 2. Push the door into place. It will snap onto the studs. Removing and installing a cable management comb The SAN768B-2 can continue to operate during the replacement of the cable management comb. Time and items required The replacement procedure for the cable management comb takes less than 5 minutes.
  • Page 111 2. Remove the cables from the cable management comb and rearrange the cables around the comb. 3. Unscrew and save the four screws holding the comb to the chassis (see Figure 30). Support the comb to prevent it from falling. 4.

  • Page 112: Removing And Installing Port, Application, And Encryption Blades

    Slots are numbered from 1 through 12, from left to right when facing the port side of the SAN768B-2. Port and application, and encryption blades can be installed in slots 1 through 4 and 9 through 12.
  • Page 113 3. Establish a Telnet or console session. Before installing a blade, establish a Telnet or console connection to determine a failure and verify operation after installation. Use the switchShow command to view the status of blades. 4. Check for adequate cable slack. Ensure there is plenty of cable slack to remove a blade without cable obstruction.

  • Page 114: Port And Application Removal And Installation (Fc16-48 Port Blade Shown As Example)

    5. Verify that the power LED on the blade displays a steady green light (it might require a few seconds to turn on). If it does not turn on, ensure that the blade is firmly seated. SAN768B-2 Installation, Service, and User Guide...

  • Page 115: Removing And Installing Blade Filler Panels

    6. The Status LED on the blade will show amber until POST completes for the blade. It should then display green. If it remains amber, the board may not be properly seated in the backplane or the board may be faulty. 7.

  • Page 116: Removing And Installing A Cp8 Control Processor Blade

    Removing and installing a CP8 control processor blade This section describes how to remove and install a control processor (CP8) blade. Each SAN768B-2 has two CP8 blades located in slots 6 and 7. Attention: The firmware upgrade policy for CP8 blades specifies testing for the current Fabric OS release and one version earlier.

  • Page 117: Time And Items Required

    ESD (electrostatic discharge) grounding strap v Workstation computer v Serial cable v IP address of an FTP server for backing up the SAN768B-2 configuration v #2 Phillips screwdriver v Replacement control processor (CP8) blade. Attention: If you are upgrading through multiple versions of the Fabric OS, refer to Table 14 on page 94, to see which intermediate versions of the Fabric OS you will need.

  • Page 118: Recording Critical San768B-2 Information

    Recording critical SAN768B-2 information Back up the SAN768B-2 configuration before you replace a CP blade. Refer to the Fabric OS Administrator’s Guide for backup information. 1. Connect to the chassis and log in as admin, using a serial console connection.

  • Page 119: Removing A Control Processor Blade (Cp8)

    Removing a control processor blade (CP8) The SAN768B-2 continues to operate while a CP blade is being installed if the redundant CP blade is active and a failover does not occur. You can prevent failover by entering the haDisable command.

  • Page 120: Installing A Control Processor Blade (Cp8)

    2. Align the flat metal side of the CP blade inside the upper and lower blade guides in the slot. Slide the CP blade into the slot until it is firmly seated. SAN768B-2 Installation, Service, and User Guide...

  • Page 121: Verifying Operation Of The New Cp Blade

    The FC8-32E and FC8-48E blades require FOS 7.0.1 or later. If the firmware on the replacement blade is earlier than 7.0.0, it must be brought up to the version (7.0.0 or later) on the active CP blade, which must be at least 7.0.0. IBM recommends upgrading to the latest version available.

  • Page 122: Downloading Firmware From An Ftp Server

    All packages have been downloaded successfully. Relocating an internal firmware image on the CP blade. 2011/05/24-11:07:22, [SULB-1032], 7260, SLOT 7 | CHASSIS, WARNING, SAN768B-2, Relocating an internal firmware image on the CP. net boot... The internal firmware image is relocated successfully.
  • Page 123 Click the link for Release 7 firmware, click Continue on the displayed page to navigate to the Brocade Downloads for IBM End Users page. f. Follow the instructions on the Brocade pages. Enter all requested information (use default values).

  • Page 124: Downloading Firmware From A Usb Device

    2011/05/24-10:59:39, [SULB-1001], 7258, SLOT 7 | CHASSIS, WARNING, SAN768B-2, Firmwaredownload command has started. 2011/05/24-10:59:39, [SULB-1036], 7259, SLOT 7 | CHASSIS, INFO, SAN768B-2, The current Version: Fabric OS v7.0.0 Start to install packages... dir ################################################## ldconfig ################################################## <some output removed> SAN768B-2 Installation, Service, and User Guide...
  • Page 125 All packages have been downloaded successfully. Relocating an internal firmware image on the CP blade. 2011/05/24-11:07:22, [SULB-1032], 7260, SLOT 7 | CHASSIS, WARNING, SAN768B-2, Relocating an internal firmware image on the CP. net boot... The internal firmware image is relocated successfully.

  • Page 126: Completing The Cp8 Blade Replacement

    Removing and installing a core switch blade (CR16-8) This section describes how to remove and install a core switch blade. Each SAN768B-2 has two core switch blades: one in slot 5 and one in slot 8. See Figure 34 on page 100.
  • Page 127 For more information about error messages, refer to the Fabric OS Message Reference. Removing a core switch blade (CR16-8) The SAN768B-2 continues to operate while a core switch blade is being replaced. Attention: Follow ESD precautions (see “ESD precautions” on page xix) whenever handling blades.

  • Page 128: Removing The Core Switch Blade

    Attention: Follow ESD precautions (see “ESD precautions” on page xix) whenever handling blades. Note: The CR16-8 blade is compatible only with the SAN768B-2. Complete the following steps to install a CR16-8 core switch blade. 1. Open the ejectors by rotating them toward the center of the blade face. Orient the CR blade so that the handles are toward you and the flat metal side is on your left.

  • Page 129: Removing And Installing A Power Supply

    Use this procedure to remove and install a power supply. Attention: Depending on the blade configuration of the chassis and the number of power supplies installed, the SAN768B-2 may be able to continue operating during the replacement. See “Power specifications” on page 150 to determine your power requirements.

  • Page 130: Removing And Installing A Power Supply

    Removing a power supply Complete the following steps to remove a power supply. 1. If the SAN768B-2 will not be operating during the replacement procedure, go to step 2. If the SAN768B-2 will continue operating during the replacement, check the power LEDs to verify that the minimum number of power supplies is functioning.

  • Page 131: Removing And Installing A Blower Assembly

    Removing and installing a blower assembly Use this procedure for removing and installing a blower assembly. Attention: The SAN768B-2 can continue operating during the replacement of one blower assembly if the other two blower assemblies are operating, To ensure continuous adequate cooling, maintain all three operating blower assemblies at all times except for the brief period when replacing a blower assembly.

  • Page 132: Removing And Installing A Wwn Bezel And Wwn Card

    There are two WWN cards located beneath the WWN bezel (logo plate). Use this procedure to remove and replace the WWN cards. If IBM Support has determined that a WWN card needs to be replaced, you need to power off the chassis, and then both the WWN cards must be replaced as a matched pair.
  • Page 133 3. Run the supportSave command on the active CP to capture all settings. These will be used later to verify that the settings have been correctly programmed. 4. Contact IBM Support for replacement of both WWN cards. IBM Support will send two WWN cards from FRU inventory to the nearest Brocade Support office to be reprogrammed.
  • Page 134 1. Open a Telnet session to the SAN768B-2 and log in to the active CP as admin. The default password is password. 2. Verify you are logged into the active CP. Run the haShow command to determine the active CP.

  • Page 135: Wwn Bezel And Card Removal And

    they remain disabled after the power is cycled. This allows you to check all the settings so that you can verify the settings before placing the chassis back into production. switch:FID128:root> switchcfgpersistentdisable Switch’s persistent state set to ’disabled’ switch:FID128:root> If there are other logical switches on your chassis, use the setcontext command to connect to all the other switches and then run switchcfgpersistentdisable on these switches as well.

  • Page 136: Removing And Installing Transceivers

    Use the instructions in this section to remove and replace transceivers. Attention: Use only transceivers that are supported for this product. Only transceivers purchased from IBM are supported. The use of transceivers that are not supported may cause data loss or cause the product to malfunction. For a listing of transceivers compatible with this product: v Go to the IBM Support Portal http://www.ibm.com/supportportal.

  • Page 137: Optical Transceiver (Sfp+) Extraction Tool

    These SFP+ transceivers do not require the extraction tool. Note: This tool is part of the SAN768B-2 ship group and should be kept with the chassis.

  • Page 138: Installing And Removing A 16-Gbps Sfp+ With Pull Tab (Shown Without Cable Attached)

    (Figure 41). Figure 41. Removing and replacing an SFP+ optical transceiver 4. Set the transceiver on a static-free surface, such as a grounding pad. SAN768B-2 Installation, Service, and User Guide...

  • Page 139: Optical Msfp Transceiver

    Note: The mSFP transceivers are used only with the FC8-64 port blade. Narrower OM-3 LC cables are used to connect the FC8-64. These cables are offered by several major manufacturers. Contact your IBM representative for options regarding different cable and patch panel configurations to simplify cable management with higher density FC8-64 port blades.
  • Page 140 2. Grasp the rubber housing on the end of the cable and pull it straight out of the QSFP transceiver. 3. Remove the QSFP transceiver by rotating the bail downward, and then use the bail to pull the transceiver out of the connector on the blade. SAN768B-2 Installation, Service, and User Guide...

  • Page 141: Removing And Replacing Inter-Chassis Link (Qsfp) Cables

    An ICL license must be installed on all systems forming the ICL connection. Beginning with Fabric OS v7.0.1, up to nine neighboring SAN384B-2 and SAN768B-2 chassis can be connected with the QSFP cables. With Fabric OS v7.0.0, a maximum of six chassis can be connected.

  • Page 142: Qsfp Cable And Transceiver

    ICL feature. The recommended topology is the parallel type where there are four QSFP cables connected between any pair of SAN384B-2 or SAN768B-2 chassis. The full mesh configuration is also supported. Figure 44. QSFP cable and transceiver Time and items required The replacement procedure for an QSFP cable takes less than five minutes.
  • Page 143 Possible ICL configurations Figure 45 on page 116 illustrates one possible QSFP cable configuration between two SAN384B-2 or SAN768B-2 chassis. Each of two cores in one chassis should be interconnected with each of two cores in the second chassis. This provides for inter-chassis link (ICL) trunking between chassis, ensuring redundancy.

  • Page 144: Qsfp Cable Connections For A San768B-2 And A San384B-2 Chassis (Sample Configuration)

    SAN384B-2 and SAN768B-2 chassis can be connected in a core/edge configuration. Figure 46 on page 117 shows two core and four edge chassis. Although only SAN768B-2 chassis are shown in the figure, the chassis can be any combination of SAN384B-2 and SAN768B-2. The cabling scheme should follow the parallel example shown in the Figure 45.

  • Page 145: Core/Edge Icl Topology For San384B-2 And San768B-2 Chassis

    SAN384B-2 and SAN768B-2 chassis can also be connected in a full mesh configuration as shown in Figure 47 on page 118. The SAN768B-2 chassis are shown in the figure, but either chassis can be connected. In this example, the three trunk groups are shown in different shades.

  • Page 146: Removing And Replacing The Chassis

    The SAN768B-2 must be removed from the fabric and powered off to perform this procedure. Contact IBM if you have any questions about whether the SAN768B-2 chassis requires replacement.
  • Page 147 “Reconnecting the system to the network and fabric” on page 127 v “Verifying the correct configuration of the fabric” on page 127 Note: The SAN768B-2 must be removed from the fabric and powered off to perform this procedure. Contact IBM Support if you have any questions about whether the chassis requires replacement.

  • Page 148: Critical Information Checklist Example

    New serial number (if available): Complete the following steps to record critical switch and SAN information: 1. Open a Telnet session and login to the SAN768B-2 as admin. The default password is password. Refer to your records for current passwords. Enable the logging function on your Telnet or serial console connection.
  • Page 149 Alternatively, you can save the configuration file to the USB device. 3. Record the SAN768B-2 values on a workstation, following steps 4 through 9 below. 4. Record the WWN value: Enter wwn, then copy the command output into a file named configmiscinfo.txt.
  • Page 150 -qsfp v fabricShow Copy the command output into a text file named SANbefor.txt. After the SAN768B-2 is restored to the fabric, this information can be used to verify that no unintentional changes have occurred to the fabric. switch:admin> nsshow Enter Pid COS PortName NodeName TTL <output truncated>...

  • Page 151: Removing Components From The Chassis

    Attention: Follow ESD precautions (see “ESD precautions” on page xix). You must remove the field replaceable units (FRUs) from the SAN768B-2 chassis in the order listed below. See the instructions in Chapter 5, “Removing and installing components,”...
  • Page 152 32-55 kg (70.5-121.2 lbs) lifting device to safely lift this part or unit. (C011) Attention: Do not place a SAN768B-2 chassis directly on the floor. It cannot be easily moved from the floor back onto a lift or pallet. 1. Uninstall the chassis from the cabinet (see “Removing a SAN768B-2 from the cabinet”...

  • Page 153: Downloading The Configuration

    9. Install the chassis door as described in “Removing and installing the chassis door” on page 81. 10. Power on the chassis “Providing power to the SAN768B-2” on page 37. The system performs a power-on self-test (POST). The POST takes a minimum of three minutes and is complete when LED activity returns to standard state.
  • Page 154 SW BLADE FC16-48 ENABLED SW BLADE FC8-64 ENABLED switch:admin> 3. Verify that the SAN768B-2 is functioning correctly by entering switchShow or switchStatusShow. The switchShow command displays chassis and port status information. switch:admin> switchshow switch:FID128:root> switchshow switchName: SAN768B-2_8 switchType: 120.1 switchState: Online...
  • Page 155 Connect the other ends to an Ethernet 10/100/1000 Base-T LAN, if not already connected. Note: The SAN768B-2 can be accessed by remote connection using any of the available management tools, such as Telnet or Web Tools. Ensure that the SAN768B-2 is not modified from other connections during the rest of this procedure.
  • Page 156 3. Resolve any issues or unintentional changes to the SAN768B-2 or fabric. v If there are any mechanical problems, try reseating the associated component. v If the configuration information is not correct for the SAN768B-2, modify as required. v If other issues exist, contact technical support.

  • Page 157: Sample Cable Routing Table For San768B-2

    Work 5 - 2 Workstation 5 Com 2 Serial Slot 8 Port 15 North 24 - 8/15 RAID 16 - 4 RAID 16 Table 19. Cable routing table for SAN768B-2 (64 ports shown) Slot/Port Cable labels Connected Slot/Port of Slot Port Switch end...

  • Page 158: Removing The Batteries

    Table 19. Cable routing table for SAN768B-2 (64 ports shown) (continued) Slot/Port Cable labels Connected Slot/Port of Slot Port Switch end Device end device device Removing the batteries Local regulations might require removal of the battery before recycling or disposing of the product. Batteries are in the control processor blades (CP8) and also in optional Encryption blades (FS8-18).

  • Page 159: Battery Locations On The Cp8 Blade

    Repair or disassemble Exchange only with the IBM approved part. Recycle or discard the battery as instructed by local regulations. In the United States, IBM has a process for the collection of this battery. For information, call 1-800-426-4333. Have the IBM part number for the battery unit available when you call.

  • Page 160: Encryption Blade Battery Location

    Figure 49. Encryption blade battery location 8. Recycle the batteries as appropriate. See the Environmental Notices and User Guide that is shipped with the product for more information on battery recycling and disposal. SAN768B-2 Installation, Service, and User Guide...

  • Page 161: Chapter 6. Installing New Features

    Refer to “Safety notices and labels” on page xiii before performing any service or installation procedures. The SAN768B-2 can be upgraded with any of the following hot-pluggable features while the SAN768B-2 is operational. Refer to the individual feature installation instructions for any possible exceptions.
  • Page 162 SAN768B-2s. Port blades can be installed in any of the slots 1-4 and 9-12. 3. IBM recommends having the latest firmware version on the CP blade. The firmware version should match on both the active and the backup CP blades. If the firmware is not at the latest level, obtain new code from the code download website, and install it prior to installing the port blade.

  • Page 163: Fc3633, Fc3649 - Installing An Enhanced 8-Gb Port Blade (32 Or 48 Ports)

    Disassembling any part of a port blade voids the part warranty and regulatory certifications. There are no user-serviceable parts inside the port blade. These instructions cover installing a new FC3633 or FC3649 in the SAN768B-2 chassis. Time required 20 minutes or less per port blade.

  • Page 164: Fc3864 - Installing An 8-Gb 64-Port Port Blade

    Disassembling any part of a port blade voids the part warranty and regulatory certifications. There are no user-serviceable parts inside the port blade. These instructions cover installing a new FC3864 in the SAN768B-2 chassis. Time required 20 minutes or more per port blade due to port and cable density...
  • Page 165 1-4 and 9-12. 4. IBM recommends having the latest firmware version on the CP blade. If the firmware is not at the latest level, obtain new code from the code download website, and install it prior to installing the port blade.

  • Page 166: Fc3880 - Installing An Fcoe10-24 Blade

    Disassembling any part of a port blade voids the part warranty and regulatory certifications. There are no user-serviceable parts inside the port blade. These instructions cover installing a new FC3880 in the SAN768B-2 chassis. Limitations of FCOE10-24 blade installation The following limitations apply when using the FCOE10-24 application blade with Fabric OS 7.3.0, in the SAN768B-2 chassis.
  • Page 167 81. 2. Verify that the blade is the correct part, PN 98Y1754. 3. Identify slot 1 of the SAN768B-2 chassis. This blade can be installed only in slot 1. 4. IBM recommends having the latest firmware version on the CP blade. If the firmware is not at the latest level, obtain new code from the code download website, and install it prior to installing the port blade.

  • Page 168: Fc3890 - Installing An Extension Blade (Fx8-24)

    FC3890 - Installing an Extension Blade (FX8-24) This feature can be installed while the SAN768B-2 is operational. Attention: Follow these precautions for all procedures in this section to avoid damaging the port blades or chassis: v Wear a grounded ESD strap when handling a port blade (see “ESD precautions”...

  • Page 169: Fc3895 - Installing An Encryption Blade (Fs8-18)

    Encryption Administrator’s Guide Supporting Tivoli Key Lifecycle Manager (TKLM) Environments to successfully complete installation, configuration, and management of the encryption functionality. This feature can be installed while the SAN768B-2 is operational. Note: If three or more FS8-18 encryption blades are installed, four power supplies are required for redundancy.
  • Page 170 See “Configuring for encryption (optional)” on page 49 for an overview of those steps. Refer to the Fabric OS Encryption Administrator’s Guide Supporting Tivoli Key Lifecycle Manager (TKLM) Environments for more detailed information regarding encryption and TKLM key management. SAN768B-2 Installation, Service, and User Guide...

  • Page 171: Fc7230 - Installing Fips 140-2 Level 2 Tamper Proof Seals

    FC7230 - Installing FIPS 140-2 Level 2 tamper proof seals The majority of the seals in this feature can be installed while the SAN768B-2 is operational. However, there are several seals that may be difficult to apply to the chassis if the chassis is already installed in a cabinet.

  • Page 172: Fc7873 - Installing A Qsfp And Enterprise Inter-Chassis License

    FC7873 - Installing a QSFP and Enterprise inter-chassis license This feature can be used to connect up to nine 2499 fabric backbone chassis and can be installed while the SAN768B-2 is operational. Time required Depending on the complexity of the ICL configuration, installation can take from 20-60 minutes, not including installation of the ICL license or any needed configuration.

  • Page 173: Appendix A. Product Specifications

    Appendix A. Product specifications This appendix provides product specifications for the SAN768B-2 for the following characteristics: v “General specifications” v “System architecture” v “System size and weight” on page 147 v “Facility requirements” on page 148 v “Environmental requirements” on page 149 v “Fibre channel port specifications”...
  • Page 174 EX_Port, and M_Port. FX8-24 application blade : F_Port, FL_Port, E_Port, and Ex_Port on FC. VE_Port on GbE. FCOE10-24 application blade: VF_Port Note: Self-discovery is based on switch type (U_Port) with an optional port type control. SAN768B-2 Installation, Service, and User Guide...

  • Page 175: System Size And Weight

    (CR16-8) System size and weight The weight of the SAN768B-2 can vary considerably depending on the combination of blades installed. Use Table 22 and Table 23 on page 148 to determine the weight of the system with your combination of port and application blades.

  • Page 176: Facility Requirements

    The power specifications listed in Table 25 on page 150 v The environmental specifications listed in Table 24 on page 149 v If the SAN768B-2 will be installed in an EIA rack, ensure the equipment meets following requirements: – All equipment installed in the rack has a reliable branch circuit ground connection, and does not rely on a connection to a branch circuit, such as a power strip.

  • Page 177: Environmental Requirements

    Watch commands to view temperature status. Fibre channel port specifications The Fibre channel ports in the SAN768B-2 support full duplex link speeds at 2, 4, 8, 10, or 16 Gbps inbound and outbound, automatically negotiating to the highest common speed of all devices connected to the port.

  • Page 178: Power Specifications

    Low line (85- 132 VAC), 1000W; High line (180 - 264 VAC), 2000W The power requirements for a given configuration depend on which blades have been installed in the chassis. Table 26 on page 151 shows the power draw for the SAN768B-2 Installation, Service, and User Guide...

  • Page 179: Power Demands Per Component

    SAN768B-2 chassis along with the power draw for the cooling fans. All numbers for the blades assume that the blade is fully populated with optical transceivers, including QSFPs for the core blades and FC16-64 port blades.

  • Page 180: Data Transmission Ranges

    2109 C36 cabinet are shipped with the product. Two additional power cords are provided if the optional upgrade power supply feature is ordered (Feature Code 7880). See the IBM TotalStorage SAN Cabinet 2109 Model SAN768B-2 Installation, Service, and User Guide...

  • Page 181: Cable Types Supported On The Fc16-64 Port Blade

    C36 Installation and Service Guide for information on connecting the cabinet to the facility power source. If the stand-alone feature is ordered for the SAN768B-2, then you must also order the country-specific power cords. Contact your IBM representative for more information on these power cords.
  • Page 182 SAN768B-2 Installation, Service, and User Guide...

  • Page 183: Appendix B. Application Blades

    FX8-24 operating in either 10-GbE mode or dual mode with the corresponding VE_ports in 10-GbE mode. All GbE ports on the blade can be configured to work with either copper or optical SFPs. © Copyright IBM Corp. 2011, 2014...
  • Page 184 The FCOE10-24 blade has 24 Fibre Channel over Ethernet (FCoE) ports that enable the transmission of FC frames over an Ethernet network via encapsulation in standard Ethernet packets. This functionality adheres to Converged Enhanced SAN768B-2 Installation, Service, and User Guide...
  • Page 185 Limitations of FCOE10-24 blade The following limitations apply for the FCOE10-24 application blade with Fabric OS 7.3.0 in the SAN768B-2 chassis. v FCOE10-24 blade is supported only in slot 1 v A maximum of one FCOE10-24 blade per chassis can be installed...
  • Page 186 SAN768B-2 Installation, Service, and User Guide...

  • Page 187: Appendix C. Diagnostics And Troubleshooting

    Fabric Manager, Web Tools, Fabric Watch, and Advanced Performance Monitoring. If the SAN768B-2 does not operate as expected, the following steps can be taken to diagnose the problem: v Check the LEDs and refer to the LED tables (see Chapter 4, “Monitoring system components,”...

  • Page 188: Interpreting Post And Boot Results

    If one or more LEDs do not return to a normal state, and this is not due to the SAN768B-2 being set to beacon, refer to the relevant LED table to identify and correct the problem. For port blades, CP blades, and core switch blades, the slotShow command can be used to check the status of the slots.

  • Page 189: Boot

    1. Universal port configuration is performed. 2. Links are initialized. 3. Fabric is analyzed. If any ports are connected to other switches, the SAN768B-2 participates in a fabric configuration. 4. The SAN768B-2 obtains a domain ID and assigns port addresses.
  • Page 190 9600 bits per second, 8 databits, no parity, 1 stop bit, no flow control. Serial port might be incompatible Ensure that the SAN768B-2 is connected to an (only RS–232 is supported). RS–232 port. RS–423 serial ports might experience difficulties due to corner-case incompatibilities of the standards.

  • Page 191: Link Troubleshooting

    Link troubleshooting IBM SAN b-type directors and switches use the latest high bandwidth Fibre Channel technology and auto-negotiate to 16 Gbps, 8 Gbps, 4 Gbps, or 2 Gbps based on the link data rate capability of the attached transceiver and the speed supported by the switches and directors.

  • Page 192: Identifying The Origin Of Failure

    Once the original failing link (link 2) has been determined, the two connecting ports of that link need to be checked for the errors: v Encoder errors v Disparity errors v Invalid transmission words SAN768B-2 Installation, Service, and User Guide...
  • Page 193 The port that displays any of the above errors is the cause of the link issue, which can be caused by dust or dirt in the connectors or fiber, an insufficient link loss budget, and/or incompatible SFPs. Dust, dirt, or other contaminants One of the most common optical link problems is caused by dust, dirt, or oil in the connectors and fiber.

  • Page 194: Specifications Of Lwl 10 Km Transceivers

    LWL transceivers or use of 8-Gbps LWL transceivers that employ rate select. 2-Gbps LWL SFP maximum receive power The IBM SAN b-type 8-Gbps and 16-Gbps directors and switches use the latest high bandwidth Fibre Channel technology and auto-negotiate to 16 Gbps, 8 Gbps, 4 Gbps, or 2 Gbps based on the link data rate capability of the attached transceiver.

  • Page 195: Maximum Receive Power Of 2-Gbps Lwl Sfps

    attenuation. The common 2-Gbps SFP Rx maximum power levels are listed in Table 32 and can be used as a quick method to relieve concerns of over saturation. Table 32. Maximum receive power of 2-Gbps LWL SFPs Max Receive Power Vendor Part number Description...
  • Page 196 SAN768B-2 Installation, Service, and User Guide...

  • Page 197: Appendix D. Tuning The System

    3 potentially has the issue. Note: In a SAN768B-2 chassis slots 1-4 and 9-12 are port blades while slots 5 and 8 are core blades. In a SAN384B-2 chassis slots 1-2 and slots 7-8 are port blades while slots 3 and 6 are core blades.
  • Page 198 1. If the Cx-5825 counters are not incrementing for any specific slot and blade port number then this indicates the Cx-1010 error message was logged for other types of errors for which tuning may not help. Contact IBM Support for further assistance.

  • Page 199: Before Tuning

    To check whether a core blade is fully operational you can use the slotshow command and verify that the status of the core blade displays as “ENABLED”. An example of power cycling a core blade in slot 3 in an IBM SAN384B-2 is shown below.
  • Page 200 Attention: All connected devices on the port blade will be disconnected during the power cycle. If you cannot risk disruption to the connected devices on the port blade, proceed to Step #3. SAN768B-2 Installation, Service, and User Guide...
  • Page 201 To power cycle the port blade, use the following command: slotpoweroff <slot #> slotpoweron <slot #> An example of power cycling a port blade in slot 8 in an IBM SAN384B-2 is shown below. SAN384B-2:FID128:admin> slotpoweroff 8 Slot 8 is being powered off SAN384B-2:FID128:admin>...
  • Page 202 SAN768B-2 Installation, Service, and User Guide...

  • Page 203: Appendix E. Blade Port Numbering

    Appendix E. Blade port numbering The illustrations in this appendix show the port numbering for the different SAN768B-2 blades. See “Port numbering” on page 28 for details on the port numbering patterns for the different blades. v Figure 53 on page 176 shows a CR16-8 core blade...

  • Page 204: Cr16-8 Core Blade

    Table 33 on page 177 shows the mappings from the numbered ports on the face of the core blade to the port mappings as shown by the slotShow command. Each external port maps to four actual ports. SAN768B-2 Installation, Service, and User Guide...

  • Page 205: Blade Port Numbering

    Table 33. External port to slotShow port mapping for CR16-8 core blades External port slotShow port External port slotShow port number numbers number numbers 32-35 36-39 8-11 40-43 12-15 44-47 16-19 48-51 20-23 52-55 24-27 56-59 28-31 60-63 Appendix E. Blade port numbering...

  • Page 206: Fc16-32 Port Blade

    Figure 54. FC16-32 port blade Power LED FC ports 16-31 (bottom to top) Status LED FC ports 0-15 (bottom to top) SAN768B-2 Installation, Service, and User Guide...

  • Page 207: Fc16-48 Port Blade

    Figure 55. FC16-48 port blade Power LED FC ports 24-47 (bottom to top) Status LED FC ports 0-23 (bottom to top) Appendix E. Blade port numbering...

  • Page 208: Fc16-64 Port Blade

    Figure 56. FC16-64 port blade | | | QSFP ports 8-15; FC ports 32-63 (bottom to up) QSFP ports 0-7; FC ports 0-31 (bottom to up) SAN768B-2 Installation, Service, and User Guide...
  • Page 209 Figure 57. FC8-32E port blade Power LED FC ports 16-23 Status LED FC ports 0-7 FC ports 24-31 FC ports 8-15 Port and trunking group Appendix E. Blade port numbering...

  • Page 210: Fc8-48E Port Blade

    Figure 58. FC8-48E port blade Power LED FC ports 24-47 Status LED FC ports 0-23 SAN768B-2 Installation, Service, and User Guide...

  • Page 211: Fc8-64 Port Blade

    Figure 59. FC8-64 port blade Power LED Port 61 LED Status LED Port 29 LED Port 63 FC ports 32-63 (bottom to top) Port 30 FC ports 0-31 (bottom to top) Appendix E. Blade port numbering...

  • Page 212: Fs8-18 Encryption Blade

    Figure 60. FS8-18 encryption blade Gigabit Ethernet ports GE0-GE1 FC ports 0-15 (bottom to top) Key management smart card interface SAN768B-2 Installation, Service, and User Guide...
  • Page 213 Figure 61. FX8-24 extension blade Status LED FC ports 0-5 (numbered bottom to top) Power LED FC ports 6-11 (numbered bottom to top) 1 GbE ports 0-3 (numbered bottom to top) 1 GbE ports 4-9 (numbered bottom to top) 10 GbE ports 0-1 (numbered bottom to top) Appendix E.

  • Page 214: Fcoe10-24 Fcoe Blade

    Figure 62. FCOE10-24 FCoE blade | | | | | 10-GbE CEE ports 12-23 Power LED | | | | 10-GbE CEE ports 0-11 Status LED SAN768B-2 Installation, Service, and User Guide...

  • Page 215: Notices

    Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe on any IBM intellectual property right may be used instead.

  • Page 216: Trademarks

    International Business Machines Corporation in the United States, other countries, or both. A complete and current list of other IBM trademarks is available on the Web at www.ibm.com/legal/copytrade.shtml Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.

  • Page 217: Industry Canada Class A Emission Compliance Statement

    Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits. IBM is not responsible for any radio or television interference caused by using other than recommended cables and connectors or by unauthorized changes or modifications to this equipment. Unauthorized changes or modifications could void the user's authority to operate the equipment.

  • Page 218: People's Republic Of China Class A Electronic Emission Statement

    Verantwortlich für die Einhaltung der EMV Vorschriften ist der Hersteller: International Business Machines Corp. New Orchard Road Armonk, New York 10504 Tel: 919-499-1900 Der verantwortliche Ansprechpartner des Herstellers in der EU ist: IBM Deutschland GmbHTechnical Regulations, Abteilung M372 IBM-Allee 1, 71139 Ehningen, GermanyTele: +049 7032 15 2941e-mail: lugi@de.ibm.com Generelle Informationen: Das Gerät erfüllt die Schutzanforderungen nach EN 55024 und EN 55022 Klasse...

  • Page 219: Japan Electronics And Information Technology Industries Association (Jeita) Statement

    Japan Electronics and Information Technology Industries Association (JEITA) Statement Japanese Electronics and Information Technology Industries Association (JEITA) Confirmed Harmonics Guideline (products greater than 20 A per phase). Korea Communications Commission (KCC) Class A Statement Please note that this equipment has obtained EMC registration for commercial use. In the event that it has been mistakenly sold or purchased, please exchange it for equipment certified for home use.
  • Page 220 SAN768B-2 Installation, Service, and User Guide...

  • Page 221: Index

    152 FC16-48 133 status 53, 159 date FC16-64 133 components setting 41 FC8-32E 135 installing 81 diagnostics 159, 161 FC8-48E 135 monitoring 53 director of licensing, address 187 FC8-64 136 removing 81 FCOE10-24 138 © Copyright IBM Corp. 2011, 2014...
  • Page 222 66 installing 86 FC8-64 blade LEDs 68 installing 86 removing 84 LEDs 68 status 59, 68 removing 84 getting help x FC16-32 port blades 84, 133 status 59, 68 FC8-64 port blades 84, 136 SAN768B-2 Installation, Service, and User Guide...
  • Page 223 187 IP addresses installation safety xiii SAN768B-2 38 planning 13 safety and environmental xiii IP addresses, SAN768B-2 38 preparation 13 types xiii installation guidelines 15 notices and labels installing 113 safety xiii blower assembly 103, 104...
  • Page 224 44 product documents xxiii SAN768B-2 32 QSFPs product specifications 145 SFP+ 108, 110 compatible 44 providing power to the SAN768B-2 37 WWN bezel 105 installing 44 WWN bezel and card 104 Smart card 48 WWN card 105 SNMP 11...
  • Page 225 53 system components monitoring 53 tables, cable routing 128 Taiwan contact information xi time setting 41 time required installing a SAN768B-2 16 time server NTP 42 time zone setting 42 tools required installing a SAN768B-2 17 trademarks 188 transmission range...
  • Page 226 SAN768B-2 Installation, Service, and User Guide...
  • Page 228 Part Number: 00MA746 Printed in USA GA32-0893-06...

Table of Contents