Page 1 IBM System Storage SAN768B Installation, Service, and User’s Guide Service information: 2499-384 Read Before Using This product contains software that is licensed under written license agreements. Your use of such software is subject to the license agreements under which they are provided.
Page 3 IBM System Storage SAN768B Installation, Service, and User’s Guide Service information: 2499-384 GA32-0574-01...
Page 4 © Copyright International Business Machines Corporation 2008. All rights reserved. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
Page 5: Read This First
Read this first Summary of changes This is the second edition of the IBM System Storage SAN768B Installation, Service, and User's Guide. The content changes since the last edition of this publication are noted by a vertical line placed in the left margin beside each change.
Page 6: How To Send Your Comments
Department GZW 9000 South Rita Road Tucson, Arizona 85744-0001 U.S.A. When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you.
Page 7 Chapter 1. Introduction ..... . 1 Overview of the SAN768B ..... 1 Hardware components .
Page 8 Parts list ......14 Unpacking the SAN768B ....15 Attaching the shelf brackets .
Page 9 Items required ......84 Recording critical SAN768B and SAN information ... 84 Chassis critical information checklist .
Page 10 Troubleshooting ......106 Powering off the SAN768B ....109 Appendix C.
Page 11 Figures 1. Port side of the SAN768B (sample configuration) ....3 2. Blower (non-port) side of the SAN768B (sample configuration) ....4 3.
Page 12 SAN768B Installation, Service, and User’s Guide...
Page 13 1. Brocade and IBM product and model number matrix ....xxvi 2. Blades available for the SAN768B ......4 3.
Page 14 SAN768B Installation, Service, and User’s Guide...
Page 15: Safety And Environmental Notices
IBM Systems Safety Notices (G229–9054) publication, which is on the CD-ROM that accompanies this product. The following notices and statements are used in IBM documents. They are listed below in order of increasing severity of potential hazards. Follow the links for more detailed descriptions and examples of the danger, caution, and attention notices in the sections that follow.
Page 16 (D004) A general electrical danger notice provides instructions on how to avoid shock hazards when servicing equipment. Unless instructed otherwise, follow the procedures in the following danger notice. SAN768B Installation, Service, and User’s Guide...
Page 17 Electrical voltage and current from power, telephone, and communication cables are hazardous. To avoid a shock hazard: v Connect power to this unit only with the IBM provided power cord. Do not use the IBM provided power cord for any other product.
Page 18: Caution Notices
Delivery and subsequent transportation of the equipment The customer should prepare his environment to accept the new product based on the installation planning information provided, with assistance from an IBM Installation Planning Representative (IPR) or IBM authorized service provider. In...
Page 19: Safety Labels
Read and comply with the following caution notices before installing or servicing this device. CAUTION: Energy hazard present. Shorting may result in system outage and possible physical injury. Remove all metallic jewelry before servicing. (C001) CAUTION: The weight of this part or unit is more than 55 kg (121.2 lb). It takes specially trained persons, a lifting device, or both to safely lift this part or unit.
Page 20: Attention Notices
Do not bend a fibre cable to a radius less than 5 cm (2 in.); you can damage the cable. Tie wraps are not recommended for optical cables because they can be easily overtightened, causing damage to the cable. xviii SAN768B Installation, Service, and User’s Guide...
Page 21: Rack Installation
Rack safety Rack installation DANGER Observe the following precautions when working on or around your IT rack system: v Heavy equipment—personal injury or equipment damage might result if mishandled. v Always lower the leveling pads on the rack cabinet. v Always install stabilizer brackets on the rack cabinet. v To avoid hazardous conditions due to uneven mechanical loading, always install the heaviest devices in the bottom of the rack cabinet.
Page 22 Pack the rack cabinet in the original packaging material, or equivalent. Also, lower the leveling pads to raise the casters off of the pallet and bolt the rack cabinet to the pallet. (R002) SAN768B Installation, Service, and User’s Guide...
Page 23: Safety Inspections
Internal machine checks Perform the following internal machine checks: 1. Check for any non-IBM changes that might have been made to the machine. If any are present, obtain the “Non-IBM Alteration Attachment Survey” form, number R009, from the IBM branch office. Complete the form and return it to the branch office.
Page 24: Product Recycling And Disposal
(TI) que reciclen responsablemente sus equipos cuando éstos ya no les sean utiles. IBM dispone de una serie de programas y servicios de devolucion de productos en varios países, a fin de ayudar a los propietarios de equipos a reciclar sus productos de TI.
Page 25: Battery Return Program
United States, go to http://www.ibm.com/ibm/environment/ products/index.shtml or contact your local waste disposal facility. In the United States, IBM has established a return process for reuse, recycling, or proper disposal of used IBM sealed lead acid, nickel cadmium, nickel metal hydride, and other battery packs from IBM equipment.
Page 26 IBM representative. This notice is provided in accordance with Royal Decree 106/2008 of Spain: The retail price of batteries, accumulators and power cells includes the cost of the environmental management of their waste. xxiv SAN768B Installation, Service, and User’s Guide...
Page 27: About This Document
IBM System Storage SAN 2499 Statement of Limited Warranty, GA32-0575 Brocade documents IBM switches use software licensed from Brocade Communications Systems, Inc. You can find information related to the software that supports the SAN768B in the following documents on the CD-ROM supplied with this product: Brocade Fabric OS v Fabric OS Administrator’s Guide...
Page 28 Table 1. Brocade and IBM product and model number matrix IBM machine type and Brocade product name IBM product name model number Brocade DCX SAN768B 2499 Model 384 Brocade 48000 SAN256B Director 2109 Model M48 Brocade 5300 SAN80B-4 2498 Model B80...
Page 29: Chapter 1. Introduction
This chapter introduces the features and components of the IBM System Storage SAN768B fabric backbone. Throughout the remainder of this document, the product will be referred to as the SAN768B. This chapter contains the following information: v “Overview of the SAN768B”...
Page 30: Hardware Components
Note: Airflow in the SAN768B is from the non-port (non-cable) side to the port (cable) side and out the exhaust vent. Figure 1 on page 3 shows a sample configuration of the port side of the SAN768B. SAN768B Installation, Service, and User’s Guide...
Page 31: Port Side Of The San768B (Sample Configuration)
Figure 1. Port side of the SAN768B (sample configuration) Exhaust vent Control processor blade (CP8) Core switch blade (CR8) FC8-48 port blade Cable management comb Figure 2 on page 4 shows a sample configuration of the non-port side of the SAN768B.
Page 32: San768B Blades
Figure 2. Blower (non-port) side of the SAN768B (sample configuration) WWN bezel Blower assembly Power supply SAN768B blades Table 2 summarizes the port, application, control processor, and core switch blades that are available for the SAN768B. Table 2. Blades available for the SAN768B...
Page 33 Table 2. Blades available for the SAN768B (continued) Description Feature Code Name Function Core switch blade The CR8 blade contains the ASICs for switching between port blades. Every port blade connects to every core switch blade. There are 384 total ports for port blades.
Page 34: High Availability
Reliability The SAN768B uses the following error detection and correction mechanisms to ensure reliability of data: v Data is protected by the Error Detection and Correction mechanism, which...
Page 35: Software Features
FC routing (FCR) purposes, and this also provides double the bandwidth for each FC router connection when connected to another 8 Gbps-capable port. Security Table 3 highlights some of the key security features available for the SAN768B and for other switches running Fabric OS 5.2.0 or newer. Table 3. Security features...
Page 36: Network Manageability
E_port disable Network Manageability The SAN768B has a single domain and is managed as a single element with the Brocade Enterprise Fabric Connectivity Manager (EFCM) or Brocade Fabric Manager (FM). The SAN768B responds to its own IP address and appears as a separate entity to the Telnet protocol and SNMP.
Page 37: Managing Cables
Slots are numbered 1 through 12, from left to right when facing the port side of the SAN768B. Control processor blades (CP8) can be installed only in slots 6 and 7. Core switch blades (CR8) can be installed only in slots 5 and 8.
Page 38 SAN768B Installation, Service, and User’s Guide...
Page 39: Chapter 2. Installing And Removing A San768B
Switch Cabinet C36. This SAN768B is to be installed and serviced only by qualified IBM service representatives. The SAN768B can be ordered pre-installed in the cabinet, or the SAN768B can be added to an existing C36 cabinet. The cabinet is designed to support a total of two SAN256Bs or SAN768Bs.
Page 40: Ordering The Lift Tool
– Routing the cables through the cable channels on the sides of the cabinet – Using patch panels v Ensure that the airflow in the vicinity of the SAN768B is a minimum of 595 cubic meters per hour (350 cubic feet per minute).
Page 41: Installation Guidelines
1. Provide a space that is 14 rack units (14U) high, 61.29 cm (24.09 in.) deep, and 43.74 cm (17.22 in.). 1U is equal to 4.45 cm (1.75 in.). 2. Plan to install the SAN768B with the non-port side facing the air-intake aisle. The SAN768B can be installed facing either direction, if serviceability and cooling requirements are met.
Page 42: Installing A San768B In A Cabinet
104 kg (228 lbs) and requires the specified lift tool to install it. Installing a SAN768B in a cabinet This section describes how to install the SAN768B in the Model C36 cabinet. These procedures use parts that are included in the 14U rack mount kit. Time required Allow approximately 3 hours to complete this procedure.
Page 43: Unpacking The San768B
Figure 3. Parts in the 14U rack mount kit Unpacking the SAN768B To unpack the SAN768B, follow these steps: 1. Cut the bands that encircle the packaging. 2. Remove the lid, the 14U rack mount kit, the accessory kit, and the packing foam from the top of the chassis.
Page 44: Attaching The Shelf Brackets
1U space below the brackets for cable management. 4. Tighten the adjusting screws on the shelf brackets to a torque of 37 cm-kg (32 in.-lb). SAN768B Installation, Service, and User’s Guide...
Page 45: Removing The Chassis Door
Step 1 on page 18 through step 9 on page 19 describe how to use the lift tool (PN 09P2481) and the 24–inch load plate (PN 11P4369) to install a SAN768B in the cabinet. Step 10 on page 19 through step 21 on page 21 describe how to install the bridge tool (PN 18P5855) in the cabinet for the lower SAN768B or the upper Chapter 2.
Page 46 SAN768B. This procedure uses parts from the 14U chassis mount kit. See “Items required” on page 84 for a list of these parts. CAUTION: A fully populated SAN768B weighs approximately 105 kg (231 lb) and requires a minimum of two people and a lift tool to install it.
Page 47: Chassis Installation From Rear (Exhaust Aisle Side) Of The Cabinet
Raise the platform to allow enough room to attach the anti-tip bracket. d. Secure the anti-tip bars by using the anti-tip bracket and bolt. 10. If you are installing the lower SAN768B, go to step 11. If you are installing the upper SAN768B, go to step 12 on page 20.
Page 48: Locking The Shelf Into Position
Note: The shelf in the picture below is shown with a different director. SJ000680 Figure 7. Locking the shelf into position 12. For the upper SAN768B, install the bridge tool by completing the following steps: a. Remove the bridge tool from the box and adjust the two supports 45°.
Page 49: Attaching The Port Side Of The Chassis To The Cabinet Rails
14. Set the wheel brake and place the wheel chocks around the wheels. 15. Remove the retention straps. 16. Slide the SAN768B into the cabinet until it rests securely on the shelf brackets. 17. Remove the wheel chocks, release the wheel brake, and move the lift tool away from the cabinet.
Page 50: Aligning The Chassis Door With The Ball Studs On The Chassis
Figure 10. Details of the chassis and door, showing the ball studs on the chassis and the mounting hardware on the door Note: For turning on the power and for the configuration instructions, see Chapter 3, “Starting and configuring the SAN768B,” on page 25. SAN768B Installation, Service, and User’s Guide...
Page 51: Removing A San768B From The Cabinet
5. Remove the three 10-32 x 5/8 in. Phillips panhead screws with washers on each side. See Figure 8 on page 21 for the location of the screws. 6. If you are replacing the lower SAN768B, go to step 7. If you are replacing the upper SAN768B, go to step 8.
Page 52 A pinch point exists between the load plate and the bridge tool. P/N 18P5850-B SJ000752 14. Slide the SAN768B from the cabinet onto the 24–inch load plate. Center the SAN768B on the platform. 15. Install the retention straps. 16. Remove the wheel chocks, release the wheel brake, and move the lift tool away from the cabinet.
Page 53: Chapter 3. Starting And Configuring The San768B
Fabric OS compatibility. This is particularly important for fabrics with 1-Gbps switches using earlier Fabric OS versions. The SAN768B must be configured before it is connected to the fabric, and all of the configuration commands must be entered through the active CP blade. The...
Page 54: Providing Power To The San768B
IP address of the control processor. To establish a serial connection and log on to the SAN768B: 1. Verify that the SAN768B is powered on and that POST is complete by verifying that all power LED indicators on the port, control processor, and core switch blades display a steady green light.
Page 55: Configuring The San768B Ip Addresses
You will receive the following login prompt: CP0 Console Login: 6. Log in to the SAN768B as admin. The default password is “password.” At the initial login, the user is prompted to enter new admin and user passwords. Make sure to write down the new passwords and keep this information in a secure location.
Page 56 Follow these steps to configure the IP addresses for both CP blades (from the active CP blade): 1. Log in to the active CP as admin using the serial or Ethernet connection. 2. Set up the SAN768B IP address by entering the ipaddrset -sw 0 command at the prompt. swDir:admin> ipAddrSet -sw 0 Enter the requested information at the prompts.
Page 57: Establish An Ethernet Connection
Establish an Ethernet connection After using a serial connection to configure the IP addresses for the SAN768B, you can connect the active CP blade to the local area network (LAN) if desired. Note: Connecting the CP blades to a private network/VLAN is recommended.
Page 58: Customize A Switch Name
Customize a switch name The switch name of the SAN768B can be up to 15 characters long; can include alpha, numeric, and underscore characters; and must begin with an alpha character. Note: Changing the name causes a domain address format RSCN to be issued.
Page 59: Enabling Software Licenses
In the example above, the license key is AAbbccDDeeFFeeGG. Make sure you keep a hardcopy of your license key in a secure location for emergency reference. The 64-bit chassis ID is required to obtain and activate licenses for the SAN768B. The chassis ID is available through the licenseIdShow command.
Page 60: Backing Up The Configuration
Backing up the configuration Save all key configuration data for the SAN768B, including license key information, and upload it to a host for emergency reference. Routine backups of the configuration are recommended to ensure the current configuration is available if needed.
Page 61: Chapter 4. Monitoring System Components
Chapter 4. Monitoring system components The SAN768B is engineered for reliability and requires no routine operational steps or maintenance. This chapter provides information about determining the status of the following components using LEDs and CLI commands. v “Control processor blade (CP8)”...
Page 62: Control Processor Blade (Cp8) Leds
Color Status Action Power Steady green CP blade has valid No action required. power. No light (LED is off) CP blade does not Ensure blade is firmly have incoming power. seated and has power. SAN768B Installation, Service, and User’s Guide...
Page 63: Core Switch Blade (Cr8)
Ensure blade is firmly the switch is still seated and switch booting. has completed booting. If LED remains yellow, contact IBM. Slow-flashing amber CP blade is not Pull blade out and (on 2 seconds; then seated correctly or is reseat it. If LED off 2 seconds) faulty.
Page 64: Core Switch Blade (Cr8) Leds
Color Status Action Power Steady green CP blade has valid No action required. power. No light (LED is off) CP blade does not Ensure blade is firmly have incoming power. seated and has power. SAN768B Installation, Service, and User’s Guide...
Page 65: Fr4-18I Router Blade
1. The FR4-18i router blade must be installed in a SAN768B in order to be powered on. 2. Power is supplied to the blade once it is installed in the SAN768B and the power switch on the blade is moved to the On position. The router blade runs POST by default each time it is powered on.
Page 66: Fr4-18I Router Blade
Table 11 on page 39. scale: 5/16" = 1" scale: 15/32" = 1" scale: 15/32" = 1" scale: 5/16" = 1" Figure 13. FR4-18i router blade FR4-18i router blade Fiber Channel port status LED SAN768B Installation, Service, and User’s Guide...
Page 67 No light Blade does not have Perform the following steps: incoming power. v Verify that the SAN768B is operational. v Verify that the router blade is seated correctly. v Verify that the power slider switch is in the up position.
Page 68: Port Or Application Blades
2. The LED patterns may temporarily change during POST and other diagnostic tests. For information about how to interpret the LED patterns, see Table 12 on page 45. 3. Check the blade status by typing slotShow. SAN768B Installation, Service, and User’s Guide...
Page 69: Fc8-16 Port Blade
Table 12 on page 45 describes the port and routing blade LED patterns and the recommended actions for those patterns. Power LED Fibre Channel port Status LED Port Status LED Figure 14. FC8-16 port blade Chapter 4. Monitoring system components...
Page 70: Fc8-32 Port Blade
Power LED Fibre Channel port Status LED Port Status LED Figure 15. FC8-32 port blade SAN768B Installation, Service, and User’s Guide...
Page 71: Fc8-48 Port Blade
Power LED Fibre Channel port Status LED Port Status LED Figure 16. FC8-48 port blade Chapter 4. Monitoring system components...
Page 72: Fc10-6 Port Blade
FC10-6 Port Blade Ejector On/Off Switch Power LED Fibre Channel Ports Blade Status LED Thumb Screw Port Status LED Figure 17. FC10-6 port blade SAN768B Installation, Service, and User’s Guide...
Page 73: Power Supply
Slow-flashing green (on 1 Port is online but segmented, Verify that the correct device is second, then off 1 second) indicating a loopback plug or attached to the SAN768B. cable or an incompatible switch. Fast-flashing green (on 1/4 Port is in internal loopback No action required.
Page 74: Blower Assembly
The LED patterns may temporarily change during POST and other diagnostic tests; for information about how to interpret the LED patterns, see Table 14 on page 47. 2. Check the blower assembly status using the fanShow command. SAN768B Installation, Service, and User’s Guide...
Page 75: Blower Assembly Leds And Other Parts
The status for each blower assembly displays OK, Absent, or Faulty. The RPM of each fan in the assembly is also provided. If a blower assembly is absent or faulty, contact IBM. Figure 19 displays the blower assembly. Figure 19. Blower assembly LEDs and other parts...
Page 76: Wwn Bezel And Wwn Card
EM-WWN_ABSENT, 2, WWN #1 not present Writing to the FRU history log 0x24c (fabos): Switch: switchname, Error (hilSetFruHistory) has failed. EM-HIL_FAIL, 2, HIL Error: hilSetFruHistory failed, rc=-3 for SLOT Figure 20 on page 49 displays the WWN bezel. SAN768B Installation, Service, and User’s Guide...
Page 77: Leds On The Wwn Card And Bezel
Figure 20. LEDs on the WWN card and bezel CP blade Status (above) and Port blade Status (above) and Power (below) LEDs Power (below) LEDs CR blade Status (above) and Slot numbers Power (below) LEDs The WWN card LED patterns and the recommended actions for those patterns are described in Table 16.
Page 78 SAN768B Installation, Service, and User’s Guide...
Page 79: Chapter 5. Removing And Installing Components
FRU replacements if the conditions specified in the procedure are followed. The following sections contain FRU removal and installation procedures. Removing and installing the chassis door Note: The chassis door must be installed to ensure the SAN768B meets EMI and other regulatory certifications. Time and items required The replacement procedure for the chassis door takes less than 5 minutes.
Page 80: Removing And Installing A Cable Management Comb
Figure 21. Chassis door Removing and installing a cable management comb The SAN768B can continue to operate during the replacement of the cable management comb. Time and items required The replacement procedure for the cable management comb takes less than 5 minutes.
Page 81: Installing A Cable Management Comb
Slots are numbered from 1 through 12, from left to right when facing the port side of the SAN768B. Port blades can be installed in slots 1 through 4 and 9 through 12. Chapter 5. Removing and installing components...
Page 82: Time And Items Required
11. Open the ejectors. Pull the blade out of the chassis using the ejectors. 12. If the blade is not being replaced by another blade, install a filler panel. See “Removing and installing port blade filler panels” on page 56. SAN768B Installation, Service, and User’s Guide...
Page 83: Installing A Port Blade
Figure 23. Port blade removal and installation (16-port blade shown as example) Installing a port blade To install a port blade, do the following: Attention: Follow ESD precautions. 1. Orient the blade so that the ports are at the front of the chassis and the flat side of the blade is on the left.
Page 84: Removing And Installing Port Blade Filler Panels
1. Remove the chassis door. 2. Unscrew the thumb screw at the bottom of the panel using the Phillips screwdriver. 3. Pull the filler panel out of the chassis. (See Figure 24 on page 57.) SAN768B Installation, Service, and User’s Guide...
Page 85: Installing A Filler Panel
This section describes how to remove and install a control processor (CP8) blade. Each SAN768B has two CP8 blades located in slot 6 and slot 7. Note: If the new CP blade does not have the same firmware as the active CP blade, you must upgrade the new blade to the same firmware version.
Page 86: Time And Items Required
For more information about error messages, refer to the Fabric OS Message Reference. Recording critical SAN768B information Back up the SAN768B configuration before you replace a CP blade. Refer to the Fabric OS Administrator’s Guide for backup information. To record critical SAN768B information, do the following: 1.
Page 87 If you cannot connect to the faulty CP, remove the faulty CP blade for repair as follows: 1) Turn the CP blade off and notify the SAN768B of a hot swap request by sliding the slider switch in the top ejector down to the off position (see Figure 25 on page 61).
Page 88: Removing A Control Processor Blade (Cp8)
Removing a control processor blade (CP8) The SAN768B continues to operate while a CP blade is being installed if the redundant CP blade is active and a failover does not occur. You can prevent failover by entering the haDisable command.
Page 89: Installing A Control Processor Blade (Cp8)
Figure 25. Removing the control processor (CP) blade Installing a control processor blade (CP8) Attention: Follow ESD precautions. To install a CP blade (slot 6 or 7): 1. Open the ejector handles to approximately 45 degrees. Orient the CP blade so that the handles are toward you and the flat metal side is on your left.
Page 90: Verifying Operation Of The New Cp Blade
CP blade, bring the replacement blade to the same firmware level as the active blade. Note: Firmware downloads require that Ethernet connections be made to both CP blades. Procedures for loading firmware are described in the Brocade Fabric OS Administrator’s Guide. SAN768B Installation, Service, and User’s Guide...
Page 91: Removing And Installing A Core Switch Blade (Cr8)
Removing and installing a core switch blade (CR8) This section describes how to remove and install a core switch blade. Each SAN768B has two core switch blades located in slot 5 and slot 8. Chapter 5. Removing and installing components...
Page 92: Time And Items Required
For more information about error messages, refer to the Fabric OS Message Reference. Removing a core switch blade (CR8) The SAN768B continues to operate while a core switch blade is being replaced. Attention: Follow ESD precautions. To remove a CR blade, do the following: 1.
Page 93: Installing A Core Switch Blade (Cr8)
Figure 26. Removing the core switch blade Installing a core switch blade (CR8) Attention: Follow ESD precautions. To install a CR blade (slot 5 or 8), do the following: 1. Open the ejector handles to approximately 45 degrees; then, orient the CR blade so that the handles are toward you and the flat metal side is on your left.
Page 94: Removing And Installing An Fr4-18I Router Blade
This section describes how to remove and install an FR4-18i router blade in the SAN768B. You can install up to two router blades in any of slots 1-4 and 9-12. To ensure proper cooling, install only one router blade in each slot grouping. See Figure 13 on page 38, for blade removal and installation, as an example of how to remove a router blade.
Page 95: Installing A Router Blade
2. Establish a Telnet or console session before removing an router blade to determine a failure and verify operation before removal. Use the switchShow command to view the status of blades on the SAN768B. 3. Check for adequate cable slack.
Page 96: Configuring Fcip And Fibre Channel Routing Services And Enabling The Ports
Verify the installation. For information about how to check the status of hardware components using the CLI, See the Fabric OS Administrator’s Guide. 11. Log into the SAN768B as the admin user. Configuring FCIP and Fibre Channel routing services and enabling the ports Refer to the Fabric OS Administrator’s Guide or the Web Tools Administrator’s...
Page 97: Removing And Installing A Power Supply
Removing a power supply To remove a power supply, do the following: 1. If the SAN768B is not operating during the replacement procedure, go to step 2. If the SAN768B is going to continue operating during the replacement, check the power LEDs to verify that the minimum number of power supplies is functioning.
Page 98: Installing A Power Supply
2. Insert the power supply into the slot and push the handle up. Verify that the power supply is seated by gently pulling on the handle. 3. Verify that the power LED on the power supply displays a steady green light. SAN768B Installation, Service, and User’s Guide...
Page 99: Removing And Installing A Blower Assembly
Removing and installing a blower assembly This procedure provides instructions for removing and installing a blower assembly. Attention: To ensure continuous adequate cooling, maintain three operating blower assemblies at all times except for the brief period when replacing a blower assembly.
Page 100: Installing A Blower Assembly
Allow approximately 20 minutes to install a WWN card. The following items are needed to install a WWN card: v Electrostatic discharge (ESD) grounding strap v #2 Phillips screwdriver (required only for some versions of the WWN card) SAN768B Installation, Service, and User’s Guide...
Page 101: Verifying Necessity Of Installation
v If a serial console session is used: serial cable and a workstation computer with a terminal emulator application (such as HyperTerminal for Windows systems or TIP for Solaris systems) Verifying necessity of installation Before installing a WWN card, verify that the installation is necessary. Any of the following events can indicate that the card requires installation: v Status LEDs on the WWN bezel not reflecting the actual status of the components...
Page 102: Removing The Wwn Bezel And Wwn Card
Attention: Follow ESD precautions. 1. Open a Telnet session to the SAN768B and log in to the active CP as admin. The default password is “password”. 2. Verify you are logged into the active CP. Run the haShow command to determine the active CP.
Page 103: Installing The Wwn Bezel And Wwn Card
v To remove a WWN card that does not have handles: Use a Phillips screwdriver to unscrew the two screws which secure the WWN card to the chassis. Hold the card by the edges and remove it. 8. Set the WWN card on a static-free surface, such as a grounding pad. Figure 29.
Page 104: Installing And Removing Fc Transceivers In A Port Blade
If a transceiver does not slide in easily, ensure that it is correctly oriented. The SAN768B comes with a transceiver extraction tool (see Figure 30 on page 77) and holster. The extraction tool is designed to remove transceivers from blades where the space is limited.
Page 105: Sfp Extraction Tool
Figure 30. SFP extraction tool Note: This tool is part of the SAN768B ship group and should be kept with the SAN768B. Chapter 5. Removing and installing components...
Page 106 SAN768B Installation, Service, and User’s Guide...
Page 107: Chapter 6. Installing New Features
Refer to “Safety and environmental notices” on page xiii before performing any service or installation procedures. The SAN768B can be upgraded with any of the following hot-pluggable features while the SAN768B is operational. Refer to the individual feature installation instructions for any possible exceptions.
Page 108: Fc3850 - Installing An Fr4-18I Routing Blade
Disassembling any part of a blade voids the part warranty and regulatory certifications. There are no user-serviceable parts inside the blade. These instructions cover installing a new FC3850 in the SAN768B chassis. SAN768B Installation, Service, and User’s Guide...
Page 109: Time Required
SAN768Bs. A maximum of two router blades can be installed in a single SAN768B chassis. Router blades can be installed in any slot 1-4 and 9-12. If there are two router blades, to ensure proper cooling install one router blade in one of the slots 1-4, and the other in one of the slots 9-12.
Page 110: Fc3870 - Installing An Fc10-6 10 Gb Blade
FC3870 - Installing an FC10-6 10 Gb blade This feature can be installed while the SAN768B is operational. Attention: Follow these precautions for all procedures in this section to avoid damaging the port blades or chassis: v Wear a grounded ESD strap when handling a port blade.
Page 111: Chapter 7. Installing The Chassis
Chapter 7. Installing the chassis The SAN768B chassis is highly reliable and unlikely to fail. This chapter describes how to remove and replace a chassis in the unlikely event of a failure. The SAN768B must be removed from the fabric and powered off to perform this procedure.
Page 112: Preparing For A Chassis Installation
(see “Chassis critical information checklist” on page 87). To record critical switch and SAN information: 1. Open a Telnet session and login to the SAN768B as admin. The default password is password. Enable the logging function on your Telnet or serial console connection.
Page 113 File Name [config.txt]: config-switch0.txt Password: xxxxxxxx upload complete swDir:admin> 3. Record the SAN768B values on a workstation, following steps 4 through 9 below. 4. Record the WWN value: Type wwn, then copy the command output into a file named configmiscinfo.txt.
Page 114 Copy the command output into a text file named SANbefor.txt. This information can be used after the SAN768B is restored to the fabric, to verify that no unintentional changes have occurred to the fabric. swDir:admin> nsshow Type Pid COS PortName NodeName TTL <output truncated>...
Page 115: Chassis Critical Information Checklist
6.0.0 <output truncated> swDir:admin> 9. Record the cable connections between the SAN768B and the target device and ports. (See “Cable routing tables” on page 93). Chassis critical information checklist Use the table below, or a similar structure to record critical information when replacing a SAN768B chassis.
Page 116: Disconnecting The San768B From The Network And Fabric
Protect the CP blades, port blades, router blades, and WWN card with static bags or grounding pads while they are out of the chassis. You must remove the field replaceable units (FRUs) from the SAN768B chassis in the order listed below. Refer to the instructions in Chapter 5, “Removing and installing components,”...
Page 117: Removing And Replacing The Chassis
1. Uninstall the chassis from the cabinet (see Chapter 2, “Installing and removing a SAN768B,” on page 11 for detailed steps) and place it onto an extra lift or on the shipping pallet originally provided with the chassis. Remove the rack mount hardware, and set the hardware aside for use with the new chassis.
Page 118: Installing Components Into The New Chassis
POST takes a minimum of three minutes and is complete when LED activity returns to standard state. 2. Verify that the SAN768B is powered on and POST is complete (all power LED indicators on the port blades, CP blades, and router blades should be a steady green).
Page 119: Verifying The Correct Operation Of The System
Verifying the correct operation of the system To verify that the SAN768B is operating correctly, follow the steps below. 1. Log in to the SAN768B as admin. swDir:root> login login: admin password: xxxxxxxx swDir:admin> 2. Enter slotShow and verify that all the installed cards are detected and that their status is operational.
Page 120: Reconnecting The System To The Network And Fabric
Attention: Refer to “Managing cables” on page 9 for information on how to physically manage the arrangement of the cables within the SAN768B chassis, and cautions on handling and routing the cables. Refer to the cable routing information recorded in “Cable routing tables” on page 93 to ensure the correct cable connections in the steps below.
Page 121: Verifying The Correct Configuration Of The Fabric
Table 21 provides a sample of cable routing information. Create your own table, or use Table 22 to record this information, if it is not already available. Table 21. Sample cable routing table for SAN768B (Switch Name: swDir) Cable labels...
Page 122 Table 22. Cable routing table for SAN768B (continued) Slot/Port Cable labels Connected Slot/Port of Slot Port Switch end Device end device device SAN768B Installation, Service, and User’s Guide...
Page 123: Appendix A. Product Specifications
Appendix A. Product specifications This section provides product specifications for the SAN768B. System architecture Table 23 lists the system architecture for the SAN768B. Table 23. System architecture Fibre Channel Ports Up to 384 ports, universal (E_Port, F_Port, FL_port, Ex_port, and M_port)
Page 124 (Access Control Lists), Admin Domains, Reliable Commit Service, NTP, Syslog, RASlog, auditing Data traffic types Fabric switches supporting unicast, multicast (255 groups), and broadcast Inter-chassis linking (ICL) Chassis-to-chassis linkage through connectors on the core switch blade (CR8) SAN768B Installation, Service, and User’s Guide...
Page 125: Physical Dimensions
Chassis door 2.09 kg (4.6 lb.) Facility requirements The facility where the SAN768B is in use must meet the following requirements to provide for correct operation: v Adequate supply circuit, line fusing, and wire size, as specified by the electrical...
Page 126: Power Specifications
The environmental specifications listed in Table 27 on page 99 v If the SAN768B will be installed in an EIA rack, ensure the following: – All equipment installed in the rack has a reliable branch circuit ground connection, and does not rely on a connection to a branch circuit, such as a power strip.
Page 127: Environmental Requirements
Note: The 10° to 40° Celsius range applies to the ambient air temperature at the air intake vents on the nonport side of the SAN768B. The temperature inside the SAN768B can be up to 75° Celsius during SAN768B operation. If the internal temperature range exceeds the operating ranges of the components, the LEDs, error messages, and Fabric Watch alerts will indicate a problem.
Page 128: Fibre Channel Port Specifications
21 m Fibre channel port specifications The Fibre channel ports in the SAN768B support full duplex link speeds at 10.51875, 8.50, 4.25, 2.125, or 1.0625 Gbit/sec inbound and outbound, automatically negotiating to the highest common speed of all devices connected to the port.
Page 129: Power Cords
Code 7880). See the IBM TotalStorage SAN Cabinet 2109 Model C36 Installation and Service Guide for information on connecting the cabinet to the facility power source. If the stand-alone feature is ordered for the SAN768B, then you must also order the country-specific power cords.
Page 130 SAN768B Installation, Service, and User’s Guide...
Page 131: Appendix B. Diagnostics And Troubleshooting
Fabric Manager, Web Tools, Fabric Watch, and Advanced Performance Monitoring. If the SAN768B does not operate as expected, the following steps can be taken to diagnose the problem: v Check the LEDs and refer to the LED tables (see Chapter 4, “Monitoring system components,”...
Page 132: Interpreting Post And Boot Results
Interpreting POST and boot results The SAN768B performs power on self test (POST) by default each time the chassis is powered on or the SAN768B is rebooted or reset. The SAN768B can be rebooted using the switchReboot, reboot (to reboot each CP individually), or fastBoot commands.
Page 133: Boot
1. Universal port configuration is performed. 2. Links are initialized. 3. Fabric is analyzed. If any ports are connected to other switches, the SAN768B participates in a fabric configuration. 4. The SAN768B obtains a domain ID and assigns port addresses.
Page 134: Troubleshooting
9600 bits per second, 8 databits, no parity, 1 stop bit, no flow control. Serial port might be incompatible Ensure that the SAN768B is connected to an (only RS–232 is supported). RS–232 port. RS–423 serial ports might experience difficulties due to corner-case incompatibilities of the standards.
Page 135 The SAN768B was connected to Refer to Chapter 3, “Starting and configuring the address/Domain ID the fabric before being configured. SAN768B,” on page 25 and the Fabric OS conflict. Administrator’s Guide for configuration information. LEDs on one or more The SAN768B might be booting or Verify that boot and POST are complete.
Page 136 The component might have failed. Enter the sensorShow command to determine component status. If component is a CP blade or port blade, enter the slotShow command to determine status. Replace component as necessary. SAN768B Installation, Service, and User’s Guide...
Page 137: Powering Off The San768B
Powering off the SAN768B To power off the SAN768B: 1. Shut down the SAN768B using the sysShutdown command. swDir::admin> sysshutdown This command will shutdown the operating systems on your switch. You are required to power-cycle the switch in order to restore operation.
Page 138 SAN768B Installation, Service, and User’s Guide...
Page 139: Appendix C. Port Numbering Templates
Appendix C. Port numbering templates Print or copy the templates on the following pages and use them to record the port numbering scheme for your SAN768B. v Figure 31 on page 112 v Figure 32 on page 113 v Figure 33 on page 114...
Page 140: Port Side Populated With Eight Fc8-48 Port Blades, Two Cr8 Blades, And Two Cp8 Blades
Figure 31. Port side populated with eight FC8-48 port blades, two CR8 blades, and two CP8 blades SAN768B Installation, Service, and User’s Guide...
Page 141: Port Side Populated With Eight Fc8-32 Port Blades, Two Cr8 Blades, And Two Cp8 Blades
Figure 32. Port side populated with eight FC8-32 port blades, two CR8 blades, and two CP8 blades Appendix C. Port numbering templates...
Page 142: Port Side Populated With Eight Fc8-16 Port Blades, Two Cr8 Blades, And Two Cp8 Blades
Figure 33. Port side populated with eight FC8-16 port blades, two CR8 blades, and two CP8 blades SAN768B Installation, Service, and User’s Guide...
Page 143: Fc10-6 Port Blade
10-6 10-6 Figure 34. FC10-6 port blade Appendix C. Port numbering templates...
Page 144: Fc4-18Ip Port Blade
16IP 16IP 16IP 16IP scale: 5/16" = 1" Figure 35. FC4-18IP port blade SAN768B Installation, Service, and User’s Guide...
Page 145: Notices
The materials at those web sites are not part of the materials for this IBM product and use of those web sites is at your own risk.
Page 146 IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
Page 147: Trademarks
Trademarks The following terms are trademarks of the International Business Machines Corporation in the United States, other countries, or both: FICON System Storage TotalStorage Brocade and Fabric OS are registered trademarks and Silkworm is a trademark of Brocade Communications Systems, Inc. in the United States, other countries or both.
Page 148: Electronic Emission Notices
Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits. IBM is not responsible for any radio or television interference caused by using other than recommended cables and connectors or by unauthorized changes or modifications to this equipment.
Page 149: Germany Electromagnetic Compatibility Directive
EU-Mitgliedsstaaten und hält die Grenzwerte der EN 55022 Klasse A ein. Um dieses sicherzustellen, sind die Geräte wie in den Handbüchern beschrieben zu installieren und zu betreiben. Des Weiteren dürfen auch nur von der IBM empfohlene Kabel angeschlossen werden. IBM übernimmt keine Verantwortung für die Einhaltung der Schutzanforderungen, wenn das Produkt ohne Zustimmung der IBM verändert bzw.
Page 150: Japan Vcci Class A Ite Electronic Emission Statement
Japan VCCI Class A ITE Electronic Emission Statement People’s Republic of China Class A Electronic Emission Statement Korea Class A Electronic Emission Statement SAN768B Installation, Service, and User’s Guide...
Page 151: Index
57 cabinet 11 CR blade cabinet installing 63, 65 C36 11 removing 63, 64 installing a SAN768B 14 critical information checklist, chassis 87 cable management comb critical SAN information high density 52 recording 84 installing 52 critical SAN768B information...
Page 152 Fibre channel routing services 68 director of licensing enabling ports 68 address 117 installing 67 disconnecting removing 66 SAN768B from network and fabric 88 FR4-18i router blade 37 documents installing 66 Brocade xxv removing 66 product xxv FR4-18i router blade status 37...
Page 153 1 IP addresses 32 ordering the lift tool and the 24–inch load plate 12 SAN768B 27 overview 1 IP addresses, SAN768B 27 parameters key data 32 configuration 27 IP addresses 32 parameters, initial configuration 27...
Page 154 95 rack relocation xx providing power to the SAN768B 26 safety inspection external machine checks xxi internal machine checks xxi safety inspections xxi safety labels xvii rack...
Page 155 30 system architecture 95 system operation, verifying 91 tables, cable routing 93 time required installing a SAN768B 14 tools required installing a SAN768B 14 trademarks 119 transceivers 30 transceivers, SFP 30 verifying chassis replacement need 83 fabric configuration 93...
Page 156 SAN768B Installation, Service, and User’s Guide...
Page 157 When you send comments to IBM, you grant IBM a nonexclusive right to use or distribute your comments in any way it believes appropriate without incurring any obligation to you. IBM or any other organizations will only use the personal information that you supply to contact you about the issues that you state on this form.
Page 158 Readers’ Comments — We’d Like to Hear from You Cut or Fold Along Line GA32-0574-01 Fold and Tape Please do not staple Fold and Tape _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ NO POSTAGE NECESSARY IF MAILED IN THE...
Page 160 Part Number: 45W1049 Printed in USA GA32-0574-01...

IBM SAN768B Installation, Service And User Manual

Chapter 1. Introduction

Chapter 2. Installing and Removing a SAN768B

Chapter 3. Starting and Configuring the SAN768B

Chapter 4. Monitoring System Components

Chapter 5. Removing and Installing Components

Chapter 6. Installing New Features

Chapter 7. Installing the Chassis

Appendix A. Product Specifications

Appendix B. Diagnostics and Troubleshooting

Appendix C. Port Numbering Templates

Quick Links

Troubleshooting

Related Manuals for IBM SAN768B

Summary of Contents for IBM SAN768B

Table of Contents