Page 1 IBM 9077 SP Switch Router: Get Connected to the SP Switch Hajo Kitzhöfer, Steffen Eisenblätter, Uwe Untermarzoner International Technical Support Organization http://www.redbooks.ibm.com SG24-5157-00...
Page 3 SG24-5157-00 International Technical Support Organization IBM 9077 SP Switch Router: Get Connected to the SP Switch November 1998...
Page 4 Take Note! Before using this information and the product it supports, be sure to read the general information in Appendix D, “Special Notices” on page 305. First Edition (November 1998) This edition applies to PSSP Version 2, Release 4 for use with AIX 4.3.1 and Ascend Embedded/OS Version 1.4.6.4.
Page 5: Table Of Contents
Contents Figures ........... .ix Tables.
Page 6 3.14 Verify an SP Switch Router Adapter Card on the Router ..97 3.14.1 Verify Media Card Operation Using ping ....97 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 7 3.14.2 Check Media Card Status Using grcard ....98 3.14.3 Reset Media Card Using grreset ......99 3.14.4 Using grstat to Display GRF Statistics .
Page 8 7.3 HIPPI Backbone Connection ......227 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 9 Appendix A. Laboratory Hardware and Software Configuration ..233 A.1 Node and Control Workstation Configuration ..... 233 A.1.1 Hard Disks .
Page 10 ITSO Redbook Evaluation ........323 viii IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 11: Figures
Figures 1. SP Switch Router..........6 2.
Page 12 73. The SP Switch Board ........299 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 13 Tables 1. Memory Configuration ........35 2.
Page 14 55. Media Card Cables and Connectors ......298 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 15: Preface
Preface The GRF is a high-performance switched IP Router which provides high-speed data communication links between IBM RS/6000 SP and external networks or hosts. It acts as a special-purpose SP node that routes IP traffic between SP nodes on the SP Switch and the outside world. Connected directly to the SP Switch, the router offers significantly improved SP I/O performance.
Page 16 IBM PPS Lab Poughkeepsie Gene Novitsky Ascend Communications, Inc. Frank May IBM Worldwide RS/6000 SP Product Marketing Wes Kinard IBM RS/6000 Networking Technologies Marcelo R. Barrios International Technical Support Organization, Poughkeepsie Center IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 17: Comments Welcome
Comments Welcome Your comments are important to us! We want our redbooks to be as helpful as possible. Please send us your comments about this or other redbooks in one of the following ways: • Fax the evaluation form found in “ITSO Redbook Evaluation” on page 323 to the fax number shown on the form.
Page 18 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 20 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 21: Chapter 1. Dependent Node
Chapter 1. Dependent Node This chapter provides an overview of a dependent node in RS/6000 SP. We start by defining the dependent node and the rationale behind its design. 1.1 Dependent Node Architecture The Dependent Node Architecture refers to a processor or node, possibly not provided by IBM, for use with the RS/6000 SP.
Page 22 As the dependent node is not a standard RS/6000 SP Switch node, it cannot be used to forward service packets to other nodes. IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 23: Chapter 2. Router Node
Chapter 2. Router Node The first dependent node is actually a new SP Switch Router Adapter in a router. This chapter offers more details about the implementation. Section 2.1, “Overview” on page 5 gives you an overview of SP Switch Router.
Page 24: Motivation
A 135 MHz wide node’s CPU becomes saturated at about 5000 packets/second. A 10 Mb/s Ethernet uses a maximum of 1500 bytes for a IBM 9077 SP Switch Router: Get Connected to the SP Switch SP Switch HIPPI...
Page 25: Functional Comparison
packet size. This would only enable a wide node to handle approximately 7.5 MB/s of IP traffic. Since Ascend’s business depends on keeping pace with networking technology, they already support the major interfaces today. The 9077 will be able to take advantage of any new interfaces that are developed in the future as well, with no further development time or money expended.
Page 26: Design Objectives
IP traffic can be routed between the systems in the networks, as shown in Figure 3 on page 9. IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 27: Typical Router Configuration
Network Network Router Network Network Figure 3. Typical Router Configuration Routers help to reduce the amount of processing required on local systems, since they perform the computation of routes to remote systems. For example, a system can communicate with a remote system by passing the message (or packets) to the router.
Page 28: Table-Based Routing
The protocols are designed to distribute information that dynamically adjusts routes to reflect changing network conditions. Routing protocols handle complex routing IBM 9077 SP Switch Router: Get Connected to the SP Switch Gateway Gateway...
Page 29: Routing Without The Grf
situations more quickly and accurately than a system administrator can do. Routing protocols are designed not only to switch to a backup route when the primary route becomes inoperable; they are also designed to decide which is the "best" route to a destination. On any network where there are multiple paths to the same destination, a dynamic routing protocol should be used.
Page 30: Routing With The Grf
Switch Router adapter can route up to 30,000 packets per second and up to 100 MB/s into the SP Switch network in each direction simultaneously. SP Switch Figure 6. Routing with GRF IBM 9077 SP Switch Router: Get Connected to the SP Switch Node Node Node...
Page 31: Ip Switch Control Board
The GRF uses a crosspoint switch (see Figure 7) instead of an I/O bus to interconnect its adapters. This switch is capable of 4 or 16 Gbit/s (model dependent) and gives better performance than the MCA bus. IP Switch Control Board Route 4Gb/s Manager...
Page 32: Conventional Routers
Layer 2 (see Figure 9 on page 15). In the case of the SP Router, the route processing is done through hardware, so all processing is done at near-wire speed. IBM 9077 SP Switch Router: Get Connected to the SP Switch Router Router...
Page 33: Overview Of Supported Routing Protocols
Switch Process Route Layer 3 Layer 2 ..Figure 9. Switched Routers Other advantages of using GRF are as follows: • Availability of a redundant power supply • Availability of a redundant fan • Availability of a hot-swappable power supply •...
Page 34: Media Adapters At-A-Glance
All the media adapters on the GRF are hot-pluggable. This differs from using an RS/6000 SP node as your router. Should any network adapter on the RS/6000 SP node fail, the node has to be brought down to replace the faulty IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 35: Price Comparison
adapter. As a result, other network adapters are brought down as well. Bringing down the router will impact all the networks in the location. Each RS/6000 SP is allowed to connect to multiple SP Switch Router Adapters, and it does not matter if these adapters are on different GRFs. Connecting multiple SP Switch Router adapters to either different partitions in an RS/6000 SP or to different RS/6000 SPs allows them to communicate with each other and with the other GRF media adapters via the SP Switch.
Page 36: Grf Software
The software functionality of the GRF is distributed between the Router Manager on the IP Switch Control Board (see also Section 2.3.2, “GRF Features” on page 26) and the individual media cards. While the Route IBM 9077 SP Switch Router: Get Connected to the SP Switch 53,000 13,500...
Page 37: Ip Protocol
Manager updates the system routing tables and performs other administrative functions, the intelligent processors on each media card perform all routing functions. This design supports efficient distributed processing of router operations. 2.2.1 IP Protocol The GRF supports IP datagram routing between major types of standard media.
Page 38: Supported Routing Protocols
Interior routing protocols are used to exchange routing information between routers within a single autonomous system. They are also used by routers that run exterior protocols to collect network reachability IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 39 information for the autonomous system. Here is the list of interior protocols supported by the GRF: • RIP The Routing Information Protocol (RIP), as delivered with most UNIX systems, is run by the routing deamon routed a request for routing updates is issued. After that, the daemon listens for responses to the request.
Page 40 Virtual Interfaces (VIFs) to which the packet is sent. • OSPF Multicast The GRF uses the multicast capability of OSPF Version 2, as described in RFC 1583 and RIP Version 2, for communications between routers. IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 41: Filtering
Host extensions for IP multicasting as described in RFC 1112 are also provided. The Router Manager acts as a host and uses the Internet Group Management Protocol (IGMP), version 2, to add and delete its membership in multicast groups. Accordingly, the Route Manager "joins"...
Page 42: System Management
The following sections give you more details about the various hardware components. 2.3.1 GRF Block Diagram Figure 11 on page 25 shows the two models: the 4-slot and the 16-slot model. IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 43: Grf Models
19" IP Switch Control Board Power IP Forwarding Media Card Supply IP Forwarding Media Card Power IP Forwarding Media Card Supply IP Forwarding Media Card 5.25" GRF 400 Figure 11. GRF Models The SP Switch Router model 9077 04S (GRF 400) can accommodate up to four media adapters.
Page 44: Grf Features
IBM 9077 SP Switch Router: Get Connected to the SP Switch supplies that are required for redundancy. accessed separately from the other parts of the GRF.
Page 45: Grf Architecture
If the temperature exceeds 57.5 °C (137 °F), the GRF does an automatic system shutdown. • Hot-swappable fan For the GRF 16S model, the cooling fan can be replaced while the GRF is in operation. • Hot-swappable adapters There are two types of adapters on the GRF: the media adapters and the IP Switch Control Board.
Page 46 With the knowledge about the local routing functions of the media cards, we now look at Figure 13 on page 29 to see how a data packet is transferred from one media card to another. IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 47: Data Packet Transfer
External Interface QBRT Internal Interface Figure 13. Data Packet Transfer The routing can be divided into the following steps: 1. A data packet is received by the media card. 2. The packet is transferred to the receive buffer by the DMA engine. 3.
Page 48: Routing Packet Processing
5. A special header is added to the packet by the CPU. This header contains information for the downstream card. The result of the hardware lookup determines whether the packet should be forwarded to the Router Manager. IBM 9077 SP Switch Router: Get Connected to the SP Switch QBRT Internal Interface...
Page 49: Ip Switch And Control Board
6. The packet is then transferred to the Combus interface by the DMA engine. 7. The packet is sent to the IP Switch Control Board’s Router Manager across the Combus. 8. The Route Manager receives the packet and passes it to the dynamic routing software.
Page 50: Side View Of Grf 400 Chassis With Slots Numbered
It is also used for the logging of messages, the dumping of memory and status, and to perform diagnostic checking of both the GRF and the media adapters. IBM 9077 SP Switch Router: Get Connected to the SP Switch 1 2 3 4 5 6 7 Control board...
Page 51: Ip Switch Control Board
2.3.3.1 Route Manager As already mentioned, the router management takes place on the IP Switch Control Board. Specific functions of the Route Manager are: • It processes all dynamic routing packets. • It synchronizes the route tables on the media cards. •...
Page 52 • The PCMCIA modem card, also available as an optional device, allows Note: For the initial setup, the console must be available locally, not IBM 9077 SP Switch Router: Get Connected to the SP Switch memory (the four shaded blocks of 32 MB of memory in the upper left corner).
Page 53: Memory Guidelines For The Ip Switch Control Board
Additionally, the RS232 port (which is not shown in the figure) allows you to connect the VT100 console by using an RS232 null modem cable. The console and cable must be supplied by the user. 2.3.4 Memory Guidelines for the IP Switch Control Board As already mentioned, the GRF base system comes with 128 MB of memory.
Page 54: Characteristics Of Grf Media Cards
The GRF supports a number of media adapters. Figure 19 describes the SP Switch Router Adapter in detail. This adapter allows the GRF to connect directly into the SP Switch. IBM 9077 SP Switch Router: Get Connected to the SP Switch 64MB RAM - System software...
Page 55: Sp Switch Router Adapter
Media Board Receive TBIC Receive Proc & C Send TBIC SP Switch Figure 19. SP Switch Router Adapter The SP Switch Router Adapter is made up of two parts: the media board and a serial daughter card. The serial daughter card is an interface for the media board into the crosspoint switch.
Page 56: Media Card Performance
• It is able to transfer up to 100 MB per second. The limiting factor is the crosspoint switch connection bandwidth. IBM 9077 SP Switch Router: Get Connected to the SP Switch assembles them into IP packets in the 16 MB buffer.
Page 57: Other Media Cards
• It is able to transfer up to 30,000 packets per second. At 20,000 packets per second, each packet needs to be at 5 KB in order to achieve the 100 MB per second transfer rate mentioned. • As previously mentioned, each adapter stores its own route tables in memory.
Page 58: Grf Operating Environment
IBM 9077 SP Switch Router: Get Connected to the SP Switch to connect to a digital network using a transmission format known as Synchronous Optical Network protocol (SONET). This standard is increasingly popular in the telecommunications industry.
Page 59 The attributes of the DependentNode class are described in detail as follows: AttributeDescription node_numberThis user-supplied node number represents the node position extension_node_identifierThis is a 2-digit slot number that the SP Switch reliable_hostnameThe hostname of the administrative Ethernet, de0, is the management_agent_hostnameThis attribute is the hostname of the SNMP snmp_community_nameThis field contains the SNMP community name that The following attributes are derived by the RS/6000 SP system when the...
Page 60: Dependentadapter Attributes
Table 4. Additional SDR Attributes Syspar_map class node_type Details of these attributes follow: IBM 9077 SP Switch Router: Get Connected to the SP Switch System Defined of an unused SP Switch port to be used by the SP Switch router adapter.
Page 61: New Commands
AttributeDescription node_typeThis attribute is set to dependent for GRF and to standard for all switch_max_ltuThis specifies the maximum packet length of data on the SP switch_link_delaySpecifies the delay for a message to be sent between the 2.4.2 New Commands To support the dependent node architecture, seven new commands were added.
Page 62: New Commands (User Executable)
. This command is used to add or change an extension node in enter_extnode the SDR DependentNode class. Its options are shown in Table 7 on page 45. IBM 9077 SP Switch Router: Get Connected to the SP Switch endefnode endefadapter...
Page 63: Endefnode Command Options
Table 7. endefnode Command Options Flags SMIT Option Administrative hostname SNMP community name Extension node SNMP Agent hostname Reconfigure the extension node Node number This command adds attribute information for the extension node. The command adds IP information, such as the IP address and endefadapter netmask for the extension node.
Page 64: Enrmnode Command Options
This command should be issued with a command is not available for the extension node after since the extension node has been removed from the SDR. IBM 9077 SP Switch Router: Get Connected to the SP Switch endefadapter option or...
Page 65: Endefadapter Command Options
2.4.2.3 The endefadapter Command command is used to add or change the extension node endefadapter adapter IP information in the SDR DependentAdapter object, and can be executed using . The fast path for smit options are shown in Table 9. Table 9.
Page 66: Enadmin Command Options
Flags SMIT Option Actions to be performed node Node number IBM 9077 SP Switch Router: Get Connected to the SP Switch . The command options are shown in Table 10. Description Either reset reconfigure extension node SNMP Agent to change the...
Page 67: Splstnode Command Options
2.4.2.6 The splstnodes Command command is used to list the node attributes of all nodes in the splstnodes SDR, and can also be executed using smit. The fast path for smit is . See all command options in Table 11. list_extnode Table 11.
Page 68: Splstadapter Command Options
-d <delimiter> -p <string> -t <node_type> <attr==value> <attr> IBM 9077 SP Switch Router: Get Connected to the SP Switch command is used to list the adapter attributes of all nodes in smit . See all command options in Table 12. Description Outputs usage information.
Page 69: Enhanced Commands
2.4.3 Enhanced Commands The following commands (see Table 13) have been modified due to the introduction of the dependent node: Table 13. Enhanced Commands Command Eprimary Estart Efence Eunfence Here is a more detailed description about the modifications: •Eprimary This command has been modified so that dependent nodes will not be able to act as a Primary or Primary Backup node for the SP Switch in the partition.
Page 70: Hardware Perspectives
The Hardware Perspective consists of the following four parts: 1. Menu bar 2. Toolbar IBM 9077 SP Switch Router: Get Connected to the SP Switch and selecting the Hardware icon. Alternatively, it can sphardware...
Page 71 3. Nodes pane (Frame or Icon View) 4. Information area The most obvious change is the addition of the IP Node icon as seen in the Nodes pane. (The figure above shows the Frame View.) The default label for this icon is IP Node <node number>. The IP Node icon is also located on the side of the frame, where a standard node with that node number would be.
Page 72: Action Menu
This will bring up another window to allow us to add the RS/6000 SP nodes to a Node Group. This action does not affect the IP Node, even though it is selectable. • 3 Digit Display IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 73: Hardware Notebook
This will bring up a window to show the three-digit display of all RS/6000 SP standard nodes in the current partition. This action does not apply to the IP Node, even though it is selectable. • Open Administrative Session... This action will open a window that is a Telnet session to the GRF, using the reliable_hostname attribute specified in the DependentNode class.
Page 74 Nodes pane and the System partitions pane. The Nodes pane (3) in this figure shows the Icon view. Notice that the IP Nodes are displayed after all the standard RS/6000 SP nodes. IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 75: System Partition Aid Perspectives
Figure 23. System Partition Aid Perspectives The IP Nodes can only be assigned to a partition here. This is done either by using the Assign icon in the toolbar (2), or by selecting Action->Nodes->Assign Nodes to System Partition on the menu bar (1). Except for the System Partition Notebook, discussed in the next figure, all other actions, though selectable, do not apply to the IP Node.
Page 76: Sp Extension Node Snmp Manager
SNMP traps to the SNMP Manager when the extension node changes state. The following commands are available to control the SP Extension Node SNMP Manager: •startsrc IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 77: Dependent Node Mib
•stopsrc •lssrc •traceson •tracesoff 2.4.6 Dependent Node MIB IBM has defined a dependent node SNMP Management Information Base (MIB) called ibmSPDepNode. This MIB contains definitions of objects representing configuration attributes of each dependent node and its state. The GRF Agent maintains the state and configuration data for each dependent node using the MIB as a conceptual database.
Page 78: Coexistence
GRF. Nodes 1 and 2 are installed with PSSP 2.4. The other nodes are installed with any other version of PSSP that can coexist with IBM 9077 SP Switch Router: Get Connected to the SP Switch switch_chip_port attributes from the DependentNode class.
Page 79: Coexistence
PSSP 2.4 to represent coexistence. Also, note that Node 16 is empty, because the SP Switch port for this node is used by the SP Switch router adapter in the GRF. PSSP 2.4 or PSSP2.3 and IX70649 on PSSP PSSP Primary switch node Backup switch node PSSP...
Page 80: Partitioning
RS/6000 SP has only 16 SP Switch ports, and two of them are used for the SP Switch router adapter, one for each partition. IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 81: Planning For The Grf
Partition B Partition A Switch Frame Figure 26. Partitioning Normally, RS/6000 SP nodes in different partitions cannot communicate with each other through the SP Switch. The GRF plays a unique role here by allowing RS/6000 SP nodes to communicate across partitions, when each partition contains at least one SP Switch router adapter, and these adapters are interconnected by TCP/IP.
Page 82 SP Extension Node SNMP Manager port #The SNMP port number used by the SP Extension Node IBM 9077 SP Switch Router: Get Connected to the SP Switch name that the SP Extension Node SNMP Manager and the GRF’s SNMP Agent will send in the corresponding field of the SNMP messages.
Page 83: Planning For The Dependent Node
2.6 Planning for the Dependent Node Next, for each dependent node on the RS/6000 SP, define the following: ParametersDescriptions Node #A user-supplied dependent node number representing the node Slot #The slot number on which the SP Switch Router Adapter is located in GRF hostnameThe hostname for the GRF administrative Ethernet.
Page 84: Conclusion
SP to now be connected into networks that will be important for its future. These include support for HSSI and Sonet, which are important for the SP’s ever-growing role as a Web server or online transaction manager. IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 85: Part 2. Scenarios
Part 2. Scenarios This part presents some sample configurations of an RS/6000 SP system with an SP Switch Router. It is beyond the scope of this book to represent all possible applications of an SP Switch Router. Nevertheless, the basic configurations shown are building blocks for more complex networking topologies that include the SP Switch Router and may inspire more complex configurations.
Page 86 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 87: Chapter 3. Installation And Configuration
Chapter 3. Installation and Configuration The SP Switch Router functions as an IP router to provide high-speed data communication links between SP processor nodes and external networks or hosts. The SP Switch Router Adapter media card connects to the SP Switch board in an SP system as shown in Figure 28.
Page 88: Initial Configuration
The intent of this chapter is to provide, or refer you to, the necessary information to enable you to attach an SP Switch Router to an IBM SP system. Coverage is provided as follows: • Information to configure the SP Switch Router Adapter card as required for SP Switch Router functionality is complete in this chapter.
Page 89: Pre-Installation Assumptions
UNIX systems. On most of the UNIX systems you are working on the shell layer after you logged onto the system. Many system management and configuration commands are now available. Enter a question mark (?) to retrieve a list of CLI commands. To edit configuration files, you must be in the UNIX shell.
Page 90 system and enter these basic configuration parameters. Procedures for starting and setting up the SP Switch Router are found in GRF 400/1600 Getting Started V.14, GA22-7368. Ignore the prompts for network logging, since we will configure logging to a PCMCIA device; just press Enter when asked to enter the remote logging host name or its IP address.
Page 91: Connecting The Grf To The Frame
Ethernet Cable RS232 Cable PSSP 2.4 Figure 29. Connecting the GRF to the Frame • You are ready to configure media cards. Procedures to configure media cards are in this redbook; complete information is in the GRF Configuration Guide 1.4, GA22-7367. Standard Switch Cable of 10m Other Switch Cables (f/c 9305)
Page 92: Order Of Information
Terminal Settings 9600 baud No parity Eight data bits One stop bit Figure 30. Connecting the GRF Console • The IBM SP system is up and operating. • The SP system administrator has given you one of these pieces of information: •...
Page 93: Installing An Sp Switch Router Adapter Card
4. Methods to determine node number and SP Switch port for an SP Switch Router Adapter card 5. A step-by-step configuration of an SP Switch Router Adapter card 6. A list of ways to verify that the SP Switch Router Adapter card is correctly installed in the SP Switch Router 7.
Page 94: Installing The Pcmcia Spinning Disk
4. Route the Ethernet twisted-pair cable between the SP Switch Router unit and the Ethernet hub, then connect the cable to the SP Switch Router control board and the Ethernet hub. 5. Verify that the SP CWS has a connection to this same Ethernet hub. If the SP CWS Ethernet adapter is configured by the system administrator, then test from the SP CWS to the configured SP Switch Router Ethernet ping...
Page 95 prompt> sh # cd / # iflash -A May 29 15:54:18 grf16 kernel: wd2: no disk label # mountf -A -w -m /mnt Device /dev/wd3a mounted on /mnt # mkdir /mnt/crash # mkdir /mnt/portcards # cd /var # mv crash crash.orig # mv portcards portcards.orig # ln -s /var/log/portcards /var/portcards # ln -s /var/log/crash /var/crash...
Page 96 5. Edit the file /etc/syslog.conf to specify the location where the logs will be kept. Uncomment the local log configuration lines in the “Log messages to Disk” section by removing #disk# from each line, and specify /var/log as the directory for each log. The entries should now look like the following: *.err;*.notice;kern.debug;lpr,auth.info;mail.crit /var/log/messages cron.info /var/log/cron local0.info /var/log/gritd.packets...
Page 97: Attaching Sp Switch Router Cables
*********************************************************************** * Log files that used to be archived by the /etc/{daily|weekly|monthly} * scripts. *********************************************************************** size=150000 logfile=/var/log/gr.console size=11000 logfile=/var/log/gr.boot 7. Save all changes and reboot: # grwrite -v # reboot 8. After the SP Switch Router is up and running again, use verify that the PCMCIA interface is available and the PCMCIA disk are up.
Page 98: Sp Switch Cable
SP Switch Router Control board Figure 31. SP System Administrative Ethernet Connections 3.4.2 SP Switch Cable The SP Switch Router Adapter card provides one full-duplex attachment and requires a specific cable with 50-pin connector ends, obtainable from IBM. The cable has a unique signal wiring map, and is not replaceable by a 50-pin HSSI cable, for example.
Page 99: Configuration Required On The Sp System
2. Using appropriate frame entry and exit holes for cable management, route the SP Switch cable between the SP Switch Router unit and the SP Switch. 3. Connect the SP Switch cable to both the media card and the correct SP Switch port, as follows: •...
Page 100: Determining The Switch Connection For A Dependent Node
3.5.1 Determining the Switch Connection for a Dependent Node The SP Switch Router Adapter connection replaces an SP node connection to the SP Switch. Each SP Switch Router Adapter media card is referred to as a dependent node, and is assigned a node number that corresponds to its specific connection on the SP Switch.
Page 101: Switch Port Assignments In Supported Frame Configurations
Switch Frame n No Switch Switch Frame n+1 Frame n Switch No Switch Frame n Frame n+1 Switch No Switch Frame n Frame n+1 Figure 32. Switch Port Assignments in Supported Frame Configurations No Switch Frame n+2 No Switch No Switch Frame n+2 Frame n+3 Installation and Configuration...
Page 102: Procedure To Get The Jack Number
Switch 1 Frame 1 Figure 33. Node Numbering for an SP System 3.5.2 Procedure to Get the Jack Number Following are the steps required to get the jack number: 1. From the SP control workstation, determine the dependent node’s number by entering output that looks like the following: # SDRGetObjects DependentNode node_number...
Page 103: Multiple Frames For Multiple System Connections
# splstdata -s | grep -p primary switch_part number ------------------------------------------------------------------------- In this case, the primary node host name is sp21n01. 4. Log into the primary node by entering node_hostname is the host name of the primary node. 5. From the primary node, enter 6.
Page 104: Step-By-Step Media Card Configuration
• The SP Switch Router card connected to port J31 of SP Switch A2 is node number 25. • The SP Switch Router card connected to port J31 of SP Switch A3 is node number 41. • The SP Switch Router card connected to port J15 of SP Switch A1 is node number 16.
Page 105 3.7.1.1 Overview of the Steps to Configure a Media Card A detailed discussion of these steps follows this overview. 1. Edit the SNMP configuration file and start the SNMP daemon on the SP Switch Router. 2. Assign an IP address and other parameters to the SP Switch Router Adapter interface.
Page 106: Step 1. Check Snmp In The Sp Switch Router System
• As an alternative, you can log on to the SP Switch Router and use a UNIX editor to enter the parameters in the /etc/grdev1.conf file. 5. Reboot the SP Switch Router unit so that the altered configuration files are installed and used.
Page 107: Put Snmp Changes Into Effect
3.9 Put SNMP Changes into Effect To have changes to /etc/snmpd.conf take effect, kill snmpd. It will be automatically restarted. Log in as root, find the snmpd PID (process ID), and then kill the SNMP daemon, as follows: # ps -ax | grep snmpd 326 00- S # kill 326 # Jun 13 16:13:18 grf16 mib2d[397]: mib2d: terminated by master agent...
Page 108 Enter Extension Node Information Type or select values in entry fields. Press Enter AFTER making all desired changes. Administrative Hostname SNMP Community Name Extension Node Identifier SNMP Agent Hostname Reconfigure the extension node? * Node Number Note: The Extension Node Identifier (the number of the slot in the GRF, the SP Switch Router Adapter card is seated) must be given as a two-digit number, so slots 0-9 must be entered as 00-09! Command: OK...
Page 109 Command: OK stdout: yes Before command completion, additional instructions may appear below. The endefadapter command has completed successfully. • Command: smitty annotator Topology File Annotator Type or select values in entry fields. Press Enter AFTER making all desired changes. Input Topology File Name Output Topology File Name Save Output File to SDR /etc/SP/expected.top.annotated now has a new line:...
Page 110 • Command: smitty manage_extnode Extension Node Management Type or select values in entry fields. Press Enter AFTER making all desired changes. Action to be performed on the extension node * Node Number Command: OK stdout: yes Before command completion, additional instructions may appear below. enadmin command: sending a reconfigure request to the agent managing extension node 03 enadmin command: : response received from agent indicates requested action...
Page 111: Method 2: Edit /Etc/Grifconfig.conf - Optional
3.10.2 Method 2: Edit /etc/grifconfig.conf - Optional Edit the /etc/grifconfig.conf file to assign an IP address to each logical SP Switch Router interface. You can also provide other information about the logical IP network to which that interface is physically attached. Each logical interface is identified in /etc/grifconfig.conf by these properties: •...
Page 112 Internet address The Internet address is the 32-bit IP address for the specified logical interface. The address is in standard dotted-decimal (octet) notation: xxx.xxx.xxx.xxx. Netmask Netmask is the 32-bit address for the logical IP network on the physical network to which the specific SP Switch Router or media card physical interface is attached.
Page 113: Putting Grifconfig.conf Additions Into Effect
Default MTUs for framing protocols are: • Frame Relay: 4352 bytes • HDLC: 4352 bytes • Point-to-Point Protocol: 1496 bytes MTU discovery facility MTU sizes are generally selected at the host end of the route. This is accomplished by turning on the host’s MTU discovery facility and allowing the host to send packets.
Page 114: Step 5. Reset Sp Switch Router System To Install Files
Nevertheless, check the file /etc/grdev1.conf. It must contain an entry for the slot in which the media card is installed. As we have our card in slot 3, the entry looks as follows: # CARD 3 Interface 0 2.21.4.1.1.1 2.21.4.1.1.2 2.21.4.1.1.3 2.21.4.1.1.4 2.21.4.1.1.5...
Page 115: Verify An Sp Switch Router Adapter Card On The Router
To save an alternate configuration on the internal flash based upon the currently running configuration on the internal flash device, use grsnapshot -si -di=revision,version. For more information about these commands, see GRF Reference Guide 1.4, GA22-7367. 3.14 Verify an SP Switch Router Adapter Card on the Router This section describes tools available with the SP Switch Router system software to check out newly installed media cards.
Page 116: Check Media Card Status Using Grcard
2. Enter a ping slot number; for example, to act on the SP Switch Router Adapter media card in slot 3, enter This is what you see when the media card responds: # ping -c4 -P grid 3 GRID ECHO 3 (0:0x3:0): 64 data bytes, 3 packets 68 bytes from 0:0x3:0: time=0.619 ms 68 bytes from 0:0x3:0: time=0.498 ms 68 bytes from 0:0x3:0: time=0.640 ms...
Page 117: Reset Media Card Using Grreset
3.14.3 Reset Media Card Using grreset Use the grreset 1. Log in as root on the SP Switch Router. 2. Enter the grreset Specify the appropriate media card by its chassis slot number. To reset all the media cards, enter ;...
Page 118: Bringing The Sp Switch Router Adapter Card Online With The Sp
Below is an actual example: # grstat -w70 all gt030 gt030 ipstat count description 11095886 total packets received 51 packets dropped 3678330 packets forwarded normally 4 packets forwarded locally to card 1214 packets handled by the card ipdrop count icmperr last count type icmpin...
Page 119: Checking Connectivity To The Sp System
one of the following actions to bring the SP Switch Router Adapter card online: • A switch initialization • An unfencing sequence • Another Switch management sequence The appropriate action depends on what state the SP system is in with respect to the dependent node.
Page 120 Each SP Switch Router Adapter media card is considered a dependent node for the SP System. Each dependent node has a node_number and other configuration and status information that is unique to that dependent node. 3.15.1.1 Procedure The following steps might give you guidance in solving some of the most common connectivity problems: 1.
Page 121 Maintenance Information Manual Dependent Node MAP, return to that procedure. For more information about configuration as related to the SP, see RS/6000 SP: Administration Guide Version 2 Release 4, GC23-3897 and RS/6000 SP: Command and Technical Reference Version 2 Release 4, GC23-3900. For additional information on troubleshooting your configuration, see RS/ 6000 SP: Diagnosis and Messages Guide Version 2 Release 4, GC23-3899.
Page 122 Installation and Configuration...
Page 123: Chapter 4. Configuration Of Ip-Forwarding Media Cards
Chapter 4. Configuration of IP-Forwarding Media Cards This chapter covers the installation and configuration of selected IP Forwarding media cards in an SP Switch Router. For detailed information refer to GRF Configuration Guide 1.4 , GA22-7366. 4.1 Ethernet 10/100Base-T Configuration This section provides the information needed to configure the Ethernet 10/100Base-T media card.
Page 124: Configuration File And Profile Overview
• Specify verbose option for messages from the Ethernet card • Specify ICMP throttling settings • Specify selective packet discard percentage IBM 9077 SP Switch Router: Get Connected to the SP Switch netmask broad_dest g e 0 x y...
Page 125: Installing Configurations Or Changes
• Change run-time binaries • Change dump variables 3. Load profile Global executable binaries are set in the Load profile in the hw-table field. These only change when you want to execute new run-time code in every Ethernet card. If you want to change the run-time code in one Ethernet card (per interface), make the change in the Card profile, in the load field.
Page 126: Specify Ethernet Card Parameters
= {1 32 no-mode 999999 4 incremental 5 300 10 10 03:00:0f:c0 disab+ super> list ether if-config = autonegotiate At this level, use the super> set if-config ? IBM 9077 SP Switch Router: Get Connected to the SP Switch netmask broad_dest arguments 255.255.255.0 mtu 1500 255.255.255.0...
Page 127: Some Maint Commands For The Ethernet Media Cards
if-config: Ethernet interface configuration. Enumerated field, values: autonegotiate: autonegotiate 10-half: 10 BaseT Half Duplex 10-full: 10 BaseT Full Duplex 100-half: 100 BaseT Half Duplex 100-full: 100 BaseT Full Duplex super> set if-config = 100-full super> write CARD2/ written super> quit The configuration of the Ethernet card is now completed.
Page 128: Atm Oc-3C Configuration
IP. Each logical interface is assigned a unique IP address in grifconfig.conf. All interface names are case sensitive. Always use lower case letters when defining interface names. IBM 9077 SP Switch Router: Get Connected to the SP Switch Logical Interfaces 0-32767...
Page 129: Components In The Atm Oc-3C Interface Name
See Figure 38 for the naming conventions of an ATM interface. 1st: always "g" for GRF 2nd: media type, a (ATM) 3rd: chassis number, always "0" (zero) 4th: slot number in hex 5th-6th: logical interface number in hex Figure 38. Components in the ATM OC-3c Interface Name Virtual Circuits A virtual circuit (VC) exists between two ATM devices.
Page 130 ATM configuration. They are maint described in Section 4.2.7, “Some maint Commands for the ATM OC-3c Media Card” on page 116; some examples are provided there. IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 131: Installing Configurations Or Changes
4.2.2 Installing Configurations or Changes In the command line interface (CLI), use configuration parameters. To save the /etc configuration directory, use Additionally, when you enter configuration information or make changes, you must also reset the media card with the command the change to take place.
Page 132: Assign Ip Addresses - Grifconfig.conf
If you do not specify a broadcast address, you create a non-broadcast, multiaccess (NBMA) interface. The optional arguments field is currently used to specify MTU values on a logical IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 133: Specify Atm Card Parameters
interface basis. This field is also used to specify ISO when an ISO address is being added to an interface’s IP address. Specify the MTU value as Leave the arguments field blank if you are not using it. The following excerpt from our /etc/grifconf.conf file shows the format of an entry: # name address ga010...
Page 134: Some Maint Commands For The Atm Oc-3C Media Card
• Then change the prompt port to the ATM media card you are working with. For example, if you are working with a card in slot 3, enter IBM 9077 SP Switch Router: Get Connected to the SP Switch commands. One set covers the receive (RX) side...
Page 135 The following message is returned along with the changed prompt: Current port card is 3 GR 3> • To leave any prompt and return to the shell, enter maint Following are just a few maint your experiences may vary. To see the list of commands for the receive side, enter maint the list of...
Page 136: Using Grrt To Display The Route Table
192.168.4.0 192.168.13.0 192.168.14.0 192.168.14.4 192.168.14.255 224.0.0.0 224.0.0.0 224.0.0.0 255.255.255.255 255.255.255.255 9 IBM 9077 SP Switch Router: Get Connected to the SP Switch command to display the current contents of the ATM 192.168.4.137 255.255.255.255 8 0.0.0.0 255.255.255.0 0.0.0.0 255.255.255.255 15 0.0.0.0 255.255.255.255 14...
Page 137: Using Grstat To Display Grf Statistics
4.2.9 Using grstat to Display GRF Statistics Use the grstat -w70 all <interface> of the ATM OC-3c card’s IP stack. The following is an actual screen shot: # grstat -w70 all ga010 ga010 ipstat count description 1955290 total packets received 1955269 packets forwarded normally 21 packets handled by the card ipdrop...
Page 138: Installing Configurations Or Changes
“Configuration Files and Profiles” on page 113 up to Section 4.2.6, “Configuring PVCs” on page 115, and refer to GRF Configuration Guide 1.4, GA22-7366 . Proceed as follows: IBM 9077 SP Switch Router: Get Connected to the SP Switch Logical Interfaces 0-1024 0-ff (range)
Page 139: Fddi Configuration
1. Identify each logical interface. Edit /etc/grifconfig.conf, to identify each logical interface by assigning: • An IP address • The GRF interface name • A netmask, as required • A destination or broadcast address, as required • An MTU, if needed 2.
Page 140: Master/Slave Connectors For Sas Interfaces
To create a logical ring, A must connect to B and B must connect to A. Otherwise, the network does not operate as a logical ring, but segments into unconnected subrings. IBM 9077 SP Switch Router: Get Connected to the SP Switch FDDI Concentrator...
Page 141: A/B Connectors For Das Interfaces
FDDI Figure 42. A/B Connectors for DAS Interfaces Configuring SAS versus DAS Only the top or bottom pair of FDDI interfaces can be set to dual attach. Interfaces 1 and 2, for example, must not be paired. It is recommended to set unused FDDI interfaces to single in the Card profiles (which is the default anyway).
Page 142 Once you get more familiar with the GRF, you may prefer the following quick way: super> read card 0 CARD/0 read super> set port 0 fddi single-dual = dual super> set port 1 fddi single-dual = dual IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 143: Optical Bypass Switch Attachments
super> write CARD/0 written super> Optical bypass Optical bypass capability has to be provided externally. The FDDI face plate has a six-pin DIN connector to directly attach a single bypass switch. As shown in Figure 44, two bypass switches can be attached with the an Y-cable adapter.
Page 144: Separate Networks Versus Bridging
Each interface may be named or numbered in four different ways: • By its physical location on the FDDI card • By a site-specified SAS/DAS setting name in the Card profile, dual IBM 9077 SP Switch Router: Get Connected to the SP Switch Concentrator M Concentrator 2 Concentrator 1...
Page 145: Physical Interface Numbers
• By a logical interface number assigned after the SAS/DAS settings are numbered (used in the /etc/grifconfig.conf file) • By a unique IP address assigned to each logical interface Figure 46 shows files where various numbers are used to configure the interfaces on an FDDI media card.
Page 146: Grf Interface Name
FDDI connection with a subset. For detailed information, see GRF Configuration Guide 1.4, GA22-7366. Proceed as follows: 1. Identify each logical interface. IBM 9077 SP Switch Router: Get Connected to the SP Switch Port FDDI media...
Page 147: Assign Ip Addresses - Grifconfig.conf
Edit /etc/grifconfig.conf to identify each logical interface by assigning: • An IP address • The GRF interface name • A netmask, as required • A destination or broadcast address, as required • An MTU, if needed 2. Specify FDDI card parameters in the Card profile. All but the first two are optional and default to the most common settings, so normally you should be just fine omitting this step.
Page 148: Specify Fddi Card Parameters
Hint : We found that some changes did not go into effect until the GRF was rebooted, although the documentation indicated otherwise. So do not hesitate if things seem not to work as they should. reboot IBM 9077 SP Switch Router: Get Connected to the SP Switch netmask broad_dest 255.255.255.0 255.255.255.0...
Page 149: Some Maint Commands For The Fddi Media Card
This completes the procedure to configure FDDI cards, and as with the ATM card, we would like to introduce some of the useful. 4.4.9 Some maint Commands for the FDDI Media Card commands display a range of information about the FDDI media maint card.
Page 150: Using Grrt To Display The Route Table
192.168.4.0 192.168.13.0 192.168.14.0 192.168.14.4 192.168.14.255 224.0.0.0 224.0.0.0 224.0.0.0 255.255.255.255 255.255.255.255 9 IBM 9077 SP Switch Router: Get Connected to the SP Switch command to display the current contents of the 192.168.4.137 255.255.255.255 8 0.0.0.0 255.255.255.0 0.0.0.0 255.255.255.255 15 0.0.0.0 255.255.255.255 14 0.0.0.0...
Page 151: Using Grstat To Display Grf Statistics
4.4.11 Using grstat to Display GRF Statistics Use the grstat -w70 all <interface> of the FDDI card’s IP stack. The following is an actual screen shot: # grstat all gf001 gf001 ipstat count description 2958246 total packets received 3 packets dropped 2958226 packets forwarded normally 17 packets handled by the card ipdrop...
Page 152 CONNECT line back to the source. Data coming from an external HIPPI I/O channel may be formatted into standard IP packets. Embedded in the front of each IP packet is an IP IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 153: Hippi I-Field Components
header. The media card reads the header only if told to do so by information in the HIPPI I-field. If the I-field tells the card to read the IP header, then an IP connection is established. 4.5.1.3 How the I-field is Used The I-field tells the GRF how to process the connection, and where to send the data.
Page 154 Again, the host does not know the route and instead supplies a logical address for the endpoint host. All switches and the GRF must be programmed to route the connection. IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 155 4.5.1.6 Direction Bit HIPPI hosts set the direction bit (D). This bit determines how a switch or router reads the 24-bits of destination address information. Figure 49 on page 135 and the previous descriptions of source routing and logical addressing have the destination address information organized as if the host has set the destination bit to 0.
Page 156: Hippi Configuration Options
HIPPI host I-field. Most of them deal with HIPPI to HIPPI configurations. HIPPI IPI-3 and the IBM HIPPI connection option, H0 HIPPI, are covered, too. IBM 9077 SP Switch Router: Get Connected to the SP Switch is preset as a default in the logical address table. 0xfc0...
Page 157: Physical And Logical Interfaces
Section 7.3, “HIPPI Backbone Connection” on page 227, describes the steps to configure the GRF’s HIPPI media card to do IP forwarding, so you have to refer to the Ascend documentation if you need to set up a different configuration. 4.5.3 Physical and Logical Interfaces The HIPPI media card provides a single duplex attachment and operates at a speed of 100 MB/s.
Page 158: Configuration Files And Profiles
Use caution if you change the recommended default. If you want to change dump settings for one HIPPI card (per physical interface), make the change in the Card profile, in the dump/config field. IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 159: Installing Configurations Or Changes
4.5.5 Installing Configurations or Changes In the command line interface (CLI), which is the working environment on the GRF with the configuration parameters onto the media card. If you apply changes to files in the /etc directory, do not forget to issue to have these changes written to flash, so that they are still in grwrite -v effect after a...
Page 160: Configuring Bridging
• RFC-1483 encapsulated bridging over ATM OC-3c PVCs with either VC-based multiplexing or LLC encapsulation • Up to 16 bridge groups per GRF • Up to 32 GRF interfaces per bridge group IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 161: Simultaneous Routing And Bridging
4.6.2 Simultaneous Routing and Bridging Ascend’s transparent bridging does not preclude the use of IP packet routing on the same physical interface. Bridging as well as IP version 4 (IPv4) routing can both be enabled on the same physical interface. In this circumstance, the GRF exchanges traffic between bridging domains and routing domains that exist on the same physical media.
Page 162: Interoperability
IPv4 frames are fragmented as necessary, as when bridging a FDDI frame of more than 1500 bytes to an Ethernet interface. IBM 9077 SP Switch Router: Get Connected to the SP Switch FDDI LLC frames. Ethernet or IEEE 802.3 frames.
Page 163: Spamming
A frame may be too large for the maximum transmission unit (MTU) of the sending GRF interface. One example is when forwarding a 4500-byte frame from FDDI to an Ethernet interface with an MTU of 1500 bytes. The GRF bridge will attempt to break such a frame into fragments that will fit the sending interface.
Page 164: Management Tools
Root Port: None Topology Change Detected: No Root Max Age: 20, Hello Time: Bridge Max Age: 20, Hello Time: IBM 9077 SP Switch Router: Get Connected to the SP Switch command which displays relevant bridged brstat command which displays brinfo...
Page 165 Interface Port ID Con State --------- ------- --- ---------- ----- ----- ----------------------- ------- gf000 128 1 Yes Forwarding 10 gf001 128 2 Yes Forwarding 10 gf002 128 3 Yes Forwarding 10 gf003 128 4 Yes Forwarding 10 Bridge Group bg1 Spanning Tree: Enabled Designated Root: 32768 00:c0:80:84:8c:eb...
Page 166: Configuration File And Profile Overview
• A destination or broadcast address, as required • An MTU value, if needed 4. Create ATM OC-3c PVCs for encapsulated bridges. IBM 9077 SP Switch Router: Get Connected to the SP Switch up broadcast running link0 link1 multicast up broadcast running link1 multicast...
Page 167 If you are going to configure an encapsulated bridge on an ATM circuit, edit the /etc/gratm.conf file to create a PVC on the ATM OC-3c logical interface. 5. Specify ARP service in the /etc/grarp.conf file, if needed. 4.6.11.1 Starting Bridged program regularly checks for the presence of /etc/bridged.conf grstart and starts the bridged daemon when the file is found.
Page 168: Interface Name For Fddi, Ethernet And Atm Oc-3C Interfaces
4.6.11.4 Create an ATM PVC for an Encapsulated Bridge Bridging over ATM can be configured in two ways: • LLC Encapsulation (RFC 1483, section 4) IBM 9077 SP Switch Router: Get Connected to the SP Switch netmask broad_dest argument 255.255.255.0 255.255.255.0...
Page 169 • VC-Based Multiplexing (RFC 1483, section 5) When LLC Encapsulation is used, a single PVC is configured to carry all bridged traffic. The same PVC can also carry nonbridged traffic such as routed IP datagrams. When VC-Based Multiplexing is used, multiple PVCs are defined for the logical interface.
Page 170 Each PDU is an FDDI frame, including fcs. • proto=vcmux_bridge,fddi_nofcs Each PDU is an FDDI frame, without fcs. • proto=vcmux_bridge,bpdu Each PDU is an 802.1d Bridging Protocol Data Unit (BPDU). IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 171 Following are some PVC configuration examples: LLC Encapsulated: # Traffic shape Traffic_Shape name=high_speed_high_quality peak=155000 sustain=155000 \ burst=2048 qos=high # Logical interface Interface ga030 traffic_shape=high_speed_high_quality \ bridge_method=llc_multiplexed # PVC PVC ga030 0/32 proto=llc,bridging Note: The single PVC defined here can carry any kind of bridged frame, as well as routed IP traffic.
Page 172: Bridging Atm
The information in the previous chapter was used in implementing bridging with two ATM ports between two GRFs; see Section 7.1.2, “ATM OC-3c Backbone - Using Two Ports” on page 215. IBM 9077 SP Switch Router: Get Connected to the SP Switch host hwaddr 172.0.130.111...
Page 173: Bridging Fddi
4.6.13 Bridging FDDI Transparent bridging is especially useful for day-to-day customer environments, where several FDDI backbones meet in the computing center and must be connected to an SP. Up to now, the SP was connected to the FDDI switch or router with one or two FDDI adapters, thus causing a bottleneck.
Page 174 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 175: Chapter 5. Single Rs/6000 Sp And Single Sp Switch Router
Chapter 5. Single RS/6000 SP and Single SP Switch Router This section provides several sample configurations that are possible with a single RS/6000 SP and a single SP Switch Router. Sample configurations range from using the SP Switch Router as a conventional high performance router up to the connection of two SP partitions, allowing high-speed Switch communication between the partitions.
Page 176: Sp Switch - Ethernet Connection
Table 14 on page 159. The netmask for all interfaces is 255.255.255.0. Figure 53. SP Switch - Ethernet Connection Table 14 on page 159 shows the IP addresses used in our configuration. IBM 9077 SP Switch Router: Get Connected to the SP Switch GRF 1600 SP Switch Router...
Page 177: Configuration Of Sp Switch - Ethernet Connection
Table 14. Configuration of SP Switch - Ethernet Connection Adapter Ethernet interface in F50 (en0 on ent0) SP Switch Router Ethernet media card (port 1) SP Switch Router Adapter card 1 SP processor nodes in SP21 To successfully run this configuration, no routes need to be set on the SP Switch Router.
Page 178 The -mtu parameter is optional but should be set to ensure optimal packet size on this route. 5. Issue some On the F50, IBM 9077 SP Switch Router: Get Connected to the SP Switch Gateway Flags Refs 9.12.1.30 9.12.1.50 10.1.1.3...
Page 179 (0)f50:/ 29$ ping 192.168.14.15 PING 192.168.14.15: (192.168.14.15): 56 data bytes 64 bytes from 192.168.14.15: icmp_seq=0 ttl=254 time=0 ms 64 bytes from 192.168.14.15: icmp_seq=1 ttl=254 time=0 ms 64 bytes from 192.168.14.15: icmp_seq=2 ttl=254 time=0 ms ----192.168.14.15 PING Statistics---- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0/0/0 ms (0)f50:/ 30$ On the chosen nodes in SP21,...
Page 180: Sp Switch - Fddi Connection
• The SP Switch Router Adapter card and SP processor node Switch adapters are in the same IP subnet. • ARP should be enabled on the SP Switch network to provide the most flexibility in assigning IP addresses (strongly recommended!). IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 181: Sp Switch - Fddi Connection
• If ARP is disabled on the SP Switch network, the IP addresses assigned to the nodes must be determined by the Switch node numbers. Refer to PSSP Planning, Volume 2, Control Workstation and Software Environment for details. Note: The SP Switch Router Adapter card will not properly forward IP data to nodes assigned with an IP address that is in another subnet.
Page 182 127/8 192.168.3/24 192.168.13/24 Route Tree for Protocol Family 24 (Internet v6): 5. On GRF 400 check /etc/grifconfig.conf for the following entry: gf000 10.2.1.2 IBM 9077 SP Switch Router: Get Connected to the SP Switch Gateway Flags Refs 192.168.4.137 10.2.1.1 127.0.0.1 192.168.4.10...
Page 183 6. On the CWS of SP2 check if the SP Switch Router Adapter card is configured. See if the SP Switch Router Adapter card shows up green in perspectives or enter SDRGetObjects switch_responds needed. 7. Issue some commands to check the connection: ping On the chosen SP2 nodes, example:...
Page 184 MB/s (observed with the freeware tool monitor from Jussi Maki). The limiting factor now was the CPU of node 10 in SP21, which was not able to handle more data simultaneously (100% busy, as seen with monitor). IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 185: Sp Switch - Atm Connection
5.1.3 SP Switch - ATM Connection This scenario might be used quite often to attach a single computer with an ATM interface to the SP Switch of an SP system. This could, for example, be an RS/6000 model S70 acting as an ADSM server or as a database server in an SAP or BAAN environment.
Page 186: Sp Switch - Atm Connection
It escapes our understanding why we had to bother with this, anyhow, as we could not set up and use SVC between the F50 and the GRF, because IBM 9077 SP Switch Router: Get Connected to the SP Switch GRF 1600...
Page 187 of the lack of an ARP server; signaling protocols should only matter with SVCs and not with PVCs. 3. On the F50, use smitty chg_atm field from SVC UNI Version Change / Show Characteristics of an ATM Adapter Type or select values in entry fields. Press Enter AFTER making all desired changes.
Page 188 = 0/3/13 ms (0)f50:/ 15$ You should also be able to ping the ga0180 port of the GRF: IBM 9077 SP Switch Router: Get Connected to the SP Switch carry out its work, exit smitty field, do not use blanks or underscores. In...
Page 189 (0)f50:/ 15$ ping 10.1.2.1 PING 10.1.2.1: (10.1.2.1): 56 data bytes 64 bytes from 10.1.2.1: icmp_seq=0 ttl=255 time=0 ms 64 bytes from 10.1.2.1: icmp_seq=1 ttl=255 time=0 ms 64 bytes from 10.1.2.1: icmp_seq=2 ttl=255 time=0 ms ----10.1.2.1 PING Statistics---- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0/0/0 ms (0)f50:/ 16$ To add the needed routing information, follow these steps:...
Page 190 64 bytes from 10.1.2.3: icmp_seq=2 ttl=254 time=0 ms ----f50 PING Statistics---- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0/0/1 ms root@sp21n01:/ IBM 9077 SP Switch Router: Get Connected to the SP Switch Gateway Flags Refs 192.168.4.137 192.168.14.4...
Page 191 If these commands fail, check routing settings again. If everything is ping as it should be, try to the SP Switch Router ATM media card or the SP ping Switch Router Adapter card to which part is failing: ping 192.168.14.4 (on chosen SP21 processor nodes) ping 10.1.2.1 (on F50) If any errors occur, check cabling, the configuration of SP Switch Router media cards (See Section 3.7, “Step-by-Step Media Card Configuration”...
Page 192: Sp Switch - Fddi Connection (Distinct Fddi Networks)
. Any other cabling might be used.). The SP Switch Router Adapter card is attached to the SP Switch of SP21, as shown in Figure 56 on IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 193: Sp Switch - Fddi Connection
page 175 and Table 17 on page 175. The netmask for all interfaces is 255.255.255.0. node 9 node 10 FDDI node 11 node 12 Figure 56. SP Switch - FDDI Connection Table 17 shows the IP addresses used in our configuration. Table 17.
Page 194 Route Tree for Protocol Family 2 (Internet): default 10.5.1/24 127/8 192.168.3/24 192.168.13/24 192.168.14/24 Route Tree for Protocol Family 24 (Internet v6): IBM 9077 SP Switch Router: Get Connected to the SP Switch Gateway Flags Refs 192.168.3.37 10.5.1.9 127.0.0.1 192.168.3.9 85376 en0 192.168.13.9...
Page 195 3. On the nodes in SP21 that are supposed to communicate with the different FDDI backbones, add the necessary routes: route add -net 10.2.1 -netmask 255.255.255.0 -mtu 4352 192.168.14.4 route add -net 10.3.1 -netmask 255.255.255.0 -mtu 4352 192.168.14.4 route add -net 10.4.1 -netmask 255.255.255.0 -mtu 4352 192.168.14.4 route add -net 10.5.1 -netmask 255.255.255.0 -mtu 4352 192.168.14.4 The -mtu parameter is optional but should be set to ensure optimal packet size on this route.
Page 196 64 bytes from 192.168.14.1: icmp_seq=1 ttl=254 time=1 ms ----192.168.14.1 PING Statistics---- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max = 1/1/1 ms IBM 9077 SP Switch Router: Get Connected to the SP Switch Network Address 00:c0:80:96:38:68 00:c0:80:96:38:68 192.168.4.4...
Page 197 If these commands fail, check routing settings and IP address ping assignment again. If everything is as it should be, try to FDDI media card ports or the GRF SP Switch media card to find the failing part: ping 10.2.1.15 (on node 12in SP2) ping 10.3.1.16 (on node 10 in SP2) ping 10.4.1.17 (on node 11 in SP2) ping 10.5.1.18 (on node 9 in SP2)
Page 198: Sp Switch - Fddi Connection (Bridging)
18 on page 181. The netmask for all interfaces is 255.255.255.0. node 9 node 10 node 11 node 12 Figure 57. SP Switch - FDDI Connection (Bridging) IBM 9077 SP Switch Router: Get Connected to the SP Switch GRF 1600 SP Switch Router FDDI Adapter card 1 bridge group...
Page 199: Configuration Of Sp Switch - Fddi Connection (Bridging)
Table 18 shows the IP addresses used in our configuration. Table 18. Configuration of SP Switch - FDDI Connection (Bridging) Adapter FDDI interface in node 9 FDDI interface in node 10 FDDI interface in node 11 FDDI interface in node 12 Bridge Group bg0 SP Switch Router Adapter card 1 SP processor nodes in SP21...
Page 200 4352 <link11> gf002 4352 <Bridge> gf003 4352 <link12> gf003 4352 <Bridge> IBM 9077 SP Switch Router: Get Connected to the SP Switch at the beginning of the respective lines. 10.10.1.13 255.255.255.0 grwrite -v should completely disable the now commented Network...
Page 201 3. Add the route to the Switch network of SP21 on all four nodes of SP2 with an FDDI interface. On node 9-12 in SP2, add the following route: route add -net 192.168.14 -netmask 255.255.255.0 -mtu 4352 10.10.1.13 4. Check for correct routing entries on all four nodes, for example: root@sp2n09:/ netstat -rn Routing tables Destination...
Page 202 300 MB files from different nodes in SP21 to the four FDDI-equipped nodes in SP2 and IBM 9077 SP Switch Router: Get Connected to the SP Switch . Use if needed.
Page 203: Sp Switch - Fddi Connection In An Adsm Environment
vice versa. We sent these files to /dev/null to eliminate any hard disk influence on the receiver side. The hardware requisites for this test are the same as described in Section 5.1.4.1, “SP Switch - FDDI Connection without Bridging” on page 174. The slow internal SCSI disks in two of our four nodes in SP2 would not allow the transfer rate to exceed 4.5 MB/s.
Page 204 SP Switch Router. Limiting factor in this scenario is the ability of the ADSM server to handle such data transfer rates (processor performance) and to write all data fast enough to storage media. IBM 9077 SP Switch Router: Get Connected to the SP Switch to the IP address of the Switch TCPServeraddress...
Page 205: Single Sp Partition And Multiple Sp Switch Router Adapter Cards
5.2 Single SP Partition and Multiple SP Switch Router Adapter Cards It is frequently necessary to maintain the data transfer even when an SP Switch Router Adapter fails. This scenario describes how to setup a dual, not truly redundant, connection between SP Switch Router and SP Switch (see Figure 59) and how to recover from an adapter or cable failure.
Page 206 If any errors occur, check cabling, the configuration of the SP Switch Router Adapter cards (especially subnet mask setting), and also the network adapters in the nodes. IBM 9077 SP Switch Router: Get Connected to the SP Switch . Use to both SP Switch Router Adapter cards from any node of if needed.
Page 207 If the SP Switch Router Adapter cards work, the can both be used to route IP traffic from the SP Switch. Add the following routes to the SP nodes of SP21: route add -net xxx.xxx.xxx.xxx -netmask yyy.yyy.yyy.yyy -mtu \ zzz 192.168.14.4 to route outgoing traffic (coming from the SP node) via SP Switch Router Adapter card 1 and: route add -net xxx.xxx.xxx.xxx -netmask yyy.yyy.yyy.yyy -mtu \...
Page 208: Complex Configuration
• All routes on the SP Switch Routers are assumed to be set correctly. Table 20 on page 191 shows the IP addresses used in our configuration. IBM 9077 SP Switch Router: Get Connected to the SP Switch SP Switch Router...
Page 209: Configuration Of A Dual Sp Switch Router - Sp Switch Connection
Table 20. Configuration of a Dual SP Switch Router - SP Switch Connection Adapter IP Address SP Switch Router 192.168.14.4 Adapter card 1 SP Switch Router 192.168.14.129 Adapter card 2 SP Switch Router 192.168.13.4 Adapter card 3 Node 1 in SP2 192.168.13.1 Node 6 in SP21 192.168.14.6...
Page 210 7. On node 10 in SP21, add the following route to the switch network of SP2: route add -net 192.168.13 -netmask 255.255.255.0 -mtu 65280 \ 192.168.14.129 IBM 9077 SP Switch Router: Get Connected to the SP Switch Gateway Flags Refs 192.168.4.137...
Page 211 8. Check for correct routing entry: root@sp21n10:/ netstat -rn Routing tables Destination Gateway Route Tree for Protocol Family 2 (Internet): default 192.168.4.137 10.2.1/24 10.2.1.1 127/8 127.0.0.1 192.168.4/24 192.168.4.10 192.168.13/24 192.168.14.129 192.168.14/24 192.168.14.10 Route Tree for Protocol Family 24 (Internet v6): 9.
Page 212 The SP Switch Adapter card with IP address 192.168.14.4 has no problem delivering IP packets to node 6 in the same subnet. IBM 9077 SP Switch Router: Get Connected to the SP Switch the SP Switch interfaces of the chosen nodes in ping commands fail, check routing settings again.
Page 213: Ip Traffic Flow When Issuing Ping 192.168.13.1 On Node 6
GRF 400 SP Switch node 1 Adapter 192.168.13.1 255.255.255.0 Figure 61. IP Traffic Flow When Issuing ping 192.168.13.1 on Node 6 Figure 63 on page 196 shows the IP traffic flow when issuing the on node 10 in SP21. All packets are first forwarded to the SP 192.168.13.1 Switch Adapter card with IP address 192.168.14.129 corresponding to the routing settings.
Page 214: Recovery Procedure For An Sp Switch Adapter Card Failure
Note: Node 8 is always affected, independent of the failing SP Switch Adapter card. Try to avoid routing settings that need both SP Switch Adapter cards for proper functioning. IBM 9077 SP Switch Router: Get Connected to the SP Switch GRF 400 GRF 1600...
Page 215: Multiple Sp Partition And Multiple Sp Switch Router Adapter Cards
But one large disadvantage remains: There is no high-speed connection between several partitions. Using an IBM 9077 SP Switch Router with two SP Switch Router Adapter cards lets you overcome this problem. You can partition your SP and set up a high-speed connection between several partitions.
Page 216: Partition-To-Partition Connection With An Sp Switch Router
• ARP should be enabled on the SP Switch network to provide the greatest flexibility in assigning IP addresses (strongly recommended!). GRF 400 Figure 64. Partition-to-Partition Connection with an SP Switch Router IBM 9077 SP Switch Router: Get Connected to the SP Switch SP Switch SP Switch Router Adapter card 1...
Page 217: Configuration Of A Partition - Partition Connection
Table 21 shows the IP addresses used in our configuration. Table 21. Configuration of a Partition - Partition Connection Adapter SP Switch Router Adapter card 1 SP Switch Router Adapter card 2 Node 11 in SP2 Node 12 in SP2 Node 15 in SP2 All other processor nodes in SP2 Configuration:...
Page 218 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max = 0/0/0 ms On any node in partition 1 in SP2, node in partition 2 in SP2, for example: IBM 9077 SP Switch Router: Get Connected to the SP Switch Gateway Flags Refs 192.168.3.37...
Page 219 root@sp2n01:/ ping 192.168.13.132 PING 192.168.13.132: (192.168.13.132): 56 data bytes 64 bytes from 192.168.13.132: icmp_seq=0 ttl=254 time=1 ms 64 bytes from 192.168.13.132: icmp_seq=1 ttl=254 time=1 ms ----192.168.13.132 PING Statistics---- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max = 1/1/1 ms If these commands fail, check routing settings again.
Page 220 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 221: Chapter 6. Multiple Rs/6000 Sps And One Sp Switch Router
Chapter 6. Multiple RS/6000 SPs and One SP Switch Router In this configuration, two RS/6000 SP systems are connected to a single SP Switch Router. This enables both SPs to communicate deploying the SP Switch data transfer rate and/or to share other network resources. See Figure 65 for an overview.
Page 222: Configuration Of Sp Switch - Sp Switch Connection
Switch Router. Just set the corresponding routes on all nodes of SP2 and SP21: 1. On nodes in SP21, add the following route to the switch network of SP2: IBM 9077 SP Switch Router: Get Connected to the SP Switch 192.168.4.137 SEND ALL TRAPS...
Page 223 route add -net 192.168.13 -netmask 255.255.255.0 -mtu 65280 \ 192.168.14.4 2. Check for correct routing entry: root@sp21n01:/ netstat -rn Routing tables Destination Gateway Route Tree for Protocol Family 2 (Internet): default 192.168.4.137 10.1.1/24 192.168.14.4 10.10.1/24 192.168.14.4 10.50.1/24 192.168.14.4 127/8 127.0.0.1 192.168.4/24 192.168.4.1 192.168.13/24...
Page 224 Switch - FDDI Connection without Bridging” on page 174. We started ftp transfers on all available nodes of SP2 and on some nodes of SP21. IBM 9077 SP Switch Router: Get Connected to the SP Switch . Use if needed.
Page 225: Sharing Network Resources
With this scenario and without further tuning (refer to Appendix A, “Laboratory Hardware and Software Configuration” on page 233 for actual parameters), we measured a stable cumulative transfer rate of up to 83 MB/s (observed with the freeware tool monitor). This was the maximum transfer rate achievable in our environment.
Page 226 SP to different SP Switch Router Adapter media cards except the one caused by limited bandwidth of the different network types (FDDI, ATM). IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 227: Chapter 7. Multiple Rs/6000 Sps And Multiple Grfs
Chapter 7. Multiple RS/6000 SPs and Multiple GRFs In this section, sample configurations with two SP systems connected with two SP Switch Routers are presented. The routers, in turn, are connected by any kind of high speed network supported by the GRF. Preferable selections are dedicated high performance networks such as FDDI, ATM or HIPPI.
Page 228: Atm Oc-3C Backbone - Using One Port
IP subnet on the respective SP. • ARP should be enabled on the SP Switch network to provide the most flexibility in assigning IP addresses (strongly recommended!). IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 229: Sp Switch - Atm - Sp Switch Connection
• If ARP is disabled on the SP Switch network, the IP addresses assigned to the nodes must be determined by the switch node numbers. Note: The SP Switch Router Adapter card will not properly forward IP data to nodes assigned with an IP address that is in another subnet. Configuration: In this scenario, we have the SP Switch of SP21 connected to the GRF 1600.
Page 230: Configuration Of Sp Switch - Atm - Sp Switch
4. The SP Switch Router Adapter card is connected to the SP Switch and configured, too. Check with and use • On GRF 400 (ATM card in slot 2, SP Switch card in slot 1): IBM 9077 SP Switch Router: Get Connected to the SP Switch IP Address 192.168.13.4 10.1.1.2 10.1.1.1...
Page 231 1. The file /etc/gratm.conf needs the configuration statements for the port used: Traffic_Shape name=high_speed_high_quality \ peak=155000 sustain=155000 burst=2048 qos=high Interface ga020 traffic_shape=high_speed_high_quality PVC ga020 0/132 proto=ip traffic_shape=high_speed_high_quality 2. The file /etc/grifconfig.conf has the following entries: gt010 192.168.13.4 ga020 10.1.1.2 3. The file /etc/grroute.conf has the following line: 192.168.14.0 This will set the correct route to the other SP Switch network over the ATM interface automatically;...
Page 232 Router media cards (see Section 3.7, “Step-by-Step Media Card Configuration” on page 86 and Section 4.2, “ATM OC-3c Configuration” on page 110) and the Switch adapters in the SP nodes. IBM 9077 SP Switch Router: Get Connected to the SP Switch 192.168.14.4 192.168.14.4 192.168.14.4...
Page 233: Atm Oc-3C Backbone - Using Two Ports
Performance: To get a rough overview of the data transfer rates that can be achieved in this scenario, the following test was performed: 1. We used nodes in SP2 to one chosen node in SP21, and at the same time used ftp to conduct several file transfers of a 300 MB file from the nodes in SP21 to a chosen node in SP2.
Page 234: Configuration Of Sp Switch - Atm Bridged - Sp Switch
Remarks : The data from Switch - FDDI Connection with Bridging” on page 179) was commented out for our convenience. Up to 16 bridge groups are allowed on a GRF IBM 9077 SP Switch Router: Get Connected to the SP Switch IP Address 192.168.13.4 10.1.1.2...
Page 235 Router, so there was no technical reason for it. The is there to remind you how to end editing of the file, and we give an as answer to the last question, as the ATM ports are already in use and therefore cannot be modified.
Page 236 This following entries remains the same as is the basic configuration: Interface ga020 traffic_shape=high_speed_high_quality \ Interface ga0280 traffic_shape=high_speed_high_quality \ IBM 9077 SP Switch Router: Get Connected to the SP Switch :wq! (no) as answer to the last question, as the GRF, and takes care of the relevant settings anyway.
Page 237 This two lines were changed from the basic configuration! PVC ga020 0/132 proto=llc,bridging PVC ga0280 0/134 proto=llc,bridging Because the GRF supports InATMARP, there is no need to have any entries in /etc/grarp.conf. The file /etc/grroute.conf also remains unchanged: 192.168.14.0 255.255.255.0 If there is no such entry in /etc/grroute.conf, the following command must be run on GRF 400 after every reboot: route add -net 192.168.14.0 -netmask 255.255.255.0 -mtu 9180 10.1.1.1...
Page 238 We saw up to about 14.5 MB/s with just one side sending data; with all nodes sending and receiving, we achieved a duplex throughput of no more than 24 MB/s over the ATM ports. IBM 9077 SP Switch Router: Get Connected to the SP Switch 192.168.13.4 192.168.13.4 192.168.13.4...
Page 239 So what happened to the expected doubling of the aggregate throughput? As it turns out, even with bridging activated, only one ATM port is allowed to send and receive data. The second port is blocked, as can be seen in the following screen shot: grf16:/root brstat Bridge Group bg1...
Page 240: Atm Oc-12C Backbone - One Port
This setup is basically the same as using just one port of an ATM OC-3c card, as described in Section 7.1.1, “ATM OC-3c Backbone - Using One Port” on page 210. IBM 9077 SP Switch Router: Get Connected to the SP Switch Enabled 32768 00:c0:80:96:38:68...
Page 241: Sp Switch - Atm Oc-12C - Sp Switch Connection
Configuration assumptions: • The SP Switch Router ATM media card has been installed according to Section 4.3, “ATM OC-12c Configuration” on page 119 on both GRF routers and works properly. • The SP Switch Router Adapter card has been installed according to Section 3.7, “Step-by-Step Media Card Configuration”...
Page 242: Configuration Of Sp Switch - Atm Oc-12C - Sp Switch
4. The SP Switch Router Adapter card is connected to the SP Switch and configured, too. Check with and use • On the GRF 400 (ATM card in slot 1, SP Switch card in slot 3): IBM 9077 SP Switch Router: Get Connected to the SP Switch IP Address 192.168.13.4 10.20.30.2 10.20.30.1...
Page 243 1. The file /etc/gratm.conf needs the configuration statements for the port used: Traffic_Shape name=bigg_speed_high_quality \ peak=622000 sustain=622000 burst=2048 qos=high Interface ga010 traffic_shape=bigg_speed_high_quality PVC ga010 0/132 proto=ip traffic_shape=bigg_speed_high_quality 2. The file /etc/grifconfig.conf has the following entries: gt030 192.168.13.4 ga010 10.20.30.2 3. The file /etc/grroute.conf has the following line: 192.168.14.0 This sets the correct route to the other SP Switch network over the ATM OC-12c interface automatically;...
Page 244 Router media cards (see Section 3.7, “Step-by-Step Media Card Configuration” on page 86 and Section 4.3, “ATM OC-12c Configuration” on page 119) and the Switch adapters in the SP nodes. IBM 9077 SP Switch Router: Get Connected to the SP Switch 192.168.14.4 192.168.14.4 192.168.14.4...
Page 245: Hippi Backbone Connection
Performance: To get a rough overview of the data transfer rates that can be achieved in this scenario, the following test was performed: 1. We used nodes in SP2 to one chosen node in SP21, and at the same time used ftp to conduct several file transfers of a 300 MB file from the nodes in SP21 to a chosen node in SP2.
Page 246: Sp Switch - Hippi - Sp Switch Connection
SP Switch Router. On the nodes of SP2 and SP21, respectively, routes to the nodes of the distant SP have to be set. IBM 9077 SP Switch Router: Get Connected to the SP Switch IP 192.168.13.4...
Page 247 The media card adapters on the GRF routers should already be up and running (according to Section 3.7, “Step-by-Step Media Card Configuration” on page 86 and Section 4.5, “HIPPI Configuration” on page 133). Important settings are repeated here, nevertheless, to be on the safe side: On the GRF 1600 (HIPPI card is in slot 8, SP Switch card is in slot 3) check for the following: 1.
Page 248 192.168.13/24 sp21n10: 192.168.13/24 sp21n11: 192.168.13/24 sp21n13: 192.168.13/24 sp21n15: 192.168.13/24 root@sp21en0:/ 4. Check for correct routing entries on all nodes in SP2: IBM 9077 SP Switch Router: Get Connected to the SP Switch SDRGetObjects switch_responds if needed. 192.168.14.4 192.168.14.4 192.168.14.4 192.168.14.4 192.168.14.4...
Page 249 root@sp2en0:/ dsh netstat -rn | grep 192.168.14 sp2n01: 192.168.14/24 192.168.13.4 sp2n05: 192.168.14/24 192.168.13.4 sp2n06: 192.168.14/24 192.168.13.4 sp2n07: 192.168.14/24 192.168.13.4 sp2n08: 192.168.14/24 192.168.13.4 sp2n09: 192.168.14/24 192.168.13.4 sp2n10: 192.168.14/24 192.168.13.4 sp2n11: 192.168.14/24 192.168.13.4 sp2n12: 192.168.14/24 192.168.13.4 sp2n13: 192.168.14/24 192.168.13.4 sp2n14: 192.168.14/24 192.168.13.4 sp2n15: 192.168.14/24 192.168.13.4 root@sp2en0:/...
Page 250 We saw up to about 48 MB/s with just one side sending data. With all nodes sending and receiving, we achieved a duplex throughput of about 54 MB/s on the HIPPI port. IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 251: Appendix A. Laboratory Hardware And Software Configuration
Appendix A. Laboratory Hardware and Software Configuration This appendix contains a detailed description of the hardware and software configuration used to test scenarios described in the second part of this redbook. All hostnames, IP addresses, adapters and other configuration information mentioned there refer to the following section if no other information is given.
Page 252: Configuration Of Sp 21
Node 6 Node 7 Node 8 Node 9 Node 10 Node 11 Node 13 Node 15 IBM 9077 SP Switch Router: Get Connected to the SP Switch Node Type Hostname RS/6000 570 sp21en0 high node sp21n01 112 Mhz,6 proc. thin node...
Page 253: Hard Disks
Table 28. Configuration of SP 2 Node Node0 (CWS) Node1 Node5 Node6 Node7 Node8 Node9 Node10 Node11 Node12 Node13 Node14 Node15 A.1.1 Hard Disks All nodes and CWSs include one or more internal SCSI disks. Some nodes are additionally equipped with SSA disks (Table 29 on page 236). For special tests (Section 5.1.5, “SP Switch - FDDI Connection in an ADSM Environment”...
Page 254: Hard Disk Equipment Of Sp 21
Node 7 Node 8 Node 9 Node 10 Node 11 Node 13 Node 15 IBM 9077 SP Switch Router: Get Connected to the SP Switch Disks Description hdisk0 1.2 GB SCSI Disk Drive hdisk1 1.2 GB SCSI Disk Drive hdisk2 1.0 GB SCSI Disk Drive...
Page 255: Hard Disk Equipment Of Sp 2 Part 1 Of 2
Table 30. Hard Disk Equipment of SP 2 Part 1 of 2 Node Disks Node0 (CWS) hdisk0 hdisk1 hdisk2 hdisk3 hdisk4 hdisk5 Node1 hdisk0 hdisk1 Node5 hdisk0 hdisk1 hdisk2 hdisk3 hdisk4 hdisk5 hdisk6 Node6 hdisk0 hdisk1 Node7 hdisk0 hdisk1 Node8 hdisk0 hdisk1 Node9...
Page 256: Hard Disk Equipment Of Sp 2 Part 2 Of 2
Table 31. Hard Disk Equipment of SP 2 Part 2 of 2 Node Node13 Node14 Node15 IBM 9077 SP Switch Router: Get Connected to the SP Switch Disks Description hdisk0 1.0 GB SCSI Disk Drive hdisk1 1.0 GB SCSI Disk Drive...
Page 257: Software Configuration
A.1.2 Software Configuration Both CWSs and every SP node are installed with AIX 4.3.1, including all fixes available on May 20th, 1998, and PSSP 2.4 PTF Set 1 (See Table 32). Table 32. Software Levels on CWS and All Nodes Part 1 of 14 Fileset Java.rte.bin Java.rte.classes...
Page 258: Software Levels On Cws And All Nodes Part 2 Of 14
X11.msg.en_US.base.rte X11.msg.en_US.motif.lib X11.msg.en_US.motif.mwm X11.vsm.lib bos.acct bos.acct bos.adt.base bos.adt.data bos.adt.debug bos.adt.graphics IBM 9077 SP Switch Router: Get Connected to the SP Switch Level Description 4.3.0.0 AIXwindows X11R3 Libraries Compatibility 4.3.0.0 AIXwindows X11R4 Libraries Compatibility 4.3.1.1 AIXwindows X11R5 Compatibility Libraries 4.3.0.0 AIXwindows X Consortium Fonts 4.3.0.0...
Page 259: Software Levels On Cws And All Nodes Part 3 Of 14
Table 34. Software Levels on CWS and All Nodes Part 3 of 14 Fileset Level bos.adt.include 4.3.1.1 bos.adt.lib 4.3.1.0 bos.adt.libm 4.3.1.0 bos.adt.prof 4.3.1.1 bos.adt.prt_tools 4.3.0.0 bos.adt.samples 4.3.1.0 bos.adt.sccs 4.3.1.0 bos.adt.syscalls 4.3.1.0 bos.adt.utils 4.3.1.0 bos.alt_disk_install.boot_images 4.3.1.0 bos.alt_disk_install.rte 4.3.1.0 bos.atm.atmle 4.3.1.0 bos.compat.cmds 4.3.1.0 bos.compat.links 4.3.1.0...
Page 260: Software Levels On Cws And All Nodes Part 4 Of 14
IBM 9077 SP Switch Router: Get Connected to the SP Switch Level Description 4.3.1.0 Base System Locale ISO Code Set - U.S. English 4.3.1.1 Mail Handler 4.3.0.0 Alternate Disk Install Msgs - U.S. English 4.3.1.0...
Page 261: Software Levels On Cws And All Nodes Part 5 Of 14
Table 36. Software Levels on CWS and All Nodes Part 5 of 14 Fileset Level bos.rte.bind_cmds 4.3.1.1 bos.rte.boot 4.3.1.0 bos.rte.bosinst 4.3.1.0 bos.rte.commands 4.3.1.1 bos.rte.compare 4.3.1.0 bos.rte.console 4.3.1.0 bos.rte.control 4.3.1.1 bos.rte.cron 4.3.1.1 bos.rte.date 4.3.1.0 bos.rte.devices 4.3.1.0 bos.rte.devices_msg 4.3.1.0 bos.rte.diag 4.3.1.0 bos.rte.edit 4.3.1.0 bos.rte.filesystem 4.3.1.0...
Page 262: Software Levels On Cws And All Nodes Part 6 Of 14
IBM 9077 SP Switch Router: Get Connected to the SP Switch Level Description 4.3.1.0 Device Config Methods 4.3.1.0 Miscellaneous Commands 4.3.1.0 Network 4.3.1.0 Object Data Manager 4.3.1.0 Front End Printer Support 4.3.1.0...
Page 263: Software Levels On Cws And All Nodes Part 7 Of 14
Table 38. Software Levels on CWS and All Nodes Part 7 of 14 Fileset Level bos.txt.spell 4.3.1.0 bos.txt.spell.data 4.3.0.0 bos.txt.tfs 4.3.1.0 bos.txt.tfs.data 4.3.0.0 bos.txt.ts 4.3.1.0 bos.up 4.3.1.1 devices.base.diag 4.3.1.0 devices.base.rte 4.3.1.0 devices.chrp.base.diag 4.3.1.0 devices.chrp.base.rte 4.3.1.0 devices.common.IBM.async.diag 4.3.1.0 devices.common.IBM.atm.rte 4.3.1.1 devices.common.IBM.bbl.diag 4.3.1.0 devices.common.IBM.cx.rte 4.3.1.0...
Page 264: Software Levels On Cws And All Nodes Part 8 Of 14
IBM 9077 SP Switch Router: Get Connected to the SP Switch Level Description 4.3.1.0 RISC PC Common Base System Device Software 4.3.1.1 Graphics Adapter Common Software 4.3.0.0 Wide SCSI Adapter Diagnostics 4.3.0.0...
Page 265: Software Levels On Cws And All Nodes Part 9 Of 14
Table 40. Software Levels on CWS and All Nodes Part 9 of 14 Fileset Level devices.mca.8f67.com 4.3.1.0 devices.mca.8f67.diag 4.3.0.0 devices.mca.8f67.diag.com 4.3.1.0 devices.mca.8f67.rte 4.3.0.0 devices.mca.8f67.ucode 4.3.1.0 devices.mca.8f7f.diag 4.3.0.0 devices.mca.8f7f.rte 4.3.0.0 devices.mca.8f7f.ucode 4.3.1.0 devices.mca.8f95.diag 4.3.1.0 devices.mca.8f95.rte 4.3.1.0 devices.mca.8f97.com 4.3.0.0 devices.mca.8f97.diag 4.3.0.0 devices.mca.8f97.rte 4.3.0.0 devices.mca.8f98.diag 4.3.0.0...
Page 266: Software Levels On Cws And All Nodes Part 10 Of14
X11.compat.lib.Motif114 devices.ssa.IBM_raid.rte devices.ssa.disk.rte IBM 9077 SP Switch Router: Get Connected to the SP Switch Level Description 4.3.0.0 Base System Device Software Msgs - U.S. English 4.3.1.0 Device Diagnostics Messages - U.S. English 4.3.0.0 RISC PC Software Messages - U.S. English 4.3.1.0...
Page 267: Software Levels On Cws And All Nodes Part 11 Of 14
Table 42. Software Levels on CWS and All Nodes Part 11 of 14 Fileset Level devices.ssa.network_agent.rte 4.3.1.0 devices.ssa.tm.rte 4.3.1.0 devices.sys.mca.rte 4.3.1.0 devices.sys.slc.diag 4.3.1.0 devices.sys.slc.rte 4.3.1.0 devices.tty.rte 4.3.1.0 ifor_ls.base.cli 4.3.1.0 ifor_ls.base.gui 4.3.1.0 ifor_ls.compat.cli 4.3.0.0 ifor_ls.compat.gui 4.3.0.0 ifor_ls.msg.en_US.base.cli 4.3.0.0 ifor_ls.msg.en_US.base.gui 4.3.0.0 ifor_ls.msg.en_US.compat.cli 4.3.0.0 ifor_ls.msg.en_US.compat.gui 4.3.0.0...
Page 268: Software Levels On Cws And All Nodes Part 12 Of 14
IBM 9077 SP Switch Router: Get Connected to the SP Switch Level Description 4.3.0.0 Hewlett-Packard LaserJet Color 4.3.0.0 IBM 2380 Personal Printer II 4.3.0.0 IBM 2381 Personal Printer II 4.3.0.0 IBM 2390 Personal Printer II 4.3.0.0...
Page 269: Software Levels On Cws And All Nodes Part 13 Of 14
Lexmark Optra E Laser Printer Lexmark Optra Ep Laser Printer Lexmark Optra N Laser Printer Lexmark Optra S Laser Printer Lexmark Optra SC Color Laser Printer Printer Backend Messages - U.S. English QMS ColorScript 100, Model 20 Printer Backend SP Authentication Server...
Page 270: Software Levels On Cws And All Nodes Part 14 Of 14
IBM 9077 SP Switch Router: Get Connected to the SP Switch Level Description 4.3.1.0 TaskGuide Runtime Environment 4.3.1.1 Web-based System Manager Applications 4.3.1.1 Web-based System Manager Client/Server Support 4.3.1.0 Web-based System Manager Icons 4.3.1.1...
Page 271: Network Options And Tuning
A.1.3 Network Options and Tuning Table 46 shows the network options on the CWS and all participating SP nodes. Options can be changed with the Table 46. Network Options of CWS and All Nodes Part 1 of 3 Parameters thewall sockthresh sb_max somaxconn...
Page 272: Network Options Of Cws And All Nodes Part 2 Of 3
IBM 9077 SP Switch Router: Get Connected to the SP Switch Value 327680 327680 65536 655360 14400 1448...
Page 273: Sp Switch Pool Size Settings
Table 48. Network Options of CWS and All Nodes Part 3 of 3 Parameters ipignoreredirects ipsrcroutesend ipsrcrouterecv ipsrcrouteforward ip6srcrouteforward ip6_defttl ndpt_keep ndpt_reachable ndpt_retrans ndpt_probe ndpt_down ndp_umaxtries ndp_mmaxtries ip6_prune tcp_timewait tcp_ephemeral_low tcp_ephemeral_high udp_ephemeral_low udp_ephemeral_high A.2 SP Switch Pool Size Settings Two important switch parameters were changed from their default values: rpoolsize and spoolsize.
Page 274: 7025-F50 Configuration
Parameter thewall sockthresh sb_max somaxconn clean_partial_conns net_malloc_police rto_low rto_high rto_limit rto_length inet_stack_size arptab_bsiz arptab_nb tcp_ndebug ifsize arpqsize ndpqsize route_expire strmsgsz strctlsz nstrpush strthresh psetimers IBM 9077 SP Switch Router: Get Connected to the SP Switch Value 16384 1310720 1024 1024...
Page 275: Network Options Of 7025-F50 Part 2 Of 3
Table 50. Network Options of 7025-F50 Part 2 of 3 Parameter psebufcalls strturncnt pseintrstack lowthresh medthresh psecache subnetsarelocal maxttl ipfragttl ipsendredirects ipforwarding udp_ttl tcp_ttl arpt_killc tcp_sendspace tcp_recvspace udp_sendspace rfc1122addrchk nonlocsrcroute tcp_keepintvl tcp_keepidle bcastping udpcksum tcp_mssdflt icmpaddressmask tcp_keepinit rfc1323 pmtu_default_age pmtu_rediscover_interval udp_pmtu_discover Value 12288...
Page 276: Sp Ip Switch Router Configuration
Both Switch Routers contain at least one SP Switch Router Adapter card. Depending on the scenario, several SP Switch Router media cards were installed, including Ethernet, FDDI, ATM OC-3c, ATM OC-12c and HIPPI media cards. IBM 9077 SP Switch Router: Get Connected to the SP Switch Value 32768 65535...
Page 277 The applied IP addresses vary with the scenario and are specified in the corresponding chapter. For specific SP Switch Router sample configuration files, refer to Appendix B, “GRF Configuration Files” on page 261. Laboratory Hardware and Software Configuration...
Page 278 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 279: Appendix B. Grf Configuration Files
Appendix B. GRF Configuration Files This appendix contains relevant SP Switch Router configuration files. Some of them are here just for information, some of them were worked out manually during setup of hardware or software and some of them were created using Ascend-supplied tools.
Page 280 OWNER=‘ls -l ${LOCAL} | awk ’{print $3}’‘ echo "’${LOCAL}’ owned by ’${OWNER}’, not ’root’; skipping sourc ing it." >&2 else . ${LOCAL} unset LOCAL # Check to see if this is an interactive session. IBM 9077 SP Switch Router: Get Connected to the SP Switch status...
Page 281: Etc/Release
if [ -t 0 ] then # Ask for a terminal type; the default is the canonical "vt100". if [ X${TERM} = X ] then TERM=vt100 eval ‘tset -s -m ?$TERM‘ export TERM # It’s interactive, so exec the new CLI shell for the GRF. # from here on commented out the next 15 lines as 99.99999% of work # is from the shell prompt, and if you exit from CLI, .profile is not # obeyed, sigh.
Page 282: Etc/Bridged.conf
# If you need to set specific values for a port in this # bridge group, then use the structure below.. # port gf040 { IBM 9077 SP Switch Router: Get Connected to the SP Switch bredit # priority : port priority allows the network manager to influence the choice of port when a bridge has two ports connected in a loop.
Page 283 to be a lead or at least low in the spanning tree. The closer a LAN is to being a leaf in the tree, the less through traffic it will be asked to carry. A LAN would be a candidate for having a large path cost if it has a lower bandwidth ot if someone wants to minimize unnecessary traffic on it.
Page 284 { #debug_level debug_level # For FDDI Backbone test Chap.5.1.4.2 bridge_group bg0 { port gf000 gf001 gf002 gf003; IBM 9077 SP Switch Router: Get Connected to the SP Switch 20 seconds; # traces all events of level NOTICE and above...
Page 285: Etc/Fstab
# For ATM - ATM two ports Test Chap.7.1.2 bridge_group bg1 { port ga010 ga0180; spanning_tree disabled; B.4 /etc/fstab This file holds the filesystem mount information. This file was changed when adding a PCMCIA hard disk in Section 3.3.2, “Installing the PCMCIA Spinning Disk”...
Page 286: Etc/Gratm.conf
# The Interfaces section is where per-logical-interface parameters such as ARP services and Traffic shapes are bound to specific logical interfaces. IBM 9077 SP Switch Router: Get Connected to the SP Switch xx:xx:xx:xx:xx:xx where ’xx’ are hexadecimal digits. C-language syntax for a 32-bit constant Example: 0x03000555 for logical address x’555.
Page 287 # The PVC section is where Permanent Virtual Circuits are defined, using traffic shapes defined in the Traffic Shaping section, along with other parameters specific to PVC configuration. # Notes on the format of this file: # Comments follow the Bourne Shell style (all characters following a # # on a line are ignored).
Page 288 # on the card (either the top connector, or the bottom connector on the card). # Each Signalling entry the ATM configuration file has the following format: # Signalling card=hex connector=top|bottom [protocol=UNI3.0|UNI3.1|NONE] \ IBM 9077 SP Switch Router: Get Connected to the SP Switch (See Examples in the PVC or Interface section If ommitted,...
Page 289 [mode=SDH|SONET] [clock=Ext|Int] # The ’card’ and ’connector’ specification are mandatory. # The card should be identified by a hexidecimal digit representing # the slot number of the card in the GigaRouter chassis. # The connector should be either ’top’ or ’bottom’. # The ’protocol’...
Page 290 # values are: ’ip’ ’raw’ ’isis’ ’llc’ IBM 9077 SP Switch Router: Get Connected to the SP Switch the protocol - Use a separate PVC for each protocol - Transmit all routed IP datagrams as Ethernet frames - Transmit all frames (routed IP datagrams and...
Page 291 (except for RFC 1483 bridging) ’llc,bridging’ any LLC-encapsulated protocol, including RFC 1483 bridging [This is the PVC type for an interface using bridge_method=llc_encapsulated.] ’vcmux_bridge’ bridged packets [This is a PVC type for an interface using bridge_method=vc_multiplexed.] An additional parameter specifies the protocol carried on the VC: ether_fcs Ethernet frames, with Frame Check Sequence ether_nofcs...
Page 292: Etc/Grclean.conf
# tmp /tmp # date ‘/bin/date +%x %r"‘ # size IBM 9077 SP Switch Router: Get Connected to the SP Switch what is it ------------------------------- name of another config file to act on # of archives kept keep arch in same place as logfile...
Page 293: Etc/Grclean.logs.conf
# DEFAULTS sets all of the above keywords to the above defaults. ################################################################################ ################################################################################ # log files. ################################################################################ include=/etc/grclean.logs.conf ################################################################################ ################################################################################ ################################################################################ # port card dump files. ################################################################################ hold=4 size=1 remove=y local=y logfile=/var/portcards/grdump.* ################################################################################ B.8 /etc/grclean.logs.conf This file is included from /etc/grclean.conf. Take special care of the location of the log files once a PCMCIA hard disk is installed.
Page 294 # Process site specific clean conf, if any. ################################################################################ include=/etc/grclean.site.conf ################################################################################ # /var/tmp/core.* file cleanup. ################################################################################ hold=1 remove=y size=1024 logfile=/var/tmp/core.* ################################################################################ # cleanup our own log file, if necessary. ################################################################################ IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 295: Etc/Grdev1.Conf
DEFAULTS hold=2 local=y size=10000 logfile=/var/log/grclean.log B.9 /etc/grdev1.conf This file normally gets updated automatically by the SNMP daemon running on the CWS. ############################################################################ DEV1 Configuration ########################################################################### There are several variables that an SP Adapter card needs at start up. These are handled by a set of GRINCHES whose descriptors are indexed by card number and interface number as follows: 2.21.{CARD+1}.1.{INTERFACE+1} This template specifies the start-up values for all potential cards...
Page 296 2.21.5.1.1.13 2.21.5.1.1.14 2.21.5.1.1.15 CARD Interface 0 2.21.6.1.1.1 2.21.6.1.1.2 IBM 9077 SP Switch Router: Get Connected to the SP Switch # Node State # Switch Chip Link # Node Delay (cycles) # Admin Status "02" # Node Name # Node Number "00:00:00:00:00:00:00:00:00:00"...
Page 297 2.21.6.1.1.3 "00:00:00:01:00:00:00:07:00:03" # Switch Token 2.21.6.1.1.4 2.21.6.1.1.5 2.21.6.1.1.6 x192.168.14.129 2.21.6.1.1.7 x255.255.255.128 2.21.6.1.1.8 1024 2.21.6.1.1.9 2.21.6.1.1.10 2.21.6.1.1.11 sp21en0 2.21.6.1.1.12 2.21.6.1.1.13 2.21.6.1.1.14 2.21.6.1.1.15 CARD Interface 0 2.21.7.1.1.1 "06" 2.21.7.1.1.2 2.21.7.1.1.3 "00:00:00:00:00:00:00:00:00:00" # Switch Token 2.21.7.1.1.4 2.21.7.1.1.5 2.21.7.1.1.6 x0.0.0.0 2.21.7.1.1.7 x0.0.0.0 2.21.7.1.1.8 1024 2.21.7.1.1.9 2.21.7.1.1.10 2.21.7.1.1.11...
Page 298 2.21.12.1.1.13 2.21.12.1.1.14 2.21.12.1.1.15 CARD 12 Interface 0 2.21.13.1.1.1 2.21.13.1.1.2 IBM 9077 SP Switch Router: Get Connected to the SP Switch # Node State # Switch Chip Link # Node Delay (cycles) # Admin Status "09" # Node Name # Node Number "00:00:00:00:00:00:00:00:00:00"...
Page 299 2.21.13.1.1.3 "00:00:00:00:00:00:00:00:00:00" # Switch Token 2.21.13.1.1.4 2.21.13.1.1.5 2.21.13.1.1.6 x0.0.0.0 2.21.13.1.1.7 x0.0.0.0 2.21.13.1.1.8 1024 2.21.13.1.1.9 2.21.13.1.1.10 2.21.13.1.1.11 "no name" 2.21.13.1.1.12 2.21.13.1.1.13 2.21.13.1.1.14 2.21.13.1.1.15 CARD 13 Interface 0 2.21.14.1.1.1 "13" 2.21.14.1.1.2 2.21.14.1.1.3 "00:00:00:00:00:00:00:00:00:00" # Switch Token 2.21.14.1.1.4 2.21.14.1.1.5 2.21.14.1.1.6 x0.0.0.0 2.21.14.1.1.7 x0.0.0.0 2.21.14.1.1.8 1024 2.21.14.1.1.9...
Page 300: Etc/Grifconfig.conf
PVC (see /etc/grpvc.conf for that). For FDDI cards, the fifth character will be 0, 1, 2, or 3 to specify the logical interface on the IBM 9077 SP Switch Router: Get Connected to the SP Switch # Node State # Switch Chip Link...
Page 301 FDDI card. NOTE: may be different from the physical interface on the card, depending on the single- or dual- attachedness of the various interfaces. "gf073" specifies the bottom-most connector on the FDDI card in slot 7; "gf020" specifies top-most connector on the FDDI card in slot 2, or the top TWO connectors on that card if they’re configured dual-attached.
Page 302: Etc/Grlamap.conf
# Only the first 4 values will be taken as valid, any extra values will # be flagged invalid, a message will be printed to gr.console & grlamap will IBM 9077 SP Switch Router: Get Connected to the SP Switch 255.255.255.0 mtu 65520 255.255.255.128 -...
Page 303: Etc/Grroute.conf
# exit. # If only 3 values are designated, the first value will be repeated as the # fourth value. # No whitespace is allowed in any field. # ie. # 5,6 997,998 # When port cards 5 & 6 receive an IP packet with a logical address of 997 or # 998, it will then attempt to randomly forward the packet to one of the # mapped ports 1, 4, 8 or 15.
Page 304: Etc/Hosts
$Id: inetd.conf,v 2.2 1996/01/02 19:55:38 polk Exp $ @(#)inetd.conf #ftp stream telnet stream #shell stream #login stream #exec stream IBM 9077 SP Switch Router: Get Connected to the SP Switch 255.255.255.0 123.45.67.89 255.255.255.255 123.45.67.89 netmask gateway/next hop 0.0.0.0 192.0.2.2 0.0.0.0 192.168.4.137 255.255.255.0 10.1.1.2 255.255.255.0...
Page 305: Etc/Motd
#uucpd stream #finger stream #tftp dgram #comsat dgram #ntalk dgram #pop stream #ident stream #bootp dgram #echo stream #discard stream #chargen stream #daytime stream #tcpmux stream #time stream #echo dgram #discard dgram #chargen dgram #daytime dgram #time dgram # amanda dgram amandad # Kerberos authenticated services...
Page 306: Etc/Snmpd.conf
# GRAMMAR: INITIAL TRANSPORT IBM 9077 SP Switch Router: Get Connected to the SP Switch /usr/local/bin/local_daemon This is used to <name> <String> <name>...
Page 307 [SNMP | SMUX] [OVER [UNIX | UDP | TCP] [SOCKET | TLI]] [AT <addr>] MANAGER <addr> [ON TRANSPORT <name>] [SEND [ALL | NO | traplist] TRAPS [TO PORT <#> ] [WITH COMMUNITY <name>]] COMMUNITY <name> ALLOW op [,op]* [OPERATIONS] [AS <name>] [USE encrypt ENCRYPTION] [MEMBERS ALLOW <subagentId>...
Page 308 TO PORT 162 WITH COMMUNITY spenmgmt COMMUNITY spenmgmt ALLOW ALL OPERATIONS USE NO ENCRYPTION IBM 9077 SP Switch Router: Get Connected to the SP Switch UNSPECIFIED SUBAGENTS UNSPECIFIED HOST[S] UNSPECIFIED PASSWORDS <ip-kind> | <rfc1449addr> | <full-ip> <hostid> | <hostid> <portid> | <portid>...
Page 309: Etc/Syslog.conf
B.18 /etc/syslog.conf Use this file to specify the type of logging in the system. If no additional hard disk is installed, logging can be directed to another network attached system; otherwise local files are used. Stanzas in /etc/grcons.log.conf determine how large the respective files may grow and how many versions are kept of them.
Page 310: Etc/Ttys
# the root password before going into single-user mode. # this by recompiling init without the -DSECURE option. # Use ‘‘kill -HUP 1’’ to make init(8) re-read this file when changes are made. IBM 9077 SP Switch Router: Get Connected to the SP Switch @server.domain.com @server.domain.com @server.domain.com...
Page 311 # Changes to the order of entries or number of ttys should only be made in # single-user mode. # name getty console "/usr/libexec/getty pccons" # Virtual consoles (named after the function key used to reach them) ttyc2 "/usr/libexec/getty pccons" ttyc3 "/usr/libexec/getty pccons"...
Page 312 IBM 9077 SP Switch Router: Get Connected to the SP Switch network network network network network network network network network network network network network network...
Page 313: Appendix C. Hardware And Software Information
Switch port numbers or the correct jack. You will get some information about updating the IBM 9077 software and how to get updates. C.1 The Front Panel of the SP Switch Router Adapter Card - Operational Figure 72 shows the front panel of the Switch Router adapter: Figure 72.
Page 314: Sp Switch Router Adapter Media Card Leds
This amber LED turns on when data is received from the crosspoint switch (through the serial daughter card). Table 53. SP Switch Router Adapter Media Card LEDs - RX/TX RX/TX ST0 (green) IBM 9077 SP Switch Router: Get Connected to the SP Switch RX/TX ST1 RX/TX ERR Description (amber) (amber) STATE_0 for hardware initialization.
Page 315: Sp Switch Router Adapter Media Card - Bootup
C.3 SP Switch Router Adapter Media Card - Bootup Table 54 shows the settings for the Switch Router Adapter Media Card LEDs during bootup. Table 54. SP Switch Router Adapter Media Card LEDs During Bootup RX/TX HB RX/TX ST0 (green) (green) RX/TX ST1 RX/TX ERR...
Page 316: Connectors And Receptacles For Different Media
Figure 73 on page 299 is taken from the Redbook RS/6000 SP: Problem Determination Guide , SG24-4778-00, Chapter 4.2 "Reviewing Switch Boards". IBM 9077 SP Switch Router: Get Connected to the SP Switch Cable Support SP Switch Cable (5, 10, 15, 20m) Two 62.5/125 micron...
Page 317: Updating Router Software
Figure 73. The SP Switch Board C.6 Updating Router Software This part provides general information about obtaining and installing new operating software (hereafter referred to as machine code) for the SP Switch Router. C.6.1 The SP Switch Router as an IBM Product As is noted in this Redbook, the SP Switch Router is based on a product from Ascend Communications, Inc.
Page 318: Obtaining New Machine Code
# cd /usr/nbin Then, to the IBM server: # ftp service2.boulder.ibm.com ftp> Enter the SP Switch Router customer ID and password as requested. 3. Now change to the /releases directory: IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 319: Sample Execution Of Grf_Update Script
ftp> cd releases ftp> cd A1_4_6 ftp> cd patches ftp> cd A1_4_6_4 4. Set the file format and download the files: ftp> bin ftp> get grf_update ftp> get RN1_4_6_4.pdf ftp> get RN1_4_6_4.txt ftp> quit 5. Change the script permissions: # chmod 755 grf_update 6.
Page 320 Loading 1.4.6.4 bsd kernel from 1.4.6.ibm,default.site.TAR.gz.bsd tar: ustar vol 1, 20 files, 3645440 bytes read. Directed Broadcast: already enabled. No need to modify /flash/etc.1.4.6.ibm,default/rc.local. The directed bcast will be enabled after the GRF reboots. IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 321 To temporarily disable the directed bcast setting later on, use: # sysctl -w net.inet.ip.fwdirbcast=0 To verify that the bcast setting is one of the sysctl executables, use: # sysctl net.inet.ip.fwdirbcast IBM GRF upgrade: testbox.site.com is up-to-date testbox.site.com will be upgraded to: Next Revision: 1.4.6.ibm Version: default Patch Revision: 1.4.6.4.ibm WARNING: testbox.site.com will now be REBOOTED to complete the upgrade.
Page 322 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 323: Appendix D. Special Notices
This publication is intended to help IBM customers, Business Partners, IBM System Engineers and other RS/6000 SP specialist who are involved in SP Switch Router (IBM 9077) projects, including education of RS/6000 SP professionals responsible for installing, configuring, and administering SP Switch Router.
Page 324 Microsoft, Windows, Windows NT, and the Windows 95 logo are trademarks or registered trademarks of Microsoft Corporation. PC Direct is a trademark of Ziff Communications Company and is used by IBM Corporation under license. IBM 9077 SP Switch Router: Get Connected to the SP Switch BookManager PROFS...
Page 325 Pentium, MMX, ProShare, LANDesk, and ActionMedia are trademarks or registered trademarks of Intel Corporation in the U.S. and other countries. UNIX is a registered trademark in the United States and other countries licensed exclusively through X/Open Company Limited. Other company, product, and service names may be trademarks or service marks of others.
Page 326 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 327: Appendix E. Related Publications
Appendix E. Related Publications The publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this redbook. E.1 International Technical Support Organization Publications For information on ordering these ITSO publications see “How to Get ITSO Redbooks”...
Page 328 Hardware and Physical Environment , GA22-7280 • GRF Configuration Guide 1.4, GA22-7366 • GRF Reference Guide 1.4, GA22-7367 • GRF 400/1600 Getting started 1.4, GA22-7368 • SP Switch Router Adapter Guide for 1.4, GA22-7310 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 329: How To Get Itso Redbooks
How to Get ITSO Redbooks This section explains how both customers and IBM employees can find out about ITSO redbooks, CD-ROMs, workshops, and residencies. A form for ordering books and CD-ROMs is also provided. This information was current at the time of publication, but is continually subject to change. The latest information may be found at http://www.redbooks.ibm.com/.
Page 330: How Customers Can Get Itso Redbooks
The intent is to get the information out much quicker than the formal publishing process allows. IBM 9077 SP Switch Router: Get Connected to the SP Switch IBMMAIL usib6fpl at ibmmail...
Page 331: Ibm Redbook Order Form
IBM Redbook Order Form Please send me the following: Title First name Company Address City Telephone number Invoice to customer number Credit card number Credit card expiration date We accept American Express, Diners, Eurocard, Master Card, and Visa. Payment by credit card not available in all countries.
Page 332 IBM 9077 SP Switch Router: Get Connected to the SP Switch...
Page 333: List Of Abbreviations
List of Abbreviations Access Control List Advanced Interactive Executive Adapter Membership Group Abstract Notation Syntax All Points Addressable Application Programming Interface Address Resolution Protocol Asynchronous Transfer Mode Boot/Install Server Berkeley Software Distribution BUMP Bring-Up Microprocessor Crown Prince Central Processing Unit Communication Subsystem Control Workstation...
Page 334 Performance Toolbox Parallel Extensions PTX/6000 Performance Toolbox/6000 Permanent Virtual Circuit Random Access Memory IBM 9077 SP Switch Router: Get Connected to the SP Switch Remote Copy Protocol Resource Monitor RMAPI Resource Monitor Application Programming Interface Request for Product Quotation Remote Statistics...
Page 335: Index
Index Symbols /etc/bridged.conf 144 /etc/fstab 77 /etc/grarp.conf 112 /etc/gratm.conf 111 /etc/grclean.conf 78 /etc/grclean.logs.conf 78 /etc/grdev1.conf 86 /etc/grifconf.conf 130 /etc/grifconfig.conf 86 /etc/grlamap.conf 138 /etc/grroute.conf 217 /etc/hosts 204 /etc/inetd.conf 286 /etc/motd 287 /etc/rc.boot 77 /etc/rc.local 287 /etc/rc.routes 213 /etc/Release 263 /etc/services 64 /etc/snmpd.conf 41 /etc/SP/expected.top.annotated 91 /etc/syslog.conf 78...
Page 336 48 sphardware 52 splstdata 84 spmon 3 sysctl 301 xterm -e telnet 72 IBM 9077 SP Switch Router: Get Connected to the SP Switch command line interface see CLI communications bus 28 Control Workstation see CWS crosspoint switch 13...
Page 337 fault service daemon 4 FDDI 6 backbone 126 concentrator 126 dual attached station 121 dual homing 125 interface 128 media card 162 single attached stations 121 FDX 105 Fiber Distributed Data Interchange see FDDI fiber optic attachment 127 FIFO 38 filtering table 144 fragmented 95 Frame Relay 95...
Page 338 MTU MCA bus 13 media adapter 16 media board 37 media card 16 media card slots 25 IBM 9077 SP Switch Router: Get Connected to the SP Switch media statistics 109 MIB 59 mib2d 100 microchannel 6 microchannel bus 16...
Page 339 disk 75 interface 79 modem card 34 slot 34 performance limitation 7 Permanent virtual circuits 112 perspectives 52 physical interface 112 physical interface number 127 point-to-multipoint 119 point-to-point 115 point-to-point connection 111 Primary Backup 51 primary node 61 primary router 66 Protocol Data Unit 152 protocol layer 143 PVC 112...
Page 340 31 thin node 6 topology database 21 traffic control 9 transfer rate 108 transmit buffer 19 IBM 9077 SP Switch Router: Get Connected to the SP Switch transparent bridging 142 UDP 23 UDP port 3 update packets 21 VCI 111...
Page 341: Itso Redbook Evaluation
ITSO Redbook Evaluation IBM 9077 SP Switch Router: Get Connected to the SP Switch SG24-5157-00 Your feedback is very important to help us maintain the quality of ITSO redbooks. Please complete this questionnaire and return it using one of the following methods: •...
Page 342 IBM 9077 SP Switch Router: Get Connected to the SP Switch SG24-5157-00...

IBM 9077 Get Connected

Figures

Preface

Part 1. Introducing and Installing the GRF

Chapter 1. Dependent Node

Chapter 2. Router Node

Tables

Part 2. Scenarios

Chapter 3. Installation and Configuration

Chapter 4. Configuration of IP-Forwarding Media Cards

Chapter 5. Single RS/6000 SP and Single SP Switch Router

Chapter 6. Multiple RS/6000 Sps and One SP Switch Router

Chapter 7. Multiple RS/6000 Sps and Multiple Grfs

Appendix A. Laboratory Hardware and Software Configuration

Appendix B. GRF Configuration Files

Appendix C. Hardware and Software Information

Quick Links

Related Manuals for IBM IBM 9077

Summary of Contents for IBM IBM 9077