Front cover OpenPower 720 Technical Overview and Introduction Deskside and rack-mount server for managing e-business Outstanding performance based on POWER5 processor technology From Web servers to integrated cluster solutions Giuliano Anselmi Gregor Linzmeier Wolfgang Seiwald Philippe Vandamme Scott Vetter Redpaper...
Page 3
International Technical Support Organization IBM Sserver OpenPower 720 Technical Overview and Introduction October 2004...
IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.
UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, and service names may be trademarks or service marks of others. OpenPower 720 Technical Overview and Introduction...
Sales Organization in Salzburg, Austria. He holds a Diplomingenieur degree in Telematik from the Technical University of Graz. The main focus of his work for IBM in the past five years has been in the areas of the IBM Sserver pSeries systems and the IBM AIX operating system.
IBM Germany Become a published author Join us for a two- to six-week residency program! Help write an IBM Redbook dealing with specific products or solutions, while getting hands-on experience with leading-edge technologies. You'll team with IBM technical professionals, Business Partners and/or customers.
Page 12
Two media bays only accept slim line media devices, such as DVD-ROM or DVD-RAM, and one half-height bay is used for a tape drive. The OpenPower 720 also has I/O expansion capability using the RIO-2 bus, which allows attachment of the 7311 Model D20 I/O drawers.
British Thermal Unit 1.2 Physical package The following sections discuss the major physical attributes found on an OpenPower 720 in rack-mounted and deskside versions (Figure 1-1 on page 4), as shown in Table 1-2. The OpenPower 720 is a 4U, 19-inch rack-mounted system or deskside system depending on the feature code selected.
19-inch rack, thereby enabling efficient use of computer room floor space. If the IBM 7014-T42 rack is used to mount the OpenPower 720, it is possible to place up to 10 systems in an area of 644 mm (25.5 inches) x 1147 mm (45.2 inches).
Figure 1-2 Detailed views of the OpenPower 720 rack-mount system 1.3 Minimum and optional features The OpenPower 720 system is based on a flexible, modular design, and it features: Up to two processor books using the POWER5 chip, for a 1-way, 2-way, or 4-way...
2-way, and 1.65 GHz 2-way cards that share 1.9 MB of L2 on chip cache and eight slots for memory DIMMS using DDR1 technology. 36 MB of L3 cache is available on the 2-way cards. Capacity on Demand (CoD) is not available on the OpenPower 720. For a list of available cards; see Table 1-3.
For today’s administration tasks, an internal diskette drive is not state-of-the-art. In some situations, the external USB 1.44 MB diskette drive for OpenPower 720 systems (FC 2591) is helpful. This super-slim-line and lightweight USB V2 attached diskette drive takes its power requirements from the USB port.
1.3.5 I/O drawers The OpenPower 720 has five internal PCI-X slots, where four of them are long slots and one is a short slot. If more PCI-X slots are needed, especially well-suited to extend the number of LPARs and Micro-Partitions, up to eight Model 7311 Model D20 I/O drawers can be attached to the rack-mount OpenPower system.
Reserved ports Rack indicator Figure 1-3 7311-D20 I/O drawer Note: The 7311 Model D20 I/O drawer is designed to be installed by an IBM service representative. I/O drawers and usable PCI slots Only the 7311 Model D20 I/O drawer is supported on an OpenPower 720 system. Depending on the system configuration, the maximum number of I/O drawers supported is different.
HMC software required for POWER5 processor-based systems (FC 0961). To upgrade an existing POWER4 HMC: Order FC 0961 for your existing HMC. Please contact your IBM Sales Representative for help. Call you local IBM Service Center and order APAR MB00691.
Page 21
SKU Identifier will be printed on the packing list and on a label (readable and barcode) on the outside of the box. Also it will appear on invoices and billing statements. The SKU Identifier helps improve IBM Distributors’ inventory management. The SKU Identifier numbers for OpenPower Express configurations are listed in Table 1-7 above.
The OpenPower 720 uses a 4U rack-mounted server drawer. If an OpenPower 720 system is to be installed in a non-IBM rack or cabinet, you should ensure that the rack conforms to the EIA standard EIA-310-D (see 1.5.6, “OEM rack” on page 16).
For detailed power cords requirements and power cord feature codes, see the publication IBM Eserver Planning Information, SA38-0508. An online copy can be found at Maps of pSeries books to the information center → Planning → Printable PDFs → Planning: http://publib16.boulder.ibm.com/infocenter/eserver/v1r2s/en_US/index.htm...
1.5.4 Rack-mounting rules for OpenPower 720 The primary rules that should be followed when mounting the OpenPower 720 into a rack are: The system is designed to be placed at any location in the rack. For rack stability, it is advisable to start filling a rack from the bottom.
DVD-RAM disk are as follows: up to 2.6 GB, 4.7 GB, 5.2 GB, and 9.4 GB Flat panel display options The IBM 7316-TF3 Flat Panel Console Kit can be installed in the system rack. This 1U console uses a 15-inch thin film transistor (TFT) LCD with a viewable area of 304.1 mm x 228.1 mm and a 1024 x 768 pels...
HMC to the OpenPower 720 system it controls. 1.5.6 OEM rack The OpenPower 720 can be installed in a suitable OEM rack, provided that the rack conforms to the EIA-310-D standard. This standard is published by the Electrical Industries Alliance, and a summary of this standard is available in the publication Site and Hardware Planning Information, SA38-0508.
Page 27
Figure 1-5 shows the drawing specifications for OEM racks. Figure 1-5 Reference drawing for OEM rack specifications Chapter 1. General description...
Page 28
OpenPower 720 Technical Overview and Introduction...
This architecture makes the chip appear as a 4-way symmetric multiprocessor to the operating system. The POWER5 processor core has been designed to support both enhanced simultaneous multi-threading (SMT) and single threaded (ST) operation modes. OpenPower 720 Technical Overview and Introduction...
2.1.1 Simultaneous multi-threading As a permanent requirement for performance improvements at the application level, simultaneous multi-threading (SMT) functionality is embedded in the POWER5 chip technology. Developers are familiar with process-level parallelism (multi-tasking) and thread-level parallelism (multi-threads). SMT is the next stage of processor saturation for throughput-oriented applications to introduce the method of instruction-level parallelism to support multiple pipelines to the processor.
2.1.4 CMOS, copper, and SOI technology IBM Systems and The POWER5 processor design is a result of a close collaboration between Technology Group IBM Microelectronics Technologies that enables IBM Sserver OpenPower systems to give customers improved performance, reduced power OpenPower 720 Technical Overview and Introduction...
Access to memory behind another processor is accomplished through the fabric buses. The OpenPower 720 supports up to two processor cards (each card is a 2-way) or a single 1-way card. Each 2-way processor card has a single DCM containing a POWER5 processor chip and a 36 MB L3 module.
Figure 2-5 Processor card with DDR1 memory socket layout view 2.2.1 Available processor speeds The OpenPower 720 operates with a processor clock rate of 1.65 GHz for 2 and 4-way POWER5 processor-based systems and 1.5 GHz for 1 and 2-way systems.
OEM memory, you could experience unexpected and unpredictable behavior. All IBM memory is identified by an IBM logo and a white label printed with a barcode on top and an alphanumeric string on the bottom, created according to the rule reported in Figure 2-7.
Figure 2-7 IBM memory certification label Sometimes OEM vendors put a label reporting the IBM memory part number but not the barcode or the alphanumeric string, or both on their DIMMs. In case of system failure caused by OEM memory installed in the system, the first thing to do is to replace the suspected memory with IBM memory and check whether the problem is corrected.
OpenPower 720 to a local area network (LAN). See the Table 2-1 for the list of additional LAN adapters available at the time of writing. IBM supports an installation with NIM using an Ethernet adapter (CHRP is the platform type).
Enablement Card (FC 1976) is installed (see 2.7.3, “RAID options” on page 29). The OpenPower 720 supports a split 8-pack disk drive backplane that is designed for hot-pluggable disk drives. The disk drive backplane docks directly to the system planar. The virtual SCSI Enclosure Services (VSES) hot-plug control functions are provided by the Ultra320 SCSI controllers.
VXA 80/160 GB tape (LVD) 2.7.2 Internal SCSI disks The OpenPower 720 can have up to eight disk drives plugged in the two 4-pack disk drives backplanes. The two 4-pack disk drives backplanes can accommodate the devices listed in Table 2-4 on page 29.
OpenPower 720 system. 2.8.1 I/O drawers As described in Chapter 1, “General description” on page 1, the OpenPower 720 system has five internal PCI-X slots, which is enough for average customer configurations. If more PCI-X slots are needed to dedicate more adapters to a partition or to increase the bandwidth of network adapters, up to eight 7311 model D20 I/O drawers can be added to the OpenPower 720 system.
As described in the 2.8, “External I/O subsystem” on page 30, you can connect up to four I/O drawers in the same loop and up to eight I/O drawers to the OpenPower 720 system. Each RIO-2 port can operate at 1 GHz in bidirectional mode and is capable of passing data in each direction on each cycle of the port.
OpenPower system to SPCN port 0 on the first I/O drawer. The loop is closed connecting the SPCN port 1 of the I/O drawer back to the port 1 of the OpenPower 720 system. If you have more than one I/O drawer, you continue the loop connecting the following drawer (or drawers) with the same rule.
OpenPower 720 supports. IBM 2104 Expandable Storage Plus The IBM 2104 Expandable Storage Plus Model DS4 is a low-cost 3U disk subsystem that supports up to 14 Ultra320 SCSI disks from 18.2 GB up to 146.8 GB, at the time this publication was written.
Fibre Channel adapter (FC 1977). Model 700 provides up to 64 bootable partitions. In most cases, both the FAStT Storage server and the OpenPower 720 or the 7311 Model D20 I/O drawers are connected to a storage area network (SAN). If only space for the rootvg is needed, the FAStT Model 100 is a good solution.
2.9.2 Virtualization As an optional feature of the OpenPower 720, logical partitions requiring dedicated resources may now be able to take advantage of a new technology that allows resources to be virtualized, allowing for a better overall balance of global system resources and their effective utilization.
Page 46
It is preferred that you use the Virtual I/O server in a partition with dedicated resources to help ensure stable performance. The two major functions that are provided from the Virtual I/O Server are described in the following sections. OpenPower 720 Technical Overview and Introduction...
SP hardware (Figure 2-13 on page 37). The OpenPower 720 uses the SP implementation. The key components include a FSP-Base (FSP-B) and an Extender chipset (FSP-E). FSP-B and FSP-E are implemented on a dedicated card.
Two service processor communications interfaces, accessible only though the service processor communications ports of OpenPower 720 on the rear side. At the time of writing, the System Management Interface (SMI) is usable if a connection is established to service processor communications port 1.
Page 49
to set flags that affect the operation of the system, according to the provided password, such as auto power restart, to view information about the system (such as the error log and VPD), network environment access setup, and to control the system power. You can start and shut down the system in addition to setting IPL options.
– When the Partition Standby power-on is completed, the operator panel on the managed system displays LPAR..., indicating the managed system is ready for you to use the HMC to partition its resources and, possibly, activate them. OpenPower 720 Technical Overview and Introduction...
– When a partition is activated, the HMC requires you to select the boot mode of the single partition. System Profile The System Profile option powers on the system according to a predefined set of profiles. The profiles are activated in the order in which they are shown in the system profile. Partition autostart This option powers on the managed system to partition standby mode and then activates all partitions that have been designated autostart.
The default uncapped weight is 128. 2.11.7 System Management Service Either booting up a full partition system or a logical partition to System Management Services (SMS), the ASCII interface or the GUI are identical in contents and functionality. OpenPower 720 Technical Overview and Introduction...
NIM server. 2.11.8 Boot options The OpenPower 720 handles the boot process in a way that is similar to other IBM UNIX servers. The initial stage of the boot process is to establish that the machine has powered up correctly and the memory and CPUs are functioning correctly.
4-pack DASD backplane the preferred boot device. See Figure 2-15 to locate all of the disk bays. Figure 2-15 Disk bays and SCSI addresses within a OpenPower 720 When SMS menus are available, the Select Boot Options menu can be used to view and set various options regarding the installation devices and boot devices: 1.
Virtual Ethernet to accomplish that. 2.11.10 Security The OpenPower 720 system allows you to set two different types of passwords to limit the access to these systems. These are defined in the ASMI menus. This password is usually general ID password used by the system administrator.
Page 56
For the latest in IBM Linux news, subscribe to the Linux Line. See: https://www6.software.ibm.com/reg/linux/linuxline-i Many of the features described in this document are operating system dependant and may not be available on Linux. For more information, check: http://www.ibm.com/servers/eserver/pseries/linux/whitepapers/linux_pseries.html Linux support IBM only supports the Linux systems of customers with a SupportLine contract covering Linux.
3.1 Reliability, availability, and serviceability Excellent quality and reliability are inherent in all aspects of the IBM Sserver OpenPower design and manufacturing. The fundamental objective of the design approach is to minimize outages. The RAS features help to ensure that the system operates when required, performs reliably, and efficiently handles any failures that might occur.
For more information, see “Dynamic or persistent deallocation” on page 51. 3.1.3 Permanent monitoring The SP included in the OpenPower 720 provides a means to monitor the system even when the main processor is inoperable. See the following subsections for a more detailed description of monitoring functions in an OpenPower 720.
ECC logic. This function is a hardware function on the memory controller chip and does not influence normal system memory performance. 3.1.5 N+1 redundancy The use of redundant parts allows the OpenPower 720 to remain operational with full resources: Redundant spare memory bits in L1, L2, L3, and main memory...
I/O adapters or devices on that bus will be deconfigured. The OpenPower 720 supports PCI Extended Error Handling (EEH) if it is supported by the PCI-X adapter. In the past, PCI bus parity errors caused a global machine check interrupt, which eventually required a system reboot in order to continue.
Error indication and LED indicators The OpenPower 720 is designed for customer setup of the machine and for the subsequent addition of most hardware features. The OpenPower 720 also allows customers to replace service parts (Customer Replaceable Unit). To accomplish this, the system provides internal LED diagnostics that will identify parts that require service.
Power subsystems PCI-X adapter cards 3.2 Manageability The functions and tools provided for IBM Sserver OpenPower systems are described in the next sections. 3.2.1 Service processor With system in power standby mode, or with an operating system in control of the machine, or controlling the related partition, the SP is working and checking the system for errors, ensuring the connection to the HMC for manageability purposes.
Figure 3-2 Advanced System Management main menu 3.2.2 Service Agent Service Agent is an application program that operates on an OpenPower, p5, pSeries or IBM RS/6000 computer and monitors them for hardware errors. It reports detected errors, assuming they meet certain criteria for criticality, to IBM for service with no customer intervention.
The OpenPower 720 is supported with the Cluster 1600 running CSM for AIX, V1.3.1. To attach a OpenPower 720 to a Cluster 1600, an HMC is required. One HMC can also control Chapter 3. RAS and manageability...
Page 66
OpenPower systems that are part of the cluster. If a OpenPower 720 is configured in partition mode (with physical or virtual resources) is part of the cluster, all partitions must be part of the cluster. (Check with your IBM support representative for the availability of this feature).
Page 67
The base security setup is all done automatically at install time. CSM Version 1.4 on AIX and Linux (planned 4Q04) The CSM V1.4 on Linux introduces an optional IBM CSM High Availability Management Server feature, designed to allow automated failover of the CSM management server to a backup management server.
Page 68
OpenPower 720 Technical Overview and Introduction...
IBM Sserver Hardware Management Console for pSeries Installation and Operations Guide, SA38-0590, provides information to operators and system administrators on how to use a IBM Hardware Management Console for pSeries (HMC) to manage a system. It also discusses the issues associated with logical partitioning planning and implementation.
IBM online sales manual http://www.ibmlink.ibm.com Linux for IBM Sserver pSeries http://www.ibm.com/servers/eserver/pseries/linux/ Microcode Discovery Service http://techsupport.services.ibm.com/server/aix.invscoutMDS POWER4 system micro architecture, comprehensively described in the IBM Journal of Research and Development, Vol 46 No.1 January 2002 http://www.research.ibm.com/journal/rd46-1.html SCSI T10 Technical Committee http://www.t10.org Silicon-on-insulator (SOI) technology http://www.ibm.com/chips/technology/technologies/soi/...
Help from IBM IBM Support and downloads ibm.com/support IBM Global Services ibm.com/services Related publications...
Page 72
OpenPower 720 Technical Overview and Introduction...
Page 74
Back cover ® OpenPower 720 Technical Overview and Introduction Redpaper Deskside and This document is a comprehensive guide covering the IBM INTERNATIONAL Sserver OpenPower 720 UNIX servers. We introduce major rack-mount server for TECHNICAL hardware offerings and discuss their prominent functions.