Front cover xSeries 440 Planning and Installation Guide Describes the technical details of the x440 models Helps you prepare for and perform an installation Covers key IBM Director management tools David Watts Reza Fanaei Aghdam Duncan Furniss Jason King ibm.com/redbooks...
Page 3
International Technical Support Organization IBM ^ xSeries 440 Planning and Installation Guide October 2002 SG24-6196-00...
IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.
SET, SET Secure Electronic Transaction, and the SET Logo are trademarks owned by SET Secure Electronic Transaction LLC. Other company, product, and service names may be trademarks or service marks of others. IBM ^ xSeries 440 Planning and Installation Guide viii...
Preface The IBM ^ xSeries 440 is IBM’s flagship industry standard server and is the first full implementation of the 32-bit IBM XA-32 chipset, code named “Summit”, as part of the Enterprise X-Architecture strategy. The x440 provides new levels of high availability and price performance, and offers scalability from two-way to 16-way SMP, from 2 GB to 128 GB of memory, and up to 24 PCI slots, all in one single system image.
Page 12
Solutions and Implementing IBM Director Management Solutions . He has a Bachelor of Engineering degree from the University of Queensland (Australia) and has worked for IBM for over 13 years. He is an IBM ^ Certified Specialist for xSeries and an IBM Certified IT Specialist.
Page 13
Ron Humphrey, Technical Project Manager, Active PCI Manager, Seattle Koichi Kii, Development Manager, Active PCI Manager, Seattle Grace Lennil, IBM Center for Microsoft Technologies, Seattle David A McIntosh, Technical Specialist, xSeries Techline, Greenock John McAbel, World Wide Cluster Offering Product Manager, Beaverton...
Keith Olsen, Gabriel Sallah, and Chandrasekhara Seetharaman. Become a published author Join us for a two- to six-week residency program! Help write an IBM Redbook dealing with specific products or solutions, while getting hands-on experience with leading-edge technologies. You'll team with IBM technical professionals, Business Partners and/or customers.
Technical description Chapter 1. The IBM ^ xSeries 440 is the latest IBM top-of-the-range server and is the first full implementation of the 32-bit IBM XA-32 chipset, code named “Summit” as part of the Enterprise X-Architecture strategy. The x440 provides new levels of high availability and price performance, and offers scalability beyond a single server.
1.1 The x440 product line The models of the x440 are being made available throughout 2002. This is because the complexity associated with developing the new IBM XA-32 chipset, formerly known by its code name “Summit”, has meant additional development...
Page 17
products. Additional testing pertains directly to the complexity of multiple SMP configurations and the time commitment required for testing the ServerProven list against each of these configurations. All of the capabilities of the x440, including 16-way SMP capability and remote I/O sharing, were announced in March 2002, but as a result of this additional configuration development and testing, the x440 configurations will be introduced in multiple phases during 2002 and 2003 as testing is completed.
Page 18
Figure 1-3 on page 5. This will be available in early 2003. Each of these configurations can optionally also have an RXE-100 attached (see Figure 1-2 on page 5 for an example). IBM ^ xSeries 440 Planning and Installation Guide...
Page 19
RXE expansion connections RXE-100 SMP expansion 6 PCI-X slots connections 12 PCI-X slots One 16-way complex Each xSeries 440 has: Eight CPUs 4-64 GB memory Figure 1-2 16-way server configuration using two eight-way x440 nodes One eight-way complex One 12-way complex x440 node 1: x440 node 1: Four CPUs...
ESX Server does not, however, support hot-adding of hardware (such as disks and adapters). For more information on ESX Server, see the redbook Server Consolidation with the IBM ^ xSeries 440 and VMware ESX Server , SG24-6852 and 3.5.7, “VMware ESX Server” on page 98. Physical partitioning This form of partitioning is available in 4Q 2002 with the release of System Partition Manager, a plug-in for IBM Director.
PCI bridges — two PCI bridges, code named “Winnipeg”, per x440 located on the centerplane and the I/O board that control both the PCI-X and Remote I/O Figure 1-4 on page 8 shows the various IBM XA-32 components in a four-way x440 configuration.
Page 22
Module or four CPUs in two SMP Expansion Modules. central electronics complex SMP Expansion Tip: The terms , and Module are used interchangeably in relation to the x440. We use SMP Expansion Module in this redbook. IBM ^ xSeries 440 Planning and Installation Guide...
Page 23
The CPUs are connected together with a 100 MHz frontside bus, but supply data at an effective rate of 400 MHz using the “quad-pump” design of the Intel NetBurst architecture as described in 1.4.1, “Intel Xeon Processor MP” on page 13. To ensure the processors are optimally used, the x440 has a 32 MB XceL4 Server Accelerator Cache, comprised of 200 MHz DDR memory.
Page 24
SMP Expansion Module is installed to form an eight-way system (Figure 1-5), the second RXE port, labeled “RXE Expansion Port B”, connects to the memory controller of the second SMP Expansion Module. IBM ^ xSeries 440 Planning and Installation Guide...
Page 25
As of November 2002, you can connect two x440 servers together to form one 16-way complex. The two x440 nodes are connected together using all three SMP Expansion Ports as shown in Figure 1-6. CEC 1 CEC 2 CPU 1 CPU 2 CPU 3 CPU 4...
SMP Expansion Modules. There is no further upgrade beyond four Xeon DP processors, other than replacing them with Xeon MP processors. See 3.1.1, “Processors” on page 64 for further discussion about what you should consider before implementing an x440 solution. IBM ^ xSeries 440 Planning and Installation Guide...
There is an additional 8 KB for data related to those instructions, for a total of 20KB. The x440 also implements a Level 4 cache as described in 1.6, “IBM XceL4 Server Accelerator Cache” on page 19.
Page 28
(APIC). For example, Figure 1-9 shows a 16-way x440 complex running Datacenter Server with Hyper-Threading enabled. Figure 1-9 Datacenter sees 32 processors when Hyper-Threading is enabled on a 16-way configuration IBM ^ xSeries 440 Planning and Installation Guide...
Page 29
Each logical processor can be individually halted, interrupted, or directed to execute a specified thread, independently from the other logical processor on the chip. Unlike a traditional two-way SMP configuration that uses two separate physical processors, the logical processors share the execution resources of the processor core, which include the execution engine, the caches, the system bus interface, and the firmware.
The Xeon DP was designed by Intel to be suitable only in uniprocessor and two-way SMP processor systems. However, with the use of the IBM XA-32 chipset, the x440 can have up to four Xeon DP processors installed. The Xeon DP models of the x440 models use 2.4 GHz processors, part 37L3533.
Feature Xeon Processor DP Xeon Processor MP Supported in multi-node configurations Core frequency (x440 models) 2.4 GHz 1.4, 1.5, 1.6, 1.9, or 2.0 GHz Level 2 cache 512 KB 256 KB Level 3 cache None 512 KB, 1 MB or 2 MB For more information about the features of the Xeon Processor DP, go to: 1.5 SMP Expansion Module The SMP Expansion Module is the central electronics complex that contains the...
Page 32
The third scalability port is not used in this single-node eight-way configuration. Each SMP Expansion Module is also equipped with the following LEDs for Light Path Diagnostics: Each DIMM Each CPU Each VRM SMP Expansion Module board IBM ^ xSeries 440 Planning and Installation Guide...
1.6 IBM XceL4 Server Accelerator Cache Integrated into each SMP Expansion Module is 32 MB of high-speed Level 4 cache (see Figure 1-10). This XceL4 Server Accelerator Cache provides the necessary extra level of cache to alleviate the bottlenecks caused by memory latency across the scalability port.
Page 34
LEDs to guide you to the defective DIMM. If memory mirroring is enabled, then the mirrored copy of the data in the damaged DIMM is used until the system is powered down and the DIMM replaced. IBM ^ xSeries 440 Planning and Installation Guide...
Page 35
Memory mirroring Memory mirroring is roughly equivalent to RAID-1 in disk arrays, in that memory is divided in two ports and one port is mirrored to the other half (see Figure 1-12). If 8 GB is installed, then the operating system sees 4 GB once memory mirroring is enabled (it is disabled in BIOS by default).
Page 36
3. Provided that memory mirroring is enabled, the third chip failure on that port would send the alert and take the DIMM offline, but keep the system running out of the redundant memory bank. IBM ^ xSeries 440 Planning and Installation Guide...
Note: The ability to hot-replace a failed DIMM or hot-add additional DIMMs are currently not supported. 1.8 PCI subsystem As shown in Figure 1-4 on page 8, there are six PCI-X slots internal to the x440: Two 133 MHz slots, which accept 32 or 64-bit, 3.3 V, PCI or PCI-X adapters, from 33-133 MHz Two 100 MHz slots, which accept 32 or 64-bit, 3.3 V, PCI or PCI-X adapters, from 33-100 MHz...
Two hot-swap power supplies with separate power cords. Note: For large configurations, redundancy is achieved only when connected to a 220 V power supply. See 3.8, “Power considerations” on page 103 for details. IBM ^ xSeries 440 Planning and Installation Guide...
Two hot-swap hard disk drive bays. An optional ServeRAID adapter can be configured to form a RAID-1 disk array for the operating system. The memory subsystem has a number of redundancy features, including memory mirroring, as described in 1.7, “System memory” on page 19. The layout of the front panel of the x440, showing the location of the drive bays, power supplies and fans, is shown in Figure 1-13.
Page 40
The system-error LED remains in the Remind mode until one of the following situations occurs: All known problems are resolved The system is restarted A new problem occurs, at which time it then is illuminated continuously IBM ^ xSeries 440 Planning and Installation Guide...
(green) COM port Figure 1-15 Remote Supervisor Adapter connectors The Remote Supervisor Adapter offers the following capabilities: In-band and out-of-band remote server access and alerting through IBM Director Full Web browser support with no other software required Enhanced security features...
Hyper-Threading. Optimized indicates that the operating system recognizes the logical processors and the operating system code has been designed to fully take advantage of the technology. IBM ^ xSeries 440 Planning and Installation Guide...
Page 43
Table 1-3 x440 operating system support Description Release SMP support Hyper-Threading support Windows 2000 Server SP2/3 Supports up to four-way Windows 2000 Advanced Server SP2/3 Supports up to eight-way Windows 2000 Datacenter Server Supports up to 32-way Windows NT Enterprise Edition Only supports four-way on the None x440...
However, a virtual machine (VM) can consist of no more than one processor. 16-way support will require Version 1.5.1. 1.13 IBM Director IBM Director is designed to manage all platforms in the Intel environment and support a variety of operating systems. IBM Director 3.1 supports IBM Enterprise X-Architecture capabilities, including Remote I/O via the IBM RXE-100 Remote Expansion Enclosure and the new Real Time Diagnostics feature of the x440.
Page 45
This utility works in concert with the IBM family of systems management processors and adapters described previously. IBM Director 3.1 added management support for the RXE-100 Remote I/O unit.
Page 46
Electronic Service Agent — Electronic Service Agent enables the Director server to contact IBM automatically in the event of a fault condition. Data gathered by IBM Director that is relevant to the fault is included in the message, in most cases allowing IBM service to respond to the condition without the need for additional details.
Page 47
IBM, including providing a contact name and phone number, and is available for systems covered under warranty or maintenance agreements. Electronic Service Agent currently requires the use of an analog phone line and modem. Access via VPN may be possible in future releases.
Page 48
IBM ^ xSeries 440 Planning and Installation Guide...
Although many applications such as file, print, and terminal servers do not scale well beyond two processors, the four-way x440 can be a good platform on which to consolidate those distributed applications. For example, using IBM ^ xSeries 440 Planning and Installation Guide...
Page 51
VMware many file and print servers that are distributed around the enterprise can be consolidated to a four-way x440 server, reducing the TCO. Using logical partitioning with four-way configurations can produce a one-box cluster solution for small-to-medium-sized businesses (SMB) that need to protect their mission-critical applications and files.
The x440 covers all high-availability features for customers looking for servers to power their SCM solutions. Also, the x440 can be considered as an IBM ^ xSeries 440 Planning and Installation Guide...
Page 53
Internet capabilities that help an enterprise manage customer relationships in an organized way. With the Intel Xeon Processor MP and the IBM XceL4 cache, the x440 provides a performance-based foundation upon which customers can build and deploy CRM solutions. The x440 will most likely be implemented as an application server and/or a database server.
The 16-way configuration can deliver a highly reliable and capable platform for customers who need to run multiple instances of databases that can scale beyond eight processors. Key database software vendors include IBM (DB2), Microsoft (SQL Server), and Oracle. Messaging/collaboration: The four-way x440 with its high-availability features is a good platform for messaging/collaboration applications.
These types of servers benefit from the processing power offered by the x440. Key e-business software vendors include IBM (WebSphere) and BEA. 2.1.4 Clustering A cluster is group of independent computers, also known as nodes, that are linked together to provide highly available resources (such as file shares) for a network.
Page 56
You can consolidate four clusters of two machines each to two physical machines with four virtual machines each. This provides protection from both hardware and software failures. IBM ^ xSeries 440 Planning and Installation Guide...
In this section we describe the major benefits of x440. 2.2.1 IBM XA-32 chipset The IBM XA-32 chipset contains advanced core logic, which determines how the various parts of a system (microprocessors, system cache, main memory, I/O, etc.) interact.
This chipset is built on IBM’s advanced copper 0.13-micron technology, which creates faster, lower power-consuming and heat-producing chips. So servers built with the chipsets will run faster, have lower power costs, and require less cooling, which increases reliability and reduces TCO.
Page 59
The Xeon DP is similar to the Xeon MP and is also based on the Intel NetBurst micro-architecture. The Xeon DP was designed by Intel to only support two-way SMP. However, with the use of the IBM XA-32 chipset, the x440 can have up to four Xeon DP processors installed.
Memory ProteXion would provide the first layer of protection. Each memory port could then sustain a second chipkill without shutting down. Provided that Active Memory with memory mirroring is enabled, the third chipkill IBM ^ xSeries 440 Planning and Installation Guide...
on that port would send the alert and take down the DIMM, but keep the system running out of the redundant memory bank. To maintain throughput to the processors, the x440 memory subsystem improves performance by the use of four-way interleaving. Interleaving improves memory performance because multiple 64-bit objects can be transferred into the memory controller in a single operation.
The other feature of System Partition Manager is chassis failure recovery. If the operating system crashes in a multi-node partition due to a failure of one of the chassis, System Partition Manager can generate an alert event to IBM Director, notifying the administrator to manually reconfigure the partition or initiating additional events to automatically reconfigure the multi-node partition and thus restart the chassis in that partition.
2.3 The benefits of system partitioning System partitioning is virtualization of system resources, including processor, memory, I/O, and storage so that all concurrent users appear to have access to the system, although each user is actually segmented and protected from the actions of other users.
Page 64
Physical partitioning includes two different types: – Static partitioning, which can be implemented using IBM System Partition Manager, requires the nodes being adjusted to be taken offline. The remaining nodes in the server are unaffected and continue to operate normally.
Using IBM technology such as memory mirroring, Chipkill Memory, Memory ProteXion and system partitioning, customers can implement high-availability cluster solutions. Scalable clusters provide customers with industry-leading scalability at a system level, as well as load balancing to maximize performance and the support received by users accessing the system.
Page 66
Hong Hong Sydney Kong Angeles Kong Figure 2-4 Centralization Centralization involves relocating existing servers to fewer sites, for example, taking 20 servers scattered over three floors in your building and moving them IBM ^ xSeries 440 Planning and Installation Guide...
Page 67
to a single server room, or moving 200 servers originally installed across 20 locations to three data centers. – Relocating existing servers to one or fewer IT sites Centralization, or data center consolidation, may be a first step for an organization after a merger.
Page 68
This can take place within the same architecture -- for example, several two-way servers replaced with one 16-way x440 server or many uniprocessor servers moving to several multiprocessor x440 servers. IBM ^ xSeries 440 Planning and Installation Guide...
Page 69
With x440 capabilities such as system partitioning, you can migrate and consolidate workloads across systems for improvements in systems management and resource utilization. This approach is typically appropriate for implementations of key packaged applications such as SAP, PeopleSoft, and Siebel, where minimal integration with other applications and data is required.
Page 70
Physical consolidation does pretty much what it says: systems are relocated to a single server site. The number of servers you have to manage remains the same, and cost savings come from better staff utilization, higher service IBM ^ xSeries 440 Planning and Installation Guide...
levels, simplified backups and restores, and better asset management and security. Rational In combination, or rational, consolidation, the company's distributed applications and services are combined onto fewer servers. It is a considerably more complex undertaking, but the potential rewards are greater.
Page 72
There are several costs associated with server consolidation, including: – Hardware costs — new servers and infrastructure, upgrades – Software costs — fewer software licenses are required with fewer servers – Disruption costs — migration, change management IBM ^ xSeries 440 Planning and Installation Guide...
Page 73
Manageability and availability Server consolidation can help you improve manageability and availability of IT systems in the following ways: – Enterprise management - Integrated operations allows for consistent management of all facilities and IT services. – Consistent performance - Providing consistent response time at peak load periods is very important.
Page 74
Server consolidation can help you to run your business without interruption in the following ways: – Consolidating IT resources can help you ensure that critical business information and processes are accessible and shared across the enterprise. IBM ^ xSeries 440 Planning and Installation Guide...
Page 75
– Implementing critical new solutions that may enable a competitive edge is easier. Reduced technical complexity Three-tier logical architectures tend, in practice, to become five-tier architectures (client, local server, central server, gateway, and enterprise server). Server consolidation can simplify technical complexities by eliminating the true number of tiers in a purported three-tier architecture by reducing or eliminating central servers and gateways.
Page 76
IBM ^ xSeries 440 Planning and Installation Guide...
Key processor configuration rules: All CPUs used in a single-server (that is, two, four or eight-way) or multi-server (eight, 12 or 16-way) configuration must be the same type, speed, and L2/L3 cache size. IBM ^ xSeries 440 Planning and Installation Guide...
For servers with Xeon MP processors: – Ensure you order sufficient processors to maintain a supported configuration of two, four, or eight CPUs. Other quantities of CPUs (3, 5, 6, or 7) are not supported. – The standard SMP Expansion Module must have four processors installed before the second one can be installed and used.
Page 80
3). If you wish to install more than 26 GB in the standard SMP Expansion Module, you will need to remove the 512 MB DIMMs and fully populate the module with 2 GB DIMMs. IBM ^ xSeries 440 Planning and Installation Guide...
Page 81
SMP Expansion Modules are individually configured for memory mirroring in the BIOS. This means that as well as full memory mirroring, you can also enable memory mirroring only in one SMP Expansion Module. IBM recommends against this. Memory mirroring does not work across SMP Expansion Modules. You cannot set up four 512 MB DIMMs in the bottom SMP Expansion Module to be mirrored by four 512 MB DIMMs in the top SMP Expansion Module.
Bus B (slot 3 and slot 4): Two 64-bit 100 MHz slots (133 MHz if only one slot is occupied) Bus C (slot 5): One 64-bit 133 MHz slot Bus D (slot 6): One 64-bit 133 MHz slot IBM ^ xSeries 440 Planning and Installation Guide...
Page 84
32 or 64 33, 66, 100 or 133 32 or 64 33, 66, 100 or 133 The physical location of these slots in the server is shown in Figure 3-3 on page 71. IBM ^ xSeries 440 Planning and Installation Guide...
Page 85
PCI-X slot 4 PCI-X slot 3 (100 (100 PCI-X slot 5 PCI-X slot 2 (133 Back of server PCI-X slot 6 PCI-X slot 1 (133 MHz) Bus: D Figure 3-3 PCI-X slots in the x440 Other configuration information: The x440 server supports connection to the RXE-100. Refer to 3.2.3, “Remote Expansion Enclosure”...
Integrated Ethernet controller Active PCI Manager Active PCI Manager is an IBM Director extension that helps manage PCI and PCI-X adapters in supported xSeries servers. It includes an analyze function that will help you to plan and optimize the PCI and PCI-X adapter placement in the x440 and Remote Expansion Enclosure (RXE-100).
Page 87
Category 5 or better Ethernet cabling is required with RJ-45 connectors. If you plan to implement a Gigabit Ethernet connection, ensure your network infrastructure is capable of the necessary throughput to match the server’s I/O capacity. You will need to provide Ethernet cables for the onboard 10/100/1000 Ethernet controller.
CPU slots in the first enclosure are fully populated, the second SMP Expansion Module can be added. For detailed instructions on installing the second SMP Expansion Module, refer to Chapter 2, “Installing Options”, in the IBM ^ xSeries 440 Installation Guide , which is available from:...
Page 89
When a second SMP Expansion Module is installed in the x440, an additional three SMP Expansion Ports are made available on the rear of the chassis, giving a total of six. The SMP Expansion Module option includes two cables that are used to connect the modules together, as shown in Figure 3-5.
Page 90
The SMP Expansion Module ports cannot currently be used as high-speed interconnects for clustering purposes. The connections do not offer redundancy. If a connection is lost, the server will shut down or restart depending on your system’s configuration. IBM ^ xSeries 440 Planning and Installation Guide...
The x440 features an integrated Remote Supervisor Adapter (RSA). For detailed information on functionality and configuration of the RSA refer to section 9.5 “Remote Supervisor Adapter” in the redbook Implementing IBM Director Management Solutions , SG24-6188. This document talks about the Remote Supervisor Adapter as a separate adapter;...
For detailed instructions on cabling ASM interconnect networks, refer to section 9.11 “ASM Interconnect” in the redbook Integrating IBM Director with Enterprise Management Solutions , SG24-5388. Note: The x440 does not include the necessary dongle to connect the Remote Supervisor Adapter to an ASM interconnect bus using the RS-485 port on the adapter.
Page 93
RXE Expansion Port Bus: Slot: Figure 3-8 RXE-100 PCI-X expansion board (6 slots) For each of the three buses (A, B, C), one of the following can be installed: One 64-bit 3.3 V PCI-X 133 MHz adapter (in the odd-numbered slot), running at up to 133 MHz Two 64-bit 3.3 V PCI-X 133 MHz adapters running at up to 100 MHz Two 64-bit 3.3 V PCI or PCI-X, 33 or 66 MHz adapters...
Page 94
This cable connects from the x440 RXE Expansion Port A to the RXE-100 as shown in Figure 3-9 on page 81. Two lengths are available: – 3.5 m Remote I/O cable kit (part number 31P6102) – 8 m Remote I/O cable kit (part number 31P6103) IBM ^ xSeries 440 Planning and Installation Guide...
Page 95
RXE Expansion RXE Management Port Port A RXE Management A (in) Port RXE-100 RXE Management A (out) Port RXE Management B (in) Port RXE Expansion Port A Additional cable required if 12 PCI-X slots are installed in the RXE-100 Figure 3-9 Connecting the RXE-100 to the x440 With single-node configurations (that is only one x440 node in a two, four or eight-way configuration), only one RXE-100 can be connected using one Remote I/O cable as shown in Figure 3-9.
Page 96
RXE-100, as shown in Figure 3-9 on page 81. Two lengths are available: – 3.5 m interconnect management cable kit (part number 31P6087) – 8 m interconnect management cable kit (part number 31P6088) IBM ^ xSeries 440 Planning and Installation Guide...
UPS remote management), then a USB-to-serial adapter is required, such as the Belkin USB to Serial Adapter (part number 10K3661). Restriction: IBM USB Serial/Parallel Adapter (part number 22P5298) is not supported in the x440. It is also possible to configure the serial port on the Remote Supervisor Adapter to be sharable between the alerting functions of the adapter and the operating system.
See “Cabling a ServeRAID adapter” in Chapter 2 of the IBM ^ xSeries 440 Installation Guide for details. Typically the x440 will be attached to an external disk enclosure for data storage requirements. Some of the supported IBM storage options include:...
Page 99
For more information on IBM SCSI RAID storage solutions go to: IBM Fibre Array Storage Technology The IBM Fibre Array Storage Technology (FAStT) family of Fibre Channel storage solutions is designed for high-availability, high-capacity requirements. FAStT solutions can support transfers over distances up to 10 km (6.2 miles) at rates of up to 200 MBps.
Page 100
EXP500 enclosures. Each RAID controller unit also contains 128 MB of battery-backup cache. Tip: The FAStT200 ships with IBM FAStT Storage Manager 7.10. This version is not supported on the x440. See the following for details:...
Page 101
256 MB of battery-backed cache and this amount can be further expanded. The IBM TotalStorage FAStT700 Storage Server The FAStT700 Storage Server is the newest addition to the FAStT range of products. As with the FAStT 500 Storage Server, you would typically implement...
The logical devices access a logical volume that is implemented using multiple disk drives. This allows ESS to connect to all IBM servers, from zSeries to iSeries, pSeries and xSeries, directly or thorough a SAN, thus helping the x440 fit into a heterogeneous environment containing a variety of server architectures.
A detailed discussion on performance tuning disk subsystems in xSeries servers is available in the redbook Tuning IBM ^ xSeries Servers for Performance , SG24-5287. 3.3.3 Tape backup As with your disk subsystem, you need to carefully analyze backup requirements before a tape solution is selected.
A detailed discussion on planning, sizing, and implementing VMware solutions on the x440 can be found in the redbook Server Consolidation with the IBM ^ xSeries 440 and VMware ESX Server , SG24-6852. 3.5 Operating system considerations...
Page 105
additional logical processors and spawning multiple threads, which can exploit the additional processing power. As well as considering whether the operating system you are installing supports Hyper-Threading, there may be licensing implications to consider before enabling Hyper-Threading technology. For a more detailed discussion on Hyper-Threading technology, refer to: Table 3-2 lists the supported operating systems for the x440 and the level of support for Hyper-Threading technology provided by the operating system.
However, a virtual machine (VM) can consist of no more than one processor. 16-way support will require Version 1.5.1. 3.5.1 Windows 2000 Datacenter Server Windows 2000 Datacenter Server is a highly scalable network operating system designed for mission-critical enterprise-wide applications. High-volume online IBM ^ xSeries 440 Planning and Installation Guide...
Page 107
2000 Datacenter operating system, which you license for a period of one year. This subscription also includes IBM updates to firmware and device drivers certified by Microsoft for use with the Datacenter solution. IBM builds, tests, and provides the complete certified package of these components.
Page 108
(*) Memory/storage and options for Datacenter models will be included as defined by customer requirements through the Special Bid process. Note: All AX models are to be ordered via an IBM Special Bid process, and all Datacenter solutions require an IBM Solutions Assurance Review, to ensure compliance with the Datacenter certified solution.
Customers can purchase the complete solution directly from IBM through the Special Bid program, or through the EXAct Business Partner program. When using the Special Bid program, IBM will perform an expert Solutions Assurance Review. If the solution is obtained through a Business Partner, they will perform this review.
Hyper-Threading technology. A custom Hardware Abstraction Layer (HAL) must be installed during the operating system installation and is available from IBM. The HAL is required to support the Active PCI-X slots in the server and the RXE-100. Download it from: 3.5.3 Microsoft Windows 2000 Server...
3.5.5 Novell NetWare IBM is working with Novell's NetWare technology team (NetWare V6.0 and Modesto 32/64-bit) and its one Net strategy to take full advantage of the capabilities of IBM Enterprise X-Architecture technology. Novell will support high...
The xSeries development team, the IBM Linux Technology Center, and other parts of IBM are working with the Linux community, Red Hat, SuSE, and other Linux alliance partners to develop advanced Enterprise X-Architecture features in upcoming releases of Linux. These features will include memory optimization, additional hot-swap/hot-add capabilities, dynamic partitioning, and additional scalability improvements.
Page 113
Dynamic logical partitioning involves: Partitioning server resources The ESX Server acts as the host operating system, provides dynamic logical partitions to hold other operating systems, and virtualizes most system resources, including processors, memory, network capacity, and disk controllers. Isolating server resources With ESX Server, each hosted operating system thinks it owns the entire computer, yet it sees only the resources that the administrator (through ESX Server) assigns to it.
For more information on VMware, refer to the redbook Server Consolidation with the IBM ^ xSeries 440 and VMware ESX Server , SG24-6852. 3.6 Application considerations As well as operating systems, there are enterprise applications currently available that are licensed on a per-processor basis.
Having faster machines in the server hardware space means more parallelism (more processors, larger memory, larger disk arrays, additional PCI buses, and so on). The obvious case of software that does not scale is DOS. Run DOS on a server with eight CPUs, 16 GB of memory, equipped with 250 15K RPM disks in RAID arrays, and you get the same performance as if you have one CPU, one disk, and 640 KB of memory.
For more information regarding multiprocessor systems and performance tuning xSeries servers, refer to the redbook Tuning IBM ^ xSeries Servers for Performance , SG24-5287. For performances results of four-way and eight-way x440s running SAP and TPC-C benchmarks, see: 3.7 Rack installation...
(110 lb.). Therefore, this system requires two people to install it in a rack. If you use a non-IBM rack, the cabinet must meet the EIA-310-D standards with a depth of at least 28 inches. Also, adequate space (approximately two inches for...
Therefore, IBM recommends that the x440 be connected to a 220 V power source to ensure power supply redundancy for large configurations. Tip: If power is not redundant, the Nonredundant LED will be lit in the Light Path Diagnostic panel (see Figure 1-14 on page 26.
Page 119
— Electronic Solution Assurance Review There is also an eSAR tool available to help you establish whether you require an expert review. This is available from: For IBM employees: , then click eSAR For Business Partners: Chapter 3. Planning...
Page 120
IBM ^ xSeries 440 Planning and Installation Guide...
Follow the installation instructions provided with each package. 4.1.2 Enabling memory mirroring Memory mirroring (part of IBM’s Active Memory technology) provides an additional level of fault tolerance to the memory subsystem. For detailed information and guidelines on memory mirroring, see 3.1.2, “Memory” on page 65.
Figure 4-1 Enabling memory mirroring 3. Select the SMP Expansion Module you want memory mirroring enabled on and press the right arrow key to change the value to Enabled. Tip: In a server with two SMP Expansion Modules installed, it is possible to enable memory mirroring in only one SMP Expansion Module;...
Page 124
2. From the main menu, select Advanced Setup -> CPU Options. Figure 4-2 appears. Figure 4-2 Enabling Hyper-Threading 3. Change the Hyper-Threading Technology setting to Enabled. 4. Exit the System Configuration Utility saving changes. IBM ^ xSeries 440 Planning and Installation Guide...
Important: The procedures and menu items described above may change as BIOS levels are revised. 4.2 Device drivers Specific device drivers are available for the x440 that may not be included with the base operating system. Drivers that you should obtain separately from the operating system include: Broadcom Ethernet controller Active PCI-X controller Remote Supervisor Adapter management processor...
To install Windows 2000, do the following: 1. Power on the x440 with bootable Windows 2000 Server or Advanced Server CD in the CD-ROM drive. 2. When prompted, press any key to boot from the CD. IBM ^ xSeries 440 Planning and Installation Guide...
Page 127
4. When you are prompted to select the Computer Type, as shown in Figure 4-3, select Other and press Enter. Figure 4-3 Installing IBM custom HAL 5. Insert the xSeries 440 Windows 2000 HAL Support Disk (the one you downloaded and created) into the diskette drive and press Enter.
Page 128
Once the Windows 2000 installation is complete, install the latest Windows 2000 service pack. During the installation, you should select No when prompted to replace the HAL.DLL file, as shown in Figure 4-5 on page 115. IBM ^ xSeries 440 Planning and Installation Guide...
Page 129
Figure 4-5 Windows 2000 Server Service Pack 2 installation Installing additional drivers After Windows 2000 is installed, Device Manager will report a number of unknown devices, as shown in Figure 4-6 on page 116. These unknown devices correspond to specific components as shown in Figure 4-6 on page 116: Chapter 4.
Page 130
Other devices, select Properties, select the Drivers tab then click the Update Driver button. Follow the steps in the Upgrade Device Driver wizard, using the downloaded driver files extracted to a floppy disk. IBM ^ xSeries 440 Planning and Installation Guide...
Page 131
3. Install the driver for the Remote Supervisor Adapter. 4. Install the Active PCI device driver. 5. Update the S3 Savage4 LT video controller driver. 6. If you have other devices installed, such as FAStT Fiber Channel adapters, update or add the drivers for these. Follow the installation instructions supplied with each individual driver package.
Page 132
3. If power is connected to the RXE-100, remove for 10 to 20 seconds 4. Re-apply power to the RXE-100. 5. Power on the server. The enclosure will power on automatically as the server is started. IBM ^ xSeries 440 Planning and Installation Guide...
Open Device Manager b. Expand the Computer entry c. Right-click ACPI Multiprocessor Node and select Properties d. Click the Driver tab The Driver Provider is listed as IBM, as shown in Figure 4-9. Indicates that the IBM custom HAL has been installed.
Page 134
Hat Linux CD or the following PDF: When you have completed the installation, do the following to install the kernel source for the summit (IBM XA-32 chipset) kernel: 1. Log in as root 2. Insert the Red Hat Linux Advanced Server Version 2.1 CD 1 and mount the...
2. Run the following commands to update additional patches to the summit kernel: 3. Copy new kernel config (kernel-2.4.9-i686-summit.config) to .config: 4. Edit the makefile to change the EXTRAVERSION field from 5. Run make clean. 6. Run make menuconfig. Exit menuconfig, saving the new kernel configuration when prompted.
Page 136
2. Power on the x440 with bootable NetWare 6 CD in the CD-ROM drive. 3. Follow the NetWare installer screen instructions up to the device driver screen, shown in Figure 4-10 on page 123. The NetWare installer cannot detect the Broadcom Gigabit controller. IBM ^ xSeries 440 Planning and Installation Guide...
Page 137
Figure 4-10 Network board installation instruction To install the network driver, follow the instructions: a. Select Modify and press Enter. b. Press Insert to add the driver. c. Follow the instruction until the driver is installed and is loaded in the NetWare installer screen.
Page 138
2. Download the PCI hot-plug driver from the link listed at the beginning of this section. 3. Copy the PCI hot-plug driver (IBMXSBD.NLM) to hard drive (C:\) IBM ^ xSeries 440 Planning and Installation Guide...
Page 139
4. Start NetWare server and go to the NetWare Console. Type Wait until a message indicates that IBMXSBD is ready for operation. Tip: Add the IBMXSBD to AUTOEXEC.NCF to run it each time NetWare starts. 5. Restart the server. 6. To verify the installation, load the Novell Configuration Manager, NCMCON.NLM.
Page 140
NBI.NLM. Otherwise, installing the support pack will overwrite the new NBI.NLM Perform the following operation: 1. Bring the server down to a DOS prompt. 2. Go to C:\NWSERVER directory and rename the NBI.NLM to NBI.OLD if it exists. IBM ^ xSeries 440 Planning and Installation Guide...
Page 141
3. There are two NBI.NLM files and one NBIUP1.TXT file in NBIUP1.EXE (one for NW5.1 in the nw51 directory and one for NW6.0 in the nw6 directory). Copy the new NBI.NLM associated with NetWare 6 into the C:\NWSERVER directory. 4. Restart the server 5.
Hyper-Threading is enabled. 4.3.4 VMware ESX Server For VMware ESX Server installation instructions, see the redbook Server Consolidation with the IBM ^ xSeries 440 and VMware ESX Server , SG24-6852. 4.4 Additional Information For additional information on the installation of the x440, refer to the following...
Chapter 5. IBM Director is the systems management software provided with the IBM ^ xSeries servers. This chapter covers the three plug-ins to IBM Director unique to IBM that are of particular relevance to the x440: 5.1, “Active PCI Manager” on page 130...
Director 3.1 service pack 1 (Version 3.1.1). Figure 5-1 Active PCI Manager revision Active PCI Manager 3.1.1 will be a plug-in for IBM Director 3.1.1, just as the current version, 1.1 is a plug-in for IBM Director 3.1. It will be available for...
Page 145
IBM Active PCI Software Version 5.0.2.0 or later. This software contains the following components: – IBM Active PCI filter driver – IBM Active PCI alert driver – IBM Active PCI alert service IBM Active PCI Software and the user’s guide are available from: Once installed, Active PCI Manager appears as a task in the Director console, as shown in Figure 5-2.
Chassis Number: The x440 is assigned chassis number 0. In multi-chassis x440 configurations, each chassis will be identified by a unique number. IBM ^ xSeries 440 Planning and Installation Guide...
Page 147
I/O Drawer: This value is only relevant when an RXE-100 is selected. The number is unique and the first drawer will be number 0. Unit Name, Unit Type: The unit name is IBM eServer xSeries 440 and the unit type is Chassis. When you select the RXE-100, the unit name is IBM RXE-100 and the unit type is I/O Drawer.
Page 148
Power fault on card in Adapter has short-circuit or other Remove the adapter and have it repaired slot problem preventing normal or replaced. operation. IBM ^ xSeries 440 Planning and Installation Guide...
Page 149
Message Meaning Recommended Action Surprise removal Operating system activity to slot This should be avoided. Use the Unplug occurred was not stopped before power to or Eject Hardware wizard to disable the adapter was removed. adapter before removing it. Slot disabled at A second 133 MHz adapter was Restart the server.
Our configuration has a ServeRAID adapter installed in slot 2 of the x440 and an RXE-100 attached. The operating system is installed on the ServeRAID attached disks. Note: The x440 and RXE-100 only support 3.3 V PCI and PCI-X adapter. 5 V adapters are not supported. IBM ^ xSeries 440 Planning and Installation Guide...
Page 151
Adding a known adapter The process to add a known adapter, such as the IBM Gigabit Ethernet SX Adapter, is as follows: 1. Select Tools -> Add Card Wizard. You are presented with Figure 5-7.
Page 152
2. To add the IBM Gigabit Ethernet SX Adapter, select it from the list. The characteristics of the adapter are listed on the right side, as shown in Figure 5-8.
Page 153
4. Upon completion of the analysis, Active PCI Manager recommends the best slot to insert the adapter (if one is available with the right criteria), as shown in Figure 5-9 on page 139. In our case it was slot 3 in the x440. Figure 5-9 Hot Add adapter to slot 3 5.
Page 154
Important: Be sure to close all adapter retaining tabs before closing the cover on the x440 or RXE-100, or the cover will not close properly and forcing it will likely break the adapter retaining arm. IBM ^ xSeries 440 Planning and Installation Guide...
Page 155
9. After the adapter has been added, the slot view window is dynamically updated, as seen in Figure 5-12. Figure 5-12 IBM Gigabit Ethernet Adapter installed in slot 3 Adding an unlisted adapter To add an adapter whose characteristics are not known to the wizard, such as the QLogic QLA23xx PCI Fibre Channel Adapter, do the following: 1.
Page 156
(64-bit or 32-bit), as shown in Figure 5-14. 64-bit slot and connector 3.3v slot 5v slot Figure 5-14 The meaning of the slots in the PCI connector IBM ^ xSeries 440 Planning and Installation Guide...
Page 157
Table 5-2 shows you the possible choices when you click Adapter Keying. As you click the button, both the graphic and the bus width and voltage pull-down menu entries change. Note: Clicking the Adapter Keying button only changes the bus width and voltage pull-down menus.
We have intentionally re-arranged the adapters described in the previous section to illustrate this capability. Figure 5-16 on page 145 shows the configuration we are starting with. IBM ^ xSeries 440 Planning and Installation Guide...
Page 159
IBM does not support booting from a Fibre Channel device. However, Active PCI Manager recognizes the QLogic adapter as a potential boot device. Active PCI Manager does not make recommendations that include moving bootable...
Page 160
1. Click the link on the line Eject and Remove the adapter. Figure 5-18 on page 147 appears indicating with an arrow the adapter to remove. IBM ^ xSeries 440 Planning and Installation Guide...
Page 161
The optimizer prompts you to remove the adapter from slot 4 Figure 5-18 Removing an adapter from slot 4 Tip: The two links in Figure 5-17 merely show you which slot to insert the adapter into or remove the adapter from. 2.
Page 162
7. Active PCI Manager then shows the adapter has been removed, as shown in Figure 5-20 on page 149, by adding an to the bottom of the graphic and changing the LED error status to “Hot eject successful”. IBM ^ xSeries 440 Planning and Installation Guide...
Page 163
Indicators that the hot-eject was successful Figure 5-20 Hot eject successful 8. Close the adapter retainer on slot 4. The slot is then reported as empty, as shown in Figure 5-21. Figure 5-21 Slot 4 is empty Chapter 5. Management...
16-way complex, comprised of two eight-way x440s, you can use System Partition Manager to split the 16-way into two eight-ways. The advantages of using this tool over simply uncabling the 16-way are that it doesn’t require any IBM ^ xSeries 440 Planning and Installation Guide...
Page 165
Windows .NET Red Hat Linux Advanced Server 2.1 VMware ESX Server Components will also be installed on the IBM Director server and all IBM Director consoles. System Partition Manager uses the following terms: Node — Functionally equivalent to an x440. Also referred to by Active PCI Manager as a chassis.
Page 166
The following is a list of characteristics that are in the initial release of System Partition Manager: The IBM Director administrator specifies which nodes (chassis) and Remote I/O Enclosures are members of a complex, and assigns a name to the complex.
Page 167
Figure 5-23 shows the IBM Director console with the managed objects introduced by System Partition Manager. Note: Figure 5-23 also shows some Tivoli-specific icons that are not normally found in an IBM Director console. They can be ignored for the purposes of introducing System Partition Manager. New objects...
Page 168
Node 1 and the B slots are allocated to Node 2. Right-clicking a partition in Partition Assistant brings up a menu with the following options: Delete — Deletes a partition. IBM ^ xSeries 440 Planning and Installation Guide...
Process Control is software for organizing and managing processes and system resources on systems running Windows 2000. Process Control was developed by IBM and built into Windows 2000 Datacenter Server. For xSeries customers, Process Control is also available for use on:...
However, the use of image name and process IDs can cause identification problems in applications such as Task Manager when multiple processes have the same image name. Figure 5-26 Task Manager, showing image names and process IDs IBM ^ xSeries 440 Planning and Installation Guide...
Page 171
Action -> Insert Rule as shown in Figure 5-27. Figure 5-27 Creating a process alias rule Figure 5-28 on page 158 shows how the process alias is assigned to any process originating in the IBM HTTP Server directory. Chapter 5. Management...
Page 172
(,), or double quotation mark ("). Similarly, we create a process alias rule for all of the processes that are generated from software in the GuildFTPd directory, as shown in Figure 5-29 on page 159. IBM ^ xSeries 440 Planning and Installation Guide...
Page 173
Figure 5-29 Assigning an alias to all processes from the GuildFTPd directory Once the two alias rules have been created, they are listed as shown in Figure 5-30. Figure 5-30 List of process alias rules Chapter 5. Management...
Figure 5-31. Figure 5-31 Identify the alias for process execution rule Click Next, and Figure 5-32 on page 161 appears with the option of creating a process group. IBM ^ xSeries 440 Planning and Installation Guide...
Figure 5-32 Creating a group process alias We recommend creating a process group, even for one process. Here we are naming a new process group web services by typing in its name. You can add processes to an existing group by selecting it from the pull-down menu. Click Next.
Page 176
From the General tab, we are able to see the process count limit. Here we have set it to 10. This means that no more than 10 processes can be started from our IBM ^ xSeries 440 Planning and Installation Guide...
Page 177
group of Web services. This will prevent the overuse of these services and therefore any impact to other processes running on this server. The next tab is the Affinity tab, shown in Figure 5-35. Figure 5-35 Processor affinity Assigning processor affinity means that the processes in the group execute only on the specified processor(s).
Page 178
To determine what priority processes have natively run the process, open Task Manager, select the Processes tab, select View -> Select Columns, and select Base Priority as shown in Figure 5-37 on page 165. IBM ^ xSeries 440 Planning and Installation Guide...
Page 179
Figure 5-37 Configuring Task Manager to show base priority In all likelihood, the processes you are interested in have a base priority of Normal, like most of the ones shown in Figure 5-38. Figure 5-38 Priorities of running processes Process group priority is rather a coarse setting. Much finer control can be achieved by setting the scheduling class, which is the next tab in the Properties window, as shown in Figure 5-39 on page 166.
Page 180
The process scheduling class determines how much CPU time processes with the same priority are allocated. The next tab in the Properties window is the Memory tab, as shown in Figure 5-40 on page 167. IBM ^ xSeries 440 Planning and Installation Guide...
Page 181
Figure 5-40 Memory limits for processes in groups This tab lets you set three parameters, which are configured in increments of 1,024 KB: The first one configures working set limits (minimum and maximum). The working set is the physical memory allocated to the process group. If the process group’s memory requirement exceeds the maximum size of the working set, the balance will be satisfied by paging to disk, even if there is available memory on the system.
Page 182
This may cause data corruption or other undesired results with some applications. IBM Director can be configured to execute an event action plan based on any entry in to the Windows event log from Process Control. To do this, create a Simple Event Filter and select ProcCon as the event type (in the Event Type tab, Figure 5-42 on page 169, uncheck Any, and expand Windows NT Event Log ->...
Page 183
-> System -> ProcCon. Figure 5-42 Selecting Process Control as the event type in IBM Director Further details about creating event action plans in IBM Director can be found in several sources, such as the redbook Implementing IBM Director Management Solutions , SG24-6188 .
Page 184
Deselecting this option allows for accumulating usage statistics for billing purposes. This can be accomplished using the Elapsed Time counter in the Performance tool, as shown in Figure 5-44 on page 171. IBM ^ xSeries 440 Planning and Installation Guide...
Page 185
Figure 5-44 Performance monitor counter Die on unhandled exceptions This option suppresses any windows that may pop up as a result of a process failing, which hopefully facilitates the full completion of the process and the release of committed resources after a process fails. This should be used on systems that have other management mechanisms in place to alert an administrator that a process has terminated abnormally.
Page 186
Then create a rule for subdirectory names that match * and apply a process count of 0. This will prevent all processes that are initiated from any other subdirectories from executing. IBM ^ xSeries 440 Planning and Installation Guide...
The publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this redbook. IBM Redbooks For information on ordering these publications, see “How to get IBM Redbooks” on page 178. Netfinity Tape Solutions , SG24-5218...
Page 190
IBM ^ xSeries 440 Installation Guide in PDF format x440 hot-plug driver for NetWare Broadcom Ethernet driver for NetWare CPU utilization fix for NetWare Tip about avoiding damaging the centerplane when removing an SMP Expansion Module Tip about NetWare 5.1 automatically rebooting after a shutdown Document Hints, Tips, and Frequently Asked Questions for the xSeries 440 Quick Reference .
Page 191
Information about VMware on xSeries Information about the Datacenter Server offerings from IBM Intel sites Information on the Xeon DP processor Information on the Xeon MP processor Whitepaper: Intel Xeon Processor Family for Servers with Hyper-Threading Technology Information on Hyper-Threading...
Redbooks are also available on CD-ROMs. Click the CD-ROMs button on the Redbooks Web site for information about all the CD-ROMs offered, as well as updates and formats. IBM ^ xSeries 440 Planning and Installation Guide IBM ^ xSeries 440 Planning and Installation Guide...
Page 194
Ethernet, Gigabit 2, 23, 72 Cognos 39 adapter teaming 73 collaboration 40 Event Log Computer Type 113 Process Control 168 configuration rules Exchange 36, 40 See rules configuration tools rack configurator 103 IBM ^ xSeries 440 Planning and Installation Guide...
Page 195
20, 46 Active PCI Manager 130 performance 67 event actions plans 168 ports 65 System Partition Manager 150 standard DIMMs 3 IBM XA-32 chipset 7, 43 messaging 40 installation 102, 107–128 Microsoft Cluster Service 111 Hyper-Threading 109 migration 37 Linux 119 models 2–3...
Page 196
158 See also RXE-100 processor affinity 163 PCI-X and PCI coexistence 70 processors 12, 64 PCI-X slots in the x440 68 product line 2 PeopleSoft 38–39 product publications 128 IBM ^ xSeries 440 Planning and Installation Guide...
Page 198
1 models 3, 94, 98 Ultra 160 SCSI ports 23 positioning 44 USB ports 23 XpandOnDemand 2, 47 USB to serial adapter 83 ZIF socket 13 vertical position not supported 102 IBM ^ xSeries 440 Planning and Installation Guide...
Describes the INTERNATIONAL technical details of standard server and is the first full implementation of the TECHNICAL 32-bit IBM XA-32 chipset, code named “Summit”, as part of the x440 models SUPPORT the Enterprise X-Architecture strategy. The x440 provides ORGANIZATION new levels of high availability and price performance, and...