IBM System Storage DS6000 Series: Copy Services with IBM System z Plan, install and configure DS6000 Copy Services with System z Learn how to use the management interfaces: TSO, DS CLI, DS GUI Learn about TPC for replication support ibm.com/redbooks...
Page 3
International Technical Support Organization IBM System Storage DS6000 Series: Copy Services with IBM System z December 2006 SG24-6782-02...
Page 10
23.3 Modify a Global Mirror session ......... 271 viii IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 11
23.3.1 Add or remove volumes to a Global Mirror session ..... 271 23.3.2 Add or remove storage disk subsystems or LSSs ..... . 272 23.3.3 Modify Global Mirror session parameters .
Page 12
26.7.4 Delete the Global Mirror session........370 IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 13
Chapter 28. Interoperability between DS6000 and DS8000 ..... 415 28.1 DS6000 and DS8000 Copy Services interoperability ......416 28.2 Preparing the environment .
Page 14
28.4.3 Managing Global Copy pairs usingthe DS CLI ......426 28.5 Managing DS6000 to DS8000 Global Mirror....... 426 28.5.1 Managing Global Mirror pairs using DS CLI .
Page 15
32.1.7 GDPS 3-site solution overview ........506 32.1.8 IBM Global Services offerings for GDPS ......507 Appendix A.
IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.
Linux is a trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others. IBM System Storage DS6000 Series: Copy Services with IBM System z Geographically Dispersed Parallel Sysplex™...
22 years. Today, in addition to his work with the ITSO, he works for IBM Global Delivery in Argentina as a Storage Specialist supporting US and European accounts.
Page 20
TotalStorage: A Guide to Implementing External Disk on IBM eServer iseries. Wenzel Kalabza is an IT Specialist in IBM Germany. He started in 1998 as a Field Quality Engineer for IBM hard disk drives and was the Technical Lead in HDD robustness and rotational vibration testing.
We want to thank Michael Eggloff and Peter Klee for hosting us at the European Storage Competency Center in Mainz, Germany. Günter Schmitt, Uwe Schweikhard, Edgar Strubel (ATS - IBM Mainz) for their help in reserving and preparing the equipment we used.
ITSO editorial assistance Become a published author Join us for a two- to six-week residency program! Help write an IBM Redbook dealing with specific products or solutions, while getting hands-on experience with leading-edge technologies. You'll team with IBM technical professionals, Business Partners and/or customers.
Summary of Changes for SG24-6782-02 for IBM System Storage DS6000 Series: Copy Services with IBM System z as created or updated on December 14, 2006. December 2006, Third Edition This revision reflects the addition, deletion, or modification of new and changed information described below.
Page 24
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Enterprise Storage Server® (ESS). This part also shows how the existing Copy Services functions from the ESS can coexist with the Copy Services for the DS6000 series. Similarly, we discuss their use with the DS8000 series Copy Services.
Page 26
You can use either the IBM System Storage DS Storage Command-Line Interface, DS CLI, or the IBM System Storage DS Storage Manager Copy Services Graphical User Interface, DS GUI, to configure Copy Services. It should be noted that: All DS6000 installations require at least an Operating Equipment License (OEL) key to operate.
Disaster Recovery. Copy Services run on the DS6000 Storage Unit and support open systems and System z environments. These functions are also supported on the DS8000 series and the previous generation of storage systems, the IBM TotalStorage Enterprise Storage Server (ESS).
DS6000 Storage Units can participate in Remote Mirror and Copy solutions with another DS6000, or with the ESS Model 750, ESS Model 800, and DS8000 Storage Units. To establish an RMC (formerly PPRC) relationship between the DS6000 and the ESS, the ESS needs to have licensed internal code (LIC) Version 2.4.3.65 or later.
Remote Mirror for z/OS (2244 Model RMZ for DS8000 Series) on primary site Remote Mirror and Copy function (2244 Model RMC for DS8000 Series or Machine Type 1750 feature code #5300 RMC for the DS6000 Series) for the primary Storage Unit and secondary Storage Units at the alternate metropolitan site Restriction: The XRC and 3-site z/OS Global Mirror environments are supported on DS6000 Series only as secondary servers at remote sites.
A Storage Unit is the physical storage device (including expansion enclosures) that you see when you walk into the computer room. If you open a rack door and look at a DS6000 system enclosure (a 1750-511 or 522) and all its attached expansion enclosures (1750-EX1 or EX2), then you are looking at a single DS6000 Storage Unit.
Page 33
Example 2-1 Difference between a DS6000 Storage Unit and DS6000 SFI dscli> lssu Date/Time: 13 November 2005 19:21:17 IBM DSCLI Version: 5.1.0.204 Name Model WWNN ========================================================= 13-00247 IBM.1750-1300247 500507630EFFFE16 dscli> lssi Date/Time: 13 November 2005 19:21:44 IBM DSCLI Version: 5.1.0.204...
A Storage Complex can be one or two DS8000 Storage Units managed by one or two DS HMCs. A Storage Complex could also be one or two DS6000 Storage Units, managed by one or two DS SMCs. In Figure 2-1, you see a logical view of two Storage Complexes, each with one DS6000 Storage Unit.
2.2 How the new structure of Copy Services works With the exception of System z commands (see “System z communication path for Copy Services” on page 13), communication to a DS6000 or DS8000 needs an available DS SMC or DS HMC. See Figure 2-2.
ESS 800 Copy Services Server running on an ESS 800 cluster. The client could also use the DS GUI to issue commands to the ESS 800 Copy Services Server if a DS6000 SMC or DS8000 HMC is available to route them through (not shown in the diagram).
The ability to send inband commands does not necessarily mean that the DS CLI or DS GUI do not have a role to play. To be able to issue a command to a DS6000 or DS8000, a System z operating system needs to be able to communicate with the relevant Storage Unit. We may have a remote Storage Unit that is not connected via FICON (or ESCON in the case of a DS8000) to an active z/OS.
Page 38
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Part In this part we discuss the interfaces available to manage the Copy Services features of the DS6000. We give an overview of the interfaces, discuss the options available, discuss configuration considerations, and give some usage examples of the interfaces.
Page 40
IBM System Storage DS6000 Series: Copy Services with IBM System z...
DS Storage Manager Chapter 3. This chapter is an introduction to the IBM System Storage DS™ Storage Manager, which can be used to configure and administer the DS storage system. The DS Storage Manager is an interface that is used to perform logical configurations, service, Copy Services management, and firmware upgrades.
The DS Storage Manager software must be installed on a user-provided computer. We refer to this computer as the DS Storage Management Console (SMC). Because the DS Storage Manager is required to manage the DS6000, to perform Copy Services operations, or to allow remote service, the DS SMC computer must always be on.
3.3 Connecting to your DS6000 SMC To connect to the DS6000 SMC from the browser, enter the Web site address (URL) of the PC or the DS SMC that you have purchased. The Web site consists of the TCP/IP address as shown in Figure 3-1, or a fully qualified name that the DNS server can resolve.
Copy functions: It requires less specialized skills for effective use. It is a real-time graphical interface for the DS6000 subsystem, which may present information more easily to some users. You do not need to install anything on your PC in order to manage Copy Services: a simple Web browser pointed to the DS SMC is enough.
If you are locally logged onto the SMC then you can also use: http://127.0.0.1:8455 To access the public version of the DS6000 Information Center, go to: http://publib.boulder.ibm.com/infocenter/ds6000ic/index.jsp Accessing the Information Center using the help symbol The help panels are accessed by selecting the? symbol on the right side of the panel, which is indicated by the arrow in Figure 3-2.
A simple scenario might involve two sites. At the production site, there is a single DS6000 managed by its own SMC. Then, at a remote site a second DS6000 is managed by its own IBM System Storage DS6000 Series: Copy Services with IBM System z...
Complex2 to Complex1. Important: Make sure the user ID you use to log on to the DS6000 DS GUI also exists on the other DS6000 SMC and that it has the same password. If not, the operation to add the Storage Complex will fail.
Page 48
GUI to create paths and Remote Mirror and Copy pairs between any of the Storage Units. You can also use the DS6000 DS GUI to manage FlashCopy pairs on any DS6000. This is all assuming the relevant licenses are present.
Chapter 4. This chapter provides an introduction to the DS Command-Line Interface (DS CLI), which can be used to configure and administer the DS6000 storage systems. It describes how it can be used to manage Copy Services relationships. In this chapter we describe:...
4.1 Introduction and functionality The IBM System Storage DS Command-Line Interface (DS CLI) enables open systems hosts to invoke and manage FlashCopy and Remote Mirror and Copy functions through batch processes and scripts. While there is no support for z/OS as a server for the DS CLI, you can use the DS CLI from a supported server to control and manage Copy Services functions on z/OS volumes.
The installation process also installs software that allows the DS CLI to be completely de-installed should it no longer be required. If you need any assistance to install the DS CLI, refer to IBM System Storage DS6000: Command-Line Interface User´s Guide, GC26-7922.
The file name is dscli.profile; for example. c:\Program Files\IBM\DSCLI\profile\dscli.profile. The available variables, detailed descriptions, and information about how to handle them can be found in IBM System Storage DS6000: Command-Line Interface User´s Guide, GC26-7922. IBM System Storage DS6000 Series: Copy Services with IBM System z...
4.5 Command structure This is a description of the components and structure of a Command-Line Interface command. A Command-Line Interface command consists of one to four types of components, arranged in the following order: 1. The command name: Specifies the task that the Command-Line Interface is to perform. 2.
Page 54
Creates a new Remote Mirror and Copy Consistency Group pausepprc Pauses an existing Remote Mirror and Copy volume pair relationship resumepprc Resumes a Remote Mirror and Copy relationship for a volume pair IBM System Storage DS6000 Series: Copy Services with IBM System z...
Example 4-1 shows the use of the single-shot command mode. Example 4-1 Single-shot command mode C:\Program Files\ibm\dscli>dscli -HMC1 10.10.10.1 -user admin -passwd adminpwd lsuser Date/Time: 24 de Maio de 2005 14h38min20s BRT IBM DSCLI Version: X.X.X.X Name Group State =====================...
Example 4-2 shows the use of the script command mode. Example 4-2 Script command mode C:\Program Files\ibm\dscli>dscli -HMC1 10.10.10.1 -user admin -passwd adminpwd -script c:\test.cli Date/Time: 24 de Maio de 2005 14h40min22s BRT IBM DSCLI Version: X.X.X.X DS: IBM IBM.1750-1367890 WWPN ===============================================================...
Enter your password: Date/Time: 24 de Maio de 2005 14h42min17s BRT IBM DSCLI Version: X.X.X.X DS: IBM.1750-1312345 dscli> lsarraysite Date/Time: 24 de Maio de 2005 15h8min57s BRT IBM DSCLI Version: X.X.X.X DS: IBM. 1750-1312345 arsite DA Pair dkcap (Decimal GB) State ================================================ dscli>...
-h, -help, or -?, for example: dscli> mkflash -help dscli> help mkflash IBM System Storage DS6000 Series: Copy Services with IBM System z Description The DS CLI server had an error. Password or user ID details are incorrect.
It is not the intent of this section to list every DS CLI command and its syntax. If you need a list of all the available commands or assistance with DS CLI commands, refer to IBM System Storage DS6000: Command-Line Interface User´s Guide, GC26-7922, or you can use the online help.
Page 60
IBM System Storage DS6000 Series: Copy Services with IBM System z...
The ANTRQST macro Native TPF commands (for z/TPF only) These interfaces have the advantage of not having to issue their commands to the DS6000 SMC. They can instead directly send commands inband over a FICON channel connection between the DS6000 and the System z operating system. Sending inband commands allows for a very quick command transfer that does not depend on any additional software stacks.
The ANTRQST macro provides an application program call to the application programming interface (API) of the z/OS system data mover (SDM). This macro allows you to call Metro Mirror, z/OS Global Mirror, and FlashCopy functions. For detailed information, see the IBM publication z/OS DFSMS Advanced Copy Services, SC35-0428. 5.6 z/TPF commands It is also possible to use native z/TPF commands to issue Copy Services commands.
Page 64
IBM System Storage DS6000 Series: Copy Services with IBM System z...
FlashCopy Part This part of the book describes the IBM System Storage FlashCopy for DS6000 when used in a System z environment. We discuss the features of FlashCopy and describe the options for its setup. We also show which management interfaces can be used, as well as the important aspects to be considered when establishing FlashCopy relationships.
Page 66
IBM System Storage DS6000 Series: Copy Services with IBM System z...
FlashCopy creates a copy of a volume at a specific point-in-time, which we also refer to as a Point-in-Time copy, instantaneous copy, or time-zero copy (t0 copy). This chapter explains the basic characteristics of FlashCopy when used in a System z environment with the DS6000. The following topics are discussed: FlashCopy operational areas. FlashCopy basic concepts.
Test environments created by FlashCopy can be used by the development team to test new application functions with real production data, thus speeding up the test setup process. IBM System Storage DS6000 Series: Copy Services with IBM System z System Reverse...
Integration system New application releases (for example, SAP® releases) are likely to be tested prior to putting them onto a production server. By using FlashCopy, a copy of the production data can be established and used for integration tests. With the capability to reverse a FlashCopy, a previously created FlashCopy can be used within seconds to bring production back to the level of data it had at the time when the FlashCopy was taken.
Page 70
While the FlashCopy relationship is being created, the DS6000 holds off the I/O activity to the volume for an interval of time by putting the source volume in an condition. No user intervention is required. I/O activity resumes when the FlashCopy establish process is completed.
Page 71
Reading from the source The data is read immediately (see Figure 6-3 on page 46). Writing to the source Whenever data is written to the source volume while the FlashCopy relationship exists, the storage subsystem makes sure that the time-zero-data is copied to the target volume prior to overwriting it in the source volume.
Figure 6-3 on page 46 and Figure 6-4 on page 47. The relationship will last until it is explicitly withdrawn or until all data in the source volume has been modified. Blocks for which no write IBM System Storage DS6000 Series: Copy Services with IBM System z persistent...
occurred on the source or on the target will stay as they were at the time when the FlashCopy was established. persistent If the FlashCopy option was specified, the FlashCopy relationship must be withdrawn explicitly. 6.4 FlashCopy in combination with other Copy Services Volume-based FlashCopy can be used in various combinations with other Copy Services, whereas the most suitable will depend on the characteristics of the environment and the requirements.
– If you create the FlashCopy first, and then do a Global Copy of the FlashCopy target, you must monitor the progress of the FlashCopy background copy. IBM System Storage DS6000 Series: Copy Services with IBM System z copy option to ensure that the entire FlashCopy source volume data is and vice versa.
The Global Copy secondary will not be in a fully consistent state until the FlashCopy background copy process is complete and the Global Copy is forced to the full duplex state. Issue the TSO CESTPAIR command with OPTION(SYNC) to force the Global Copy to enter the full duplex state.
Page 76
FlashCopy volume source dataset target dataset Figure 6-10 Source data set and target data set can reside in the same volume IBM System Storage DS6000 Series: Copy Services with IBM System z...
FlashCopy options Chapter 7. This chapter discusses the options of FlashCopy when working with IBM System Storage DS6000 series in a System z environment. The following options are explained: Multiple relationship FlashCopy Consistency Group FlashCopy FlashCopy on existing Metro Mirror or Global Copy source...
DS CLI support multiple relationships at the data set level. Also in Figure 7-8 on page 61, as stated in Note 1, it is important to point out that though TSO and the ANTRQST IBM System Storage DS6000 Series: Copy Services with IBM System z FlashCopy...
Consistency groups can be used to help create a consistent point-in-time copy across multiple volumes, and even across multiple DS6000 storage systems, thus managing the consistency of dependent writes.
However, using the incremental option will automatically convert this relationship to a copy relationship, and the background copy will begin. IBM System Storage DS6000 Series: Copy Services with IBM System z target Remote site...
Page 81
FlashCopy with copy option If the original FlashCopy was established with the updates that took place on the source volume since the last FlashCopy will be copied to the target volume. Also, the updates done on the target volume will be overwritten with the contents of the source volume.
Page 82
Tip: You can do the incremental copy at any time. You do not have to wait for the previous background copy to complete. IBM System Storage DS6000 Series: Copy Services with IBM System z change recording takes place, the bitmap used for...
7.5 Remote FlashCopy There are command interfaces (see Figure 7-8 on page 61) which are able to manage a FlashCopy relationship at a remote site. The commands can be issued from the local site and they are then transmitted over the Metro Mirror or Global Copy links. This eliminates the need for a network connection to the remote site solely for the management of FlashCopy.
7.10 Options and interfaces Now that we have discussed the options available with FlashCopy, let us see how the DS6000-provided interfaces and the z/OS-provided interfaces support them; see Figure 7-8 on page 61. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 85
Interface Function Multiple relationship FlashCopy Consistency Group FlashCopy Target on existing Metro Mirror or Global Copy primary Incremental FlashCopy Remote FlashCopy Persistent Flashcopy Dataset FlashCopy Reverse restore, fast reverse restore (1) Extents can be specified, but the VTOC and the catalogs are not updated (2) Persistent relationships are available via Incremental support (3) With z/OS V1R6 or later, and APARs OA11002, OA12707, OA12748, and OA14105 Figure 7-8 FlashCopy options and interfaces...
Page 86
IBM System Storage DS6000 Series: Copy Services with IBM System z...
—license size in terms of physical capacity— for use of an associated licensed function. This is also referred to as the The extent of IBM authorization for the use of a licensed function on a 1750 system is established by acquiring an 52xx feature number on the 1750 base enclosure. The same 52xx feature numbers acquired to enable a licensed function also establish the extent of IBM's authorization.
Feature Activation (DSFA) application. Also, the DS6000 licensed functions are activated by the installation of feature activation codes into the 1750 system. The feature activation codes are made available by IBM and are obtained using the DSFA (Disk Storage Feature Activation) application at: http://www.ibm.com/storage/dsfa...
Page 90
Example 8-1 FlashCopy example A DS6000 has a total physical capacity of 15 TB and that capacity will be configured as: 10 TB open systems (FB) 5 TB System z (CKD) Then, here's the required licenses: Operating environment ==> 15 TB (equal to total machine capacity) Parallel access volumes ==>...
The model of the DS6000 can be taken from the order. Serial number of the DS6000 The serial number of a DS6000 can be taken from the front of the base frame (lower right corner). If several servers have been delivered, this is the only way to obtain the serial number of a DS6000 located in a specific point in the computer center.
Page 92
IBM System Storage DS6000 Series: Copy Services with IBM System z...
The setup of FlashCopy in a System z environment can be done using different interfaces. This chapter explains and gives examples of the interfaces that can be used for FlashCopy management when FlashCopy is used with the IBM System Storage DS6000 in a System z environment.
FlashCopy management and control. The DS Open API is not covered in this book. For information on the DS Open API, refer to IBM System Storage DS Open Application Programming Interface Reference, GC35-0516.
9.2.1 Local FlashCopy management The commands you can use as well as the displayed panel actions and options you can select when working with the DS6000-provided interfaces DS CLI and DS SM for local FlashCopy management are listed in Table 9-1.
9.2.2 Remote FlashCopy management The commands that can be used when working with the DS6000-provided interface DS CLI for remote FlashCopy management are listed in Table 9-2. Table 9-2 Remote FlashCopy using DS CLI commands Options Create a FlashCopy Create a remote FlashCopy...
9.4 Local FlashCopy using the DS CLI The DS CLI can be downloaded from the IBM Web site and then installed on a workstation. It communicates with the DS SMC. For detailed information about the DS CLI, refer to IBM System Storage DS6000: Command-Line Interface User´s Guide, GC26-7922.
Page 98
FlashCopy relationships. source:target: identification of source volume and target volume fast: reverse FlashCopy before background copy finished IBM System Storage DS6000 Series: Copy Services with IBM System z Permit FlashCopy Resulting action to occur if target...
#--- script to establish FlashCopy relationships #------------------------------------------------------------ mkflash -dev IBM.1750-13ABC2A Date/Time: July 8, 2005 10:31:59 AM CEST IBM DSCLI Version: 5.0.3.134 DS: IBM.1750-13ABC2A CMUC00137I mkflash: FlashCopy pair 0000:0100 successfully created. mkflash -dev IBM.1750-13ABC2A -freeze -seqnum 01 0001:0101 0005:0105 Date/Time: July 8, 2005 10:32:26 AM CEST IBM DSCLI Version: 5.0.3.134 DS: IBM.1750-13ABC2A CMUC00137I mkflash: FlashCopy pair 0001:0101 successfully created.
Page 100
Example 9-2 on page 77 shows a script with several lsflash commands and the output of the script (this script is logically based on the example for mkflash). IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 101
-dev IBM.1750-13ABC2A -activecp 0000-0004 Date/Time: July 8, 2005 3:01:48 PM CEST IBM DSCLI Version: 5.0.3.134 DS: IBM.1750-13ABC2A CMMCI9006E No FlashCopy instances named 0000-0004 found that match criteria: dev = IBM.1750-13ABC2A and activecp = true. #--- Example 6 lsflash -dev IBM.1750-13ABC2A -record 0000-0004 Date/Time: July 8, 2005 3:02:05 PM CEST IBM DSCLI Version: 5.0.3.134 DS: IBM.1750-13ABC2A...
Page 102
This command needs to be executed prior to running a commitflash or revertflash. Example 9-3 on page 79 illustrates two situations using the setflashrevertible command. IBM System Storage DS6000 Series: Copy Services with IBM System z Disabled Disabled Disabled...
Use the mkflash command with the -freeze parameter to create a FlashCopy Consistency Group. This command causes the DS6000 to briefly prevent I/O to the volumes in the Consistency Group. During this time, any I/O that comes from the host will be returned with a long busy error, which the host bus adapter will automatically retry.
9.5 Remote FlashCopy using the DS CLI Remote FlashCopy commands are similar to local FlashCopy commands. The remote commands can be issued whenever a DS6000 mirroring takes place from one DS6000 to another DS6000. In this situation the Fibre Channel links between the two DS6000s—that are used for mirroring purposes—are also used to transmit the FlashCopy commands to the...
FlashCopy. The -conduit parameter identifies the path to be used for transmitting the commands to the remote site. IBM System Storage DS6000 Series: Copy Services with IBM System z DS CLI Commands...
9.6.1 Initiate FlashCopy using Create After you log in to the DS SM, select Real-time manager on the left, then FlashCopy Identify the DS6000 for which you would like to initiate a FlashCopy. From the Select Action box, select Create. See Figure 9-3.
Page 112
Table 9-6 Comparison of options/parameters used for FlashCopy DS CLI and DS SM Options Options for the source volume Multiple relationship FlashCopy Consistency Groups for FlashCopy IBM System Storage DS6000 Series: Copy Services with IBM System z Parameter Parameter with DS SM with DS CLI FlashCopy create command...
On the DS SM window, select Real-time manager on the left, then FlashCopy DS6000 (storage unit and LSS for example) for which you would like to display FlashCopy information. This will give you a list of all active FlashCopy relationships; see Figure 9-5.
Page 114
In this folder all properties of the selected FlashCopy are presented. See Figure 9-6. Figure 9-6 General folder with FlashCopy information IBM System Storage DS6000 Series: Copy Services with IBM System z be presented. Select only one FlashCopy relationship to view its prop-...
Page 115
Out-of-synch tracks The window displaying the out-of-synch tracks can be used to monitor how the FlashCopy performs in the background; see Figure 9-7. A refresh interval can be set to refresh the display after a preselected period of time. Figure 9-7 Out-of-synch tracks folder Properties display - DS CLI vs.
FlashCopy that might be changed during the reverse process. Changing the values of the parameters and then clicking OK will start the reverse process for the FlashCopy IBM System Storage DS6000 Series: Copy Services with IBM System z lsflash Properties with DS SM...
To initiate a background copy for a persistent relationship, start on the DS SM front end window and select Real Time Manager on the left, then FlashCopy Identify the DS6000 (Storage Unit and LSS, for example) for which you would like to increment a FlashCopy. This will give you a list of all active FlashCopy relationships similar to Figure 9-9 on page 94.
Figure 9-11 on page 95. Then check the box at the left of the FlashCopy you want to resynchronize. Doing so, the available Select Actions for this FlashCopy relationship will be shown. Then select Resync target. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 119
Figure 9-11 Resynchronize the FlashCopy relationship The following prompt window asks for more details for the resync request; see Figure 9-12. Figure 9-12 Prompt window to detail resync request for FlashCopy relationship Chapter 9. FlashCopy interfaces...
Figure 9-13 Select Action - Delete, to delete an existing FlashCopy relationship The next window is a prompt asking you to confirm the delete request; see Figure 9-14. Figure 9-14 Prompt window to confirm delete request for FlashCopy relationship IBM System Storage DS6000 Series: Copy Services with IBM System z...
PURGE Full volume FlashCopy DFSMSdss can implicitly use the hardware function of the DS6000 to perform a FlashCopy if the following conditions are met in conjunction with the COPY FULL command: The source and target volumes must have the same track format.
Page 122
The procedure consists of freezing the source volume during each volume copy operation, and thawing all the frozen volumes using the CGCREATE command after a FlashCopy Consistency IBM System Storage DS6000 Series: Copy Services with IBM System z Parameter with Remark...
Page 123
DFSMSdss utility, then FCTOPPRCPrimary is ignored. When FCTOPPRCPrimary is not specified, or if the capability is not supported by the DS6000, a Metro Mirror or Global Copy primary volume is not eligible to become a FlashCopy target volume.
Page 124
It is possible to determine whether the data of the source volume should be copied to the target volume in the background or not. If DFSMSdss uses the DS6000 FlashCopy, the parameter FCNOCOPY is analyzed to determine whether a copy should take place or not.
Page 125
FASTREPLICATION(REQUIRED) FASTREPLICATION(NONE) Data set FlashCopy DFSMSdss can implicitly use the hardware function of the DS6000 to perform a FlashCopy if the following conditions are met in conjunction with the COPY DATASET command: The source and target types are the same.
Page 126
Key range data set DFSMSdss / IDCAMS Extended-format VSAM DFSMSdss / IDCAMS IBM System Storage DS6000 Series: Copy Services with IBM System z Notes All partitioned data sets that are not load modules are compressed during a copy. Specify NOPACKING if FlashCopy is to be used.
Data set type Data mover Integrated catalog IDCAMS facility user catalogs (EXPORT/IMPORT) Undefined DSORG DFSMSdss 9.7.2 FlashCopy using TSO commands In this section we describe the FlashCopy functions invoked via TSO commands and parameters. For more detailed information about the TSO FlashCopy commands, refer to DFSMS Advanced Copy Services, SC35-0428.
Page 128
(see Example 9-16 on page 105). When the DS6000 receives an update to a source track in a FlashCopy NOCOPY relationship, a copy of the point-in-time (pre-update) data is preserved on the target volume.
Page 129
All specified source device tracks are updated. The DS6000 copies all tracks from source to target when a threshold number of source tracks are updated. A FlashCopy withdraw (using the FCWITHDR command) is issued to remove the FlashCopy relationship. A NOCOPY relationship is converted to a COPY relationship through the NOCOPY2COPY mode option.
Page 130
REMOTE(YES) parameter. Once the FlashCopy is established, the direct host connection from local to remote DS6000 is not required for a background copy to complete. The host connection would be needed, however, before any new FlashCopy tasks could be initiated.
Page 131
In the Example 9-18, the REMOTE(YES) parameter specifies that this relationship is to be located on the remote DS6000 storage subsystem identified by SSID 4500. This must be the same as the SSID value specified for the Metro Mirror secondary on the TSO CESTPAIR command.
Page 132
3500 as a target volume. Revert is a function to be used with Global Mirror for DS6000 when recovering from an outage. It specifies a rollback to the state saved by a previous automatic FlashCopy establish command.
Page 133
Example 9-21 FlashCopy withdraw target only //********************************************************************* WITHDRAW FLASHCOPY RELATIONSHIP TARGET ONLY TDEVN - TARGET FLASHCOPY VOLUME //********************************************************************* //STEP1 EXEC PGM=IKJEFT01,REGION=256K //SYSTSPRT DD SYSOUT=* //SYSUADS DD DSN=SYS1.UADS,DISP=SHR //SYSLBC DD DSN=SYS1.BRODCAST,DISP=SHR //SYSTSIN DD * FCWITHDR TDEVN(X'320B') In Example 9-22, both the SDEVN parameter and the TDEVN parameter allow you to limit the scope of the withdraw to those FlashCopy relationships that have source extents on the specified SDEVN and corresponding target extents on the TDEVN, regardless of whatever source and target relationships with other devices may exist.
Page 134
ANTF0420I FCQUERY Formatted -2 DEVN SSID LSS CCA CU SERIAL MAX XC PC CC RV SEQNUM 420A 4200 02 0A 1750 0000000ABTV1 1 50099 N S N N 00000000 IBM System Storage DS6000 Series: Copy Services with IBM System z...
The lsda command lists the available device adapters. Rank - An array site made into an array which is then made into a rank. For the DS6000 a rank is a collection of 8 disk drive modules (DDMs). The lsrank command displays detailed information about the ranks.
Server1. 10.1.2 LSS/LCU versus rank considerations In the DS6000 it is much more meaningful to discuss volume location in terms of ranks and not in terms of logical subsystem (LSS) or logical control unit (LCU). On the ESS 800 and earlier IBM disk subsystems, the physical locations of the volumes were described in terms of the logical subsystem LSS/LCU.
Note: The term write to the source has occurred. This occurs on the the DS6000 writes to non-volatile cache, there is typically no direct response time delay on host writes. The forced copy only occurs when the write is destaged onto disk.
Tip: The DS6000 gives higher priority to application performance than background copy performance. This means that the DS6000 will throttle the background copy if necessary, so that applications are not unduly impacted. The recommended placement of the FlashCopy source and target volumes, regarding the physical FlashCopy phase, was already discussed in the previous section.
FlashCopy and restore your production data in seconds, instead of the several hours it would normally take to retrieve the data from tape. IBM System Storage DS6000 Series: Copy Services with IBM System z incremental...
When backing up to disk, it is important to take the necessary steps to protect your data. Remember that, until the background copy is complete, you still only have one physical copy of the data, and that copy is vulnerable. Therefore, it is important to always establish the FlashCopy with the COPY option.
Page 142
COPY relationship during a quiet time. To minimize the amount of data to be copied when taking the desired point-in-time copy, schedule an incremental refresh sufficiently in advance IBM System Storage DS6000 Series: Copy Services with IBM System z collision...
of the point-in-time refresh to complete the copy of the changed data. Finally, take the required point-in-time copy with the incremental refresh at the required point in time. 10.6.4 Scenario #4: Ranks reserved for FlashCopy Another configuration worth considering is the one where 50% of the ranks (capacity) are all FlashCopy source volumes—and where the application write I/Os take place—and the remaining 50% of the ranks (capacity) are all FlashCopy target volumes.
Page 144
IBM System Storage DS6000 Series: Copy Services with IBM System z...
3201 could not be the target for one FlashCopy relationship and the source for another FlashCopy relationship at the same time. You must wait until the background copy for 3200 and 3201 finishes successfully before starting Part 2. IBM System Storage DS6000 Series: Copy Services with IBM System z...
FlashCopy. An initial full volume FlashCopy is followed by subsequent incremental FlashCopies, which only copy the updates that took place on the source volume. See Example 11-5 on page 125. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Metro Mirror Part This part of the book describes IBM System Storage Metro Mirror for DS6000 when used in a System z environment. Here we discuss the characteristics of Metro Mirror and describe the options for its setup. We also show which management interfaces can be used, as well as the important aspects to be considered when establishing a Metro Mirror environment.
Page 152
IBM System Storage DS6000 Series: Copy Services with IBM System z...
The Fibre Channel connection between primary and secondary subsystems can be direct, through a switch, or through other supported distance solutions (for example, Dense Wave Division Multiplexor, DWDM). IBM System Storage DS6000 Series: Copy Services with IBM System z Write acknowledge Write to secondary...
Consistency Group. Consistency is provided by means of the systems) conditions. These are triggered when the DS6000 detects a condition where it cannot update the Metro Mirror secondary volume. The volume pair that first detects the error will go into the extended long busy condition, such that it will not do any writes.
IBM offers services and solutions for the automation and management of the Metro Mirror environment, which include GDPS and eRCMF. For more information on GDPS and eRCMF see Part 8, “Solutions” on page 431. You can also visit the IBM Web site and refer to the Services & Industry Solutions page.
Part 8, “Solutions” on page 431. 13.1.2 Open systems - Clustering For open system environments, IBM offers several solutions in this area, including GDS for Windows environments, and HACMP™ for AIX. For more information, refer to Part 8, “Solutions”...
Page 159
The switch back is completed with one more sequence of a Metro Mirror Failover followed by a Metro Mirror Failback operations, both given at the now-recovered production site. Figure 13-1 summarizes the process. Primary site (A) Normal operation site (A) production site site (B) recovery site When planned/unplanned outage at (A): At (B): Metro Mirror Failover...
2. Deposit paycheck in checking account A. 3. Withdraw cash from checking account B. 4. WIthdraw cash from checking account A. IBM System Storage DS6000 Series: Copy Services with IBM System z data consistency and then explain how the Metro Mirror Consistency is preserved in the data copy.
DS6000 detects a condition where it cannot update the Metro Mirror target volume. This operation can be done across multiple LUNs or volumes, multiple LSSs, and even across multiple disk subsystems.
Page 162
In this case, the first update is included in the Metro Mirror target volumes, and the second and third updates are not included. Therefore, this case is also consistent. IBM System Storage DS6000 Series: Copy Services with IBM System z LSS11 Wait...
Page 163
LSS11 LSS12 Wait LSS13 Source DS6000 Target DS6000 state and the other volumes in LSS11 and 13 Chapter 13. Metro Mirror options and configuration LSS21 LSS22...
The default 2-minute timer of the extended long busy state gives the automation enough time to issue a CGROUP FREEZE command to the necessary LSSs. I/O resumes after the default 2 minutes if a CGROUP RUN command is not received. IBM System Storage DS6000 Series: Copy Services with IBM System z LSS11 Completed...
Metro Mirror will suspend the volume and allow subsequent write requests to the Metro Mirror primary volume. The pair is suspended, the secondary volume does not receive any more updates, and the primary DS6000 will perform change recording, thus keeping track of the primary updates for subsequent resynchronization.
An IEA491E message is returned to the issuing system of the next I/O that is attempted to the volume that is suspended. For open systems, an SNMP trap will be issued to the address specified when the DS6000 SNMP service was configured.
Metro Mirror will balance the workload across the available paths between the primary and secondary LSSs. Note: Keep in mind that the LSS is not a physical construct in the DS6000; it is a logical construct. Volumes in an LSS can come from multiple disk arrays.
LSS3 in DS6000 1 to LSS3 in DS6000 2 Alternatively, if the volumes in each of the LSSs of DS6000 1 map to volumes in all three secondary LSSs in DS6000 2, there will be nine logical paths over the physical link (not fully illustrated in Figure 13-7).
TotalStorage Business Continuity Solutions Guide, SG24-6547. 13.6 LSS design Because the DS6000 has made the LSS a topological construct, which is not tied to a physical array as in the ESS, the design of your LSS layout can be simplified. It is now possible to assign LSSs to applications, for example, without concern regarding under-allocation or over-allocation of physical disk subsystem resources.
On DS6000 #1, volumes defined in LSS 00 are mirrored to volumes in LSS 00 on DS6000 #2 (volume P1 is paired with volume S1, P2 with S2, P3 with S3, and so on). Volumes in LSS 01 on DS6000 #1 are mirrored to volumes in LSS 01 on DS6000 #2, and so on.
DS6000. Figure 13-8 shows a logical configuration, but this idea applies equally to the physical aspects of the DS6000. You should attempt to balance workload and apply symmetrical concepts to other aspects of your DS6000 (for example, the Extent Pools).
Metro Mirror pairs can only be established between disk subsystems of the same (or similar) type and features. For example, a DS6000 can have a Metro Mirror pair with another DS6000, a DS8000, an ESS 800, or an ESS 750. It cannot have a Metro Mirror pair with an RVA or an ESS F20.
– DS6000 interfaces – Other attached servers that support control of Metro Mirror The following are the DS6000 interfaces that can also be used with the previous list of operating systems: DS Command-Line Interface (DS CLI). The DS CLI can be used to invoke Metro Mirror commands from a server that supports the DS CLI (for example, a Windows XP server), provided that the server has appropriate connectivity to the DS6000 DS SMC.
Similar functions of the interfaces for Metro Mirror management Table 14-1 lists the commands and selections for the different interfaces that provide similar Metro Mirror control functions. Table 14-1 Commands for the different interfaces Command Establish path Establish pair Freeze Consistency Group Thaw...
Some Metro Mirror TSO commands require the use of the channel connection address (CCA) of the device in question. The CCA on a DS6000 is always relative to the LSS, and is always between 00 and FF. If the device numbers on the DS6000 have been generated as a...
In Example 14-1, the primary volume resides on LSS x’00’ of the application site DS6000. The SSID of the LSS is x’0002’, the serial number of the DS6000 is AAVCA, its CCA is x’00’, and the LSS is x’00’. The secondary volume resides in LSS x’00’ of the recovery site DS6000.
This command resumes all operations for the Metro Mirror volumes on the specified LSS. The CGROUPY RUN command is used in order to reset the ELB condition and release application I/O to the primary volumes. IBM System Storage DS6000 Series: Copy Services with IBM System z SEC(X'0003' 500507630EFFFCA0 X'01')
Example 14-6 CQUERY command CQUERY DEVN(6400) The output of the CQUERY command (shown in Example 14-7) provides volume related information, such as SSID, CCA, LSS number, DS6000 serial number and WWNN. Example 14-7 CQUERY output ANTP8802I CQUERY DEVN(6400) ANTP0090I CQUERY FORMATTED LVL 3 739...
The CRECOVER command is used to allow the recovery system to gain control of the volumes. This command is issued from the recovery system. It signals the recovery DS6000 to force the secondary volume into simplex state, thus allowing the recovery system to gain control of the volume.
MSGREQ(YES) In Example 14-10, the CRECOVER command brings device x’6400’ (on the recovery DS6000) to simplex state. It also changes the volume label from VOL002 to VOL001. 14.2.9 CSUSPEND This command is used to suspend Metro Mirror operations between a volume pair. Metro Mirror stops mirroring data to the secondary volume and starts keeping record of the primary volume tracks that are updated.
DD UNIT=3390,VOL=SER=DS6400,DISP=SHR //SYSIN DD * PPRCOPY DELPAIR DDNAME(VOL1) PRI(X'0002',AAVCA,X'00') - SEC(X'0003',AAVCA,X'00') LSS(X'00',X'01') IBM System Storage DS6000 Series: Copy Services with IBM System z Description Establishes Metro Mirror paths between a primary and secondary LSS Establishes Metro Mirror volume pairs Deletes Metro Mirror paths between a primary...
Fibre Channel links. The analyze pathing reports include the Fibre Channel Connection Information Table. This information indicates the potential connectivity of the Fibre Channel ports in the DS6000 where the I/O is issued to each system adapter port in the DS6000 that is specified by the secondary WWNN.
In Example 14-19, the FCPP parameter specifies up to 8 paths, where each path is an eight-digit hexadecimal address in the form X’aaaabbbb’ and: ‘aaaa ’ ‘bbbb’ WWNN(X'pwwnn',X'swwnn') IBM System Storage DS6000 Series: Copy Services with IBM System z is the primary system adapter ID (SAID). is the secondary system adapter ID (SAID).
This specifies the World Wide Node Name of the primary and secondary DS6000. Each WWNN is an 8-byte hexadecimal value X’wwwwwwwwwwwwwwww’ where X’pwwnn’ represents the primary WWNN and X’swwnn’ represents the secondary WWNN. 14.3.6 PPRCOPY ESTPAIR The ESTPAIR command is used to establish a Metro Mirror relationship between a primary and a secondary volume.
Page 186
STORAGE CONTROL DESCRIPTOR = E8 DEVICE DESCRIPTOR = 0A ADDITIONAL DEVICE INFORMATION = 4800243D TRKS/CYL = 15, # PRIMARY CYLS = 3339 IBM System Storage DS6000 Series: Copy Services with IBM System z DEVICE SUPPORT FACILITIES 17.0 QUERY REMOTE COPY - VOLUME (PRIMARY)
Page 187
ICK04029I DEVICE IS IN SUSPENDED PPRC STATE QUERY REMOTE COPY - PATHS PRIMARY CONTROL UNIT INFORMATION SERIAL NUMBER SSID LSS ------- ---- --- ---------------- AAVCA 0002 00 ICKDSF - MVS/ESA DEVICE SUPPORT FACILITIES 17.0 SECONDARY CONTROL UNIT INFORMATION SERIAL NUMBER SSID LSS ------- ---- --- ---------------- AAVCA...
This command is issued from the recovery system. It signals the recovery site DS6000 to remove the volume from the Metro Mirror relationship (the volume becomes simplex), and thus gives the volume control back to the recovery system. During this process the volser can be verified and also the volume can be relabeled.
(for example, Windows XP). The DS CLI can be used to create scripts for setup and control of DS6000 functions. It is a flexible and powerful interface. The DS CLI commands are documented in IBM System Storage DS6000: Command-Line Interface User´s Guide, GC26-7922.
The mkpprcpath command is used to establish Metro Mirror paths between LSS pairs on DS6000 subsystems. You can also use this command to replace existing paths. Using the -consistgrp parameter with this command, you create Consistency Groups. Example 14-27 shows a mkpprcpath command with two paths being defined.
Date/Time: 23 November 2005 23:59:50 IBM DSCLI Version: 5.1.0.204 DS: IBM.1750-1300247 CMUC00158I resumepprc: Remote Mirror and Copy volume pair 0601:0101 relationship successfully resumed. This message is being returned before the copy completes. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 194
(in other words, from the backup site to the production site), then you must have the corresponding remote copy paths established from the remote site to the local site. If you do not have these paths defined, the command fails. IBM System Storage DS6000 Series: Copy Services with IBM System z...
To establish Metro Mirror paths from the GUI, you can follow the process below. Figure 14-1 shows the Copy services Paths panel. To define paths from LSS 06 of DS6000 serial number 00247 to LSS 01 of DS6000 serial number 00819, we go to the Select Action menu, then select Create .
Page 197
Now you must select the target LSS, using the panel shown in Figure 14-3. From the menus provided, select the device to which you want to establish the path. In this example, we chose LSS 01 on a different DS6000. Then click Next . Figure 14-3 Select target LSS panel Next, you select the source I/O ports, using the panel shown in Figure 14-4 on page 174.
Page 198
Next, the panel shown in Figure 14-6 on page 175 opens. Here you can indicate whether the paths will be a Consistency Group path by using the check box. Click Next . IBM System Storage DS6000 Series: Copy Services with IBM System z...
Figure 14-6 Select path options panel Next, the verification panel (see Figure 14-7) opens. Here you can verify that everything has been selected correctly. If so, click Finish . If not, click Back or Cancel as appropriate. Figure 14-7 Create paths verification panel 14.6.2 Create Metro Mirror pairs To establish a Metro Mirror pair from the GUI, you can follow the process below.
Page 200
If you select Automatic volume pair assignment, then the panel in Figure 14-10 on page 177 opens. You then page through the list of volumes listed, and check the one you want to establish. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 201
Figure 14-10 Automatic volume assignment source volume selection panel In our example, we selected volumes 0600 and 0601. After clicking Next , the panel shown in Figure 14-11 opens. On this panel you select a target volume. Because we selected automatic volume pairing, we are taken straight to the target LSS so that we can select the target volumes.
Page 202
Figure 14-13 Metro Mirror pair verification panel The Metro Mirror panel indicating the successful establishment of the Metro Mirror pairs opens, as shown in Figure 14-14. Figure 14-14 Metro Mirror pair established, full duplex state IBM System Storage DS6000 Series: Copy Services with IBM System z...
14.6.3 Resume suspended pair To resume a suspended pair from the DS Storage Manager, you can follow a procedure similar to the procedure described in this section. First, you must access the Metro Mirror panel. Then, select the volume you want to resume, then click Resume from the Select Action menu, as shown in Figure 14-15.
Page 204
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Metro Mirror process from using too many primary site resources. This might prolong the synchronization process if your DS6000 is busy at the time. You can choose to stagger your synchronization tasks or to run them at a time of low utilization to make this process more efficient.
15.2 Scalability The DS6000 Metro Mirror environment can be scaled up or down as required. If new volumes are added to the DS6000 that require mirroring, they can be dynamically added. If additional Metro Mirror paths are required, they also can be dynamically added.
Page 208
IBM System Storage DS6000 Series: Copy Services with IBM System z...
AAVCA). The path information is also shown (one path from primary Fibre Channel adapter 0000 to secondary Fibre Channel adapter 0100). We can see that this volume is mirrored to the same DS6000 via a loopback path (the serial number for the primary and secondary DS6000 are the same).
Example 16-2 Resume suspended Metro Mirror pair from TSO CESTPAIR DEVN(X'6400') PRIM(X'0002' AAVCA X'00' X'00') - SEC(X'0003' AAVCA X'00' X'01') OPTION(SYNC) MODE(RESYNC) ANTP8802I CESTPAIR DEVN(X'6400') PRIM(X'0002' AAVCA X'00' X'00') SEC(X'0003' AAVCA X'00' X'01') ANTP8802I (CONT) C) MODE(RESYNC) ANTP0001I CESTPAIR COMMAND COMPLETED FOR DEVICE 6400. COMPLETION CODE: IEA494I 6400,DS6400,PPRC PAIR PENDING,SSID=0002,CCA=00 IEA494I 6400,DS6400,PPRC PAIR FULL DUPLEX,SSID=0002,CCA=00 Tip: You may want to do a FlashCopy of your recovery site prior to running the...
Page 212
SEC(X'2060' AAGXA X'30' X'00') ANTP8802I (CONT) LOVER) ANTP0001I CESTPAIR COMMAND COMPLETED FOR DEVICE 6430. COMPLETION CODE: ANTP8802I CQUERY DEVN(6030) IBM System Storage DS6000 Series: Copy Services with IBM System z (PRIMARY) SSID CCA LSS SSID CCA LSS* STATE PATH STATUS SERIAL# ACTIVE..
Both devices are in suspend state. Note that for device 6430, the direction of the Metro Mirror pairing has been reversed. Because the volume is in suspend state, changes will be recorded by the DS6000. At this stage you could start running your application at the secondary site. 16.2.2 Failback process The high level failback process in a planned scenario is as follows: 1.
Page 214
Example 16-7 Syslog messages for failback process ANTP8802I CQUERY DEVN(6030) ANTP0090I CQUERY FORMATTED LVL 3 257 VOLUME REPORT ************** PPRC REMOTE COPY CQUERY - VOLUME ******************** IBM System Storage DS6000 Series: Copy Services with IBM System z (PRIMARY) (SECONDARY) * SSID CCA LSS SSID CCA LSS*...
16.3 Open systems volumes with TSO commands It is possible to manage Metro Mirror, Global Copy, and FlashCopy of open systems devices through the TSO interface. We show an example of this. IBM System Storage DS6000 Series: Copy Services with IBM System z ACTION(FAI (PRIMARY)
Page 219
Establish a volume pair Similar to System z volumes, we first have to collect the required information. In this example, we already had a path defined to the secondary subsystem. We issued a CQUERY command with the ODEVN parameter to check the status of the volume, as seen in Example 16-8. Note that we have to direct the command (using the DEVN parameter) to a z/OS device with the same server affinity as the open systems volume (therefore, in this example, we direct it to a volume in LSS 00, which has the same server affinity as LSS 16).
/* ESTABLISH PPRC PATH FROM 00/ABTV1 TO 90/BYGT1 /* --------------------------------------------------------- */ - PPRCOPY DDNAME FCPPATHS (X'00420242') WWNN IBM System Storage DS6000 Series: Copy Services with IBM System z OPTION(SYNC) MODE(COPY) (PRIMARY) SSID LUN LSS SSID LUN LSS* STATE PATH STATUS SERIAL# ACTIVE..
Page 221
Example 16-12 on page 196 shows an ICKDSF job that is defining the Metro Mirror path. Notice that the PPRCOPY ESTPATH command replaces any path definitions that currently exist. In Example 16-13 we show the output from the ESTPATH command. Example 16-13 PPRCOPY ESTPATH output ICKDSF - MVS/ESA DEVICE SUPPORT FACILITIES 17.0...
Global Copy Part In this part of the book, we describe IBM System Storage Global Copy for DS6000. After presenting an overview of Global Copy, we discuss the options available, the interfaces you can use, and the configuration considerations. We also provide examples of the use of Global Copy.
Page 224
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Therefore, the primary and secondary copies can be separated by any distance. Figure 17-1 illustrates how Global Copy operates, and the flow is described here: 1. The host server makes a write I/O to the primary DS6000. The write is staged through cache and non-volatile storage (NVS).
17.2 Volume states and change logic Figure 17-2 illustrates the basic states and the change logic of a volume that is in either a Metro Mirror or Global Copy relationship. The following considerations apply to the volume states when the pair is a Global Copy pair: Simplex : The volume is not in a Global Copy relationship.
Global Copy can also be used for application recovery solutions based on periodic point-in-time copies of the data. This requires short quiescings of the application’s I/O activity. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Only modified tracks are sent to the secondary volume, because the DS6000 kept a record of all changed tracks on the primary volume while the volumes were suspended. When resuming a Global Copy relationship, you can use the same options you use to initially establish a Global Copy pair, except for the no copy option.
18.1.4 Terminate Global Copy pair This operation ends the remote copy relationship between the volume pair; the volumes return to the simplex state. 18.1.5 Convert a Global Copy pair to Metro Mirror This operation is known as the you would convert a pair from Global Copy mode to Metro Mirror mode: Situation 1 You have used Global Copy to complete the bulk transfer of data in the creation of many copy pairs, and you now want to convert some or all of those pairs to Metro Mirror mode.
Figure 18-1 Convert to synchronous using GUI To convert a Global Copy pair to a Metro Mirror pair, you can select the Global Copy pair and select Convert to synchronous from the Select Actions menu. IBM System Storage DS6000 Series: Copy Services with IBM System z...
With the DS CLI you can use the lspprc command; see Example 18-4. Example 18-4 lspprc command dscli> lspprc -dev IBM.1750-13AAGXA -remotedev IBM.1750-13AAVCA -l 1610 Date/Time: June 14, 2005 5:51:35 PM CDT IBM DSCLI Version: 5.0.3.110 DS: IBM.1750-13AAGXA State ==========================================================================================...
Page 234
6. Reestablish suspended pairs (resync) Figure 18-3 Create a Global Copy consistent copy IBM System Storage DS6000 Series: Copy Services with IBM System z point-in-time consistent catch-up to their primary counterparts. Global Copy non-synchronous...
Cascading can be useful when you are migrating data from an ESS to the DS6000. If the volumes to be migrated are mirrored between two ESSs with Metro Mirror, you can set up a cascaded Global Copy from the secondary ESS to the DS6000.
Page 236
Global Copy (or Metro Mirror), and they in turn would be copied to the target volumes on the DS6000 using cascading Global Copy. The intermediate ESS has to be at LIC level 2.4.3.65 or later in order to support Global Copy with the DS6000.
—license size in terms of physical capacity—for use of an associated licensed function. This is also referred to as the The extent of IBM authorization for the use of a licensed function on a 1750 system is established by acquiring 53xx feature number on the 1750 base enclosure. The same 53xx feature numbers acquired to enable a licensed function also establish the extent of IBM's authorization.
Global Copy pairs can only be established between disk subsystems of the same (or similar) type and features. For example, a DS6000 can have a Global Copy pair with another DS6000, a DS8000, an ESS 800, or an ESS 750. It cannot have a Global Copy pair with an RVA or an ESS F20.
Global Copy will balance the workload across the available paths between the source and target LSSs. Note: Remember that the LSS is not a physical construct in the DS6000; it is a logical con- struct. Volumes in an LSS can come from multiple disk arrays.
Dense Wave Division Multiplexors (DWDM) on dark fibre Channel extender Channel extender vendors connect DS6000 systems with a variety of Wide Area Network (WAN) connections, including Fibre Channel, Ethernet/IP, ATM-OC3, and T1/T3. When you use channel extender products with Global Copy, the channel extender vendor determines the maximum distance supported between the primary and secondary DS6000.
18.9 Other planning considerations Figure 18-6 illustrates the use of Global Copy for point-in-time backup solutions. Primary Site primary channel extender minimum performance impact Figure 18-6 Global Copy environment When you are planning to use Global Copy for point-in-time backup solutions, and if you are going to have tertiary copies, then within the target disk subsystem you should have an available set of volumes ready to become the FlashCopy target.
Page 242
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Global Copy volumes, as compared to the suspended volumes, because with Global Copy, the changes have to be sent to the remote DS6000. But this is a negligible overhead for the application, as compared with the typical synchronous overhead.
Global Copy management when Global Copy is used with the IBM System Storage DS6000 in System z environments. The information discussed in this chapter can be complemented with the following: Chapter 3, “DS Storage Manager”...
Global Copy management and control. Coverage of the DS Open API is beyond the scope of this IBM Redbook. For information on the DS Open API, refer to IBM System Storage DS Open Application Programming Interface Reference, GC35-0516.
Page 247
Table 20-1 Comparison of commands Task Global Copy paths commands List available I/O ports that can be used to establish Global Copy paths. List established CQUERY PATH Global Copy paths. Establish path CESTPATH Delete path CDELPATH Global Copy pairs commands Failback CESTPAIR AC- TION(FAILBACK)
Table 20-3 on page 225 summarizes the values of the CESTPAIR command parameters that you use when working with Global Copy pairs. Refer also to Table 20-3 for the parameter values for a go-to-sync transition. IBM System Storage DS6000 Series: Copy Services with IBM System z Description Establishing Global Copy volume pairs...
When establishing a path between DS6000s for Global Copy, use the CESTPATH command. There must be a physical Fibre Channel connection between the two DS6000 subsystems. You need to know the SSID, World Wide Node Name (WWNN), and LSS number for the primary and secondary DS6000s.
Note: A single LSS can be paired with up to four other LSSs. Therefore, you might have to issue up to four CGROUP commands to suspend all pairs on a single primary LSS. IBM System Storage DS6000 Series: Copy Services with IBM System z Stops all host application I/O to the primary volumes on the specified LSS pair.
CQUERY DEVN(X'6030') The output of the CQUERY command, as shown in Example 20-7, provides volume-related information, such as SSID, CCA, LSS number, and DS6000 serial number. The TSO CQUERY command output for a Global Copy pair returns the number of out-of-sync tracks.
MSGREQ(YES) In Example 20-8, the CRECOVER command brings device x’2242’ (on the recovery DS6000) to simplex state. It also changes the volume label from VOL002 to VOL001. 20.2.9 CSUSPEND This command is used to suspend Global Copy operations between a volume pair. Global Copy stops mirroring data to the secondary volume and starts keeping a record of the primary volume tracks that are updated.
DS6000 functions. It is a flexible and powerful interface. In this section, we give an overview of the available DS CLI commands that you can use for Global Copy. For detailed information, refer to IBM System Storage DS6000: Command-Line Interface User´s Guide, GC26-7922.
Global Copy paths, see Example 20-11. Example 20-11 lsavilpprcport command dscli> lsavailpprcport -l -dev IBM.1750-13AAGXA -remotedev IBM.1750-13AAVCA -remotewwnn 500507630EFFFCA0 16:16 Date/Time: June 14, 2005 9:36:35 AM CDT IBM DSCLI Version: 5.0.3.110 DS: IBM.1750-13AAGXA Local Port Attached Port Type Switch ID Switch Port =================================================== I0000...
Example 20-14 rmpprcpath command dscli> rmpprcpath -dev IBM.1750-13AAGXA -remotedev IBM.1750-13AAVCA 16:16 Date/Time: June 12, 2005 5:58:25 AM CDT IBM DSCLI Version: 5.0.3.110 DS: IBM.1750-13AAGXA CMUC00152W rmpprcpath: Are you sure you want to remove the Remote Mirror and Copy path 16:16:? [y/n]:y CMUC00150I rmpprcpath: Remote Mirror and Copy path 16:16 successfully removed.
Page 256
Example 20-18 mkpprc command dscli> mkpprc -dev IBM.1750-13AAGXA -remotedev IBM.1750-13AAVCA -type gcp -mode full 1600:1600 Date/Time: June 14, 2005 11:25:49 AM CDT IBM DSCLI Version: 5.0.3.110 DS: IBM.1750-13AAGXA CMUC00153I mkpprc: Remote Mirror and Copy volume pair relationship 1600:1600 successfully created.
Example 20-22 rmpprc command dscli> rmpprc -dev IBM.1750-13AAGXA -remotedev IBM.1750-13AAVCA 1600:1600 Date/Time: June 14, 2005 12:48:09 PM CDT IBM DSCLI Version: 5.0.3.110 DS: IBM.1750-13AAGXA CMUC00160W rmpprc: Are you sure you want to delete the Remote Mirror and Copy volume pair...
Global Copy pairs. You can get to the Metro Mirror panel as follows: 1. Select Real-time manager . 2. Select Copy services . 3. Click Metro Mirror . Figure 20-3 on page 235 shows the Metro Mirror panel. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 259
Figure 20-3 Metro Mirror panel To create a new Global Copy pair, choose Create from the Select Action pull-down menu. The DS Storage Manager will guide you through the process to create a new pair. Figure 20-4 Metro Mirror panel If you select an existing Global Copy pair (see Figure 20-4), then the Select Action pull-down menu will show additional actions you can perform with the selected volume pair: Delete : Use this action to delete a Global Copy pair.
Page 260
IBM System Storage DS6000 Series: Copy Services with IBM System z...
CQUERY command. We did this for one volume, as shown in Example 21-3 on page 239. IBM System Storage DS6000 Series: Copy Services with IBM System z LCU 00...
2. We checked which FCP ports were available for establishing paths between LSS 05 on the ESS 800 and LSS 02 on the DS6000. We used the DS CLI in one-shot mode to issue the availpprcport command; see Example 21-10 on page 242. Profile ess-22399.prf contains the necessary logon information for the ESS 800 source system.
Page 266
Example 21-10 Check ports C:\IBM\DSCLI>dscli -cfg ess-22399.prf lsavailpprcport -dev ibm.2105-22399 -remotedev ibm.1750-1300247 -remotewwnn 500507630efffe16 05:02 Date/Time: November 22, 2005 4:08:10 PM EET IBM DSCLI Version: 5.1.0.204 DS: IBM.2105-22399 Local Port Attached Port Type ============================= I000C I0103 I00AC I0003 3. We established paths from source LSS 05 to target LSS 02. The CLI script file to do this is shown in Example 21-11.
Page 267
Example 21-16 Synchronize pairs C:\IBM\DSCLI>dscli -cfg ess-22399.prf -script syncpair.cli Date/Time: November 22, 2005 4:42:20 PM EET IBM DSCLI Version: 5.1.0.204 DS: IBM.2105-22399 CMUC00153I mkpprc: Remote Mirror and Copy volume pair relationship 050A:023A successfully created. Date/Time: November 22, 2005 4:42:42 PM EET IBM DSCLI Version: 5.1.0.204 DS: IBM.2105-22399 CMUC00153I mkpprc: Remote Mirror and Copy volume pair relationship 050B:023B successfully created.
ESCON/FICON director configurations as relevant. 7. As a final clean-up step, we removed the paths between the ESS 800 and the DS6000. We did this using CLI in one-shot mode; see Example 21-19.
2C00 Primary Primary Primary Primary local site Figure 22-1 Synchronous data replication IBM System Storage DS6000 Series: Copy Services with IBM System z dependent writes and data consistency are explained in detail in Host Server Synchronous Replicate Secondary Storage Disk...
Page 271
In synchronous data replication methods such as Metro Mirror, an application write always goes through the following four steps; see Figure 22-1 on page 246: 1. Write the data to the primary storage disk subsystem cache and present channel end to free up the channel for further I/O.
Page 272
This does not happen with an automated solution such as GDPS, that makes use of the freeze capabilities of the IBM System Storage DS6000. Had GDPS been there, after failing over to the secondary site, the database subsystem would have just restarted without the necessity for a lengthy database recovery.
In an asynchronous data replication environment, an application write I/O goes through the following steps; see Figure 22-4: 1. Write application data to the primary storage disk subsystem cache. IBM System Storage DS6000 Series: Copy Services with IBM System z Host Server...
Page 275
2. Present channel end and device end and acknowledge to the application successful I/O completion. The application can then immediately schedule the next I/O. 3. Replicate the data from the primary storage disk subsystem cache to the secondary storage disk subsystem cache. 4.
Page 276
All this is what basically Global Mirror is about. IBM System Storage DS6000 Series: Copy Services with IBM System z Database Subsystem...
To accomplish the necessary activities with minimum impact on the application write I/O, Global Mirror introduces a smart bitmap approach in the primary storage disk subsystem. With this, Global Mirror can resume the application I/O processing immediately after a very brief serialization period for all involved primary storage disk subsystems —this brief serialization periodically occurs at the very beginning of a sequence of events that resemble the ones outlined above.
Page 278
The Master also receives all acknowledgements from his subordinates and their secondaries, and coordinates and serializes all the activities in the session. IBM System Storage DS6000 Series: Copy Services with IBM System z...
When the Master and Subordinate are in a single storage disk subsystem the Subordinate is internally managed by the Master. With two or more storage disk subsystems at the local site, which participate in a Global Mirror session, the Subordinate is external and needs separate attention when creating and managing a Global Mirror session or environment.
Copy replicates the data from the A volume to the B volume based on this out-of-sync bit map. IBM System Storage DS6000 Series: Copy Services with IBM System z Host...
In the following paragraphs we refer to the primary volume as the A volume and to the secondary volume as the B volume for simplicity. Global Copy does not immediately copy the data as it arrives to the A volume. Instead, this is an asynchronous process.
Currently only a single session is allowed per storage server. The architecture allows for more than one session and will be exploited in the future. IBM System Storage DS6000 Series: Copy Services with IBM System z nocopy property.
22.3.6 Populate Global Mirror session with volumes Add Global Copy primary volume to Global Mirror session Primary Primary Primary PENDING Local site Figure 22-14 Add Global Copy primary volume to Global Mirror session The next step is the definition of volumes in the Global Mirror session. The focus is still on the local site;...
The numbers in Figure 22-16 on page 261 illustrate the sequence of the events involved in the creation of a Consistency Group. This illustration provides only a high level view that is sufficient to understand how this process works. IBM System Storage DS6000 Series: Copy Services with IBM System z Host Global Copy...
Page 285
Done Start Start Serialize all Global Copy Drain data from local to remote site primary volumes Primary Primary Local Figure 22-16 Formation of consistent set of volumes at the secondary site Note that before step 1 and after step 3, Global Copy constantly scans through the out-of-sync bitmaps and replicates data from A volumes to B volumes as described in “Create Global Copy relationship between local and remote volume”...
Global Mirror will stay in Global Copy mode while regularly re-evaluating the situation to determine when to start to form the next Consistency Group. IBM System Storage DS6000 Series: Copy Services with IBM System z Maximum...
Page 287
If this persists for a significant period of time, then eventually Global Mirror will force the formation of a new Consistency Group. In this way Global Mirror ensures that during periods when the bandwidth is insufficient, production performance is protected and data is transmitted to the secondary site in the most efficient manner possible.
Page 288
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Global Mirror Part This part of the book describes IBM System Storage Global Mirror for DS6000 when used in a System z environment. We discuss the characteristics of Global Mirror and describe the options for its setup. We also show which management interfaces can be used, as well as the important aspects to be considered when establishing a Global Mirror environment.
Page 290
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Mirror tuning parameters and how to modify an active Global Mirror session. We also discuss a scenario where a sites switch is performed due to a primary site failure. The information discussed in this chapter can be complemented with the following IBM publications: z/OS DFSMS Advanced Copy Services, SC35-0428 IBM System Storage DS6000: Command-Line Interface User´s Guide, GC26-7922...
This set of volumes can reside in one or more LSSs and one or more storage disk subsystems at the primary site. Open systems volumes and z/OS volumes can both be members of the same session. IBM System Storage DS6000 Series: Copy Services with IBM System z recovery point...
When you start or resume a session, Consistency Groups are created, and the Master storage disk subsystem controls the session by communicating with the Subordinate storage disk subsystems. There is also a session concept at the LSS level. But all LSS sessions are combined and grouped together within a Global Mirror session.
Page 294
4. With external Subordinates, that is, with more than one involved disk subsystem at the local site, you need paths between the Master LSS and any potential Subordinate storage IBM System Storage DS6000 Series: Copy Services with IBM System z Global Copy...
disk subsystem at the local site. If you did not establish these paths in the very first step, then this is the time to create these paths before you continue with the next step. 5. Define a token that identifies the Global Mirror session. This is a session ID with a number between 1 and 255.
If you resume a paused session without specifying these parameters, they will be set to their default values; see 22.4.2, “Consistency Group parameters” on page 262. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Important: When setting new values for the tuning parameters, be sure to check for errors in Consistency Group formation and in draining the out-of-sync bitmaps. A few errors are not significant and do not jeopardize the consistency of your Global Mirror. However, if failures repeatedly occur, such as, no more consistency groups are formed, or the percentage of successful Consistency Groups is unacceptable, or the frequency of Consistency Groups is not meeting your requirements (Recovery Point Objective-RPO),...
The SSID parameter addresses the LSS that contains the source volume. In both examples, consider that despite the removal of the IBM System Storage DS6000 Series: Copy Services with IBM System z TARGET(73081 00 0E) +...
volumes from the Global Mirror session, Global Copy keeps running and replicating newly arrived write I/Os over the paths to the remote storage disk subsystem. The termination of FlashCopy relationships, may be needed when you want to change the FlashCopy targets within a Global Mirror configuration and choose, for example, another LSS for the FlashCopy targets.
Page 300
Subordinates. Not considering availability, from a communications and traffic viewpoint only, a link would be sufficient for the traffic between the Master and its Subordinates. For redundancy, we suggest configuring two links. IBM System Storage DS6000 Series: Copy Services with IBM System z Global Copy Network...
Page 301
Note that when you configure links over a SAN network, the same FCP ports of the storage disk subsystem may be used for the Global Mirror session communication, as well as for the Global Copy communication, and for host connectivity. However, for performance reasons, and to prevent host errors from disrupting your Global Mirror environment, it is often a good idea to use separate FCP ports.
Page 302
Subordinate storage disk subsystems. Still, dedicated ports for Global Mirror control communication between Master and Subordinate provides a maximum of responsiveness. IBM System Storage DS6000 Series: Copy Services with IBM System z Global Copy links Global Copy links...
Primary Primary Subordinate Primary PENDING Primary Primary Subordinate Primary PENDING Master Primary Primary Primary PENDING Local site Figure 23-6 Dedicated Global Mirror links and dedicated Global Copy links 23.6 Connectivity between local and remote site The choice of which interface to use for Global Mirror management may depend on how the 2-site configuration is designed.
Page 304
From a management viewpoint this may not be the preferable approach to managing a Global Mirror environment. IBM System Storage DS6000 Series: Copy Services with IBM System z Global Mirror session links...
23.6.2 Single site host connectivity Primary Primary Primary PENDING Primary Primary Primary PENDING Host channels Primary Primary Primary PENDING FICON FICON/FCP director(s) Host Figure 23-8 Single site host connectivity - with or without FICON connectivity between sites Figure 23-8 shows a single host configuration example. This is again a 2-site disaster recovery solution, although there are no hosts on one of the sites, the recovery site.
Master storage disk subsystem that is also the primary disk subsystem—and it just failed, and cannot communicate any longer with its partners at the remote site. IBM System Storage DS6000 Series: Copy Services with IBM System z Host Global Copy...
Primary Primary Primary Primary Primary PENDING Local site Figure 23-10 Primary site fails The goal is to swap to the remote site and restart the applications. This requires, first, to make the set of consistent volumes at the remote site available for the application, before the application can be restarted at the remote site.
Page 308
DD DDNAME=SYSIN CESTPAIR DEVN (X'3C00') PRIM (X'3C00' 73081 X'00' X'0C') SEC (X'2C00' 27131 X'00' X'0C') ACTION(FAILOVER) ONLINSEC(NO) MSGREQ(NO) CRIT(NO) + OPTION(XD) IBM System Storage DS6000 Series: Copy Services with IBM System z Host Failover B to A Primary Primary Primary Primary...
Note that this command just changes the state of the secondary volumes from pending primary suspended disk subsystem at all, even though it is specified in the SEC parameter of the command. Once all the Failover commands are successfully executed, we can move on to the next step. 23.7.4 Check for valid Consistency Group state Primary Primary...
Page 310
Table 23-1 Consistency Group and FlashCopy validation decision table Are all FC relationships revertible? Case 1 IBM System Storage DS6000 Series: Copy Services with IBM System z SERIAL MAX XC PC CC RV SEQNUM 1 50099 N S N N 42B03957 Transmit updates in Global Copy mode...
Page 311
Are all FC relationships revertible? Case 2 SOME - Some FlashCopy pairs are revertible and others are not revertible. Case 3 YES. Case 4 SOME - Some FlashCopy pairs are revertible and others are not revertible. If you see a situation other than the above four situations, then the Global Mirror mechanism has been corrupted.
Page 312
FlashCopy relationship to its current state and resets the revertible state to NO. Note again, when you issue this command to FlashCopy pairs that are not revertible any longer, you are going to see only an error message and no action is performed. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Example 23-8 Withdraw Global Mirror FlashCopy relationship with ACTION(COMMIT) //* -------------------------------------------------------------- *** //FCWITHDR EXEC PGM=IKJEFT01 //SYSPRINT DD SYSOUT=* //SYSTSPRT DD SYSOUT=* //SYSTSIN DD DDNAME=SYSIN FCWITHDR SDEVN(X'6400' TDEVN(X'6500') ACTION(COMMIT) 23.7.5 Set consistent data on B volumes At this point only the C volumes comprise a set of consistent data volumes. The B volumes per definition do not provide consistent data, because Global Copy does not provide data consistency.
//* -------------------------------------------------------------- *** //FCESTBL EXEC PGM=IKJEFT01 //SYSPRINT DD SYSOUT=* //SYSTSPRT DD SYSOUT=* IBM System Storage DS6000 Series: Copy Services with IBM System z nocopy relationship between B and C caused some I/Os from B to C. MODE(ASYNC) OPTION (GET READY FOR GM)
Page 315
//SYSTSIN DD DDNAME=SYSIN FCESTABL SDEVN(X'3C00') TDEVN(X'3E00') MODE(ASYNC) Now you may restart the applications at the remote site using the B volumes. Note the B volumes are Global Copy primary volumes in suspended state, which implies that change recording takes place. Later this allows you to resynchronize from B to A, before returning to the local site.
B to A before restarting the application at the local site. This is accomplished doing a Failback operation (Copy Services Failback function) from B to A; see Figure 23-16. IBM System Storage DS6000 Series: Copy Services with IBM System z Host Restart applications...
Note that the Failback operation is issued to the B volumes as the primary and the A volumes as the secondary. This command changes the A volume from its previous primary pending state to secondary pending and starts the resynchronization of the changes from B to A. Before doing the Failback operation, ensure that paths are established from the remote site LSS to its corresponding LSS at the local site.
Page 318
Primary Primary Primary PENDING Local site Figure 23-19 Establish Global Mirror FlashCopy relationship between B and C IBM System Storage DS6000 Series: Copy Services with IBM System z Host Host Resync from A to B Global Copy Host Global Copy...
Page 319
Last but not least, if you did not already establish the FlashCopy relationship from B to C during the Failover - Failback sequence at the remote site, then you have to do it now. This may be an inband FlashCopy as shown in Figure 23-19. A TSO command example is provided in Example 23-13.
2-site remote copy configurations. IBM offers the GDPS and eRCMF service offerings to deliver solutions in this area; see Part 8, “Solutions” on page 431, for more information. You can also visit the IBM Web site and see the Services & Industry Solutions page for more information.
Chapter 20, “Global Copy interfaces” on page 221 The examples presented in Chapter 26, “Global Mirror examples” on page 341 Chapter 31, “IBM TotalStorage Productivity Center for Replication” on page 467 z/OS DFSMS Advanced Copy Services, SC35-0428 Device Support Facility User’s Guide and Reference, SC35-0033 IBM System Storage DS6000: Command-Line Interface User´s Guide, GC26-7922...
TotalStorage Productivity Center for Replication (TPC for Replication) provides management of DS6000 series business continuance solutions, including FlashCopy, Metro Mirror, and Global Mirror. TPC for Replication is covered in Chapter 31, “IBM TotalStorage Productivity Center for Replication” on page 467. TPC for Replication includes functions similar to Global Mirror Utility (GMU).
Write I/O Primary Primary Primary Primary PENDING Local site Figure 24-1 Establish FlashCopy relationship within Global Mirror 24.2.1 Establish FlashCopy using TSO Example 24-1 shows the TSO command that creates the FlashCopy relationship between the B and the C volumes. Example 24-1 Establish FlashCopy between B and C volumes using a TSO command FCESTABL SDEVN(X'3C00') TDEVN(X'3E00') MODE(ASYNC) In the FCESTABL command, the source and target volumes are identified by their z/OS device...
DS8000 environment. In this case, it indicates that the commands have to go through the HMC, which is identified by its corresponding IP address. For a DS6000 it also identifies the external SMC with the necessary software stack to handle the Copy Services commands.
24.2.3 Establish FlashCopy using ICKDSF ICKDSF is usually the interface that is used to manage remote copy configurations in z/VM and z/VSE environments. It is a batch-oriented approach and requires the JCL to invoke ICKDSF. Example 24-7 shows the FlashCopy command used to create a Global Mirror FlashCopy relationship.
TSO commands may also be executed from REXX or CLIST procedures. TSO commands have the advantage that they do not need a DS6000 SMC, nor an ad hoc storage management server. They are directly forwarded, via an inband approach, to the storage disk subsystem.
Example 24-9 shows the TSO command that is used to define the four logical paths, at once, between the primary LSS and the secondary LSS. If using TSO commands, there is no change in how to define a path on the DS6000 or the DS8000, as compared to the ESS 800. Example 24-9 Define logical paths...
Page 328
Master. Any LSS in the Subordinate storage disk subsystems is eligible for establishing the Master - Subordinate relationship needed for the Global Mirror session. IBM System Storage DS6000 Series: Copy Services with IBM System z X'02300230' X'03310330') CGROUP(NO) Local site...
For redundancy reasons it is better to define two paths between the primary disk subsystems. Note that the FCP ports may be shared using a SAN fabric. See Figure 24-3. 24.3.3 Establish Global Copy volume pairs After defining the paths, you create the Global Copy volume pairs. 2C00 Primary LCU: 2C00...
Page 330
Tip: The recommendation is to wait until this first replication phase is finished before you proceed to establish the Global Mirror FlashCopy relationships between the B and C volumes. IBM System Storage DS6000 Series: Copy Services with IBM System z (PRIMARY) SSID CCA LSS SSID CCA LSS*...
The TSO command RSESSION is used to set up and manage a Global Mirror session; see Example 24-15. This includes the ability to define a Global Mirror session by means of the ACTION(DEFINE) parameter option. Other options that can be specified for the ACTION parameter are: START and STOP a Global Mirror session, as well as PAUSE and RESUME of the session, or to UNDEFINE the session.
VOLSER indicates an online z/OS volume serial number. This utility volume is used to address the RQUERY command to the particular LSS where the query report is requested. IBM System Storage DS6000 Series: Copy Services with IBM System z - ALLOW 10 MINUTES FOR DRAINING VOLSER(XX2C00)
Page 335
ACTION is required and specifies which kind of query report is requested. Three different query reports can be requested with this parameter: – GMLSTAT provides summary information pertaining to the Global Mirror session. This includes information about the Master storage disk subsystem, the Subordinate storage disk subsystems, as well as the number of successfully created Consistency Groups and how often Consistency Group creation failed.
Page 336
Consistency Groups formation at the remote site. IBM System Storage DS6000 Series: Copy Services with IBM System z Running . Refer to z/OS DFSMS Advanced Copy...
24.4 DS CLI to manage Global Mirror volumes in z/OS The DS CLI has a set of commands that are common between the DS6000, the DS8000, and the ESS 800 (from LIC level 2.4.3 and above), to manage a Copy Services environment.
Manage a Global Mirror session; pause and resume, start and stop aGlobal Mirror session 24.5.2 Define paths There is no change on how to define paths on the DS6000, or the DS8000, as compared to the ESS 800. Note: For remote copy functions, only Fibre Channel links are supported on the DS6000.
Page 339
Paths Subordinate Global Mirror session paths Host Master WWNN: 5005076300C09517 Local site (primary) Figure 24-8 Define all needed paths for the Global Mirror environment through ICKDSF Example 24-23 shows the JCL and command lines used to define paths between two storage disk subsystems.
(SEC) parameters require positional parameters, with SSID in the first specification. The second parameter is the serial number of the corresponding storage disk subsystem, not in IBM System Storage DS6000 Series: Copy Services with IBM System z Primary volumes Master...
hex notation. In hex notation the third parameter refers to the channel connection address (CCA) of the corresponding device. 24.5.4 Establish FlashCopy relationships The next step is to create the FlashCopy relationship between the B volume and the C volumes at the remote site; note in Figure 24-10 the particular attributes for FlashCopy because it is being used in a Global Mirror environment.
Global Mirror setup, requires to be defined in the session before adding volumes to the session. As Figure 24-11 on page 319 shows, the session number applies only to the LSS at the local site. IBM System Storage DS6000 Series: Copy Services with IBM System z (X'0C',X'00',X'2C00' 03461) - (X'0E',X'00',3E00)
Primary volumes Session number Subordinate Global Mirror session paths Master Figure 24-11 ICKDSF - define Global Mirror session Example 24-27 shows an ICKDSF job that defines a Global Mirror session involving the LSS that volume RS7000 belongs to. Note that with this Global Mirror command, you do not need to define an LSS number, nor a CCA, nor the SSID.
Page 344
LSS that is addressed by the UNIT parameter. Example 24-29 Multiple volume ranges in ICKDSF Global Mirror command with RVOLLIST RVOLLIST ((X’00’,X’1F’),(X’30’,X’3F)) VOLCNT(2) IBM System Storage DS6000 Series: Copy Services with IBM System z Secondary volumes = Flashcopy source Subordinate...
Note that the VOLCNT parameter counts the number of ranges you specify in the RVOLLIST parameter. In Example 24-29 the VOLCNT is 2 because RVOLLIST contains two ranges. Instead of RVOLLIST, you can select dedicated volumes that are going to become a part of Global Mirror session through the IVOLLIST parameter.
Copy primary volumes (simplex, SX). This means the volumes have been added to the session with the POPULATESESSION command, although these volumes are not Global Copy primary volumes. This is indicated by the SX code. IBM System Storage DS6000 Series: Copy Services with IBM System z SESSIONNO(001) MAXCOORDTIME(05) -...
This is because the FlashCopy operations were part of the process of Consistency Groups formation, but now we have asked to stop the session, thus to stop the Consistency Groups formation activity. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Example 24-33 Stop Global Mirror session with ICKDSF //* -------------------------------------------------------------- *** //TERMSESS EXEC PGM=ICKDSF //SYSPRINT DD SYSOUT=* //DD01 DD UNIT=3390,VOL=SER=AA6000,DISP=SHR //SYSIN DD * PPRCOPY DDNAME(DD01) TMASYNC SESSNO(001) TERMINATE MASTER Note also that an ongoing process to form a Consistency Group may not come to a successful end when you TERMINATE a session.
TGTVOL parameters, we identify the FlashCopy source and target volumes at the remote site. This command will end the FlashCopy relationship between the B and C volumes. IBM System Storage DS6000 Series: Copy Services with IBM System z /* WITHDRAW...
24.5.14 Delete Global Copy pairs Example 24-37 shows how to delete the Global Copy volume pairs. Example 24-37 Delete Global Copy pairs with ICKDSF commands //* -------------------------------------------------------------- *** //DELPAIR EXEC PGM=ICKDSF //SYSPRINT DD SYSOUT=* //DD01 DD UNIT=3390,VOL=SER=AA6000,DISP=SHR //DD02 DD UNIT=3390,VOL=SER=AA6001,DISP=SHR //DD03 DD UNIT=3390,VOL=SER=AA6002,DISP=SHR //DD04...
Note: The DS SM examples that we present in this section were run in a DS8000 HMC, but are basically similar to what you see in a DS6000 SMC when using the DS SM GUI. Figure 24-16 shows the entry point to the Global Mirror real-time application.
24.7.1 View Global Mirror volumes in session From the panel in Figure 24-16 on page 328, we select the View session volumes from the pull-down list, as shown in Figure 24-17. Figure 24-17 View Global Mirror volumes in session1 - select action The next panel, shown in Figure 24-18, provides the requested list of Global Copy primary volumes that are defined to session number 01.
Figure 24-18 suggests you choose meaningful nicknames for the volumeswhen you define them to the DS6000. These nicknames indicate that the volumes belong to Extent Pool2, which is a CKD pool, and the corresponding z/OS device numbers are 2000+. The syntax of the nicknames is a bit limited and does, for example, not allow you to use numerics in the prefix part of the nickname when defined through the GUI.
Page 355
Next you receive a confirmation panel as shown in Figure 24-20. Figure 24-20 Pause selected session number 1 - confirmation panel Click OK and you receive the next panel; see Figure 24-21. Figure 24-21 Session is paused Figure 24-21 shows the result as well as the status information indicating that session number 01 is paused.
Page 356
You receive another confirmation panel asking whether to continue with the resume operation; see Figure 24-23. Figure 24-23 Resume paused session number 1 through the GUI - confirmation panel IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 357
We click OK and then receive the next panel; see Figure 24-24. Figure 24-24 Resume paused session number 1 through the GUI - session is running The session is back and running. There is a more extensive exercise based on the GUI in Chapter 26, “Global Mirror examples” on page 341.
Page 358
IBM System Storage DS6000 Series: Copy Services with IBM System z...
This chapter discusses performance considerations for planning and configuring Global Mirror for DS6000. It also explains the potential impact that the three phases of Consistency Group formation might have on application write I/Os. Finally, it covers the distribution of B volumes and C volumes across different ranks, and how to provide extra care for very busy volumes.
Primary Primary PENDING FICON Local site Host Figure 25-1 Application write I/O within two Consistency Group formation events IBM System Storage DS6000 Series: Copy Services with IBM System z Read FCP links nocopy attribute. This implies before the source Primary...
There is potential impact on the Global Copy data replication operation, depending on whether persistent memory or non-volatile cache is over-committed in the secondary storage disk subsystem. In this situation, the FlashCopy source tracks might have to be preserved first to the FlashCopy target volume, before the Global Copy write completes. Usually, however, all writes are quick writes to cache and persistent memory.
Through a one-to-one mapping from the local to the remote storage disk subsystem, you achieve the same configuration at the remote site for the B volumes and the C volumes. IBM System Storage DS6000 Series: Copy Services with IBM System z maximum drain time...
Page 363
Figure 25-3 on page 339 proposes spreading the B and C volumes over different ranks at the remote storage disk subsystem. Primary Primary Primary PENDING Rank 1 Primary Primary Primary Host PENDING channels Rank 2 Primary Primary Primary FICON PENDING Rank 3 Local site Host...
I/O load for the first initial copy pass. If possible, then plan a massive add of new Global Copy volumes into an existing session during off-peak periods. IBM System Storage DS6000 Series: Copy Services with IBM System z links Host...
Deal with a primary site failure and the subsequent recovery at the backup site. Also, the management of a planned outage is discussed. Remove a Global Mirror environment. The information discussed in this chapter can be complemented with the following IBM publications: z/OS DFSMS Advanced Copy Services, SC35-0428 IBM System Storage DS6000: Command-Line Interface User´s Guide, GC26-7922...
Figure 26-1. 26.2.1 Query a Global Mirror session The RQUERY command provides information about a Global Mirror session. RQUERY has the following options: IBM System Storage DS6000 Series: Copy Services with IBM System z Global Copy Global Copy DWDM or...
DVCSTAT GMLSTAT GMPSTAT The RQUERY command and its options have been explained in 24.3.8, “Query a Global Mirror session” on page 310. 26.2.2 Query Global Mirror volume status - DVCSTAT option The DVCSTAT option returns information pertaining to the volumes in the LSS where VOLSER points to.
-- ---------- ------ ------ -------- 0C CGInPrgrs 1 Example 26-5 shows the formatted output with the session status details for LCU 2C00. IBM System Storage DS6000 Series: Copy Services with IBM System z Pct CrnBadCG TotBadCG LastGoodCGSCntlClock Pct CrnBadCG TotBadCG LastGoodCGSCntlClock...
Creating consistency groups relies also on internal timing information. It is important to understand that the internal timer in the DS6000 is not synchronized with an external clock. Example 26-6 shows an RQUERY command example with a TIME command just before the RQUERY command.
First you define paths from A to B; see Example 26-7 on page 347. These are the paths that will be used for data transmission between the Global Copy pairs. IBM System Storage DS6000 Series: Copy Services with IBM System z join pending...
Page 371
Example 26-7 Define paths for Global Copy from A to B //* ---------------------------- TSO ----------------------------- *** //* ESTABLISH PATH(S) for Global Copy pairs //* -------------------------------------------------------------- *** //EPATHS EXEC PGM=IKJEFT01 //SYSPRINT DD SYSOUT=* //SYSTSPRT DD SYSOUT=* //SYSTSIN DD DDNAME=SYSIN CQUERY DEVN (X'2C00') PATHS CESTPATH DEVN (X'2C00') PRIM (X'2C00' 5005076303FFC228 X'0C') + SEC (X'3C00' 5005076303FFC422 X'0C') +...
DEVN (X'2D01') Make sure the establish commands complete successfully and their initial copy phase starts. For this you use a CQUERY command; see Example 26-10 on page 349. IBM System Storage DS6000 Series: Copy Services with IBM System z MODE(COPY) MODE(COPY)
DD DDNAME=SYSIN RSESSION SNBR(01) VOLSER(XX2C00) ACTION(DEFINE) LSSTYPE(CKD) LSSNBR(0C) ESSSERIAL(27131) MSSERIAL (27131) IBM System Storage DS6000 Series: Copy Services with IBM System z ONLINTGT(YES) ONLINTGT(YES) SERIAL MAX XC PC CC RV SEQNUM 0 50099 N S N N 00000000 MODE (ASYNC)
RSESSION SNBR(01) VOLSER(XX2D00) ACTION(DEFINE) LSSTYPE(CKD) LSSNBR(0D) ESSSERIAL(27131) MSSERIAL (27131) Note that the VOLSER parameter is used to point to the LSSs that hold the Global Copy primary volumes that will be part of this Global Mirror configuration. These volumes have to be online to the system on which this job executes.
TSO command examples. Figure 26-2 on page 353 shows the configuration during normal operations. IBM System Storage DS6000 Series: Copy Services with IBM System z - ALLOW 10 MINUTES FOR DRAINING THE STUFF *** VOLSER(XX2C00)
FICON Local site 2D01 2D00 2C00 Primary Primary Primary Primary Primary 27131 Figure 26-2 Global Mirror configuration before unplanned primary failure The production applications write to three primary volumes that are part of a Global Mirror session. 26.4.1 Primary site failure We simulate a primary site failure that may not be fatal to the storage disk subsystem.
MSSERIAL (27131) Note: Address all Global Mirror session commands to the Master LSS. This is the LSS that was used when the Global Mirror START command was given 26.4.3 Failover from B to A volumes Once the primary volumes fail and the application I/O stops at the primary site, the status of the secondary volumes (B) is changed from done with the ACTION(FAILOVER) on the secondary volumes;...
Optionally, you can create a second copy of valid data by doing a copy of the B volumes on a set of D volumes. Example 26-20 on page 357 shows how to do this. IBM System Storage DS6000 Series: Copy Services with IBM System z fast reverse restore , FRR;...
Example 26-20 Create optional second copy of data consistent D volumes //* ---------------------------- TSO ------------ CREATE (5) ----- *** //* FLASHCOPY B -> D TO CREATE COPY TO WORK (TEST) WITH //* -------------------------------------------------------------- *** //FCESTBL EXEC PGM=IKJEFT01 //SYSPRINT DD SYSOUT=* //SYSTSPRT DD SYSOUT=* //SYSTSIN DD DDNAME=SYSIN...
OPTION(XD) CESTPAIR DEVN (X'3D01') PRIM (X'3D00' 73081 X'01' X'0D') SEC (X'2D00' 27131 X'01' X'0D') ACTION(FAILBACK) OPTION(XD) 26.4.10 Return to the local site and resume Global Mirror At some time you will plan to return the application to the local site. This requires first that you quiesce the application at the remote site.
EXEC PGM=IKJEFT01 //SYSPRINT DD SYSOUT=* //SYSTSPRT DD SYSOUT=* //SYSTSIN DD DDNAME=SYSIN RSESSION SNBR(01) VOLSER(XX2C00) IBM System Storage DS6000 Series: Copy Services with IBM System z MSGREQ(NO) CRIT(NO) + CASCADE(NO) MSGREQ(NO) CRIT(NO) + CASCADE(NO) MSGREQ(NO) CRIT(NO) + CASCADE(NO) first thing to do ***...
ACTION(STOP) LSSTYPE(CKD) LSSNBR(0C) ESSSERIAL(27131) MSSERIAL (27131) RQUERY SNBR(01) VOLSER(XX2C00) ACTION(DVCSTAT) RQUERY SNBR(01) VOLSER(XX2C00) ACTION(GMLSTAT) RQUERY SNBR(01) VOLSER(XX2C00) ACTION(GMPSTAT) The GMPSTAT query shown in Example 26-25 informs that session 01 is not active any longer. Numbers are reset to zeros. Example 26-25 Session query after session stop RQUERY SNBR(01) VOLSER(XX2C00) ACTION(GMPSTAT) RQUERY Output Volser(XX2C00) Action(GMPSTAT) Version(001)
After the Global Mirror session is removed and deleted, you may remove the FlashCopy relationships between the B and C volumes. Example 26-29 on page 363 shows how to do this. IBM System Storage DS6000 Series: Copy Services with IBM System z PriPPRCStat SecCascStat PriPPRCStat SecCascStat...
Page 388
* ----- --------- ------ ------------------- 0030 0030 0130 0130 0230 0230 0331 0330 * SUBSYSTEM * ----------- ---------------- IBM System Storage DS6000 Series: Copy Services with IBM System z X'2D00' X'2D01' SSID ##### CCA (PRIMARY) SSID CCA LSS SSID CCA LSS* STATE PATH STATUS SERIAL# ACTIVE..
Primary Volumes (9) Failback (A=Primary, B=Secondary) (10) Resume session Figure 26-6 Global Mirror planned outage scenario IBM System Storage DS6000 Series: Copy Services with IBM System z this completes the GM cleanup B volumes Global Copy (2) Suspend all GC pairs Secondary Volumes (6) FlashCopy B->C...
Page 391
Figure 26-6 summarizes the scenario. The numbers indicate the sequence of events and main considerations, and also relate to Figure 26-7 where the corresponding ICKDSF commands are shown. The sequence of steps for a Global Mirror planned outage is as follows: 1.
LSS that contains the range of volumes to be removed. The JCL DD uses a utility volume for addressing purposes (VOL=SER=AA6000), which is also one of the volumes to be removed. Note that the volumes must be online. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Example 26-37 Remove volumes from a Global Mirror session with ICKDSF //* -------------------------------------------------------------- *** //REMOVE EXEC PGM=ICKDSF //SYSPRINT DD SYSOUT=* //DD01 DD UNIT=3390,VOL=SER=AA6000,DISP=SHR //SYSIN DD * PPRCOPY DDNAME(DD01) POPSESS REMOVE SESSNO VOLCOUNT (1) RANGE RVOLLIST ((X'00',X'03')) 26.7.3 Withdraw FlashCopy relationships We are going to withdraw the FlashCopy relationships between the B and C volumes using ICKDSF inband commands.
DD UNIT=3390,VOL=SER=AA6003,DISP=SHR //SYSIN DD * PPRCOPY DDNAME(DD01) DELPAIR LSS(X'00' X'00') PRI(X'2060' AAGXA X'00') - SEC(X'0002' AAVCA X'00') PPRCOPY DDNAME(DD02) DELPAIR LSS(X'00' X'00') PRI(X'2060' AAGXA X'01') - SEC(X'0002' AAVCA X'01') IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 395
PPRCOPY DDNAME(DD03) DELPAIR LSS(X'00' X'00') PRI(X'2060' AAGXA X'02') - SEC(X'0002' AAVCA X'02') PPRCOPY DDNAME(DD04) DELPAIR LSS(X'00' X'00') PRI(X'2060' AAGXA X'03') - SEC(X'0002' AAVCA X'03') For each single Global Copy pair you must specify a corresponding PPRCOPY command. The syntax for the ICKDSF command is slightly different from the equivalent TSO command. Again, the DDNAME parameter is required because the Global Copy primary volumes are usually online with the system that issues the application I/Os.
//SYSPRINT DD SYSOUT=* //SYSIN DD * ANALYZE DDNAME(DD01) NODRIVE NOSCAN This is a useful command, especially when you are collecting detailed information in case of errors and problem reporting. IBM System Storage DS6000 Series: Copy Services with IBM System z 06/16/05...
Mirror environment when using the DS Storage Manager GUI. Note: The DS SM examples that we present in this section were run in a DS8000 HMC, but are basically similar to what you see in a DS6000 SMC when using the DS SM GUI. target...
These are the volumes that are going to be members of the Global Mirror session. Figure 26-9 Global Copy paths creation step 1 - select the source LSS Click Next to proceed with the second step of this wizard. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 399
The creation wizard then displays the “Select target LSS” panel; see Figure 26-10. Here you select from the pull-down lists the Storage complex , then the Storage unit , then the Storage Image and finally the LSS , which contains the corresponding target volumes of the Global Copy pairs.
Page 400
Figure 26-13 Global Copy path creation step 5 - select the path options Click Next to proceed with the sixth and last step of this wizard. IBM System Storage DS6000 Series: Copy Services with IBM System z...
This brings you to the Verification panel; see Figure 26-14. Here you can check all the components of your path definitions and, if necessary, click Back to correct any of them, or click Finish to validate the configuration and end the wizard. Figure 26-14 Global Copy path creation step 6 - verification 26.9.2 Create Global Copy volume pairs To create Global Copy volume pairs for a Global Mirror session, using the DS Storage...
Page 402
Click Next to proceed with the second step of this wizard. Then the creation wizard displays the “Select source volumes” panel; see Figure 26-17. Figure 26-17 Global Copy creation step 2 - select the source volumes IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 403
In the “Select source volumes” panel (see Figure 26-17), select from the pull-down lists the Storage complex , then the Storage unit , then the Storage Image , then the Resource type and, if necessary, its appropriate parameter to display the list of volumes. If you have chosen the Resource type LSS, select from the pull-down list the LSS number that contains the source volumes you intend to use.
Page 404
381), select Global Copy to define the type of replication relationship. If this is the first synchronization between source and target volumes of these pairs, check the box for Perform initial copy . IBM System Storage DS6000 Series: Copy Services with IBM System z...
Figure 26-20 Global Copy creation step 4 - select the copy options Click Next to proceed with the last step of this wizard. The Verification panel is displayed; see Figure 26-21. In this panel check all the components of your Global Copy session configuration, and, if necessary, click Back to correct any of them, or click Finish to validate.
Page 406
If you have chosen the Resource type LSS, then select from the pull-down lists the LSS number that contains the source volumes you want to IBM System Storage DS6000 Series: Copy Services with IBM System z record...
Page 407
use. Select with the check boxes the source volumes you plan to use for FlashCopy within the Global Mirror session. Figure 26-24 FlashCopy creation step 2 - select the source volumes Note: Although the following panels show open systems volumes, the panels and their order apply also to CKD volumes.
Page 408
In this panel check all the components of your FlashCopy session definitions and if necessary, click Back to correct any of them, or click Finish to validate. IBM System Storage DS6000 Series: Copy Services with IBM System z select from the...
Figure 26-27 FlashCopy creation step 5 - verification 26.9.4 Create a Global Mirror session To define a Global Mirror session with the DS Storage Manager, you go through another staged panel process. To launch this wizard you first need to go to the Global Mirror panel under the Copy Services menu of DS Storage Manager GUI;...
Page 410
Figure 26-29 Global Mirror session creation step 1 - select volumes IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 411
Click Next to proceed with the second step of this wizard. The creation wizard then displays the “Define properties” panel; see Figure 26-30. Figure 26-30 Global Mirror creation step 2 - define properties When the creation wizard displays this panel, complete the “Enter session number” field with the appropriate session number.
Page 412
Storage complex , then the Storage unit , then the Storage Image , which is the Master Global Mirror session, and wait until the screen is refreshed. If it is necessary, click Refresh to refresh the panel. See Figure 26-32. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Note: The example presented in this section was run on a DS8000. The same process and commands are applicable to a DS6000 configuration. The components that have to be defined, as well as the procedure to be followed, to set up a Global Mirror environment are the same, independent of the management interface that is used.
ID with the corresponding storage disk subsystem serial numbers. Example 26-45 Sample DS CLI configuration file DS-01.profile hmc1: xxx.yyy.zzz.xxx username: admin password: passw0rd devid:IBM.2107-7506551 remotedevid:IBM.2107-7573731 fullid: off banner: on verbose: off paging: off olc: off IBM System Storage DS6000 Series: Copy Services with IBM System z...
LSS 65 in the storage disk subsystem at site 2. Example 26-47 lsavailpprcport dscli lsavailpprcpport -remotewwnn 5005076303FFC426 65:65 -cfg $DSCLI/profile/DS-01.profile Date/Time: June 14, 2005 6:18:16 PM EDT IBM DSCLI Version: 5.0.3.134 DS: IBM.2107-7506551 Local Port Attached Port Type ============================= I0100...
-remotewwnn 5005076303FFC426 -consistgrp -srclss 65 -tgtlss 65 -cfg $DSCLI/profile/DS-01.profile I0100:I0040 I0101:I0110 Date/Time: June 14, 2005 3:26:06 PM EDT IBM DSCLI Version: 5.0.3.134 DS: IBM.2107-7506551 CMUC00149I mkpprcpath: Remote Mirror and Copy path 65:65 successfully established. To list the newly created paths, use the command lspprc, which is described in 26.11.1, “Query status of the paths”...
Example 26-54 mkgmir dscli mkgmir -lss 65 -session 01 -cfg $DSCLI/profile/DS-01.profile Date/Time: June 14, 2005 3:30:33 PM EDT IBM DSCLI Version: 5.0.3.134 DS: IBM.2107-7506551 CMUC00162I mkgmir: Global Mirror for session 01 successfully started. To list a Global Mirror session, use the command showgmir as described in 26.11.5, “Query Global Mirror session information”...
Example 26-56. Example 26-56 lspprc command output dscli lspprc -l -cfg $DSCLI/profile/DS-01.profile 6500-6501 Date/Time: June 14, 2005 3:28:08 PM EDT IBM DSCLI Version: 5.0.3.134 DS: IBM.2107-7506551 State Reason Type Out Of Sync Tracks Tgt Read Src Cascade Tgt Cascade Date Suspended SourceLSS Timeout (secs)
Example 26-64 pausegmir with Master only dscli pausegmir -lss 65 -session 01 -cfg $DSCLI/profile/DS-01.profile Date/Time: June 15, 2005 10:22:39 AM EDT IBM DSCLI Version: 5.0.3.134 DS: IBM.2107-7506551 CMUC00163I pausegmir: Global Mirror for session 01 successfully paused. Example 26-65 shows the result of pausing Global Mirror session 01. This time, the session consisted of a Master running in LSS 65 of one storage image, and a Subordinate running in LSS 67 of a different storage image.
Example 26-66 resumegmir with Master only dscli resumegmir -lss 65 -session 01 -cfg $DSCLI/profile/DS-01.profile Date/Time: June 15, 2005 10:56:51 AM EDT IBM DSCLI Version: 5.0.3.134 DS: IBM.2107-7506551 CMUC00164I resumegmir: Global Mirror for session 01 successfully resumed. To visualize the resumed Global Mirror session use the command showgmir as discussed in 26.11.5, “Query Global Mirror session information”...
Example 26-69 failback - erasing data on site 1 with data from site 2 dscli failbackpprc -type gcp -tgtread 6500:6500 6501:6501 -cfg $DSCLI/profile/DS-02.profile Date/Time: June 15, 2005 12:32:27 PM EDT IBM DSCLI Version: 5.0.3.134 DS: IBM.2107-7573731 CMUC00197I failbackpprc: Remote Mirror and Copy pair 6500:6500 successfully failed back.
To query the newly created FlashCopy relationships use the command lsflash as described in 26.11.3, “Query FlashCopy pairs” on page 396. 26.12.4 Verify FlashCopy status between B and C volumes After a local site failure, you will need to check the status of all FlashCopy pairs that were in the Global Mirror session.
Example 26-74 rmgmir on Master LSS dscli rmgmir -quiet -lss 65 -session 01 -cfg $DSCLI/profile/DS-01.profile 01 Date/Time: June 15, 2005 2:18:17 PM EDT IBM DSCLI Version: 5.0.3.134 DS: IBM.2107-7506551 CMUC00165I rmgmir: Global Mirror for session 01 successfully stopped. Note: The quiet option turns off the confirmation prompt for this command.
Example 26-75 rmsession dscli rmsession -quiet -lss 65 01 -cfg $DSCLI/profile/DS-01.profile Date/Time: June 15, 2005 2:20:05 PM EDT IBM DSCLI Version: 5.0.3.134 DS: IBM.2107-7506551 CMUC00146I rmsession: Session 01 closed successfully. Note: The quiet option turns off the confirmation prompt for this command.
Page 431
Example 26-78 rmpprcpath dscli rmpprcpath -quiet 65:65 -cfg $DSCLI/profile/DS-01.profile Date/Time: June 15, 2005 2:24:05 PM EDT IBM DSCLI Version: 5.0.3.134 DS: IBM.2107-7506551 CMUC00150I rmpprcpath: Remote Mirror and Copy path 65:65 successfully removed. In Example 26-78 we remove a path from the source LSS 65 in the storage disk subsystem at site 1 to the target LSS 65 in the storage disk subsystem at site 2.
Page 432
IBM System Storage DS6000 Series: Copy Services with IBM System z...
However, once the freeze is first issued on the Metro Mirror relationship, from that point forward the remote will only be IBM System Storage DS6000 Series: Copy Services with IBM System z DWDM...
Page 437
consistent with the secondary. The local during this process is still being updated and is changing. The remote will have a snapshot of the time since the freeze was issued. DWDM PPRC-- GC PPRC-- GC DS6K DS6K Secondary Local Figure 27-2 Global Copy changed to Metro Mirror and direction reversed Once data migration and consistency have been accomplished at the remote site, you can start production at the remote site, if desired.
Page 438
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Chapter 28. and DS8000 In this chapter we show the interoperability between the Copy Services functions in the DS6000 and the DS8000. It contains the following sections: DS6000 and DS8000 Copy Services interoperability Preparing the environment RMC: Establishing paths between DS6000 and DS8000...
DS CLI or the DS GUI, your requirements are as follows: For FlashCopy management: – If you want to use the DS8000 DS GUI to manage FlashCopy on the DS6000, then you need network connectivity between the DS8000 HMCs and the DS6000 SMCs.
DS8000, it must authenticate with the DS8000. The DS user ID and password that you used to log on to the DS6000 DS GUI is used to authenticate with the DS8000 HMC. The same applies if you use the DS8000 DS GUI to manage a DS6000.
Important: Make sure that the user ID that you use to log on to the DS8000 DS GUI also exists on the DS6000 SMC and that it has the same password. If not, the operation to add the Storage Complex will fail. You must always use this user ID for multi-complex management.
Page 443
5. Select Add Storage Complex . Important: Make sure that the user ID you use to log on to the DS6000 DS GUI also exists on the DS8000 HMC and that it has the same password. If not, the operation to add the Storage Complex will fail.
Page 444
8. Having added the DS8000 Storage Complex to the DS6000 Storage Complex, you are now able to use the DS6000 DS GUI to create paths and Remote Mirror and Copy pairs, where the DS8000 is the source device. You can also use the DS6000 DS GUI to manage FlashCopy pairs on the DS8000.
DS8000 DS GUI. The same applies if you are logged on to the DS8000 DS GUI and wish to configure storage on the DS6000. You must log on to the DS6000 DS GUI to do this.
P is the port number on the card (0 to 3). So I0103 is controller 1, card slot 0, port 28.3.2 Path creation using the DS GUI Path creation between a DS6000 and a DS8000 is no different from the process that is used to create paths between two DS8000s or two DS6000. See 13.4, “Metro Mirror paths and links”...
Page 447
PPRC paths. In Example 28-6 we are logged onto the DS8000 using DS CLI, so the remote device is the DS6000. We display ports available to establish paths between LSS 14 on the DS8000 and LSS 18 on the DS6000.
Important: When you connect using the DS CLI to the DS8000 HMC, the DS8000 is the local device and the DS6000 is the remote device. If you connect with the DS CLI to the DS6000, then the DS6000 is now the local device and the DS8000 is the remote device.
In this example, we show how you can establish Metro Mirror volume pairs between a DS8000 and a DS6000 with the DS CLI. We created two Metro Mirror pairs. Volumes 0801 and 0802 from the DS8000 are the source volumes, and the target volumes on the DS6000 are 0601 and 0602.
In Example 28-9 on page 425, we connected to the DS8000 HMC with the DS CLI, so the DS6000 is the remote device. To establish pairs where the DS6000 is the source device, we must connect to the DS6000 with DS CLI. This makes the DS8000 the remote device.
28.6.1 Creating a remote FlashCopy on an DS6000 using DS CLI It is also possible to use DS CLI to create a remote FlashCopy on a DS6000 where the source PPRC device is a DS8000 and vice versa. In Example 28-12, we connected to a DS8000 using the DS CLI.
-dev parameter to refer to the remote machine is correct. 28.7 z/OS Global Mirror Using a DS8000 as the primary Storage Unit and a DS6000 as a secondary Storage Unit is a supported configuration for the purposes of z/OS Global Mirror. However, the authors did not test it for this book.
Page 453
Storage Units. If the secondary Storage Unit, the DS6000, is less capable (in performance) than the primary Storage Unit, it is likely that you will not be able to complete primary business applications in the required or expected time frame.
Page 454
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Solutions Part In this part we discuss solutions offered by IBM to assist you in the management, automation, and control of your Copy Services implementation on the DS6000. We provide an overview of the solutions, discuss the options available, and give some examples of using the solutions.
Page 456
IBM System Storage DS6000 Series: Copy Services with IBM System z...
DS8000 and the ESS 800. This chapter contains the following sections: Sections in this chapter include: DS6000 and ESS 800 Copy Services interoperability Preparing the environment RMC: Establishing paths between DS6000 and ESS 800 Managing Metro Mirror or Global Copy pairs Managing ESS 800 Global Mirror Managing ESS 800 FlashCopy...
CLI or the DS GUI, your requirements are as follows: For FlashCopy management: – If you want to use the DS6000 DS GUI to manage FlashCopy on the ESS 800, then you need network connectivity between the DS6000 SMCs and the ESS 800 Copy Services servers.
GUI is not necessary. For simplified management, you can still create a matching user ID and password. Creating a user ID on the DS6000 Log on to the DS6000 SMC using the DS GUI and create a user ID that is in either the op_storage. op_copy_services change the initial password.
If you wish to use the DS GUI to manage FlashCopy on an ESS 800, or RMC paths and pairs between an ESS 800 and a DS6000, you must add the ESS Copy Services domain to the DS SMC. You need the IP address of the ESS 800 Copy Services servers (server A and if desired, server B).
DS6000. You can only perform Copy Services management tasks on the alternative device. If you are logged on to the DS6000 DS GUI and wish to configure some storage on the ESS 800, you must log on to the ESS 800 Web Specialist.
Page 462
Figure 29-2 Viewing ESS 800 volume size using ESS Specialist GUI You can also use the ESS CLI to view the volume size as shown in Example 29-4 on page 439. IBM System Storage DS6000 Series: Copy Services with IBM System z Normal 3390-3...
When viewing port IDs in the DS GUI or DS CLI, you can decode the IDs to show which physical port on the DS6000 or ESS 800 is in use. For DS6000, port IDs range from I0000 to I0001 and I0100 to I0103. These break out as IEECP. The EE is the controller number (00 or 01), C is the card slot number (always 0), and P is the port number on the card (0 to 3).
Figure 29-3 ESS 800 I/O ports decoded 29.3.2 Creating paths with the DS GUI In this example, we show how to establish two PPRC paths from DS6000 LSS 06 to ESS LSS 05 with the DS Storage Manager. Tip: CKD LCUs on an ESS 800 are always LSS 00 to LSS 0F. If you select ESS 800 LSS 10 to ESS 800 LSS 1F, you are working with open systems LSSs on the ESS 800.
Page 465
Mirror and Copy paths (see Figure 29-7 on page 442). Select the ports and click Next . Because you want to establish two paths from the DS6000 to the ESS, you must select both I/O ports from the DS6000 that are available for RMC. You only see physical connections that actually exist.
Page 466
Figure 29-7 Select source I/O ports 9. In the next panel (see Figure 29-8), you select, for each source I/O port from the DS6000, a target I/O port on the ESS. When you are finished, click Next . Figure 29-8 Select target I/O ports 10.In the next two panels, you are asked whether you want built a Consistency Group and to...
The previous example showed how to create a path from the DS6000 to the ESS 800. In many cases, it is likely that you will need paths from ESS 800 to the DS6000. Because you have established paths in one direction, you can now establish paths in the opposite direction.
Page 468
Note: This is not the DS CLI. ESS CLI is a separate software package that you can get from your IBM Service Representative if you do not already have it. An example of the command syntax is shown in Example 29-6. The advantage of this technique is that you can copy and paste the output.
Page 469
Note: When issuing commands that refer to an ESS 800, the ESS 800 serial number is only five digits, and not the seven you see for the DS6000 or DS8000. So, in our examples, the serial number syntax we use is IBM.2105-22399, not IBM.2105-1322399.
To establish paths where the ESS 800 is the source, you should connect to the ESS 800 using the DS CLI and follow the same process, but specify the DS6000 as the remote device. Important: When you connect using DS CLI to the DS6000 SMC, the DS6000 is the local device and the ESS 800 is the remove device.
Page 471
Metro Mirror pairs. Volumes 0600 and 0601 from the DS6000 are the source volumes, and the target volumes are 0500 and 0501 from the ESS 800. We followed the same method to set up a Global Copy pair, except that Global Copy is selected (Figure 29-16 on page 449): 1.
Page 472
9. Next, select the target volume for the second source volume as shown in Figure 29-15 on page 449. To expand your choices, you must select the small blue boxes. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 473
Metro Mirror pairs for LSS 06 that we established. To manage the established pairs (for example, suspend pair) you can select the volume pair you want to manage and then select from the appropriate action that you want to perform from the menu. Chapter 29. Interoperability between DS6000 and ESS 800...
CMUC00155I rmpprc: Remote Mirror and Copy volume pair 0600:0500 relationship successfully withdrawn. We connected to the DS6000 SMC using DS CLI, so the ESS 800 is the remote device. To establish pairs where the ESS 800 is the source device, you must connect to the ESS 800 using the DS CLI.
In this example, we show how you can establish Global Copy volume pairs between a DS6000 and an ESS 800 with the DS CLI. We created a Global Copy pair. Volume 0603 from the DS6000 is the source volume, and the target volume on the ESS is 0503.
DS CLI or DS GUI. The establishment of a FlashCopy pair on an ESS 800, using the DS GUI, is no different than establishing a DS6000 FlashCopy pair (see 9.6, “FlashCopy management using the DS SM” on page 87). The establishment of a FlashCopy pair on an ESS 800 using the DS CLI is also no different (see 9.4, “Local FlashCopy using the DS CLI”...
Figure 29-19 Selecting ESS 800 source volumes for FlashCopy 10.Select the target volumes and click Next . 11.Select the options that you plan to use and click Next . in them. This is normal. Chapter 29. Interoperability between DS6000 and ESS 800...
PPRC device is a DS6000. In Example 29-16, we connected to a DS6000. We created a Metro Mirror pair from volume 0600 on the DS6000 to volume 0500 on the ESS 800. We then created a remote FlashCopy on the ESS 800 between ESS 800 volumes 0500 and 0501, using a conduit LSS to send the command.
Page 479
-remotedev. However, because a Flashcopy must be sent to the remote site and then performed locally there, the use of the -dev parameter to refer to the remote machine is correct. Chapter 29. Interoperability between DS6000 and ESS 800...
Page 480
IBM System Storage DS6000 Series: Copy Services with IBM System z...
ESS800, DS8000, and DS6000 Copy Services in two-site or three-site topologies. It is a common management tool for both z/OS and open system environments. The Copy Services functions managed by eRCMF are Metro Mirror, Global Copy, Global Mirror, and Metro/Global Copy.
And this is what you want to avoid in a Tier 4 or higher IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 483
solution. However, in a real disaster (fire, explosion, or earthquake) you can never expect the components of your complex to fail all at the same moment. Failures will be intermittent and gradual, and the disaster will occur over many seconds or even minutes. This is known as a Rolling Disaster.
Page 484
I/O to the affected primary volumes, the write dependent mechanism of the application prevents the Remote Copy secondaries from becoming inconsistent. IBM System Storage DS6000 Series: Copy Services with IBM System z Primary Primary Secondary Secondary 1.
Page 485
When Remote Copy is used in conjunction with automation, such as the Geographically Dispersed Parallel Sysplex (GDPS) or enterprise Remote Copy Management Facility (eRCMF) service offerings from IBM Global Services, a freeze command can be simultaneously issued to all LSSs within the configuration. This ensures globally consistent data across all LSSs in the secondary copy of data during a disaster.
The goal of the TotalStorage Rapid Data Recovery for UNIX and Windows solution, based on the combination of ESS or DS6000 or DS8000 Copy Services with enterprise Remote Copy Management Facility (eRCMF), is to protect your data from being a mirror of a dying scenario.
second PCM in the form of logs from the Master Process. These logs are then used to update state information in case the Backup Process must take control of the configuration, as well as for documentation purposes if there is an alternate site failure. Site 1 - Production Storage Server (s) FlashCopy...
Page 488
Consistency Group are split in a manner that assures data consistency at the remote site. IBM System Storage DS6000 Series: Copy Services with IBM System z •eRCMF issues freeze command to all Storage •eRCMF issues freeze command to all Storage...
If the event turns out not to be a disaster, however, the production will be halted until the I/Os are freed. 30.4 Additional information Further information can be found on the IBM Web site at: http://www-1.ibm.com/services/us/index.wss/so/its/a1000110 For further information, you can refer to the following papers:...
Page 490
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Controller (SVC) as well as the ESS 800 when using FCP links for PPRC paths between ESS 800s or between ESS 800 and DS6000 and/or DS8000. This applies also to FlashCopy For installation and configuration details, refer to Replication Management with IBM...
31.1 IBM TotalStorage Productivity Center The IBM TotalStorage Productivity Center or TPC is a suite of software products. It is designed to support customers in monitoring and managing their storage environments. Design and development emphasis for TPC is on scalability and standards. The approach based on open standards allows TPC to manage any equipment or solution implementation which follow the same open standards.
31.3 What TPC for Replication provides TPC for Replication is designed to help administrators manage copy services. This applies not only to the copy services provided by DS6000 and DS8000, but also to copy services provided by the ESS 800 and SAN Volume Controller (SVC).
I/O operations in the storage server back-end, or a NOCOPY option. FlashCopy is available on the DS6000 and DS8000 as well as on the ESS 800. FlashCopy is also available on the DS4000 family and with SAN Volume Controller. Note, however, that the DS400 and SVC use different implementations of the FlashCopy function that are not compatible with the DS6000.
GM is also the base for a two-site disaster recovery solution involving any DS6000, DS8000, and/or ESS 800. The function as such is also possible between products of the DS4000 family and the SVC.
Page 496
The option to resynchronize from either site is possible due to the availability of change bitmaps maintained by the DS6000 or DS8000 at both sites. IBM System Storage DS6000 Series: Copy Services with IBM System z Suspends due to planned...
31.5 TPC for Replication terminology TPC for Replication manages and integrates not only the DS6000 and DS8000 but also the SAN Volume Controller. In search of a common terminology and to describe the functions for the different disk storage servers in a common way, new terms are introduced here that are different from those normally used in the context of Copy Services with the ESS 800, DS6000, and DS8000.
Figure 31-6 on page 475 shows an example of two storage servers at the local site and two corresponding storage servers at the remote site. The example further assumes that a Metro Mirror relation is established to replicate data between both sites. IBM System Storage DS6000 Series: Copy Services with IBM System z Global Copy Primary...
Page 499
LSS must not contain other Copy Sets. This is because the scope of the freeze function is at the LSS level and affects all volumes within that LSS. Chapter 31. IBM TotalStorage Productivity Center for Replication Remote DS6000 / DS8000...
Global Mirror builds on three volumes per Copy Set. TPC for Replication makes it possible to also manage a configuration that only replicates data through Global Copy in the opposite direction from what Global Mirror did before. IBM System Storage DS6000 Series: Copy Services with IBM System z...
A Copy Set contains the volumes that are part of a Copy Services relationship. Metro Mirror knows two volumes per Copy Set. Global Mirror requires three volumes per Copy Set. FlashCopy again consists of two volumes per Copy Set. suspended Chapter 31. IBM TotalStorage Productivity Center for Replication prepared...
Global Mirror remote site. When a session needs to be recovered at the remote site, the journal volume is used to restore data to the last consistency point. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Primary Primary Primary Primary Primary Primary Session 3 Primary Primary Primary Primary Primary Session 4 Chapter 31. IBM TotalStorage Productivity Center for Replication Remote DS6000 / DS8000 Primary Primary Primary Copy Set Primary Primary Primary Primary Primary Primary Primary Primary...
Page 504
This also includes a capability to distinguish between the different storage servers that can be managed by the Replication Manager, such as DS6000, DS8000, ESS 800, and SVC. This approach has the potential to be enhanced as storage servers change over time without touching the functional code and the involved database.
Page 505
System p DS8000 Figure 31-9 Replication Manager server connectivity to DS6000 and DS8000 The actual connectivity between the TPC for Replication server and the storage servers is based on Ethernet networks and connects to particular Ethernet ports in the System p™ in the DS8000.
Page 506
Date/Time: 28 August 2006 13:20:00 CEST IBM DSCLI Version: 5.2.200.308 DS: IBM.2107-7503461 I9801 IP Address 9.155.50.53 Subnet Mask 255.255.255.0 Gateway 0.0.0.0 IBM System Storage DS6000 Series: Copy Services with IBM System z Gateway Primary DNS Secondary DNS State Location 0.0.0.0 0.0.0.0 9.64.163.21 9.64.162.21 0.0.0.0 0.0.0.0 9.64.163.21 9.64.162.21 Server Online 00...
Management console connects to because the DS6000 controller or server card contains only a single Ethernet port. For the DS6000 there is only a single Ethernet port per cluster or server card. This port is shared between the Replication Manager server or servers as well as with one or two Storage Management consoles.
TPC server is managing can fail, the firmware in the storage server waist for a heartbeat signal from the TPC server. TPC for Replication can enable this heartbeat in the corresponding LSS for Metro Mirror sessions. IBM System Storage DS6000 Series: Copy Services with IBM System z Replication Manager Server FREEZE...
The TPC for Replication server can currently run under the following operating systems: Windows 2003 Server Edition with SP1 Windows 2003 Enterprise Edition SP1 Replication Manager Server PPRC FCP links Session Primaries Chapter 31. IBM TotalStorage Productivity Center for Replication Ethernet ports FCP ports Secondaries...
10 GB free disk space When TPC for Replication runs on AIX, the following minimum hardware configuration is suggested: Server p, IBM POWER4™ (TM) or IBM POWER5™ (TM) processor, 1 GHz 2 GB RAM memory 10 GB free disk space Disk space is required to hold data in DB2 databases and WebSphere (R) Express Application Server code besides the actual TPC for Replication server code.
TPC for Replication provides a graphical user interface (GUI) to manage and monitor any Copy Services configuration and Copy Services operations. This GUI is Web browser-based and does not rely on any other product such asTotalStorage Productivity Center and IBM Director.
This will present the sign-on panel shown in Figure 31-15 on page 489. Once you sign out from the RM server, the same panel is also displayed. IBM System Storage DS6000 Series: Copy Services with IBM System z Login User machine...
31.15.2 Health Overview panel After a successful login into the Replication Manager server, the Health Overview panel is displayed, as shown in Figure 31-16 on page 490. URL of GUI (RM server) user name password Chapter 31. IBM TotalStorage Productivity Center for Replication...
Page 514
Here you start when you define storage servers to the RM server that are going to be used for Copy Services. ESS/DS Paths This link allows you to manage everything that is related to PPRC path management. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Figure 31-18 on page 492 illustrates that you first select a session and then choose the action you want to perform against that session. Chapter 31. IBM TotalStorage Productivity Center for Replication...
It is also used to modify an existing session and add or remove Copy Sets. 31.15.4 Storage Subsystems panel Figure 31-20 on page 493 displays all storage subsystems currently connected to the RM server. IBM System Storage DS6000 Series: Copy Services with IBM System z (2) Select action (1) Select session...
Page 517
Figure 31-21 displays the available action list. From this list you select, for instance, the View/Modify Details action and apply it to the previously selected storage server. Figure 31-21 Select the storage subsystem and the View/Modify Details action Chapter 31. IBM TotalStorage Productivity Center for Replication...
All the other fields are self-explanatory. 31.15.5 Path Management panel Figure 31-23 displays the entry panel to manage PPRC paths. Figure 31-23 Path overview panel IBM System Storage DS6000 Series: Copy Services with IBM System z...
You may select any path here and the only available action in this case is to then remove the selected path(s). 31.15.6 RM Server Configuration panel The panel in Figure 31-25 on page 496 displays the status of the Replication management server or servers. Chapter 31. IBM TotalStorage Productivity Center for Replication...
LAN to which both servers are connected. 31.15.7 Advanced Tools panel Figure 31-26 on page 497 displays a panel through which you handle some specific tasks. IBM System Storage DS6000 Series: Copy Services with IBM System z take over...
31.15.8 Console log Figure 31-27 on page 498 displays an example of a console log. This panel shows a list of the most recent commands which this user entered through the GUI. Chapter 31. IBM TotalStorage Productivity Center for Replication...
Besides the GUI you may also manage TPC for Replication through a command line interface (CSMCLI). As with the DSCLI for DS8000 and DSCLI for DS6000, the CSMCLI command structure is similar for all three CLI products, such as mk... for make, ch... for change, etc.
Page 523
Example 31-6 Script mode to execute CLI commands ... start csmcli ... csmcli -script ~/rm/scrtips/devreport In contrast to DSCLI for the DS storage servers, the CSMCLI currently does not use a -profile option. Chapter 31. IBM TotalStorage Productivity Center for Replication...
Page 524
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Also see the following URLs: http://www.ibm.com/servers/eserver/zseries/gdps/ http://www.ibm.com/services/storage Note that GDPS is a continuous availability solution for System z and is an IBM implementation service and not a product. Important: The various GDPS offerings are not products. They are delivered as IBM Global Service offerings.
GDPS is an integrated end-to-end solution composed of software automation, software, servers and storage, networking, and IBM Global Services to configure and deploy the solution, as shown in Figure 32-1. The GDPS solution has components in the areas denoted by dark shading.
The GDPS family of System z Business Continuity solutions consists of two major offering categories, and each category has several subofferings. Each GDPS solution is delivered through IBM Global Services, and is specifically tailored to fit a specific set of client recovery needs, budgetary requirements, physical distance and infrastructure, and other factors.
100 km fiber distance The GDPS/PPRC solution offering combines System z Parallel Sysplex capability and ESS, DS6000, and/or DS8000 Metro Mirror disk mirroring technology to provide a Business Continuity solution for IT infrastructures that have System z at the core. GDPS/PPRC offers...
Can run as a NetView application - System Automation not required 32.1.4 GDPS/XRC overview IBM System Storage z/OS Global Mirror, formerly known as Extended Remote Copy (XRC), is a combined hardware and z/OS software asynchronous remote copy solution for System z data.
GDPS solutions. A 3-site solution can combine the advantages of metropolitan distance Business Continuity and regional or long distance Disaster Recovery. GDPS PPRC/XRC GDPS/PPRC and GDPS/XRC is a supported configuration for the 3-site requirements, as shown in Figure 32-3. IBM System Storage DS6000 Series: Copy Services with IBM System z...
GDPS/XRC and GDPS/PPRC off of the same volume is a System z solution only. 32.1.8 IBM Global Services offerings for GDPS The various GDPS offerings are not products. They are delivered as IBM Global Service offerings. GDPS is an end-to-end solution in which IBM Global Services tailors and installs the specific combination of components, integrated within the client’s environment.
Page 532
IBM Implementation Services for GDPS/PPRC or GDPS/XRC will assist you with planning, configuration, automation code customization, testing, onsite implementation assistance, and training in the IBM GDPS solution. Either option supports Peer-to-Peer Virtual Tape Server (PtP VTS) form of tape data mirroring.
Concurrent Copy works not only on a full-volume basis, but also at a data set level. Also, the target is not restricted only to DASD volumes in the same DS6000, but the target can also be a tape cartridge or a DASD volume on another DS6000 (see Figure A-1).
Intercepted writes When an application tries to update information that is included in a Concurrent Copy domain, the DS6000 intercepts those writes, thus maintaining a copy of the data as it was at the time when the Concurrent Copy was requested.
DFSMSdss as the copy program, such as the DB2 COPY utility. The SDM establishes a Concurrent Copy session with the DS6000. There can be up to 64 sessions active at a time per DS6000 logical subsystem (LSS).
With the target within the same logical subsystem or DS6000 as the source and FlashCopy installed, DFSMSdss will start a FlashCopy copy process instead of Concurrent Copy. So, you get a FlashCopy invocation with a DFSMSdss COPY FULL command even if the CONCurrent (or CC) parameter is coded in the command.
Page 538
Data integrity is assured for VSAM KSDSs even when CICS access results in control interval or control area splits, or data set obtaining another extent. IBM System Storage DS6000 Series: Copy Services with IBM System z...
Concurrent Copy coexistence with z/OS Global Mirror The DS6000 is not supported as a source for z/OS Global Mirror, and so there should be no concerns with coexistence. Simultaneous Concurrent Copy sessions As said before, each Concurrent Copy session generates additional channel load and increases utilization of the storage paths within the DS6000.
Page 540
CC keyword is specified so that you obtain both ADR806I and ADR734I Concurrent Copy initialization successful messages. Example: A-6 Using FlashCopy and Concurrent Copy together //STEPT40 EXEC PGM=ADRDSSU //SYSPRINT DD SYSOUT=* //SYSUDUMP DD SYSOUT=V,OUTLIM=3000 IBM System Storage DS6000 Series: Copy Services with IBM System z SYSOUT=* UNIT=SYSDA,VOL=SER=(SSDASD),DISP=OLD UNIT=TAPE,VOL=SER=(TAPE01,TAPE02,TAPE03),LABEL=(1,SL), COMPRESS CONCURRENT SYSOUT=*...
Page 541
//SYSIN DD * COPY FULL - INDYNAM ((CP11S3)) - OUTDYNAM ((TP11S3)) - COPYVOLID - ADR101I (R/I)-RI01 (01), TASKID 001 HAS BEEN ASSIGNED TO COMMAND 'COPY ' ADR109I (R/I)-RI01 (01), 2000.107 16:09:59 INITIAL SCAN OF USER CONTROL STATEMENTS COMPLETED. ADR016I (001)-RI01 (01), RACF LOGGING OPTION IN EFFECT FOR THIS TASK ADR006I (001)-STEND(01), 2000.107 16:10:00 EXECUTION BEGINS ADR241I (001)-DDTFP(01), TARGET VTOC BEGINNING AT 000550:0000 AND ENDING AT 000550:0014 IS OVERLAID...
Page 542
Usage of the Concurrent Copy function can also be controlled through the installation options exit, a product-sensitive programming interface intended for users. Refer to Options Installation Exit Routine (ADRUIXIT) described in z/OS DFSMS Installation Exits, SC26-7396, for more information. IBM System Storage DS6000 Series: Copy Services with IBM System z...
FIBRE 0003 XXXXXX 0003 XXXXXX 17 FIBRE 0103 XXXXXX 0002 XXXXXX 17 When the DS6000 can communicate again by any of the links, trap 102, as shown in Example B-3, is sent after one or more of the interrupted links are available again.
Page 545
Fibre Channel Path Secondary Adapter not PPRC capable. This could be due to: 1. Secondary Adapter not configured properly, or does not have the correct microcode loaded. 2. The secondary adapter is already a target of 32 different ESS, DS8000, DS6000. Fibre Channel Path Secondary Adapter not available.
Asynchronous PPRC Session is in a Fatal State UNIT: Mnf Type-Mod SerialNm IBM 1750-511 13-00247 Session ID: 4002 IBM System Storage DS6000 Series: Copy Services with IBM System z SerialNm) of the primary and secondary machine, the ). To avoid SNMP trap flooding, the number of SNMP...
Page 547
Subordinate. Consider running a rmgmir against the Subordinate to prevent any interference with other Global Mirror sessions. Example: B-12 Trap 216: Asynchronous PPRC Subordinate termination unsuccessful Asynchronous PPRC Slave Termination Unsuccessful UNIT: Mnf Type-Mod SerialNm Master: IBM 1750-511 13-00247 Slave: IBM 1750-511 13-00260 Session ID: 4002 Master cannot terminate the Subordinates slave ).
Page 548
DS CLI command pausegmir or the corresponding GUI function. Example: B-13 Trap 217: Asynchronous PPRC paused Asynchronous PPRC Paused UNIT: Mnf Type-Mod SerialNm IBM 1750-511 13-00247 Session ID: 4001 IBM System Storage DS6000 Series: Copy Services with IBM System z...
Licenses All DS6000 Series machines must have an Operating Environment License or OEL for the total storage installed, as calculated in decimal TB. Licenses are also required for use of Copy Services functions. Each function is enabled for a DS6000 system by acquiring licences for specific feature numbers, as listed in Table C-1.
DS6000. Charging example A client can choose to purchase any or all DS6000 licenses at an authorization level at or above the installed raw disk capacity. It may be more cost effective to pre-install authorization to use greater than the currently installed storage capacity.
Page 552
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Migrating ESS CLI to DS CLI With the introduction of the IBM DS6000 Storage Unit, a new Copy Services application is also introduced. The Copy Services functions can be issued with the GUI or the DS CLI. The advanced Copy Services functions that are available in the ESS 800 are also available on the DS6000 (except for Global Mirror).
DS CLI scripts. Convert the individual tasks Choose the ESS CLI tasks that you need to translate to the DS CLI. Refer to IBM System Storage DS6000: Command-Line Interface User´s Guide, GC26-7922. You can then save each translated task and run it in the DS6000 CLI environment.
ESS / DS CLI comparison Table D-2 shows a brief comparison of the major components between the ESS CLI and the DS CLI. IBM System Storage DS6000 Series: Copy Services with IBM System z ESS CLI parameter DS CLI conversion 2105.23953...
Page 557
Table D-2 ESS and DS CLI commands and parameters comparison ESS CLI DS CLI list server lsserver list volumespace lsextpool, showextpool, lsrank, showrank, lsarray, showarray, lsarraysite create volumespace mkextpool, mkarray, mkrank delete volumespace rmrank, rmarray, rmextpool list diskgroup lsarraysite list port lsioport, showioport set port setioport...
Page 558
Extents that can be allocated from one or more Ranks. A fixed block Extent is 1 GB (using binary counting). IBM System Storage DS6000 Series: Copy Services with IBM System z DS CLI Comments...
Page 559
For 2105, a Rank is either assigned to server 0 or server 1, depending on the Array Site location. A 2105 Rank is assigned to one of 32 possible LSS IDs, depending on device adapter pair location and storage type configuration. For 1750, an Extent Pool is assigned to server 0 or server 1.
Page 560
IBM System Storage DS6000 Series: Copy Services with IBM System z...
The publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this redbook. IBM Redbooks For information about ordering these publications, see “How to get IBM Redbooks” on page 539. Note that some of the documents referenced here may be available in softcopy only.
How to get IBM Redbooks You can search for, view, or download Redbooks, Redpapers, Hints and Tips, draft publications and Additional materials, as well as order hardcopy Redbooks or CD-ROMs, at this Web site: ibm.com/redbooks Help from IBM IBM Support and downloads ibm.com/support...
Page 564
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 566
32 single-shot mode 31 supported environments 165 supported operating systems for the DS CLI 26 IBM System Storage DS6000 Series: Copy Services with IBM System z usage examples 35 user accounts 27 user assistance 34 using the application 31...
Page 567
DS CLI 88 configuration 63 Consistency Group 55, 85 create relationships for Global Mirror with DS CLI 393 create remote FlashCopy on DS6000 using DS CLI data backup system 44 data mining system 44 Data set FlashCopy 59, 101...
Page 568
216 lsavailpprcport 230 lspprcpath 230 Metro Mirror panel 234 mkpprcpath 230 overview 202 IBM System Storage DS6000 Series: Copy Services with IBM System z path commands 230 path panel 233 peak bandwidth requirements 220 performance 220 planning considerations 217...
Page 569
PPRC paths for multiple primary storage servers PPRC paths through TSO commands 303 PPRC paths with ICKDSF 314 session 258 session through ICKDSF 318–319 delete Global Copy pairs with ICKDSF 327 dependent writes 246, 250 Disaster Recovery practice 402 DS CLI example to establish FlashCopy between B and C 300 DS CLI profile files 390 DS CLI to manage volumes in z/OS 313...
Page 570
ESS 800 FlashCopy 452 managing Metro Mirror or Global Copy pairs 446 DS8000 / ESS (Enterprise Storage Server) 416 IBM System Storage DS6000 Series: Copy Services with IBM System z ESS 800 and DS8000 433 volume size considerations for RMC 437...
Page 572
Resource Management Facility see RMF restart application at remote site 292 resume suspended pair 179 resumepprc 168, 232 IBM System Storage DS6000 Series: Copy Services with IBM System z resyncflash 80 resynchronizing a suspended volume 186 return codes 33 return to local site 293...
Page 573
34 volumes 147 add or remove 271 VTOC 164 WWNN determine for DS6000 using the DS GUI 422 determine for ESS 800 using DS CLI 444 determining the remote device 422 XRC 6 z/OS 51 benefits of using Concurrent Copy 511...
Page 574
IBM System Storage DS6000 Series: Copy Services with IBM System z...
Page 578
It also addresses functionality and terminology interfaces: TSO, DS differences from other IBM Copy Services products. CLI, DS GUI You can read this book in conjunction with the IBM Redbook IBM Learn about TPC System Storage DS6000 Series: Architecture and for replication Implementation, SG24-6781.