Installing disks into a DDN enclosure
There are four different enclosure configurations for a DDN based SAN: 5, 10, or 20 enclosures
5 Enclosures (SS7000_1X Enclosure mapping)
| BACK | ||||||||||||
| I/O Modules PSU |
||||||||||||
| 25 | 26 | 27 | 28 | 29 | 30 |
DIMMs
|
25 | 26 | 27 | 28 | 29 | 30 |
| 19 | 20 | 21 | 22 | 23 | 24 | 19 | 20 | 21 | 22 | 23 | 24 | |
| 13 | 14 | 15 | 16 | 17 | 18 | 13 | 14 | 15 | 16 | 17 | 18 | |
| 7 | 8 | 9 | 10 | 11 | 12 | 7 | 8 | 9 | 10 | 11 | 12 | |
| 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 | |
| A | B | |||||||||||
| FRONT | ||||||||||||
10 Enclosures (SS7000_2X Enclosure mapping)
| BACK | ||||||||||||
| I/O Modules PSU |
||||||||||||
| 49 | 50 | 51 | 52 | 53 | 54 |
DIMMs
|
55 | 56 | 57 | 58 | 59 | 60 |
| 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | |
| 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | |
| 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | |
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | |
| A | ||||||||||||
| FRONT | ||||||||||||
20 Enclosures (SS7000_2X Enclosure mapping)
| BACK | ||||||||||||
| I/O Modules PSU |
||||||||||||
| 49 | 50 | 51 | 52 | 53 | 54 |
DIMMs
|
55 | 56 | 57 | 58 | 59 | 60 |
| 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | |
| 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | |
| 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | |
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | |
| A | ||||||||||||
| FRONT | ||||||||||||
| BACK | ||||||||||||
| I/O Modules PSU |
||||||||||||
| 109 | 110 | 111 | 112 | 113 | 114 |
DIMMs
|
115 | 116 | 117 | 118 | 119 | 120 |
| 97 | 98 | 99 | 100 | 101 | 102 | 103 | 104 | 105 | 106 | 107 | 108 | |
| 85 | 86 | 87 | 88 | 89 | 90 | 91 | 92 | 93 | 94 | 95 | 96 | |
| 73 | 74 | 75 | 76 | 77 | 78 | 79 | 80 | 81 | 82 | 83 | 84 | |
| 61 | 62 | 63 | 64 | 65 | 66 | 67 | 68 | 69 | 70 | 71 | 72 | |
| A | ||||||||||||
| FRONT | ||||||||||||
Here is an example of a 5 enclosure install already populated with "14 tiers" of disks:
| BACK | ||||||||||||
| I/O Modules PSU |
||||||||||||
| 25 | 26 | 27 | 28 | 29 | 30 |
DIMMs
|
25 | 26 | 27 | 28 | 29 | 30 |
| 19 | 20 | 21 | 22 | 23 | 24 | 19 | 20 | 21 | 22 | 23 | 24 | |
| 13 | 14 | 15 | 16 | 17 | 18 | 13 | 14 | 15 | 16 | 17 | 18 | |
| 7 | 8 | 9 | 10 | 11 | 12 | 7 | 8 | 9 | 10 | 11 | 12 | |
| 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 | |
| A | B | |||||||||||
| FRONT | ||||||||||||
| BACK | ||||||||||||
| I/O Modules PSU |
||||||||||||
| 25 | 26 | 27 | 28 | 29 | 30 |
DIMMs
|
25 | 26 | 27 | 28 | 29 | 30 |
| 19 | 20 | 21 | 22 | 23 | 24 | 19 | 20 | 21 | 22 | 23 | 24 | |
| 13 | 14 | 15 | 16 | 17 | 18 | 13 | 14 | 15 | 16 | 17 | 18 | |
| 7 | 8 | 9 | 10 | 11 | 12 | 7 | 8 | 9 | 10 | 11 | 12 | |
| 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 | |
| C | D | |||||||||||
| FRONT | ||||||||||||
| BACK | ||||||||||||
| I/O Modules PSU |
||||||||||||
| 25 | 26 | 27 | 28 | 29 | 30 |
DIMMs
|
25 | 26 | 27 | 28 | 29 | 30 |
| 19 | 20 | 21 | 22 | 23 | 24 | 19 | 20 | 21 | 22 | 23 | 24 | |
| 13 | 14 | 15 | 16 | 17 | 18 | 13 | 14 | 15 | 16 | 17 | 18 | |
| 7 | 8 | 9 | 10 | 11 | 12 | 7 | 8 | 9 | 10 | 11 | 12 | |
| 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 | |
| E | F | |||||||||||
| FRONT | ||||||||||||
| BACK | ||||||||||||
| I/O Modules PSU |
||||||||||||
| 25 | 26 | 27 | 28 | 29 | 30 |
DIMMs
|
25 | 26 | 27 | 28 | 29 | 30 |
| 19 | 20 | 21 | 22 | 23 | 24 | 19 | 20 | 21 | 22 | 23 | 24 | |
| 13 | 14 | 15 | 16 | 17 | 18 | 13 | 14 | 15 | 16 | 17 | 18 | |
| 7 | 8 | 9 | 10 | 11 | 12 | 7 | 8 | 9 | 10 | 11 | 12 | |
| 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 | |
| G | H | |||||||||||
| FRONT | ||||||||||||
| BACK | ||||||||||||
| I/O Modules PSU |
||||||||||||
| 25 | 26 | 27 | 28 | 29 | 30 |
DIMMs
|
25 | 26 | 27 | 28 | 29 | 30 |
| 19 | 20 | 21 | 22 | 23 | 24 | 19 | 20 | 21 | 22 | 23 | 24 | |
| 13 | 14 | 15 | 16 | 17 | 18 | 13 | 14 | 15 | 16 | 17 | 18 | |
| 7 | 8 | 9 | 10 | 11 | 12 | 7 | 8 | 9 | 10 | 11 | 12 | |
| 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 | |
| P | S | |||||||||||
| FRONT | ||||||||||||
Tier Information:
-----------------
Space
Capacity Available Disk
Tier Owner (MiB) (MiB) Status LUN List
-----------------------------------------------------------------------------
1 + 1 4578344 0 ABCDEFGHPS 0
2 + 2 4578344 0 ABCDEFGHPS 1
3 + 1 4578344 0 ABCDEFGHPS 2
4 + 2 4578344 0 ABCDEFGHPS 3
5 + 1 4578344 0 ABCDEFGHPS 4
6 + 2 4578344 0 ABCDEFGHPS 5
7 + 1 4578344 0 ABCDEFGHPS 6
8 + 2 4578344 0 ABCDEFGHPS 7
9 + 1 4578344 0 ABCDEFGHPS 8
10 + 2 4578344 0 ABCDEFGHPS 9
11 + 1 4578344 0 ABCDEFGHPS 10
12 + 2 4578344 0 ABCDEFGHPS 11
13 + 1 4578344 0 ABCDEFGHPS 12
14 + 2 4578344 0 ABCDEFGHPS 13
Verifying TIER 1, 38.3%, Continuous.
Verifying TIER 3, 0.4%, Continuous.
Verifying TIER 8, 83.1%, Continuous.
Verifying TIER 10, 71.2%, Continuous.
All disks are healthy.
Automatic disk restarting: Disabled
Automatic disk rebuilding: Enabled
Automatic SMART replacement: Disabled
Maximum active rebuilds: 4
Maximum active verifies: 2
System rebuild extent: 64 MiB
System rebuild delay: 10
System delay IO limit: 0
Journaling: Enabled
System Capacity 64096816 MiB, 0 MiB available.
If you were to add additional drives, say 30 drives for a total of 3 new tiers (10 drives per tier), you would add them to "15", "16", and "17" of each of the five enclosures.
| BACK | ||||||||||||
| I/O Modules PSU |
||||||||||||
| 25 | 26 | 27 | 28 | 29 | 30 |
DIMMs
|
25 | 26 | 27 | 28 | 29 | 30 |
| 19 | 20 | 21 | 22 | 23 | 24 | 19 | 20 | 21 | 22 | 23 | 24 | |
| 13 | 14 | 15 | 16 | 17 | 18 | 13 | 14 | 15 | 16 | 17 | 18 | |
| 7 | 8 | 9 | 10 | 11 | 12 | 7 | 8 | 9 | 10 | 11 | 12 | |
| 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 | |
| A | B | |||||||||||
| FRONT | ||||||||||||
...
Once the disks are installed you will create internal LUNs. For ease of configuration use one LUN per Tier. You will use the command lun add=<LUN#>:
NOTE: LUN numbers start at "0" but Tier numbers start at "1". In our example, Tier 15 will be used to create LUN 14 which we label "LUN14"
S2A 9900[1]: lun add=14 Enter a label for LUN 14 (up to 16 characters): LUN14 Enter the capacity (in Mbytes) for LUN 14, LUN14 0 for all available capacity (default): 0 Enter the number of tiers (1..8) Default will auto select, 'e' to escape: 1 Enter the tiers, each one on a new line, or 'e' to escape: 15 Enter the block size, (512, 1024, 2048, 4096) Default is 512, 'e' to escape: 512 Attempting to add LUN 14 Operation successful: LUN 14 was added to the system. The LUN must be formatted before it can be used. Would you like to format the LUN now? (y/N): Y INFO INIT_137 1-22 18:48:21 Starting Format of LUN 14
NOTE: The lines that say (default) in them will allow simply hitting the ENTER key to apply the default value instead of entering a value.
Repeat the above for each internal LUN / Tier that has been added.
NOTE: Each LUN / Tier will be "owned" by the controller that was used to create it. To "load balance" the creation of LUNs you can alternate creation between both controllers.
The following will need to be done on each controller individually
Next we need to present, or map, the internal LUN / Tier through the fiber ports as "external" LUNs. This is done using the zoning edit=n command:
NOTE: zoning edit can be invoked without specifying a port number (=n) in which case you will be asked to specify a port number.
S2A 9900[1]: zoning edit=1 Enter the new LUN zoning for host port 1. Enter the unique LUN mapping, as follows: G.l GROUP.LUN number P Place-holder R Before GROUP.LUN to indicate Read-Only N Clear current assignment ENTER No change E Exit command ? Display detailed help text External LUN 0: is not mapped. Enter new internal LUN:
NOTE: zoning edit will cycle through each external LUN number even after you have passed the number of available internal LUNs / Tiers, to escape the loop type e
CAUTION: Changes take effect immediately! If you accidentally change the mapping for an existing LUN it could cause data loss/corruption and will most-likely at least interrupt (offline) the SAN. Changes should be done carefully. Mistakes are best avoided by focusing on each line individually, the line will indicate current LUN mappings. When in doubt strike the ENTER key or use e to escape and start over.
Next, run tier verify=on to allow the controller to continuously check the tier for disk related problems.
S2A 9900[1]: tier verify=on
Tier Status
Space
Capacity Available Disk
Tier Owner (MiB) (MiB) Status LUN List
-----------------------------------------------------------------------------
1 + 1 4578344 0 ABCDEFGHPS 0
2 + 2 4578344 0 ABCDEFGHPS 1
3 + 1 4578344 0 ABCDEFGHPS 2
4 + 2 4578344 0 ABCDEFGHPS 3
5 + 1 4578344 0 ABCDEFGHPS 4
6 + 2 4578344 0 ABCDEFGHPS 5
7 + 1 4578344 0 ABCDEFGHPS 6
8 + 2 4578344 0 ABCDEFGHPS 7
9 + 1 4578344 0 ABCDEFGHPS 8
10 + 2 4578344 0 ABCDEFGHPS 9
11 + 1 4578344 0 ABCDEFGHPS 10
12 + 2 4578344 0 ABCDEFGHPS 11
13 + 1 4578344 0 ABCDEFGHPS 12
14 + 2 4578344 0 ABCDEFGHPS 13
15 + 1 4578344 0 ABCDEFGHPS 14
16 + 2 4578344 0 ABCDEFGHPS 15
17 + 1 4578344 0 ABCDEFGHPS 16
Tier Verification Status:
TIER Scheduled Continuous Progress Passes Last Verify Completion Time
-------------------------------------------------------------------------------
1 Yes 0.8% 29 16:17:07 01/22/2011
2 No Yes 29 16:17:05 01/22/2011
3 Yes 28 19:25:51 01/12/2011
4 No Yes 28 11:47:25 01/16/2011
5 Yes 28 09:35:10 01/22/2011
6 No Yes 27 09:46:24 01/22/2011
7 Yes 24 15:09:06 11/28/2010
8 No Yes 24 15:20:22 12/01/2010
9 Yes 24 09:21:15 12/04/2010
10 No Yes 24 15:10:33 12/12/2010
11 Yes 24 23:28:35 12/13/2010
12 No Yes 24 12:19:44 12/21/2010
13 Yes 48 22:39:50 12/30/2010
14 No Yes 0 12:46:02 01/05/2011
15 Yes 0 21:10:56 01/05/2011
16 No Yes 0 23:02:30 01/05/2011
17 Yes 0 23:02:30 01/05/2011
System verify extent: 32 Mbytes
System verify delay: 40
Maximum active verifies: 2
Please enter a TIER ('a' for all TIERs owned by this unit or 'q' to quit): a
ALL valid TIERs owned by this unit selected
Do you want the verify to run continuously? (y/N): y
Next, run cache writeback=on and av fastav=on
S2A 9900[1]: cache writeback=on
Current Cache settings
Write Maximum MF Prefetch
LUN Caching Prefetch Bit Ceiling
------------------------------------------------------------------------------
0 Enabled x 1 On 65535
1 Enabled x 1 On 65535
2 Enabled x 1 On 65535
3 Enabled x 1 On 65535
4 Enabled x 1 On 65535
5 Enabled x 1 On 65535
6 Enabled x 1 On 65535
7 Enabled x 1 On 65535
8 Enabled x 1 On 65535
9 Enabled x 1 On 65535
10 Enabled x 1 On 65535
11 Enabled x 1 On 65535
12 Enabled x 1 On 65535
13 Enabled x 1 On 65535
14 Enabled x 1 On 65535
15 Enabled x 1 On 65535
16 Enabled x 1 On 65535
Writeback Limit: 75%
2560.0 Mbytes of Cache Installed
(2048 Segments of 1024 Kbytes)
S2A 9900[1]: av fastav=on
Current LUN Audio/Visual settings
Read Write Maximum
LUN Label FastAV Continuous Caching Prefetch
-----------------------------------------------------------
0 SAS_0 On Off On x 1
1 SAS_1 On Off On x 1
2 SAS_2 On Off On x 1
3 SAS_3 On Off On x 1
4 SAS_4 On Off On x 1
5 SAS_5 On Off On x 1
6 SAS_6 On Off On x 1
7 SAS_7 On Off On x 1
8 SAS_8 On Off On x 1
9 SAS_9 On Off On x 1
10 SAS_10 On Off On x 1
11 SAS_11 On Off On x 1
12 SAS_12 On Off On x 1
13 SAS_13 On Off On x 1
14 SAS_14 On Off On x 1
15 SAS_15 On Off On x 1
16 SAS_16 On Off On x 1
Disk Audio/Visual settings are: Disabled (Using disk defaults)
Recovery Time Limit: 65535
Ordered Tag Count: 0
Unit Attention: Enabled
FASTAV Timeout: 200
RC Timeout: 250
Fail Check Condition: Disabled
No comments:
Post a Comment