Avici Systems Inc.

Field Replacement Procedure

Connecting Multiple SSR Chassis

05719-00 Rev. AA

This document covers the connection of multiple Stackable Switch Routers (SSR).

Before beginning this procedure, carefully inspect the package to ensure no damage occurred during shipping or delivery. If you suspect any possible damage, contact Support Services immediately.

NOTE This document covers only the connection of multiple SSR chassis in a rack, not actual installation.

For easy and quick reference, this Field Replacement Procedure (FRP) is organized as follows:

Support Services
Tools
Connecting Multiple Chassis
Connecting Dual Chassis
Removing Rear Covers
Installing the Thinnet Ethernet
Installing Cable Racks
Preparing to Install Connector Cables
Installing Connector Cables
Bringing Up the Y Axes

Support Services

Avici offer three ways to obtain information on customer service and training:

Tools

Use the following tools for installing multiple chassis and connector cables:

Connecting Multiple Chassis

The architecture of the SSR chassis allows for either cold or live upgrades from one to two chassis within one rack or in side-by-side racks. Connector cables between the upper and lower chassis backplanes extend the toroidal mesh via module links and allow module-to-module communication between the chassis. After installing connector cables, future addition of router module pairs to the additional chassis may be made without service interruption or additional hardware installation.

This document covers the connection of already installed SSR chassis in a rack. The Stackable Switch Router Guide shipped with each SSR chassis covers the installation of the SSR in standard racks.

Figure 1 shows two SSR chassis in a rack.

Figure 1. Dual SSR Chassis

After installing and securing the second SSR chassis, use the following basic procedures to connect the two chassis:

If installing two chassis side-by-side, the racks must be positioned on a 24" center; that is, the center of each chassis must be 24" from each other (see Figure 2).

Figure 2. Positioning Dual Side-by-Side Chassis - 2

Connecting Dual Chassis

The upgrade from one chassis to two requires physically joining the backplanes of the adjacent chassis using connector cables. Connector cables, also known as Y-connector cables, physically connect the backplanes of adjacent chassis. Cable connectors provide the module-to-module communication via Y links (also known as axes) and extend the toroidal mesh by providing the pathway for module communication between the chassis.

When connecting chassis, if one chassis is live, it is necessary to temporarily shut down one link per module. Toroidal mesh resiliency ensures modules experience no performance loss during the connection process. If both chassis are newly installed, there is no need to temporarily shut down links.

Chassis Numbering

Whether the initial installation of a chassis is in the bottom or top of a rack, the first chassis installed is always number "1" and the second chassis installed is always number "2."

NOTE Do not confuse chassis numbering with rotary and toggle switches. Chassis numbering is a separate issue.

Temporarily Shutting Down the Y Axes

It is necessary to temporarily shut down the Y axis in the live SSR chassis before installing Y-connector cables. After installing Y-connector cables and router modules and powering up the cold chassis, the Y axes are brought back up. Use this process to maintain fabric integrity of the toroidal mesh of the SSR during the installation process.

Axes within the toroidal mesh have either a plus or a minus designation. Y axes in the top row of the SSR chassis have a minus designation and Y axes in the second row of the SSR chassis have a plus designation. Refer to Table 1 "Backplane Axes Designations"" and Figure 3.

Table 1. Backplane Axes Designations
Chassis 1 and 2 Router Module Slots Y Axis Designation - Plus or Minus

1-10

Minus

11-20

Plus

Figure 3. Backplane Axes Designation

PROCEDURE: Use the following procedure to temporarily shut down the Y axes in the live chassis before installing the Y-connector cables. Each Y axis is shut down one at a time.

The Y axes in the router modules 1 and 11 in chassis 1 are used as an example in the following procedure.

PROCEDURE: Use the CLI command, shutdown fabric link in configuration mode to shutdown the Y axis to temporarily shut down the traffic from the effected router module.

Step 1 Use the shutdown fabric link command to shut down the fabric link on the Y minus axis for module 1/1.

Step 2 Repeat Step 1 for router modules 1/2 through 1/10.

Step 3 Use the end command to return to configuration mode.

Step 4 Use the shutdown fabric link command to shut down the fabric link on the Y plus axis for module 1/11.

Step 5 Repeat Step 4 for router modules 1/12 through 1/20

Step 6 Use the end command to return to configuration mode.

router(config)#module 1/1

router(config-module)# shutdown fabric link yminus

router(config)#module 1/11

router(config-module)# shutdown fabric link yplus

router(config)#end

Removing Rear Covers

Remove the two rear EMI covers from each SSR chassis using the following procedure.

PROCEDURE: Beginning on the top SSR chassis, use the following procedure to remove the EMI covers from both of the SSR chassis:

Step 1 Hand loosen the four thumb screws securing the EMI cover to the top of the chassis.

Step 2 Lift the EMI cover away from the chassis (refer to Figure 4).

Step 3 Repeat Step 1 and Step 2 for the bottom EMI cover.

Step 4 Repeat Step 1 through Step 3 to remove the two EMI covers from the chassis in the bottom of the rack.

Figure 4. Removal of EMI Covers

Removing Bay Controller Covers

The removal of bay controller covers allows access to the bay controller backplane and the thinnet Ethernet connections.

PROCEDURE: Use the following procedure to remove the backplane cover from the top chassis:

CAUTION (1) Risk of electrostatic damage. When handling modules or removing covers, wear a grounded antistatic wrist strap or equivalent protection to avoid damaging electrostatic parts.

Step 1 Verify that the antistatic wrist strap you are wearing is properly grounded.

Step 2 Using a #2 Phillips screwdriver, remove the six M3 Phillips screws from the backplane cover (see Figure 5). Set aside the cover and screws for later reinstallation.

Step 3 Remove the cover.

Step 4 Repeat Step 2 and Step 3 to remove the backplane cover from the bottom chassis (see Figure 5).

Figure 5. Removal of Backplane Cover

Installing the Thinnet Ethernet

In multi-chassis configurations, a thinnet Ethernet cable connects the bay controller backplanes of adjacent SSR chassis. BNC connectors (ports) on the bay controller backplanes of each chassis provide the connection points.

PROCEDURE: Use the following procedure to install the thinnet Ethernet cable:

Step 1 Remove the terminator BNC connectors from Port 7 on the top and bottom chassis (see on Figure 6).

Step 2 Connect the thinnet Ethernet cable to the BNC connector on P7 on the top chassis.

Step 3 Connect the other end of the thinnet Ethernet cable to the BNC connector on P7 of the bottom chassis (refer to Figure 6).

Step 4 Replace the backplane covers. Using a #2 Phillips screwdriver, secure the backplane cover on the top and bottom chassis using the six M3 Phillips screws.

Figure 6. Thinnet Ethernet Connection

Adjusting Rotary and Toggle Switches

On each chassis bay controller backplane, there is a rotary switch and a toggle switch used to set the position (rotary) and the number (toggle) of each SSR chassis (see Figure 7). For example, the bottom chassis in a rack is in position "0", and its number is "1."

Figure 7. Chassis Identifier Switches

The toggle switch specifies whether this chassis is in the bottom (0) or top (1) of the rack. The rotary switch indicates the number of each SSR chassis in physical configuration. For example, the bottom chassis is in position "0" and is numbered "1," and the top chassis would be in position "1" and is numbered "1." Refer to Table 2 "Rotary and Toggle Switch Settings."

Table 2. Rotary and Toggle Switch Settings
Chassis Toggle (SW2) Rotary (SW1)

First Chassis

0

1

Second Chassis

1

1

PROCEDURE: Use the following steps to set the chassis identifier switches for a top (0) chassis location:

Step 1 Set toggle switch to "1."

Step 2 Set chassis number SW1 rotary switch to "1."Chassis Numbering

Whether the initial installation of a chassis is in the bottom or top of a rack, the first chassis installed is always number "1" and the second chassis installed is always number "2."

NOTE Do not confuse chassis numbering with rotary and toggle switches. Chassis numbering is a separate issue.

Installing Cable Racks

Before installing the connector cables, install the two cable guide racks. These cable racks help in the cable installation and management. Install the top cable racks in the top chassis (see Figure 8). Install the bottom cable rack on the chassis rack between the chassis (refer to Figure 8). Four 10-32X 1 in. self-tapping screws attach each cable racks to the chassis rack.

Figure 8. Top and Bottom Cable Rack

PROCEDURE: Use the following procedure to install the two cable racks on the rack holding the SSR chassis:

Step 1 Connect the crosspiece of the cable rack to the two sides of the cable rack (refer to Figure 8).

Step 2 Using a #1 Phillips screwdriver, attach the cable rack to the top of the chassis rack on both sides.

Step 3 Repeat Step 1 and Step 2 to install the second cable rack (refer to Figure 8).

If the chassis being connected are initial installations, proceed to "Preparing to Install Connector Cables" .

Preparing to Install Connector Cables

After removal of the EMI covers and connection of the thinnet Ethernet cables, connect the backplanes of the top and bottom SSR chassis using connector cables. Connector cables provide connectivity for module-to-module communication between the chassis (refer to Figure 9).

CAUTION (2) Risk of electrostatic damage. When handling circuit cards, wear a grounded antistatic wrist strap or equivalent protection to avoid damaging electrostatic parts.

Figure 9. Connector Cables

On the SSR chassis, each router module slot is numbered (refer to Figure 11). A label on the SSR backplane indicates the corresponding backplane numbering for these router modules slots (refer to Figure 12). Labels on the connector cables clearly indicate which shelves and backplane slots the connectors fit.

NOTE Two lengths of connector cables provide SSR-to- SSR connection. A short cable connects the inner rows of the SSRs; a long cable connects the outer rows.

For ease of installation, follow the predefined order when installing connector cables. Refer to Table 3 "SSR Cable Installation - Inner Row" and Table 4 "SSR Cable Installation - Outer Row" for the installation sequence of connector cables.

Figure 10. Connector Cable Part Number Label

Figure 11. SSR Router Module Slot Numbering

Figure 12. SSR Backplane Numbering

Installing Connector Cables

Each connector cable fits into the numbered slots in the SSR backplane. Guide pins located in backplane slots guide the connectors squarely into the backplane slots. Captive screws then secure the connector cables to the backplane (refer to Figure 14 and Figure 15).

NOTE Double check connector cable part nos. before installing to ensure you are installing the correct cables for the each backplane slot. See Table 3 "SSR Cable Installation - Inner Row" and Table 4 "SSR Cable Installation - Outer Row" for specific information.

Connector cables are first installed from the bottom row of the top SSR to the top row of the bottom of the top SSR (refer to Figure 16). This is also referred to as the "inner row" of cable connectors. The connector cables are then installed from the top of the top SSR to the bottom of the bottom SSR (refer to Figure 18). This is also referred to as the "outer row" of cable connectors.

Connector cables are installed one at a time. During installation, drape one end of the connector cable on the cable rack to hold it while installing the other end of the cable. Prior to installing each of the connector cables, a visual inspection of the Very High Density Metric (VHDM) connectors must be performed.

For ease of installation, follow the predefined sequence when installing connector cables. Refer to Figure 12 for backplane numbering. Refer to Table 3 "SSR Cable Installation - Inner Row" and Table 4 "SSR Cable Installation - Outer Row" for the installation sequence of connector cables.

CAUTION (3) Risk of electrostatic damage. When installing the connector cables, wear a grounded antistatic wrist strap or equivalent protection to avoid damaging electrostatic parts.

Inner Row of Connector Cables

PROCEDURE: Beginning with slot 11 in the top SSR and the short connector cables, use the following procedure to install the connector cables from the bottom SSR chassis to the top SSR chassis:

Step 1 Verify that the antistatic wrist strap you are wearing is properly grounded.

Step 2 Hold one end of the connector cable on the cable rack and drape the other end of the connector cable over the cable rack. Carefully remove the protective cap from one end only of the connector cable.

Step 3 Prior to installing each of the connector cables, a visual inspection of the VHDM connectors must be performed. Carefully inspect the connector for damage such as deformed sockets, holes between socket columns, and deformed guide fins on top and bottom of the socket columns

NOTE If the VHDM connector has any signs of damage, DO NOT insert it into the backplane. Mark the module as damaged and call TSR-BY-AVICI (877-292-8424) to request an Return Material Authorization (RMA).

Figure 13. Y Cable VHDM Connector

Step 4 Position the connector cable over the guide pins in slot number 11 in the top chassis (refer to Figure 14 and Figure 15).

Figure 14. Backplane Slot - Guide Pins - 1

Step 5 Once seated, carefully push the connector cable into the backplane slot (refer to Figure 14 and Figure 15).

Figure 15. Backplane Guide Pins - 2

Step 6 Using a 3/32 hex bit, tighten the four captive screws on the connector cable to secure it to the backplane.

Step 7 Bring the connector to position while keeping the cable in front of the cable rack (refer to Figure 16).

Step 8 Remove the protective cap from the other end of the connector cable.

Step 9 Position the connector cable over the guide pins in slot number 1 in the bottom chassis (refer to Figure 16).

Figure 16. Connector Cable Installation - 1

Step 10 Once seated, carefully push the connector cable into the backplane slot (refer to Figure 16).

Step 11 Using a 3/32 hex bit, tighten the four captive screws on the connector cable to secure it to the backplane.

Table 3. SSR Cable Installation - Inner Row
SSR Backplane Slot Connections
Top Chassis (No.1) Bottom Chassis (No.2)

11

1

12

2

13

3

14

4

15

5

16

6

17

7

18

8

19

9

20

10

Step 12 Repeat Step 3 through Step 11 for the remaining nine connector cables.

Step 13 Use tie wraps to fasten the connector cables to the cable guide rack.

Outer Row of Connector Cables

PROCEDURE: Beginning with slot 1 in the top SSR and the long connector cables, use the following procedure to install the connector cables from the bottom SSR chassis to the top SSR chassis:

Step 1 Hold one end of the connector cable on the cable rack and drape the other end of the connector cable over the cable rack. Carefully remove the protective cap from one end only of the connector cable.

Step 2 Prior to installing each of the connector cables, a visual inspection of the VHDM connectors must be performed. Carefully inspect the connector for damage such as deformed sockets, holes between socket columns, and deformed guide fins on top and bottom of the socket columns (see Figure 17).

NOTE If the VHDM connector has any signs of damage, DO NOT insert it into the backplane. Mark the module as damaged and call TSR-BY-AVICI (877-292-8424) to request an RMA.

Figure 17. OTT Cable VHDM Connector

Step 3 Position the connector cable over the guide pins in slot number 1 in the top chassis (refer to Figure 18).

Step 4 Once seated, carefully push the connector cable into the backplane slot (refer to Figure 18).

Table 4. SSR Cable Installation - Outer Row
SSR Backplane Slot Connections
Top Chassis (No.1) Bottom Chassis (No.2)

1

11

2

12

3

13

4

14

5

15

6

16

7

17

8

18

9

19

10

20

Step 5 Using a 3/32 hex bit, tighten the four captive screws on the connector cable to secure it to the backplane.

Step 6 Bring the connector to position while keeping the cable in front of the cable rack.

Figure 18. Connector Cable Installation - 2

Step 7 Remove the protective cap from the other end of the connector cable.

Step 8 Position the connector cable over the guide pins in slot number 11 in the bottom chassis.

Step 9 Once seated, carefully push the connector cable into the backplane slot (refer to Figure 15).

Step 10 Using a a 3/32 hex bit, tighten the four captive screws on the connector cable to secure it to the backplane.

Step 11 Repeat Step 2 through Step 11 for the remaining nine connector cables.

Step 12 Use tie wraps to fasten the connector cables to the cable guide rack.

Figure 19. Connector Cable Installation

Figure 20. Connector Cable Installation - Tie Wrapped

NOTE When installation of the connector cables is complete, refer to "Ipriori Software Configuration Guide (Vol.1)" for information on booting up and configuring the SSR.

Bringing Up the Y Axes

Upon completion of Y-connector cable and router module installation, the newly installed router modules are booted up. Then, the Y axes supporting communication to these installed modules in the upper chassis are brought back up.

According to router module population rules, the first 4 modules installed in the upper chassis are the modules in slots 15 and 16. The router modules pair, 15 and 16, in chassis 2 and communicate via the Y axes to router module pair, 5 and 6, in chassis 1 (lower).Refer to Table 5 "Module/Y Axes Communication."

Table 5. Module/Y Axes Communication
Chassis 1 (Bottom) Connects      to Chassis 2 (Top)

1

11

2

12

3

13

4

14

5

15

6

16

7

17

8

18

9

19

10

20

11

1

12

2

13

3

14

4

15

5

16

6

17

7

18

8

19

9

20

10

The router module pairs in chassis 1 (5, 6) directly communicate with the router modules pairs (16, 15) in chassis 2. Refer to Table 6 "Y Axes Designations."

This procedure brings up the Y axis supporting communication from chassis 1 to chassis 2. Use the CLI command, no shutdown fabric link yminus to bring up the Y minus axis in router module pairs 5 and 6 in chassis 1 to initiate the flow of traffic to router modules pairs 15 and 16 in chassis 2. Refer to Table  "Table 6 "Y Axes Designations."

Table 6. Y Axes Designations
Chassis 1 and 2 (Router Module Slot Numbers) Y Axis Designation (Plus or Minus)

1-10

Minus

11-20*

Plus

Step 1 Use the no shutdown fabric link yminus command to bring up the fabric link on the Y minus for the router modules in slots 5 and 6 in chassis 1:

For example:

router(config)#module 1/5

router(config-module)# no shutdown fabric link yminus

router(config)#module 1/6

router(config-module)#no shutdown fabric link yminus


Step 2 Use the no shutdown fabric link yplus command to bring up the fabric link on the Y minus for the router modules in slots 15 and 16 in chassis 2:

For example:

router(config)#module 2/15

router(config-module)# no shutdown fabric link yplus

router(config)#module 2/16

router(config-module)#no shutdown fabric link yplus


Step 3 Use the end command to return to configuration mode.

Step 4 Repeat Step 1 and Step  to bring up the Y axes from chassis 1 for each router module pair installed in chassis 2.

Copyright © 2003 Avici Systems Inc.
Avici® and TSR® is a registered trademark of Avici Systems Inc.
IPriori™, Composite Links™, SSR™, QSR, and NSR® are trademarks of Avici Systems Inc.

   Source File Name: 05719-00_revAA.fm
    HTML File Name: 05719-00_revAA.html
    Last Updated: 06/27/03 at 13:45:19

Please email suggestions and comments to: doc@avici.com