This procedure is for replacing a TSR® server module. Before beginning this procedure, carefully inspect the package to ensure no damage occurred during shipping or delivery. If you suspect any possible damage to any field replacement unit, contact Customer Service immediately.
Tools Needed
You will need a 1/2-inch flat-head screwdriver.
Support Services
To obtain information on customer service and training, there are three ways to contact Avici Customer Service:
- Phone:
United States Support: 877-292-8424 (TSR-BY-AVICI)
International Support: 01-978-964-2350
- E-mail: support@avici.com
- World Wide Web: http://www.avici.com
Server Modules
The TSR offers two physically identical servers, a primary and secondary (warm stand-by) server.
Primary Server
Each server module provides a 300 Mhz PowerPC 604e CPU, 576 Mbytes of memory (64 Mb on the baseboard and 512 Mb of add-on PMC memory), and 32Kbytes of NVRAM for maintaining configuration and software images.
The server module also supports five 10/100BaseT Ethernet port and one DB-9 console port connections.
Each server module resides in a module enclosure together with a power conversion card, persistent file storage, and a pair of solid state disks.
Secondary Server (Warm Stand-by Server)
Physically identical to the primary server, the warm stand-by server is designed and implemented to take over in the event the primary server becomes unusable. The servers connect to the bay controllers via the server connector panel. The ETH 3 and ETH 4 ports of the server connect to the server connector panel. See Figure 1.
Figure 1. Server Ethernet Ports
The server connector panel connection leads to an Ethernet repeater located on the bay controllers. Refer to Figure 2 for a logical view of the server connector panel. This repeater allows the bay controller and servers to look like one logical LAN.
The ETH 0 port provides a redundant warm stand-by connection between the servers in the event the primary warm server communication path via ETH 3 and ETH 4 goes down.
Figure 2. Logical View of the Server Connector Panel and Bay Controller Connections (Full Bay)
The primary and secondary servers contain two heartbeat connections for redundancy. ETH 3 and ETH 4 connections are required to form the peering session. The ETH 3 and ETH 4 connection is a multicast connection. The first heartbeat is a multicast message over the bay controller network. The second heartbeat is over the server's ETH 0 port and this unicast connection requires an external network. The two heartbeats ETH 3/ETH 4 and ETH 0 work in unison and begin as soon as you have established an active/backup pair also known as "final" state.
If a server stops receiving heartbeats (multicast or unicast) a trap will be immediately sent (within one second) stating that the communication (primary or secondary) is no longer available. After four minutes of non-connection to the other server via both paths, the server will send a trap notifying that the sever is gone and the central office critical alarm is activated. The central office alarm is based on loss of communication with the bay controller. Since every server must register with the bay controller (and constantly update itself with the bay controllers, they must see each other (since it is the same physical link/protocol). Warm stand-by relies on the bay controller to create the central office alarm if a server goes down. After 5 minutes of no communication on both paths the backup server will assume the active role (if it is still functioning).
For software configuration details, refer to the IPriori CLI Reference (Vol. 1).
NOTE In a Split Bay configuration, you must chose between having either a redundant bay controller or warm stand-by server. This is due to a limitation in available ports.
Population Rules
The Terabit Switch Router (TSR) Full Bay and Split Bay configuration both support two server modules per router. In the TSR Full Bay configuration, the first and second server modules are installed in the left most slot (11) of the second shelf and the right most slot (20) respectively.
In the Split Bay configuration, the first and second server modules are installed in slots 11 and 20 for the upper router and in slots 31 and 40 of the lower router.
CAUTION Risk of electrostatic damage. This caution alerts you to the need to wear a grounded antistatic wrist strap or equivalent protection to avoid damaging electronics parts.
Server Attached Modules
In each TSR bay, the server attaches to one or two router modules known as Server-Attached Modules (SAMs). The power receptacle on the server module plugs directly into three power pins on the inside of the system near the backplane and does not plug into a module slot in the backplane.
Removal of the server module is detected by the SAM module after the SAM attempts to communicate with the server and receives no response. The SAMs act as intermediaries by providing access to all router modules. It is necessary to re-cable the connection to the SAM when replacing the server. When removing a server module you must do a controlled shut down. Refer to IPriori Software Configuration Guide (Vol.1) for information about removing a module.
NOTE You may choose any two modules to act as your SAM modules. For maximum fault tolerance, we recommend that the primary and backup SAM module be on different shelves for power redundancy and separate columns for communications.
Removing the Server Module
Prior to removing the server module take note of the position of the interface cables on the module enclosure faceplate and the color of the label located on the top of the route server module. The label color (red or blue) indicates which module can be inserted into a particular slot in the shelf. If you have a server module with the wrong indicator mark, call Support Services.
PROCEDURE: Use the following steps to remove the server module from the TSR bay shelf:
CAUTION Within five minutes of removal of a module, a replacement module or a filler module must be installed in the empty slot.
Step 1 Push on the server module where instructed. The server door opens and displays the module cable connections. Refer to Figure 3 and Figure 4.
Figure 3. Server Module Door
Step 2 Record the Ethernet and console cable connections for each port on a piece of paper.
Step 3 Disconnect the cables from the interface ports on the module faceplate. Refer to Figure 4.
Figure 4. Server Module Faceplate
Step 4 Using a 1/2-inch flat-blade screwdriver, turn the two captive screws on the server faceplate counter clockwise to loosen. The server module lock latch releases.
Step 5 Carefully pull the server module straight out to release it from the backplane and remove it from the shelf. Refer to Figure 5.
Figure 5. Server Module Removal
Step 6 Place the removed server module in the static-proof bag.
Installing the Server Module
PROCEDURE: Use the following procedure to install the server module:
Step 1 Remove the server module from its static-proof bag.
Step 2 Check that the door of the server module is closed. If the door is open, close it.
Figure 6. Server Module Faceplate
Step 3 Check the color indicator on the top of the module to determine if it is the right type for this slot (red circle or blue square). If it is not the correct color, contact Support Services. Refer to Figure 7.
Figure 7. Server Module Color Indicator
Step 4 Position the metal tabs of the lock latch release levers under the lip of the server.
Step 5 Align the module with the card guides of the slot and slide the server module into the slot. Refer to Figure 8.
Figure 8. Server Module Installation
.
Step 6 Using a 1/2-inch flat-blade screwdriver, turn the captive screws on the server faceplate clockwise to tighten, continuing to turn carefully until screw rotation is no longer possible. This ensures full engagement. The server module locks into place.
Installing Server Module Cables
Each server module supports five Ethernet ports (ETH 0-4) and one female console (DB-9) port. The Ethernet ports provide for interconnection to other modules within the bay and to the network management system. The console port provides for interconnection to a console terminal for use when configuring via the CLI.
Redundant Bay Controllers
The TSR offers fault tolerance via a connection from both the primary and secondary server's ETH 3 and ETH 4 ports to the bay controller network on the server connector panel.
These server connector panel ports can be found under the BIP panel cover and are labeled only with "Bay Controller L" and "Bay Controller R." Refer to Figure 9.
Figure 9. Breaker Interface and Server Connector Panels
To further illustrate the recommended Full Bay ETH 3 and ETH 4 connections on the server connector panel for the primary and secondary servers, please refer to Figure 10. This logical view borrows from Figure 9 and depicts the recommend port hook ups for the primary server in slot 11 (Bay Controller L-1/1 and Bay Controller R-2/1) and for the secondary server in slot 20 (Bay Controller L-1/2 and Bay Controller R-2/2). The dotted lines illustrate the connections between each of the server connector panel ports to the bay controllers.
Figure 10. Recommended Server Connector Panel Port Connections
It is necessary to connect one of the two server ports to each side of the server connector panel as the left-hand two ports of the server connector panel connect to the left bay controller and the right-hand two ports connect to the right bay controller, as illustrated in Figure 10. This minimizes shared components in each path.
Table 1 specifies the recommended port connections for each server.
Table 1. Recommended Server Configurations
(Full Bay)Server ETH 3 ETH 4 Primary
Left 1/1
Right 2/1
Secondary
Right 1/2
Left 2/2
TSR Full Bay Configuration
The server module in the Full Bay configuration attaches to two router modules, also called Server-Attached Modules (SAMs). The server must be installed in position 11. Any router module can serve as a SAM. The dual SAM system provides system redundancy.
NOTE You may choose any two modules to act as your SAM modules. For maximum fault tolerance, we recommend that the primary and backup SAM module be on different shelves for power redundancy and separate columns for communications.
PROCEDURE: Use the following steps to install the Ethernet and console cables for the server modules. Refer to Figure 11 for an illustration of the cables and connectors described in these procedures.
Figure 11. Server Module Cable Connections
Step 1 ETH 0 - Attach an RJ-45 Ethernet cable from this connector on the server module (slot 11) to the remote network management system within the central office.
Step 2 CONSOLE - Attach a female DB-9 RJ-45 adapter from this connector on the server module (slot 11) to one end of the UTP cable with RJ-45 connectors on each end. Take the RJ-45 connector on the other end of the UTP cable and plug it into the female adapter, which can plug into a console terminal (PC) port, or connection of your choice.
Step 3 ETH 1 - Attach an RJ-45 Ethernet cable from this connector on the server module (slot 11) to the RJ-45 connector located in the AUX tray of any other router module. (Slide out the AUX tray to make the connection.) This router module is the primary SAM. Refer to Figure 12.
NOTE You may choose any two modules to act as your SAM modules. For maximum fault tolerance, we recommend that the primary and backup SAM module be on different shelves for power redundancy and separate columns for communications.
Step 4 ETH 2 - Attach an RJ-45 Ethernet cable from this connector on the server (slot 11) to the RJ-45 connector located in the AUX tray of any other router module. Slide out the AUX tray to make the connection.
- This router module is referred to as the secondary SAM. Refer to Figure 12.
Figure 12. RJ-45 Ethernet Cable Connection
Step 5 Remove the BIP panel cover to expose the server connector panel. Refer to Figure 13.
Step 6 ETH 3 - Attach the RJ-45 Ethernet cable from the server module to the left most server connector panel port (Bay Controller L 1/1). Each of the four server connector panel ports is connected internally to the bay controller.
Step 7 ETH 4 - Attach the RJ-45 Ethernet cable from the server module to the left most port of the right two server connector ports (Bay Controller R 2/1). Each of the four server connector panel ports is connected internally to the bay controller.
Figure 13. Server Panel Ethernet Connections
Step 8 For a warm stand-by server, repeat Step 6 and Step 7 to connect the server in slot 20 to Bay Connector L 1/2 and Bay Connector R 2/2.
TSR Split Bay Configuration
The server modules in the Split Bay configuration attach to dual SAMs. Any router module can serve as a SAM.
NOTE With Split Bay you must choose between having either redundant controllers or redundant servers.
To complete the replacement of the server module all cables must be reconnected to the replacement server module.
NOTE The following configuration is ONLY for a Split Bay with redundant servers on both the upper and lower routers. For any other server configuration contact Support Services.
Each server module supports five Ethernet ports (ETH 0 - ETH 4) and one female console (DB-9) port. The Ethernet ports provide for interconnection to other modules within the bay and to the network management system. The console port provides for interconnection to a console terminal for use when configuring via the CLI.
Table 2 specifies the recommended port connections for each server.
Upper Router (Servers Slot 11 and 20)
PROCEDURE: Use the following steps to install the Ethernet and console cables for the server module in the upper router:
Step 1 ETH 0 - Attach an RJ-45 Ethernet cable from this connector on the server module (slot 11) to the remote network management system within the central office.
Step 2 CONSOLE - Attach a DB-9 RJ-45 adapter from this connector on the server module (slot 11) to one end of the UTP cable with RJ-45 connectors on each end. Take the RJ-45 connector on the other end of the UTP cable and plug it into the female adapter, which can plug into a console terminal (PC) port, or connection of your choice.
Step 3 ETH 1 - Attach an RJ-45 Ethernet cable from this connector on the server module (slot 11) to the RJ-45 connector located in the AUX tray of any other router module (slide out the AUX tray to make this connection). This router module is referred to as the primary SAM. Refer to Figure 14.
NOTE You may choose any two modules to act as your SAM modules. For maximum fault tolerance, we recommend that the primary and backup SAM module be on different shelves for power redundancy and separate columns for communications.
Figure 14. RJ-45 Ethernet Cable Connection
Step 4 ETH 2 - Attach an RJ-45 Ethernet cable from this connector on the server module (slot 11) to the RJ-45 connector located in the AUX tray of any router module (slide out the AUX tray to make this connection). This router module is referred to as the secondary SAM. Refer to Figure 14.
Step 5 Remove the BIP cover to expose the server connector panel. Refer to Figure 15.
Step 6 ETH 3 - Attach the RJ-45 Ethernet cable from this connector on the server module (slot 11) to the left most server connector panel port (Bay Connector L 1/1). Each of the four server connector panel ports is connected internally to the bay controller.
Step 7 ETH 4 - This server port is unused.
Figure 15. Server Connector Panel Ethernet Connections
Step 8 For a warm stand-by server in the upper router, repeat Step 6 through Step 7 to connect the server in slot 20 to Bay Connector L 1/2. ETH 4 is also unused.
Lower Router (Servers Slot 31 and 40)
PROCEDURE: Use the following steps to install the Ethernet and console cables for the server modules in the lower router:
Step 1 ETH 0 - Attach an RJ-45 Ethernet cable from this connector on the server module (slot 31) to the remote network management system within the central office.
Step 2 CONSOLE - Attach a DB-9 RJ-45 adapter from this connector on the server module (slot 31) to one end of the UTP cable with RJ-45 connectors on each end. Take the RJ-45 connector on the other end of the UTP cable and plug it into the female adapter, which plugs into the console terminal (PC) port.
Step 3 ETH 1 - Attach an RJ-45 Ethernet cable from this connector on the server module (slot 31) to the RJ-45 connector located in the AUX tray of any router module. (Slide out the AUX tray to make this connection.) This router module is the primary SAM. Refer to Figure 16.
NOTE You may choose any two modules to act as your SAM modules. For maximum fault tolerance, we recommend that the primary and backup SAM module be on different shelves for power redundancy and separate columns for communications.
Step 4 ETH 2 - Attach an RJ-45 Ethernet cable from this connector on the server module in slot 31 directly to the connector located in the AUX tray of any router module. (Slide out the AUX tray to make this connection.) This router module is the secondary SAM. Refer to Figure 16.
Step 5 Remove the BIP cover to expose the server connector panel. See Figure 15.
Step 6 ETH 3 - Attach the RJ-45 Ethernet cable from this connector on the server module in slot 31 to the left port of the two right most server connector panel ports (Bay Controller R 2/1). Each of the four server connector panel ports is connected internally to the bay controller.
Figure 16. RJ-45 Ethernet Cable Connection
Step 7 ETH 4 - This server port is unused.
Step 8 Repeat Step 6 through Step 7 to connect the server in slot 40 to Bay Connector R 2/2. ETH 4 is also unused.
Copyright © 2001
Avici Systems Inc.
Avici® and TSR® are registered
trademarks of Avici Systems Inc.
IPriori™ is a trademark of Avici Systems Inc.
Source File Name: 02131-01_revBA.fm
HTML File Name: 02131-01_revBA.html
Last Updated: 07/31/01 at 08:52:17
Please email suggestions and comments to: doc@avici.com