WO2000042746A1 - A method for routing information over a network - Google Patents

A method for routing information over a network Download PDF

Info

Publication number
WO2000042746A1
WO2000042746A1 PCT/US2000/000971 US0000971W WO0042746A1 WO 2000042746 A1 WO2000042746 A1 WO 2000042746A1 US 0000971 W US0000971 W US 0000971W WO 0042746 A1 WO0042746 A1 WO 0042746A1
Authority
WO
WIPO (PCT)
Prior art keywords
nodes
node
path
physical path
links
Prior art date
Application number
PCT/US2000/000971
Other languages
French (fr)
Inventor
Ali Najib Saleh
Haig Michael Zadikian
Zareh Baghdasarian
Vahid Parsi
Original Assignee
Cisco Technology, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cisco Technology, Inc. filed Critical Cisco Technology, Inc.
Priority to AU35820/00A priority Critical patent/AU3582000A/en
Publication of WO2000042746A1 publication Critical patent/WO2000042746A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/02Topology update or discovery
    • H04L45/04Interdomain routing, e.g. hierarchical routing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04JMULTIPLEX COMMUNICATION
    • H04J14/00Optical multiplex systems
    • H04J14/02Wavelength-division multiplex systems
    • H04J14/0287Protection in WDM systems
    • H04J14/0293Optical channel protection
    • H04J14/0295Shared protection at the optical channel (1:1, n:m)
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/02Topology update or discovery
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/22Alternate routing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/28Routing or path finding of packets in data switching networks using route fault recovery
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/32Flooding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/62Wavelength based
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q11/00Selecting arrangements for multiplex systems
    • H04Q11/0001Selecting arrangements for multiplex systems using optical switching
    • H04Q11/0062Network aspects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04JMULTIPLEX COMMUNICATION
    • H04J14/00Optical multiplex systems
    • H04J14/02Wavelength-division multiplex systems
    • H04J14/0278WDM optical network architectures
    • H04J14/0284WDM mesh architectures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q11/00Selecting arrangements for multiplex systems
    • H04Q11/0001Selecting arrangements for multiplex systems using optical switching
    • H04Q11/0062Network aspects
    • H04Q2011/0079Operation or maintenance aspects
    • H04Q2011/0081Fault tolerance; Redundancy; Recovery; Reconfigurability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q11/00Selecting arrangements for multiplex systems
    • H04Q11/0001Selecting arrangements for multiplex systems using optical switching
    • H04Q11/0062Network aspects
    • H04Q2011/009Topology aspects
    • H04Q2011/0098Mesh

Definitions

  • This invention relates to the field of information networks, and more particularly relates to a protocol for configuring routes over a network.
  • SONET synchronous optical network
  • SONET is a physical transmission vehicle capable of transmission speeds in the multi-gigabit range, and is defined by a set of electrical as well as optical standards.
  • SONET networks have traditionally been protected from failures by using topologies that dedicate something on the order of half the network's available bandwidth for protection, such as a ring topology.
  • Two approaches in common use today are diverse protection and self-healing rings (SHR), both of which offer relatively fast restoration times with relatively simple control logic, but do not scale well for large data networks. This is mostly due to their inefficiency in capacity allocation.
  • SHR protection and self-healing rings
  • Their fast restoration time makes most failures transparent to the end-user, which is important in applications such as telephony and other voice communications.
  • a SONET network using an SHR topology provides very fast restoration of failed links by using redundant links between the nodes of each ring.
  • each ring actually consists of two rings, a ring supporting information transfer in a "clockwise” direction and a ring supporting information transfer in a "counter-clockwise” direction.
  • the terms “east” and “west” are also commonly used in this regard.
  • Each direction employs its own set of fiber optic cables, with traffic between nodes assigned a certain direction (either clockwise or counter clockwise). If a cable in one of these sub-rings is damaged, the SONET ring "heals" itself by changing the direction of information flow from the direction taken by the information transferred over the failed link to the sub-ring having information flow in the opposite direction
  • the mesh topology is similar to the point-to- point topology used in inter-networking
  • Each node in such a network is connected to one or more other nodes
  • each node is connected to the rest of the network by one or more links
  • a path from a first node to a second node uses all or a portion of the capacity of the links between those two nodes
  • Networks based on mesh-type restoration are inherently more capacity-efficient than ring-based designs, mainly because each network link can potentially provide protection for fiber cuts on several different links
  • a SONET network using a mesh topology can provide redundancy for failure restoration at less than 100% of the bandwidth capacity originally required
  • Such networks are even more efficient when traffic transits several links
  • the corresponding ring-based design required five rings and a total DS-3 redundancy of 330%
  • path restoration often consumes several minutes m such a topology This is much slower than the restoration times
  • WDMs Back-to-back wavelength division multiplexers
  • OXCs optical cross connects
  • WDMs may be connected in back-to-back configurations to allow the connection of various wavelength routes to one another (also known as "patching" or “nailing up” connections).
  • Provisioning paths in such architectures is done manually using a patch panel.
  • provisioning is slow and prone to mistakes due to human error and equipment failure.
  • restoration is performed manually in such architectures, and is again slow and error-prone.
  • Such architectures scale poorly because additional bandwidth is added by either adding to the number of wavelengths supported (requiring the replacement of equipment at nodes, and possibly the replacement of fiber optic cables as well) or adding new fiber optic cables and supporting node equipment.
  • Such architectures are also inherently unmanageable, due to the lack of centralized control. And while the initial capital investment tends to be relatively low (as a result of their simplicity), operating expenses for such architectures tends to be relatively high because of the costs associated with configuration, expansion, and management. Thus, a mesh topology employing back-to-back WDMs will tend to be slow to deploy and difficult to manage due to the need for manually "nailing up” paths and lack of centralization.
  • OXC optical cross connect
  • An OXC can be either transparent (purely optical, in which the signals are never converted from optical signals) or opaque (in which the optical signals are converted from optical signals into electrical signals, switched, and then converted back into optical signals).
  • Transparent optical cross connects provide little in the way manageability because the information is never made accessible to the OXCs operator.
  • opaque OXCs can be configured to permit access to the information being switched.
  • neither type of OXC maintains information regarding the topology of the network and, in fact, OXCs possess no intrinsic network intelligence.
  • OXC technology is expensive, making initial investment quite high, as well as the cost of future expansion.
  • a SONET network may be configured in a ring (SHR) topology by using add/drop multiplexers (ADMs).
  • An ADM is a SONET multiplexer that allows signals to be added into or dropped from a higher rate signal.
  • ADMs have two bidirectional ports, commonly referred to as an east and a west port.
  • a SONET network in a SHR topology uses a collection of nodes equipped with ADMs in a physical closed loop such that each node is connected to two adjacent nodes with a duplex connection. Any loss of connection due to a single failure of a node or a connection between nodes is automatically restored. The traffic terminated at a failed node, however, is lost.
  • Bidirectional rings Two types of SHRs are unidirectional (UPSR) and bidirectional (BLSR), as defined by the traffic flow in normal conditions.
  • UPSR unidirectional
  • BLSR bidirectional
  • Bidirectional rings have a capacity carrying advantage over unidirectional rings because of the ability to share protection capacity among the links between nodes, as opposed to unidirectional rings, which dedicate capacity all the way around the ring.
  • Provisioning in such architectures is centralized and can be performed in minutes. While restoration can also be performed quickly (on the order of 50 ms, as previously noted), 100% spare bandwidth is required.
  • the user must install fiber optic cabling for two networks, one for normal traffic and one to be used in the event of a failure.
  • ADMs are stacked in an SHR in order to increase capacity.
  • stacked ADMs are blocking.
  • the switching function may not be transparent as a result of the ADMs not being available on a full-time basis (i.e., occasionally blocking).
  • an architecture employing ADMs is best suited for small offices or other situations that do not require the relatively large amounts of bandwidth (implying the need for stacked ADMs).
  • stacked ADMs are also difficult to manage and expensive due to the extra hardware required for 100% spare capacity.
  • WDMs can be combined with OXCs (either transparent or opaque) in order to create a network having a mesh topology.
  • OXCs either transparent or opaque
  • Such an architecture supports the cross-connection of wavelength routes by either manual connection or under centralized control.
  • such an architecture is also difficult to expand due to the need to add WDMs/fiber optic cables and the increase in size of the OXC, and cannot restore failed links quickly enough to avoid dropping or interrupting telecommunications connections.
  • DCS digital cross-connect system
  • a DCS is used to terminate digital signals and cross-connect them, integrating multiple functionalities such as signal adding and dropping, cross- connection capabilities, and multiplexing and demultiplexing of signals.
  • DCS based networks enjoy an advantage over networks employing back-to-back WDMs because the use of DCS eliminates the need for additional back-to- back electrical multiplexing, thus reducing the need for labor-intensive jumpers. Operational cost savings are realized by a DCS through electronically controlling cross-connections, test access and loopbacks, and maintenance.
  • Two types of DCSs are wideband DCSs and broadband DCSs.
  • Wideband DCS terminates full duplex OC-Ns and DS3s, has VT cross-connection capability, and provides DS1 interfaces.
  • a broadband DCS terminates full-duplex OC-N signals and provides DS3 interfaces.
  • the B-DCS makes two-way cross connection at the DS3, STS-1, and concatenated STS-Nc levels.
  • STS-Nc may be used, for example, in broadband services such as high definition television (HDTV), where an STS-3c cross connection may be used to cross connect the signal as a single, high-capacity channel.
  • HDTV high definition television
  • DCSs in a mesh configuration to create a fault-tolerant network
  • Some of these configurations rely on a central database and a central controller (usually an Operations System or OS) to restore failures.
  • OS Operations System
  • these schemes often exhibit restoration times exceeding 10 minutes, such restoration times are an improvement over manual restoration, which requires hours, or even days to effect restoration.
  • these results are not enough to meet the 50-200 ms restoration time required by existing telecommunication network equipment.
  • Other implementations employ distributed architectures in which control is shared among multiple network nodes. This results in faster restoration times (on the order of about 2-10 seconds), but still does not address the need for restoration times below 200 ms.
  • a routing protocol that supports relatively simple provisioning and relatively fast restoration (on the order of , for example, 50 ms), while providing relatively efficient bandwidth usage (i.e., minimizing excess bandwidth requirements for restoration, on the order of less than 100% redundant capacity and preferably less than 50% redundant capacity).
  • Such a routing protocol is, in one embodiment, easily be scaled to accommodate increasing bandwidth requirements.
  • an apparatus and method are described for configuring routes over a network.
  • Such a method embodied in a protocol of the present invention, provides several advantages.
  • a protocol according to the present invention provides relatively fast restoration (on the order of 50 ms), while providing relatively efficient bandwidth usage (i.e., minimizing excess bandwidth requirements for restoration, on the order of less than 100% redundant capacity and preferably less than 50% redundant capacity).
  • a protocol according to one embodiment of the present invention scales well to accommodate increasing bandwidth demands of the services being supported.
  • a method of operating an optical network includes a number of nodes coupled by a number of links.
  • a method according to this embodiment of the present invention provisions a virtual path between a first and a second one of the plurality of nodes by: identifying the first and the second nodes, discovering a physical path from the first node to the second node, and establishing the virtual path.
  • the method discovers a physical path from the first node to the second node by automatically identifying nodes forming the physical path.
  • the method establishes the virtual path by configuring a set of connections between the nodes forming the physical path.
  • a method that terminates the virtual path by sending a termination message from one of the first and second nodes to the other of the first and second nodes.
  • the termination message is sent along the physical path and resources for the virtual path are deallocated by each one of the nodes forming the physical path as the termination message is sent to the next one of the nodes that form the physical path.
  • a method that restores a virtual path in response to a failure along the physical path created between a first node and a second node by a provisioning operation such as that described above (although a virtual path restored by a method according to the present invention may be provisioned in any manner deemed desirable).
  • Such a method begins by discovering an alternate physical path from the first node to the second node.
  • the alternate physical path is discovered by automatically identifying nodes forming the alternate physical path This may be based on any number of criteria, such as cost, quality of service, latency, or other metric
  • the method then re-establishes the virtual path by configuring a set of connections between the nodes forming the alternate physical path This may require an entirely new end-to-end alternate physical path, or may simply be the addition of a node or link to the existing physical path
  • Fig 1 illustrates the layout of a Node Identifier (Node ID)
  • Fig 2 is a block diagram of a zoned network consisting of four zones and a backbone
  • Fig 3 is a flow diagram illustrating the actions performed by a neighboring node in the event of a failure
  • Fig 4 is a flow diagram illustrating the actions performed by a downstream node in the event of a failure
  • Fig 5 is a flow diagram illustrating the actions performed in sending a Link State Advertisement (LSA)
  • LSA Link State Advertisement
  • Fig 6 is a flow diagram illustrating the actions performed in receiving an LSA
  • Fig 7 is a flow diagram illustrating the actions performed in determining which of two LSAs is the more recent
  • Fig 8 is a state diagram of a Hello Machine according to the present invention
  • Fig 9 is a flow diagram illustrating the actions performed in preparation for path restoration in response to a link failure
  • Fig 10 is a flow diagram illustrating the actions performed in processing received Restore-Path Requests
  • Fig 1 1 is a flow diagram illustrating the actions performed in the processing of an RPR by the RPR's target node
  • Fig. 12 is a flow diagram illustrating the actions performed in returning a negative response in response to an RPR.
  • Fig. 13 is a flow diagram illustrating the actions performed in returning a positive response to a received RPR.
  • Fig. 14 is a block diagram illustrating an exemplary network according to the present invention.
  • Fig. 15 is a flow diagram illustrating the actions performed in calculating the shortest path between nodes based on Quality of Service (QoS) for a given Virtual Path (VP).
  • QoS Quality of Service
  • VP Virtual Path
  • Fig. 16 illustrates the layout of a protocol header according to the present invention.
  • Fig. 17 illustrates the layout of an initialization packet according to the present invention.
  • Fig. 18 illustrates the layout of a Hello Packet of a protocol according to the present invention.
  • Fig. 19 illustrates the layout of an RPR Packet of a protocol according to the present invention.
  • Fig. 20 illustrates the layout of a GET_LSA Packet of a protocol according to the present invention.
  • Fig. 21 illustrates the layout of a CREATE_PATH packet of a protocol according to the present invention.
  • a routing protocol is described that provides many advantages, including restoration times on the order of 50 ms or less (e.g., comparable to those of SHRs) and relatively high utilization efficiency (e.g. by reducing the amount redundant bandwidth, preferably to, for example, 50% or less).
  • the protocol achieves the former by using a physical network layer (e.g., SONET) for communications between network nodes.
  • SONET physical network layer
  • no other protocols are interspersed between the routing protocol and the transmission medium.
  • all protocol-related status and control messages are communicated in-band (e.g., carried by the physical network layer, for example, in certain of a SONET frame's overhead bytes), which allows events to be sent between network nodes at hardware speeds.
  • the protocol in one embodiment, relies on a distributed routing protocol, which employs event pipelining and parallel execution of protocol processes Because multiple actions occur in parallel, event delays are minimized
  • the protocol also uses a distributed database and relies on distributed control to restore failures
  • every node maintains an up-to-date view of network topology, (1 e , available nodes and links, and configured connections) Changes that occur in the network, whether caused by failed links, newly provisioned connections, or added/failed/removed nodes, are 'broadcast" throughout the network, using special protocol packets and procedures Topology distribution normally runs concurrently with, and in parallel to, failure restoration activities, but at a much lower priority
  • protection bandwidth a user-configurable parameter, and attaching a priority (or QoS) metric to all configured connections (referred to herein as virtual paths or VPs) and links
  • QoS priority
  • the QoS parameter makes it possible to reduce the required percentage of protection bandwidth even further while maintaining the same quality of service for those connections that need and, more importantly, can afford such treatment
  • availability is mapped into a cost metric and only made available to users who can justify the cost of a given level of service
  • networks like the protocol described herein can be divided into smaller logical groups called "zones" Each zone runs a separate copy of the topology dist ⁇ but on algorithm, and nodes within each zone are only required to maintain information about their own zone There is no need for a zone s topology to be known outside its boundaries, and nodes within a zone need not be aware of the network's topology external to their respective zones
  • Border nodes are required to maintain a separate topological database, also called a link-state or connectivity database, for each of the zones they attach to Border nodes use the connectivity database(s) for intra-zone routing Border nodes are also required to maintain a separate database that describes the connectivity of the zones themselves This database, which is called the network database, is used for inter- zone routing It describes the topology of a special zone, referred to herein as the backbone, which is always assigned an ID of 0 The backbone has all the characteristics of a zone There is no need for a backbone's topology to be known outside the backbone, and its border nodes need not be aware of the topologies of other zones
  • a network is referred to heiein as flat if it consists of a single zone (1 e , zone 0 or the backbone zone)
  • a network is referred to herein as hierarchical if it contains two or more zones, not including the backbone
  • the resulting multi-level hierarchy (I e , nodes and one or more zones) provides the following benefits
  • the protocol routes information at two different levels inter-zone and intra-zone
  • the former is only used when the source and destination nodes of a virtual path are located in different zones
  • Inter-zone routing supports path restoration on an end-to-end basis from the source of the virtual path to the destination by isolating failures between zones
  • the border nodes in each transit zone originate and terminate the path-restoration request on behalf of the virtual path's source and destination nodes
  • a border node that assumes the role of a source tor destination) node during the path restoration activity is referred to herein as a proxy source (destination) node
  • proxy source (destination) node Such nodes are responsible for originating (terminating) the RPR request with their own zones
  • Proxy nodes are also required to communicate with border nodes in other zones to establish an inter-zone path for the VP
  • every node in a network employing the protocol is assigned a globally unique 16-bit
  • a node ID is divided into two parts, zone ID and node address Logically, each node ID is a pair (zone ID, node address), where the zone ID identifies a zone within the network, and the node address identifies a node within that zone
  • the protocol defines three type:* of node IDs, each with a different size zone ID field, although a different number of zone types can be employed
  • the network provider selects which packet type to use based on the desired network architecture
  • Fig 1 illustrates the layout of a node ID 100 using three types of node IDs
  • a field referred to herein as type ID 1 10 is allocated either one or two bits, a zone ID 120 of between 2-6 bits in length, and a node address 130 of between about 8-13 bits in length
  • Type 0 IDs allocate 2 bits to zone ID and 13 bits to node address, which allows up to 2 13 or 8192 nodes per zone
  • type 1 IDs devote 4 bits to zone ID and 10 bits to node address, which allows up to 2 10 (I e 1024) nodes to be placed in each zone
  • type 2 IDs use a 6-bit zone ID and an 8-bit node address, as shown in Fig 1 This allows up to 256 nodes to be addressed within the zone
  • the node ID bits can be apportioned in several other ways to provide more levels of addressing Type 0 IDs work well for networks that contain a small number of large zones (e.g.
  • Type 2 IDs are well suited for networks that contain a large number of small zones (e.g.. more than about 15).
  • Type 1 IDs provide a good compromise between zone size and number of available zones, which makes a type 1 node ID a good choice for networks that contain an average number of medium size zones (e.g., between about 4 and about 15).
  • the node IDs of the nodes in a zone may be delineated as two decimal numbers separated by a period (e.g., ZonelD.NodeAddress).
  • Fig. 2 illustrates an exemplary network that has been organized into a backbone, zone 200, and four configured zones, zones 201-204, which are numbered 0-4 under the protocol, respectively.
  • the exemplary network employs a type 0 node ID, as there are relatively few zones (4).
  • the solid circles in each zone represent network nodes, while the numbers within the circles represent node addresses, and include network nodes 211- 217, 221-226, 231-236, and 241-247.
  • the dashed circles represent network zones.
  • the network depicted in Fig. 2 has four configured zones (zones 1 -4) and one backbone (zone 0).
  • Nodes with node IDs 1.3, 1.7, 2.2, 2,4, 3.4, 3.5, 4.1 , and 4.2 are border nodes because they connect to more than one zone. All other nodes are interior nodes because their links attach only to nodes within the same zone.
  • Backbone 200 consists of 4 nodes, zones 201-204, with node IDs of 0.1, 0.2, 0.3, and 0.4, respectively.
  • the protocol allows the user to configure one or more end-to- end connections that can span multiple nodes and zones. This operation is referred to herein as provisioning.
  • provisioning Each set of physical connections that are provisioned creates an end-to-end connection between the two end nodes that supports a virtual point-to-point link (referred to herein as a virtual path or VP).
  • the resulting VP has an associated capacity and an operational state, among other attributes.
  • the end points of a VP can be configured to have a master/slave relationship.
  • the terms source and destination are also used herein in referring to the two end- nodes.
  • the node with a numerically lower node ID assumes the role of the master (or source) node, while the other assumes the role of the slave (or destination) node.
  • the protocol defines a convention in which the source node assumes all recovery responsibilities and that the destination node simply waits for a message from the source node informing it of the VP's new path, although the opposite convention could easily be employed.
  • VPs are also assigned a priority level, which determines their relative priority within the network.
  • This quality of service (QoS) parameter is used during failure recovery procedures to determine which VPs are first to be restored.
  • QoS levels (0-3) are nominally defined in the protocol, with 0 being the lowest, although a larger or smaller number of QoS levels can be used Provisioning is discussed in greater detail subsequently herein.
  • network nodes use a protocol such as that referred to herein as the Hello Protocol in order to establish and maintain neighbor relationships, and to learn and distribute link-state information throughout the network
  • the protocol relies on the periodic exchange of bi-directional packets (Hello packets) between neighbors During the adjacency establishment phase of the protocol, which involves the exchange of INIT packets, nodes learn information about their neighbors, such as that listed in Table 1
  • each node constructs a structure known as a Link State Advertisement (LSA), which contains a list of the node's neighbors, links, the capacity of those links, the quality of service available on over links, one or more costs associated with each of the links, and other pertinent information
  • LSA Link State Advertisement
  • the node that constructs the LSA is called the originating node Normally, the originating node is the only node allowed to modify its contents (except for the HOP_COUNT field, which is not included in the checksum and so may be modified by other nodes)
  • the originating node retransmits the LSA when the LSA's contents change
  • the LSA is sent in a special Hello packet that contains not only the node's own LSA in its advertisement, but also ones received from other nodes
  • the structure, field definitions, and related information are illustrated subsequently in Fig 18 and described in the corresponding discussion
  • Each node stores the most recently generated instance of an LSA in its database
  • the list of stored LSAs gives the
  • null Hello packets In the case of a stable network, the majority of transmitted Hello packets are empty (I e , contain no topology information) because only altered LSAs are included in the Hello messages Packets containing no changes (no LSAs) are referred to herein as null Hello packets
  • the Hello protocol requires neighbors to exchange null Hello packets periodically
  • the Hellolnterval parameter defines the duration of this period Such packets ensure that the two neighbors are alive, and that the link that connects them is operational
  • An INIT message is the first protocol transaction conducted between adjacent nodes and is performed upon network startup or when a node is added to a pre-existing network
  • An INIT message is used by adjacent nodes to initialize and exchange adjacency parameters
  • the packet contains parameters that identify the neighbor (the node ID of the sending node), its link bandwidth (both total and available, on a QoS3/QoSn basis), and its configured Hello protocol parameters.
  • the structure, field definitions, and related information are illustrated subsequently in Fig. 17 and described in the text corresponding thereto.
  • the Hello parameters include the Hellolnterval and HelloDeadlnterval parameters.
  • the Hellolnterval is the number of seconds between transmissions of Hello packets. A zero in this field indicates that this parameter hasn't been configured on the sending node and that the neighbor should use its own configured interval.
  • both nodes send a zero in this field then a default value (e.g., 5 seconds) should be used.
  • the HelloDeadlnterval is the number of seconds the sending node will wait before declaring a silent neighbor down. A zero in this field indicates that this parameter hasn't been configured on the sending node and that the neighbor should use its own configured value. If both nodes send a zero in this field then a default value (e.g., 30 seconds) should be used.
  • the successful receipt and processing of an INIT packet causes a START event to be sent to the Hello State machine, as is described subsequently.
  • the nodes periodically exchange Hello packets.
  • the interval between these transmissions is a configurable parameter that can be different for each link, and for each direction.
  • Nodes are expected to use the Hellolnterval parameters specified in their neighbor's Hello message.
  • a neighbor is considered dead if no Hello message is received from the neighbor within the HelloDeadlnterval period (also a configurable parameter that can be link- and direction-specific).
  • nodes in a network continuously receive Hello messages on each of their links and save the most recent LSAs from each message.
  • Each LSA contains, among other things, an LSID (indicating which instance of the given LSA has been received) and a HOP_COUNT.
  • the HOP_COUNT specifies the distance, as a number of hops, between the originating node and the receiving node. The originating node always sets this field of 0 when the LSA is created.
  • the HOP_COUNT field is incremented by one for each hop (from node to node) traversed by the LSA instance.
  • the HOP_COUNT field is set to zero by the originating node and is incremented by one on every hop of the flooding procedure.
  • the ID field is initialized to FIRST_LSID during node start-up and is incremented every time a new instance of the LSA is created by the originating node.
  • the initial ID is only used once by each originating node.
  • an LSA carrying such an ID is always accepted as most recent. This approach allows old instances of an LSA to be quickly flushed from the network when the originating node is restarted.
  • the originating node of an LSA transmits LS update messages when the node detects activity that results in a change in its LSA.
  • the node sets the HOP_COUNT field of the LSA to 0 and the LSID field to the LSID of the previous instance plus 1.
  • Wraparound may be avoided by using a sufficiently-large LSID (e.g., 32 bits).
  • LSID e.g., 32 bits.
  • the node records the LSA in its database and schedules it for transmission to its own neighbors.
  • the HOP_COUNT field is incremented by one and transmitted to the neighboring nodes.
  • the nodes downstream of the current node receive an update message with a HOP_COUNT of H, they transmit their own update message to all of their neighbors with a HOP_COUNT of H+l , which represents the distance (in hops) to the originating node. This continues until the update message either reaches a node that has a newer instance of the LSA in its database or the hop- count field reaches MAXJHOPS.
  • Fig. 3 is a flow diagram illustrating the actions performed in the event of a failure.
  • the inactivity counter associated with the neighboring node is cleared (step 300).
  • the receiving node clears the inactivity counter (step 300). If the neighboring node fails, or any component along the path between the node and the neighboring node fails, the receiving node stops receiving update messages from the neighboring node. This causes the inactivity counter to increase gradually (step 320) until it reaches HelloDeadlnterval (step 330). Once HelloDeadlnterval is reached, several actions are taken.
  • the node changes the state of the neighboring node from ACTIVE to DOWN (step 340).
  • the HOP_COUNT field of the LSA is set to LSInfinity (step 350).
  • a timer is then started to remove the LSA from the node's link state database • mihmLSZombieTime (step 360).
  • a copy of the LSA is then sent to all active neighbors (step 370).
  • a LINK_DOWN event is generated to cause all VP " s that use the link between the node and its neighbor to be restored (step 380).
  • a GETJ SA request is sent to all neighbors, requesting their copy of all LSA's previously received from the now- dead neighbor (step 390).
  • Fig. 4 is a flow diagram illustrating the actions performed when a downstream node receives a GET LSA message.
  • the downstream node When the downstream node receives the request, it first acknowledges the request by sending back a positive response to the sending node (step 400).
  • the downstream node looks up the requested LSA's in its link state database (step 410) and builds two lists, list A and list B (step 420).
  • the first list, list A contains entries that were received from the sender of the GET_LSA request.
  • the second list, list B contains entries that were received from a node other than the sender of the request, and so need to be forwarded to the sender of the GET_LSA message.
  • All entries on list A are flagged to be deleted within LSTimeToLive, unless an update is received from neighboring nodes prior to that time (step 430).
  • the downstream node also sends a GET_LSA request to all neighbors, except the one from which the GET_LSA message was received, requesting each neighbor's version of the LSAs on list A (step 430). If list B is non-empty (step 450), entries on list B are placed in one or more Hello packets and sent to the sender of the GET_LSA message (step 460). No such request is generated if the list is empty (step 450).
  • the LSA of the inactive node propagates throughout the network until the hop-count reaches MAX_HOPS.
  • Various versions of the GETJLSA request are generated by nodes along the path, each with a varying number of requested LSA entries. An entry is removed from the request when it reaches a node that has an instance of the requested LSA that meets the criteria of list B.
  • Al! database exchanges are expected to be reliable using the above method because received LSA's must be individually acknowledged.
  • the acknowledgment packet contains a mask that has a "1 " in all bit positions that correspond to LSA's that were received without any errors.
  • the low-order bit corresponds to the first LSA received in the request, while the high-order bit corresponds to the last LSA.
  • the sender verifies the checksum of all LSA's in its database that have a corresponding "0" bit in the response. It then retransmits all LSA's with a valid checksum and ages out all others. An incorrect checksum indicates that the contents of the given LSA has changed while being held in the node's database. This is usually the result of a memory problem. Each node is thus required to verify the checksum of al) LSA's in its database periodically.
  • the LS checksum is provided to ensure the integrity of LSA contents. As noted, it is used to detect data corruption of an LSA. This corruption can occur while the advertisement is being transmitted, while it is being held in a node's database, or at other points in the networking equipment.
  • the checksum can be formed by any one of a number of methods known to those of skill in the art, such as by treating the LSA as a sequence of 16-bit integers, adding them together using one's complement arithmetic, and then taking the one's complement of the result.
  • the checksum doesn't include the LSA's HOP_COUNT field, in order to allow other nodes to modify the HOP_COUNT without having to update the checksum field. In such a scenario, only the originating node is allowed to modify the contents of an LSA except for those two fields, including its checksum. This simplifies the detection and tracking of data corruption.
  • the LSA's ID field the LSID.
  • the LSID makes it possible to detect old and duplicate LSAs. Similar to sequence numbers, the space created by the ID is circular: it starts at some value (FIRSTJ SID), increases to some maximum value (FIRST_LSID-1), and then goes back to FIRSTJLSID+1.
  • FIRSTJ SID some value
  • FIRST_LSID-1 some maximum value
  • FIRST_LSID-1 some maximum value
  • the initial value is only used once during the lifetime of the LSA, which helps flush old instances of the LSA quickly from the network when the originating node is restarted. Given a large enough LSID, wrap-around will never occur, in a practical sense For example, using a 32 bit LSID and a MinLSInterval of 5 seconds, wrap-around takes on the order of 680 years
  • LSIDs must be such that two LSIDs can be compared and the greater (or lesser) of the two identified, or a failure ol the comparison indicated Given two LSIDs x and >, x is considered to be less than ⁇ if either
  • FIG 5 shows a flow diagram illustrating the actions performed in sending link state information using
  • each node is required to send a periodic Hello message on each of its active links Such packets are usually empty (a null Hello packet), except w hen changes are made to the database, either through local actions or received advertisements
  • Fig 5 illustrates how a given node decides which LSAs to send, when, and to what neighbors It should be noted that each Hello message may contain several LSAs thai are acknowledged as a group by sending back an appropriate response to the node sending the Hello message
  • step 500 Foi each new LSA in the link state database (step 500), then, the following steps are taken If the LSA is new, several actions are performed For each node in the neighbor list (step 510), the state of the neighboring node is determined If the state of the neighboring node is set to a value of less than ACTIVE, that node is skipped (steps 520 and 530) If the state of the neighboring node is set to a value of at least ACTIVE and if the LSA was received from this neighbor (step 540), the given neighbor is again skipped (step 530) If the LSA was not received from this neighbor (step 540), the LSA is added to the list of LSAs that are waiting to be sent by adding the LSA to this neighbor's LSAsToBeSent list (step 550) Once all LSAs have been processed (step 560), requests are sent out This is accomplished by stepping through the list of LSAs to be sent (steps 570 and 580) Once all the LSAs have been sent, the process
  • Fig 6 illustrates the steps performed by a node that is receiving LSAs As noted, LSAs are received in
  • Each Hello message may contain several distinct LSAs that must be acknowledged as a group by sending back an appropriate response to the node from which the Hello packet was received
  • the process begins at step 600, where it is determined whether the Hello message received contains any LSAs requiring acknowledgment
  • An LSA requiring processing is first analyzed to determine if the HOP_COUNT is equal to MAX_HOPS (step 610) This indicates that HOP_COUNT was incremented past MAX_HOPS by a previous node, and implies that the originating node is too far from the receiving node to be useful If this is the case, the current LSA is skipped (step 620).
  • the LSA's checksum is analyzed to ensure that the data in the LSA is valid (step 630). If the checksum is not valid (i.e., indicates an error), the LSA is discarded (step 435).
  • the node's link state database is searched to find the current LSA (step 640), and if not found, the current LSA is written into the database (step 645). If the current LSA is found in the link state database, the current LSA and the LSA in the database are compared to determine if they were sent from the same node (step 650). If the LSAs were from the same node, the LSA is installed in the database (step 655). If the LSAs were not from the same node, the current LSA is compared to the existing LSA to determine which of the two is more recent (step 660). The process for determining which of the two LSAs is more recent is discussed in detail below in reference to Fig. 7.
  • the LSA stored in the database is the more recent of the two, the LSA received is simply discarded (step 665). If the LSA in the database is less recent than the received LSA, the new LSA is installed in the database, overwriting the existing LSA (step 670). Regardless of the outcome of this analysis, the LSA is then acknowledged by sending back an appropriate response to the node having transmitted the Hello message (step 675).
  • Fig. 7 illustrates one method of determining which of two LSAs is the more recent.
  • An LSA is identified by the Node ID of its originating node.
  • the process of determining the more recent of the two begins at step 700 by comparing the LSAs LSIDs.
  • the special ID FIRST_LSID is considered to be higher than any other ID. If the LSAs LSIDs are different, the LSA with the higher LSID is the more recent of the two (step 710). If the LSAs have the same LSIDs, then HOP_COUNTs are compared (step 720).
  • the LSAs are identical and neither is more recent than the other (step 730). If the HOP_COUNTs are not equal, the LSA with the lower HOP_COUNT is used (step 740). Normally, however, the LSAs will have different LSIDs.
  • broadcast storm The basic flooding mechanism in which each packet is sent to all active neighbors except the one from which the packet was received can result in an exponential number of copies of each packet. This is referred to herein as a broadcast storm.
  • the severity of broadcast storms can be limited by one or more of the following optimizations:
  • each LSA can be configured with a HOP_COUNT field.
  • the field which is initialized to zero by the originating node, is incremented at each hop and, when it reaches MAX_HOP, propagation of the LSA ceases.
  • Nodes can be configured to record the node ID of the neighbor from which they received a particular LSA and then never send the LSA to that neighbor.
  • Nodes can be prohibited from generating more than one new instance of an LSA every MinLSAInterval interval (a minimum period defined in the LSA that can be used to limit broadcast storms by limiting how often an LSA may be generated or accepted (See Fig. 15 and the accompanying discussion)). 4. Nodes can be prohibited from accepting more than one new instance of an LSA less than MinLSAInterval "younger" than the copy they currently have in the database.
  • Every node establishes adjacency with all of its neighbors.
  • the adjacencies are used to exchange Hello packets with, and to determine the status of the neighbors.
  • Each adjacency is represented by a neighbor data structure that contains information pertinent to the relationship with that neighbor. The following fields support such a relationship:
  • a node maintains a list of neighbors and their respective states locally.
  • a node can detect the states of is neighbors using a set of "neighbor states,” such as the following:
  • Fig 8 illustrates a Hello state machine (HSM) 800 according to the present invention
  • HSM 800 keeps track of adjacencies and their states using a set of states such as those above and transitions therebetween
  • each node maintains a separate instance of HSM 800 for each of its neighbors
  • HSM 800 is driven by a number of events that can be grouped into two main categories internal and external Internal events include those generated by timers and other state machines
  • External events are the direct result of received packets and user actions Each event may produce different effects, depending on the current state of the adjacency and the event itself For example, an event may
  • HSM 800 includes a Down state 805, an INIT-Sent state 810. a ONE-WAY state 815, an EXCHANGE state 820, an ACTIVE state 825, and an INIT-Received state 830 HSM 800 transitions between these states in response to a START transition 835, IACK_RECEIVED transitions 840 and 845, INIT_RECEIVED transitions 850, 855, and 860, and an EXCHANGE DONE transition 870 in the manner described in Table 3 It should be noted that the Disabled state mentioned in Table ⁇ is merely a fictional state representing a non-existent neighbor and, so. is not shown in Fig 8 for the sake of clarity Table 3 shows state changes, their causing events, and resulting actions
  • Exchange is a transitional state that allows both nodes to synchronize their databases before entering the Active State.
  • Database synchronization involves exchange of one or more Hello packets that transfer the contents of one node's database to the other.
  • a node should not send a Hello request while its awaiting the acknowledgment of another.
  • the exchange may be made more reliable by causing each request to be transmitted repeatedly until a valid acknowledgment is received from the adjacent node.
  • a Hello packet arrives at a node, it is processed as previously described. Specifically, the node compares each LSA contained in the packet to the copy it currently has in its own database. If the received copy is more recent then the node's own or advertises a better hop-count, it is written into the database, possibly replacing the current copy.
  • the exchange process is normally considered completed when each node has received, and acknowledged, a null Hello request from its neighbor. The nodes then enter the Active State with fully synchronized databases which contain the most recent copies of all LSAs known to both neighbors.
  • a sample exchange using the Hello protocol is described in Table 4. In the following exchange, node 1 has four LSAs in its database, while node 2 has none.
  • node 1 has four LSAs (1 through 4) in its database, and node 2 has 7 (3 and 5 through 10). Additionally, node 2 has a more recent copy of LSA3 in its database than node 1.
  • VPs may be provisioned statically or dynamically. For example, a user can identify the nodes through which the VP will pass and manually configure each node to support the given VP. The selection of nodes may be based on any number of criteria, such as QoS, latency, cost, and the like.
  • the VP may be provisioned dynamically using any one of a number of methods, such as a shortest path first technique or a distributed technique.
  • a shortest path first technique might, for example, employ the shortest path first technique of the present invention.
  • An example of a distributed technique is the restoration method described subsequently herein.
  • failures are detected using the mechanisms provided by the underlying physical network.
  • LOS loss of signal
  • the LOS condition propagated an Alarm Indication Signal (AIS) downstream, and Remote Defect Indication (RDI) upstream (if the path still exists), and an LOS defect locally.
  • AIS Alarm Indication Signal
  • RTI Remote Defect Indication
  • OS Operations System
  • GR-253 Synchronous Optical Network (SGNET) Transport Systems, Common Generic Criteria, Issue 2 [Bellcore, Dec.
  • the handling of the LOS condition follows Bellcore's recommendations in GR-253, which allows nodes to inter-operate, and co-exist, with other network equipment (NE) in the same network and which is included by reference herein in its entirety and for all purposes.
  • the mesh restoration protocol is invoked as soon as the LOS defect is detected by the line card, which occurs 3ms following the failure (a requirement under GR-253).
  • each node is allowed a maximum of 125 microseconds to forward the AIS downstream, which quickly propagates failures toward the source node.
  • the node scans its VP table looking for entries that have the failed link in their path. When the node finds one, it releases all link bandwidth used by the VP. Then, if the node is a VP's source node or a proxy border node, the VP's state is changed to RESTORING and the VP placed on a list of VPs to be restored.
  • the state of the VP is changed to DOWN, and a timer is started to delete it from the database if a corresponding restore-path request isn't received from the origin node within a certain timeout period
  • QoS quality of service
  • Fig 9 illustrates the steps performed in response to the failure of a link
  • the failure of a link results in a LOS condition at the nodes connected to the link and generates an AIS downstream and an RDI upstream
  • a failure has been detected (step 900)
  • each affected node performs several actions in order to maintain accurate status information with iegard to the VPs that it currently supports
  • the first action taken in such a case is that the node scans its VP table looking for entries that have the failed link in their path (steps 910 and 920) If the VP does not use the failed link, the node goes to the next VP in the table and begins analyzing that entry (steo 930) If the selected VP uses the failed link the node releases all link bandwidth allocated to that VP fstep 940) The node then determines whether it is a souice node or a proxy border node for the VP (step 950) If this is the case,
  • the node For each VP on the list, the node then sends an RPR to all eligible neighbors in order to restoie the VP
  • the network will, of couise attempt to restore all failed VPs Neighbor eligibility is determined b> the state of the neighbor, available link bandwidth, current zone topology, location of the Target node, and other parameteis
  • One method for determining the eligibility of a particular neighbor follows
  • the origin node builds a shortest path first (SPF) tree with "self as root Prior to building the SPF tree, the link-state database is pruned of all links that either don't have enough (available) bandwidth to satisfy the request, or have been assigned a QoS level that exceeds that of the VP being restored
  • SPF shortest path first
  • the node selects the output l ⁇ nk(s) that can lead to the target node in less than M ⁇ X_HOPS hops
  • the structure and contents of the SPF tree generated simplifies this step
  • the RPR carries information about the VP, such as:
  • RPR to be identified by the nodes.
  • An 8-bit field that carries the distance, in hops, between the origin node the receiving node. This field is initially set to zero by the originating node, and is incremented by 1 by each node along the path.
  • tandem nodes Due to the way RPR messages are forwarded by tandem nodes and the unconditional and periodic retransmmission of such messages by origin nodes, multiple instances of the same request are not uncommon, even multiple copies of each instance, circulating the network at any given time. To minimize the amount of broadcast traffic generated by the protocol and aid tandem nodes in allocating bandwidth fairly for competing RPRs, tandem nodes preferably execute a sequence such as that described subsequently.
  • the terms "copy of an instance,” or more simply “copy” are used herein to refer to a retransmission of a given instance. Normally, ta.idem nodes select the first instance they receive since in oit. but not all cases, as the first RPR received normally represenis the quickest path to the origin node. A method for making such a determination was described in reference to Fig. 5. Because such information must be stored for numerous RPRs, a standard data structure is defined under a protocol of the present invention.
  • the Restore-Path Request Entry is a data ferrycture that maintains information about a specific instance of a RPRE packet. Tandem nodes use the structure to store information about the request, which helps them identify and reject other instances of the request, and allows them to correlate received responses with forwarded requests. Table 6 lists an example of the fields that are preferably present in an RPRE.
  • the choice of neighbors is related to variables such as link capacity and distance Specifically, a paiticular neighbor is selected to receive a copy of the packet if
  • the output link has enough resources to satisfy the requested bandwidth Nodes maintain a separate available bandwidth" counter for each of the defined QoS levels (e g QoSO-2 and QoS3) VPs assigned to certain QoS level, say "n,” are allowed to use all link resources reserved for that level and all levels below it l e , all resources reserved tor levels 0 through n, inclusive
  • the path through the neighbor is less than MAX_HOPS in length
  • the distance from this node to the target node is less than MAX_HOPS minus the distance from this node to the origin node
  • Fig 10 illustrates the actions performed by tandem nodes in processing teceived RPR tests Assuming that this is the first instance of the request, the node allocates the requested bandwidth on eligible links and transmits a modified copy of the received message onto them The bandwidth remains allocated until a response (either positive or negative) is received from the neighboring node, or a positive response is received from any of the other neighbors (see Table 7 below) While awaiting a response from its neighbors, the node cannot use the allocated bandwidth to restore other VPs, regardless of their priority (l e QoS)
  • Step 1000 Processing of RPRs begins at step 1000, in which the target node's ID is compared to the local node's ID It the local node's ID is equal to the target node's ID, the local node is the target of the RPR and must process the RPR as such.
  • Fig. 10 This is illustrated in Fig. 10 as step 1005 and is the subject of the flow diagram illustrated in Fig. 1 1.
  • the RPR's HOP_COUNT is compared to MAX_HOP in order to determine if the HOP_COUNT has exceed or will exceed the maximum number of hops allowable (step 1010).
  • a negative acknowledgment (NAK) with a Flush indicator is then sent back to the originating node (step 1015). If the HOP_COUNT is still within acceptable limits, the node then determines whether this is the first instance of the RPR having been received (step 1020). If this is the case, a Restore-Path Request Entry (RPRE) is created for the request (step 1025). This is done by creating the RPRE and setting the RPRE's fields, including starting a time-to-live (TTL) or deletion timer, in the following manner:
  • TTL time-to-live
  • RPRE.QoS Header.Parms.RestorePath.QoS
  • RPRE.Bandwidth Header. Parms.RestorePath.Bandwidth
  • the local node determines whether the target node is a direct neighbor (step 1035). If the target node is not a direct neighbor of the local node, a copy of the (modified) RPR is sent to all eligible neighbors (step 1040). The PendingReplies and SentTo Fields of the corresponding RPRE are also updated accordingly at this time. If the target node is a direct neighbor of the local node, the RPR is sent only to the target node (step 1045). In either case, the RPRE corresponding to the given RPR is then updated (step 1050).
  • the local node attempts to determine whether this might be a different instance of the RPR (step 1055). A request is considered to be a different instance if the RPR:
  • a NAK Wrong Instance is sent to the originating neighbor (step 1060).
  • the response follows the reverse of the path carried in the request. No broadcasting is therefore necessary in such a case.
  • the local node determines whether a Terminate NAK has been received for this RPR (step 1070).
  • the RPR is rejected by sending a Terminate response to the originating neighbor (step 1075) If a Terminate NAK was not received for this RPR, the new sequence number is recorded (step 1080) and a copy of the RPR is forwarded to all eligible neighbors that have not sent a Flush response to the local node for the same instance of this RPR (step 1085) This may include nodes that did't previously considered by this node due to conflicts with other VPs, but does not include nodes from which a Flush response has already been received for the same instance of this RPR The local node should then save the number of sent requests in the PendmgReplies field of the corresponding RPRE
  • the term "eligible neighbors" refers to all adjacent nodes that are connected through links that meet the link-eligibility requirements previously described Preferably, bandwidth is allocated only once for each request so that subsequent transmissions of the request do not consume any bandwidth
  • Fig 11 illustrates the process peiformed at the target node once the RPR finally reaches that node
  • the target node begins processing of the RPR by first determining whether this is the first instance of this RPR that has been received (step 1 100) If that is not the case, a NAK is sent with a Terminate indicator sent to the originating node (step 1105) If this is the first instance of the RPR received, the target node determines whether or not the VP specified in the RPR actually terminates at this node (step 1110) If the VP does not terminate at this node, the target node again sends a NAK with a Terminate to the originating node (step 1105) By sending a NAK with a Terminate indicator, resources allocated along the path are fieed by the corresponding tandem nodes
  • the target node determines whether an RPRE exists for the RPR received (step 1 115) If an RPRE already exists for this RPR, the existing RPRE is updated (e.g., the RPRE' sLastSequenceNumber field is updated) (step 1120) and the RPRE deletion timer is restarted (step 1125).
  • the existing RPRE is updated (e.g., the RPRE' sLastSequenceNumber field is updated) (step 1120) and the RPRE deletion timer is restarted (step 1125).
  • an RPRE is created (step 1 130), pertinent information from the RPR is copied into the RPRE (step 1135), the bandwidth requested in the RPR is allocated on the input link by the target node (step 1140) and an RPRE deletion timer is started (step 1145).
  • a checksum is computed for the RPR (step 1150) and written into the checksum field of the RPR (step 1155).
  • the RPR is then returned as a positive response to the origin node (step 1160).
  • the local (target) node then starts its own matrix configuration. It will be noted that the RPRE created is not strictly necessary, but makes the processing of RPRs consistent across nodes.
  • Figs. 12 and 13 are flow diagrams illustrating the processes performed by originating nodes that receive negative and positive RPR responses, respectively. Negative RPR responses are processed as depicted in Fig. 12.
  • An originating node begins processing a negative RPR response by determining whether it has an RPRE associated with the RPR (step 1200). If the receiving node does not have an RPRE for the received RPR response, the RPR response is ignored (step 1205). If an associated RPRE is found, the receiving node determines whether the node sending the RPR response is listed in the RPRE (e.g., is actually in the SentTo list of the RPRE) (step 1210). If the sending node is not listed in the RPRE, again the RPR response is ignored (step 1205).
  • the RPR sequence number is analyzed to determine whether or net it is valid (step 1215). As with the previous steps, if the RPR contains an invalid sequence number (e.g., doesn't fall between FirstSequenceN umber and LastSequence Number, inclusive), the RPR response is ignored (step 1205). If the RPR sequence number is valid, the receiving node determines whether Flush or Terminate in the RPR response (step 1220). If neither of these is specified, the RPR response sequence number is compared to that stored in the last sequence field of the RPR (step 1225). If the RPR response sequence number does not match that found in the last sequence field of the RPRE, the RPR response is again ignoied (step 1205).
  • the RPR sequence number is compared to that stored in the last sequence field of the RPR (step 1225). If the RPR response sequence number does not match that found in the last sequence field of the RPRE, the RPR response is again ignoied (step 1205).
  • the bandwidth on all links over which the RPR was forwarded is freed (step 1245) and the Terminate and Flush bits from the RPR response are saved in the RPRE (step 1250). If a Terminate was not specified in the RPR response, bandwidth is freed only on the input link (i.e., the link from which the response was received) (step 1255), the Terminate and Flush bits are saved in the RPRE (step 1260), and the Flush bit of the RPR is cleared (step 1265). If a Terminate was not specified in the RPR, the Pending Replies field in the RPRE is decremented (step 1270). If this field remains non-zero after being decremented the process completes.
  • the RPR is sent to the node specified in the RPR's Received From field (i.e. the node that sent the corresponding request) (step 1280).
  • the bandwidth allocated on the link to the node specified in the RPR's Received From field is released (step 1285) and an RPR deletion timer is started (step 1290).
  • Fig. 13 illustrates the steps taken in processing positive RPR responses.
  • the processing of positive RPR responses begins at step 1300 with a search of the local database to determine whether an RPRE corresponding to the RPR response is stored therein. If a corresponding RPRE cannot be found, the RPR response is ignored (step 1310). If the RPR response RPRE is found in the local database, the input link is verified as being consistent with the path stored in the RPR (step 1320). If the input link is not consistent with the RPR path, the RPR response is ignored once again (step 1310). If the input link is consistent with path information in the RPR, the next hop information specified in the RPR response path is compared with the Received From field of the RPRE (e.g , Response. Path[ Response.
  • the Received From field of the RPRE e.g , Response. Path[ Response.
  • Pathlndex + I] ! RPRE.ReceivedFrom) ⁇ tep 1330). If the next hop information is not consistent, the RPR response is again ignored (step 1310). However, if the RPR response's next hop information is c..r_si_.tent, bandwidth allocated on input and output links related to the RPR is committed (step 1340). Conversely, bandwidth allocated on all other input and output links for that VP is freed at this time (step 1350). Additionally, a positive response is sent to the node from which the RPR was received (step 1360). and an RPR deletion timer is started (step 1370) and the local matrix is configured (step 1380).
  • the protocol pipelines such activity with the forwarding of RPRs in order to minimize the impact of matrix configuration overhead on the time required for restoration. While the response is making its way from node Nl to node N2, node Nl is busy configuring its matrix. In most cases, by the time the response reaches the origin node, all nodes along the path have already configured their matrices
  • Terminate indicator prevents "bad" instances of an RPR from circulating around the network for extended periods of time.
  • the indicator is propagated all the way back to the originating node and prevents it, and all other nodes along the path, from sending or forwarding other copies of the corresponding RPR instance.
  • Terminating RPR Packets are processed as follows. The RPR continues along the path until it encounters any one of the following four conditions:
  • HOP_COUNT reaches the maximum allowed (i.e. MAX_HOPS). 2.
  • the request reaches a node that doesn't have enough bandwidth on any of its output links to satisfy the request.
  • the request reaches a node that had previously accepted a different instance of the same request from another neighbor. 4.
  • the request reaches its ultimate destination: the target node, which is either the Destination node of the VP, or a proxy border node if the Source and Destination nodes are located in difference zones.
  • Conditions 1, 2 and 3 cause a negative response to be sent back to the originating node, flowing along the path carried in the request, but in the reverse direction.
  • a mechanism is defined to further reduce the amount of broadcast traffic generated for any given VP.
  • a tandem node can immediately return a no- commit positive response to that neighbor, which prevents it from sending further copies of the instance.
  • the response simply acknowledges the receipt of the request, and doesn't commit the sender to any of the requested resources.
  • the sender (of the positive response) periodically transmits the acknowledged request until a valid response is received from its downstream neighbor(s).
  • This mechanism implements a piece- wise, or hop-by-hop, acknowledgment strategy that limits the scope of retransmitted packets to a region that gets progressively smaller as the request gets closer to its target node.
  • Communication protocols often handle link errors by starling a timer after every transmission and, if a valid response isn't received within the timeout period, the message is retransmitted. If a response isn't received after a certain number of ;etransm ⁇ ssion, the sender generates a local error and disables the connection.
  • the timeout period is usually a configurable parameter, but in some cases it is computed dynamically, and continuously, by the two end points. The simplest form of this uses some multiple of the average round trip time as a timeout period, while others use complex mathematical formulas to determine this value.
  • the timeout period can range anywhere from millisecond to seconds.
  • the above strategy is not the preferred method of handling link errors in the present invention. This is because the fast restoration times required dictates that 2-way, end-tc-end communication be carried out in less than 50ms.
  • a drawback of the above-described solution is the time wasted while waiting for an acknowledgment to come back from the receiving node.
  • a safe timeout period for a 2000 mile span, for instance, is over 35ms, which doesn't leave enough time for a retransmission in case of an error.
  • the protocol can further improve link efficiency by using small packets during the restoration procedure.
  • FIG. 14 illustrates an exemplary network 1400.
  • Network 1400 includes a pair of computers (computers).
  • nodes 1405 and 1410) and a number of nodes (nodes 1415-1455).
  • the nodes also have a node ID which is indicated inside circles depicting the node which range from zero to eight successively.
  • the node IDs are assigned by the network provider.
  • Node 1415 (node ID 0) is referred to herein as a source node
  • node 1445 (node ID 6) is referred to herein as a destination node for a VP 0 (not shown).
  • this adheres to the protocol's convention of having the node with the lower ID be the source node for the virtual path and the node with the higher node ID be the destination node for the VP.
  • Network 1400 is flat, meaning that all nodes belong to the same zone, zone 0 or the backbone zone. This also implies that Node IDs and Node Addresses are one and the same, and that the upper three bits of the Node ID (address) arc always zeroes using the aforementioned node ID configuration.
  • Table 8 shows link information for network 1400. Source nodes are listed in the first column, and the destination nodes are listed in the first row of Table 8. The second row of Table 8 lists the link ID (L), the available bandwidth (B), and distance (D) associated with each of the links. In this example, no other metrics (e.g., QoS) are used in provisioning the VPs listed subsequently.
  • QoS QoS
  • Table 9A shows a list of exemplary configured VPs
  • Table 9B shows the path selected for each VP by a shortest-path algorithm according to the present invention.
  • the algorithm allows a number of metrics, e.g. distance, cost, delay, and the like to be considered during the path selection process, which makes it possible to route VPs based on user preference.
  • the QoS metric is used to determine which VP has priority.
  • Routes are computed using a QoS-based shortest-path algorithm.
  • the route selection process relies on configured metrics and an up-to-date view of network topology to find the shortest paths for configured VPs.
  • the topology database contains information about all network nodes, their links, and available capacity. All node IDs are assigned by the user and must be globally unique. This gives the user control over the master/slave relationship between nodes. Duplicate IDs are detected by the network during adjacency establishment. All nodes found with a duplicate ID are disabled by the protocol, and an appropriate alarm is generated to notify the network operations center of the problem so that proper action can be taken.
  • the algorithm uses the following variables.
  • Ready - A queue that holds a list of nodes, or vertices, that need to be processed.
  • Database The pruned copy of the topology database, which is acquired automatically by the node using the Hello protocol. The computing node removes all vertices and or links that do not meet the specified QoS and bandwidth requirements of the route.
  • Neighbors [A] An array of "A" neighbors. Each entry contains a pointer to a neighbor data structure as previously described.
  • Path [N][H] - A two dimensional array (N rows by H columns, where N is the number of nodes in the network and H is the maximum hop count). Position (n. h) of the array contains a pointer to the following structure (R is the root node, i.e., the computing node):
  • Fig. 15 illustrates a flow diagram of the above QoS-based shortest path route selection process (referred to herein as a QSPF process) that can be used in one embodiment of the protocol.
  • the process begins at step 1500 by starting with the first column of the array that the QSPF process generates.
  • the process initializes the first column in the array for each node n known to node R.
  • node R first determines if the current node is a neighbor (step 1505). If the node is the neighbor, several variables are set and the representation of node n is placed in the Ready queue (step 1510).
  • node n is not a neighbor of node R, those variables are set to indicate that such is the case (step 1515). In either case, node R continues through the list of possible node n's (step 1520). Node R then goes on to fill other columns of the array (step 1525) until the Ready queue which holds a list of nodes waiting to be processed is empty (step 1530). Assuming that nodes remain to be processed, the column preceding the current column is copied into the current column (step 1535) and a new cost is generated (step 1535).
  • step 1540 If this new cost is greater than the cost from node R to node m (step 1545) then the entry is updated with new information then m is placed on the Ready queue (step 1550). Once this has been accomplished or if the new cost is less'than the current cost from node R to node m, the process loops if all neighbors m of node n have not been processed (steps 1555 and 1560). If more nodes await processing in the Ready queue (step 1565). they are processed in order (step 1570). but if all nodes have been processed, the Last Hop variable is set to the number of columns in the array (step 1575) and the process is at an end.
  • Path [] ultimately contains the best route from R to all other nodes in the network.
  • row n of the array is searched until an entry with a cost not equal to MAX_COST is found.
  • entries 1 through LastHop of row n are scanned, and the entry with the lowest cost selected.
  • Protocol messages preferably begin with a standard header to facilitate their processing.
  • a header preferably contains the information necessary to determine the type, origin, destination, and identity of the packet.
  • the header is then followed by some sort of command-specific data (e.g., zero or more bytes of information).
  • Fig. 16 illustrates the layout of a header 1600 Shown therein is a request response indicator (RRI) 1610, a negative response indicator (NRI), a terminate/commit path indicator (TPI) 1630, a flush path indicator (FPI) 1640, a command field 1650, a sequence number (1660). an origin node ID (1670) and a target node ID (1680). A description of these fields is provided below in Table 10. It will be notes that although the terms "origin” and “target” are used in describing header 1600, their counterparts (source and destination, respectively) can be used in their stead.
  • packets sent using a protocol according to the present invention employ a header layout such as that shown as header 1600. Header 1600 is then followed by zero or more bytes of command specific data, the format of which, for certain commands, is shown in Figs. 17-21 below.
  • Table 10 The layout of exemplary header 1600.
  • the protocol can be configured to use a number of different commands. For example, seven commands may be used with room in the header for 9 more. Table 11 lists those commands and provides a brief description of each, with detailed description of the individual commands following.
  • Fig 17 illustrates the layout of command specific data for an initialization packet 1700 which in turn causes a START event to be sent to the Hello State Machine of the receiving node
  • Initialization packet 1700 includes a node ID field 1710, a link cost field 1720, one or more QoS capacity fields (as exemplified by QoS3 capacity (Q3C) field 1730 and a QoSn capacity (QnC) field 1740), a Hello interval field 1750 and a time-out interval field 1760
  • Q3C QoS3 capacity
  • QnC QoSn capacity
  • the initialization (or INIT) packet shown in Fig 17 is used by adjacent nodes to initialize and exchange adjacency parameters
  • the packet contains parameters that identify the neighbor, its link bandwidth (both total and available), and its configured Hello protocol parameters
  • the INIT packet is normally the first protocol packet exchanged by adjacent nodes As noted previously, the successful receipt and processing of the INIT packet causes a START event to be sent to the Hello State machine
  • Table 12 The field definitions appear in Table 12
  • Fig 18 illustrates the command-specific data foi a Hello packet 1800
  • the command-specific data of Hello packet 1800 includes a node ID field 1805, an LS count field 1810, an advertising node field 1820. a checksum field 1825, an LSID field 1830, a HOP_COUNT field 1835, a neighbor count field 1840, a neighbor node ID field 1845, a link ID field 1850, a link cost field 1855, a Q3C field 1860, and a QnC field 1865
  • Hello packets are sent periodically by nodes in order to maintain neighbor relationships, and to acquire and propagate topology information throughout the network
  • the interval between Hello packets is agreed upon during adjacency initialization
  • Link state information is included in the packet in several situations, such as when the database at the sending nodes changes, either due to provisioning activity, port failure, or recent updates received from one or more originating nodes.
  • Preferably, only modified LS entries are included in the advertisement.
  • a null Hello packet, also sent periodically, is one that has a zero in its LSCount field and contains no LSAs.
  • a QoSn VP is allowed to use any bandwidth reserved for QoS levels 0 through n.
  • Table 13 describes the fields that appear first in the Hello packet. These fields appear only once.
  • NodelD Node ID of the node that sent this packet, i.e. our neighbor
  • Table 13 Field definitions for the first two fields of a Hello packet.
  • Table 14 describes information carried for each LSA and so is repeated LSCount times:
  • Table 14 Field definitions for information carried for each LSA.
  • Table 15 describes information carried for each neighbor and so is repeated NeighborCount times:
  • Table 15 Field definitions for information carried for each neighbor.
  • Fig. 19 illustrates the layout of command-specific data for a GET_LSA packet 1900 of a protocol according to the present invention.
  • GET_LSA packet 1900 has its first byte set to zero (exemplified by a zero byte 1905).
  • GET LSA packet 1900 includes an LSA count 1910 that indicates the number of LSAs being sought and a node ID list 1920 that reflects one or more of the node IDs for which an LSA is being sought.
  • Node ID list 1920 includes node IDs 1930(1 )-(N).
  • the GETJLSA response contains a mask that contains a "1" in each position for which the target node possesses an LSA.
  • the low-order bit corresponds to the first node ID specified in the request, while the highest-order bit corresponds to the last possible node ID.
  • the response is then followed by one or more Hello messages that contain the actual LSAs requested.
  • Table 16 provides the definitions for the fields shown in Fig. 19.
  • NodelDO- The node IDs for which the sender is seeking an LSA. Unused fields need not be NodelDn included in the packet and should be ignored by the receiver.
  • Fig. 20 illustrates the layout of command-specific data for an RPR packet 2000 of a protocol according to the present invention
  • RPR packet 2000 includes a virtual path identifier (VPID) field 2010, a checksum field 2020, a path iength field 2030, a HOP_COUNT field 2040, and an array of path lengths (exemplified by a path field 2050).
  • Path field 2050 may be further subdivided into hop fields (exemplified by hop fields 2060 (l )-(N), where N may assume a value no largei than MAX._HOPS).
  • the Restore Path packet is sent by source nodes (or proxy border nodes), to obtain an end-to-end path for a VP.
  • the packet is usually sent during failure recovery procedures but can also be used for provisioning new VPs.
  • the node sending the RPR is called the origin or source node.
  • the node that terminates the request is called (he target or destination node.
  • Fig 21 illustrates the layout of command-specific data for a CREATE_PATH (CP) packet 2100
  • CP packet 2100 includes a virtual path identifier (VPID) field 21 10, a checksum field 2120, a path length field 2130, a HOP_COUNT field 2140, and an array of path lengths (exemplified by a path field 2150)
  • Path field 2150 may be further subdivided into hop fields (exemplified by hop fields 2160 (l )-(N), where N may assume a value no larger than MAX_HOPS)
  • the CP packet is sent by source nodes (or proxy border nodes), to obtain an end-to-end path for a VP
  • the node sending the CP is called the origin or souice node
  • the node that terminates the request is called the target or destination node
  • a CP instance is uniquely identified by its origin and target nodes, and VP ID Multiple copies of the same CP instance are identified by the unique sequence number assigned to each of them Only the sequence number need be unique across multiple copies of the same instance of a Create-Path packet Table 18 provides the definitions for the fields shown in Fig 21
  • the Delete Path packed is used to delete an existing path and leleases all of its allocated link resources It can use the same packet format as the Restore Path packet
  • the origin node is lesponsible tor initializing the Path [J, PathLength, and Checksum fields to the packet, which should include the full path of the VP being deleted It also sets Pathlndex to zero Tandem nodes should release link resources allocated tor the VP after they have received a valid response from the target node Tne target node should set the Pathlndex field to zero prior to computing the checksum of packet.
  • the TestPath packet is used to test the integrity of an existing virtual path. It uses the same packet format as the RestorePath packet.
  • the originating node is responsible for initializing the Path [], PathLength, and Checksum fields of the packet, which should include the full path of the span being tested. It also sets Pathlndex to zero.
  • the target node should set the Pathlndex field to zero prior to computing the checksum of packet.
  • the TestPath packet may be configured to test functionality, or may test a path based on criteria chosen by the user, such as latency, error rate, and the like.
  • the Link-Down Packet is used when master nodes are present in the network. It is used by slave nodes to inform the master node of link failures. This message is provided for instances in which the alarms associated with such failures (AIS and RDI) do not reach the master node.
  • AIS and RDI alarms associated with such failures

Abstract

A method of operating a network is described. The network includes a number of nodes connected by a number of links. A method according to the present invention provisions a virtual path between a first and a second one of the plurality of nodes by: identifying the first and the second nodes, discovering a physical path from the first node to the second node, and establishing the virtual path. The method discovers a physical path from the first node to the second node by automatically identifying nodes forming the physical path. The method establishes the virtual path by configuring a set of connections between the nodes forming the physical path.

Description

A METHOD FOR ROUTING INFORMATION OVER A NETWORK
TECHNICAL FIELD
This invention relates to the field of information networks, and more particularly relates to a protocol for configuring routes over a network.
BACKGROUND ART
Today's networks carry vast amounts of information. High bandwidth applications supported by these networks include streaming video, streaming audio, and large aggregations of voice traffic. In the future, these demands are certain to increase. To meet such demands, an increasingly popular alternative is the use of lightwave communications carried over fiber optic cables. The use of lightwave communications provides several benefits, including high bandwidth, ease of installation, and capacity for future growth.
The synchronous optical network (SONET) protocol is among those protocols employing an optical infrastructure. SONET is a physical transmission vehicle capable of transmission speeds in the multi-gigabit range, and is defined by a set of electrical as well as optical standards. SONET's ability to use currently-installed fiber optic cabling, coupled with the fact that SONET significantly reduces complexity and equipment functionality requirements, gives local and interexchange carriers incentive to employ SONET. Also attractive is the immediate savings in operational cost that this reduction in complexity provides. SONET thus allows the realization of a new generation of high-bandwidth services in a more economical manner than previously existed.
SONET networks have traditionally been protected from failures by using topologies that dedicate something on the order of half the network's available bandwidth for protection, such as a ring topology. Two approaches in common use today are diverse protection and self-healing rings (SHR), both of which offer relatively fast restoration times with relatively simple control logic, but do not scale well for large data networks. This is mostly due to their inefficiency in capacity allocation. Their fast restoration time, however, makes most failures transparent to the end-user, which is important in applications such as telephony and other voice communications. The existing schemes rely on 1-plus- l and 1-for-l topologies that carry active traffic over two separate fibers (line switched) or signals (path switched), and use a protocol (Automatic Protection Switching or APS), or hardware (diverse protection) to detect, propagate, and restore failures.
A SONET network using an SHR topology provides very fast restoration of failed links by using redundant links between the nodes of each ring. Thus, each ring actually consists of two rings, a ring supporting information transfer in a "clockwise" direction and a ring supporting information transfer in a "counter-clockwise" direction. The terms "east" and "west" are also commonly used in this regard. Each direction employs its own set of fiber optic cables, with traffic between nodes assigned a certain direction (either clockwise or counter clockwise). If a cable in one of these sub-rings is damaged, the SONET ring "heals" itself by changing the direction of information flow from the direction taken by the information transferred over the failed link to the sub-ring having information flow in the opposite direction
The detection of such faults and the restoration of information flow thus occurs very quickly, on the order of 10 ms for detection and 50 ms for restoration for most ring implementations The short restoration time is critical in supporting applications, such as current telephone networks, that are sensitive to quality of service (QoS) because it prevents old digital terminals and switches from generating red alarms and initiating Carrier Group Alarms (CGA) These alarms are undesirable because such alarms usually result in dropped calls, causing users down time aggravation Restoration times that exceed 10 seconds can lead to timeouts at higher protocol layers, while those that exceed 1 minute can lead to disastrous results for the entire network However, the price of such quickly restored information flow is the high bandwidth requirements of such systems By maintaining completely redundant sub- rings, an SHR topology requires 100% excess bandwidth
An alternative to the ring topology is the mesh topology The mesh topology is similar to the point-to- point topology used in inter-networking Each node in such a network is connected to one or more other nodes Thus, each node is connected to the rest of the network by one or more links In this manner, a path from a first node to a second node uses all or a portion of the capacity of the links between those two nodes
Networks based on mesh-type restoration are inherently more capacity-efficient than ring-based designs, mainly because each network link can potentially provide protection for fiber cuts on several different links By sharing the capacity between links, a SONET network using a mesh topology can provide redundancy for failure restoration at less than 100% of the bandwidth capacity originally required Such networks are even more efficient when traffic transits several links One study found that for an 1 1 -node, 22-span network, only 51 % redundant net capacity was required for 100% restorabihty, as reported in, "The design and simulation of an intelligent transport network with distributed control," by T Chujo, H Komine, K Miyazaki, T Ogura, and T Soejima, presented at the Network Operations Management Symposium, San Diego, February 1 1-14, 1990, which is included herein by reference, in its entirety and for all purposes The corresponding ring-based design required five rings and a total DS-3 redundancy of 330% However, path restoration often consumes several minutes m such a topology This is much slower than the restoration times exhibited by ring topologies and is so long that connections are often lost during the outage
Various kinds of networking equipment can be used to support the ring and mesh topologies just described Options include 1 Back-to-back wavelength division multiplexers (WDMs) and optical cross connects (OXCs) for use in mesh topologies
2 Back-to-back optical add/drop multiplexers (O-ADM) for ring topologies
3 Other combinations (e g , WDM combined with OXC, digital cross connect systems (DCSs), and other such equipment) WDMs may be connected in back-to-back configurations to allow the connection of various wavelength routes to one another (also known as "patching" or "nailing up" connections). Provisioning paths in such architectures is done manually using a patch panel. Thus, provisioning is slow and prone to mistakes due to human error and equipment failure. In the event of a failure, restoration is performed manually in such architectures, and is again slow and error-prone. Such architectures scale poorly because additional bandwidth is added by either adding to the number of wavelengths supported (requiring the replacement of equipment at nodes, and possibly the replacement of fiber optic cables as well) or adding new fiber optic cables and supporting node equipment. Such architectures are also inherently unmanageable, due to the lack of centralized control. And while the initial capital investment tends to be relatively low (as a result of their simplicity), operating expenses for such architectures tends to be relatively high because of the costs associated with configuration, expansion, and management. Thus, a mesh topology employing back-to-back WDMs will tend to be slow to deploy and difficult to manage due to the need for manually "nailing up" paths and lack of centralization.
Another architectural element that may be used to create a mesh topology is the optical cross connect (OXC). OXCs allow provisioning using a centralized scheme to accomplish provisioning in a matter of minutes. Restoration in the event of a failure may be performed manually or may be effected using a centralized management system. However, restoration still requires on the order of minutes per wavelength route restored. As with the back-to-back WDM architecture, a mesh topology that employs OXCs scales poorly due, in part, to the large increase in size and cost such scaling entails.
An OXC can be either transparent (purely optical, in which the signals are never converted from optical signals) or opaque (in which the optical signals are converted from optical signals into electrical signals, switched, and then converted back into optical signals). Transparent optical cross connects provide little in the way manageability because the information is never made accessible to the OXCs operator. In contrast, opaque OXCs can be configured to permit access to the information being switched. However, neither type of OXC maintains information regarding the topology of the network and, in fact, OXCs possess no intrinsic network intelligence. Moreover, OXC technology is expensive, making initial investment quite high, as well as the cost of future expansion.
Alternatively, a SONET network may be configured in a ring (SHR) topology by using add/drop multiplexers (ADMs). An ADM is a SONET multiplexer that allows signals to be added into or dropped from a higher rate signal. ADMs have two bidirectional ports, commonly referred to as an east and a west port. Using ADMs, a SONET network in a SHR topology uses a collection of nodes equipped with ADMs in a physical closed loop such that each node is connected to two adjacent nodes with a duplex connection. Any loss of connection due to a single failure of a node or a connection between nodes is automatically restored. The traffic terminated at a failed node, however, is lost. Two types of SHRs are unidirectional (UPSR) and bidirectional (BLSR), as defined by the traffic flow in normal conditions. Bidirectional rings have a capacity carrying advantage over unidirectional rings because of the ability to share protection capacity among the links between nodes, as opposed to unidirectional rings, which dedicate capacity all the way around the ring. Provisioning in such architectures is centralized and can be performed in minutes. While restoration can also be performed quickly (on the order of 50 ms, as previously noted), 100% spare bandwidth is required. For all intents and purposes, then, the user must install fiber optic cabling for two networks, one for normal traffic and one to be used in the event of a failure. Moreover, the cabling for each link should be physically diverse in order to minimize the possibility that a cause of physical damage will damage both links and cause both directions of a ring to fail. These issues detrimentally affect cost, manageability, and scalability. With regard to expansion, ADMs are stacked in an SHR in order to increase capacity. However, stacked ADMs are blocking. In other words, the switching function may not be transparent as a result of the ADMs not being available on a full-time basis (i.e., occasionally blocking). Thus, an architecture employing ADMs is best suited for small offices or other situations that do not require the relatively large amounts of bandwidth (implying the need for stacked ADMs). As noted, stacked ADMs are also difficult to manage and expensive due to the extra hardware required for 100% spare capacity.
Other combinations can also be employed. For example, WDMs can be combined with OXCs (either transparent or opaque) in order to create a network having a mesh topology. Such an architecture supports the cross-connection of wavelength routes by either manual connection or under centralized control. However, such an architecture is also difficult to expand due to the need to add WDMs/fiber optic cables and the increase in size of the OXC, and cannot restore failed links quickly enough to avoid dropping or interrupting telecommunications connections.
Another option is the use of a digital cross-connect system (DCS). A DCS is used to terminate digital signals and cross-connect them, integrating multiple functionalities such as signal adding and dropping, cross- connection capabilities, and multiplexing and demultiplexing of signals. DCS based networks enjoy an advantage over networks employing back-to-back WDMs because the use of DCS eliminates the need for additional back-to- back electrical multiplexing, thus reducing the need for labor-intensive jumpers. Operational cost savings are realized by a DCS through electronically controlling cross-connections, test access and loopbacks, and maintenance. Two types of DCSs are wideband DCSs and broadband DCSs. Wideband DCS (W-DCS) terminates full duplex OC-Ns and DS3s, has VT cross-connection capability, and provides DS1 interfaces. A broadband DCS (B-DCS) terminates full-duplex OC-N signals and provides DS3 interfaces. The B-DCS makes two-way cross connection at the DS3, STS-1, and concatenated STS-Nc levels. STS-Nc may be used, for example, in broadband services such as high definition television (HDTV), where an STS-3c cross connection may be used to cross connect the signal as a single, high-capacity channel.
Various attempts have been made to use DCSs in a mesh configuration to create a fault-tolerant network, but have not met with broad success in reducing restoration times below a few seconds. Some of these configurations rely on a central database and a central controller (usually an Operations System or OS) to restore failures. Although these schemes often exhibit restoration times exceeding 10 minutes, such restoration times are an improvement over manual restoration, which requires hours, or even days to effect restoration. However, these results are not enough to meet the 50-200 ms restoration time required by existing telecommunication network equipment. Other implementations employ distributed architectures in which control is shared among multiple network nodes. This results in faster restoration times (on the order of about 2-10 seconds), but still does not address the need for restoration times below 200 ms.
A routing protocol that supports relatively simple provisioning and relatively fast restoration (on the order of , for example, 50 ms), while providing relatively efficient bandwidth usage (i.e., minimizing excess bandwidth requirements for restoration, on the order of less than 100% redundant capacity and preferably less than 50% redundant capacity). Such a routing protocol is, in one embodiment, easily be scaled to accommodate increasing bandwidth requirements.
DISCLOSURE OF INVENTION According to one embodiment of the present invention, an apparatus and method are described for configuring routes over a network. Such a method, embodied in a protocol of the present invention, provides several advantages. A protocol according to the present invention provides relatively fast restoration (on the order of 50 ms), while providing relatively efficient bandwidth usage (i.e., minimizing excess bandwidth requirements for restoration, on the order of less than 100% redundant capacity and preferably less than 50% redundant capacity). Moreover, a protocol according to one embodiment of the present invention scales well to accommodate increasing bandwidth demands of the services being supported.
In one embodiment of the present invention, a method of operating an optical network is described. The network includes a number of nodes coupled by a number of links. A method according to this embodiment of the present invention provisions a virtual path between a first and a second one of the plurality of nodes by: identifying the first and the second nodes, discovering a physical path from the first node to the second node, and establishing the virtual path. The method discovers a physical path from the first node to the second node by automatically identifying nodes forming the physical path. The method establishes the virtual path by configuring a set of connections between the nodes forming the physical path.
In another embodiment of the present invention, a method is described that terminates the virtual path by sending a termination message from one of the first and second nodes to the other of the first and second nodes. The termination message is sent along the physical path and resources for the virtual path are deallocated by each one of the nodes forming the physical path as the termination message is sent to the next one of the nodes that form the physical path.
In yet another embodiment of the present invention, a method is described that restores a virtual path in response to a failure along the physical path created between a first node and a second node by a provisioning operation such as that described above (although a virtual path restored by a method according to the present invention may be provisioned in any manner deemed desirable). Such a method begins by discovering an alternate physical path from the first node to the second node. The alternate physical path is discovered by automatically identifying nodes forming the alternate physical path This may be based on any number of criteria, such as cost, quality of service, latency, or other metric The method then re-establishes the virtual path by configuring a set of connections between the nodes forming the alternate physical path This may require an entirely new end-to-end alternate physical path, or may simply be the addition of a node or link to the existing physical path
The foregoing is a summary and thus contains, by necessity, simplifications, generalizations and omissions of detail, consequently, those skilled in the art will appreciate that the summary is illustrative only and is not intended to be in any way limiting Other aspects, inventive features, and advantages of the present invention, as defined solely by the claims, will become apparent in the non-limiting detailed description set forth below
BRIEF DESCRIPTION OF DRAWINGS
The present invention may be better understood, and its numerous objects, features, and advantages made apparent to those skilled in the art by referencing the accompanying drawings
Fig 1 illustrates the layout of a Node Identifier (Node ID)
Fig 2 is a block diagram of a zoned network consisting of four zones and a backbone
Fig 3 is a flow diagram illustrating the actions performed by a neighboring node in the event of a failure
Fig 4 is a flow diagram illustrating the actions performed by a downstream node in the event of a failure
Fig 5 is a flow diagram illustrating the actions performed in sending a Link State Advertisement (LSA)
Fig 6 is a flow diagram illustrating the actions performed in receiving an LSA
Fig 7 is a flow diagram illustrating the actions performed in determining which of two LSAs is the more recent
Fig 8 is a state diagram of a Hello Machine according to the present invention
Fig 9 is a flow diagram illustrating the actions performed in preparation for path restoration in response to a link failure
Fig 10 is a flow diagram illustrating the actions performed in processing received Restore-Path Requests
(RPR) executed by tandem nodes
Fig 1 1 is a flow diagram illustrating the actions performed in the processing of an RPR by the RPR's target node Fig. 12 is a flow diagram illustrating the actions performed in returning a negative response in response to an RPR.
Fig. 13 is a flow diagram illustrating the actions performed in returning a positive response to a received RPR.
Fig. 14 is a block diagram illustrating an exemplary network according to the present invention.
Fig. 15 is a flow diagram illustrating the actions performed in calculating the shortest path between nodes based on Quality of Service (QoS) for a given Virtual Path (VP).
Fig. 16 illustrates the layout of a protocol header according to the present invention.
Fig. 17 illustrates the layout of an initialization packet according to the present invention.
Fig. 18 illustrates the layout of a Hello Packet of a protocol according to the present invention.
Fig. 19 illustrates the layout of an RPR Packet of a protocol according to the present invention.
Fig. 20 illustrates the layout of a GET_LSA Packet of a protocol according to the present invention.
Fig. 21 illustrates the layout of a CREATE_PATH packet of a protocol according to the present invention.
The use of the same reference symbols in different drawings indicates similar or identical items.
MODES FOR CARRYING OUT THE INVENTION
The following is intended to provide a detailed description of an example of the invention and should not be taken to be limiting of the invention itself. Rather, any number of variations may fall within the scope of the invention which is defined in the claims following the description.
In one embodiment, a routing protocol is described that provides many advantages, including restoration times on the order of 50 ms or less (e.g., comparable to those of SHRs) and relatively high utilization efficiency (e.g. by reducing the amount redundant bandwidth, preferably to, for example, 50% or less). The protocol achieves the former by using a physical network layer (e.g., SONET) for communications between network nodes. Preferably, no other protocols are interspersed between the routing protocol and the transmission medium. Also preferably, all protocol-related status and control messages are communicated in-band (e.g., carried by the physical network layer, for example, in certain of a SONET frame's overhead bytes), which allows events to be sent between network nodes at hardware speeds. However, out-of-band communication channels can also be successfully employed to carry such information. Another mechanism employed by the protocol to improve restoration time is distributed intelligence, which also supports end-to-end provisioning The protocol, in one embodiment, relies on a distributed routing protocol, which employs event pipelining and parallel execution of protocol processes Because multiple actions occur in parallel, event delays are minimized In one embodiment, the protocol also uses a distributed database and relies on distributed control to restore failures In such an embodiment every node maintains an up-to-date view of network topology, (1 e , available nodes and links, and configured connections) Changes that occur in the network, whether caused by failed links, newly provisioned connections, or added/failed/removed nodes, are 'broadcast" throughout the network, using special protocol packets and procedures Topology distribution normally runs concurrently with, and in parallel to, failure restoration activities, but at a much lower priority
This is achieved by making the protection bandwidth a user-configurable parameter, and attaching a priority (or QoS) metric to all configured connections (referred to herein as virtual paths or VPs) and links The QoS parameter makes it possible to reduce the required percentage of protection bandwidth even further while maintaining the same quality of service for those connections that need and, more importantly, can afford such treatment Thus, availability is mapped into a cost metric and only made available to users who can justify the cost of a given level of service
Network architecture
To limit the size of the topology database and the scope of broadcast packets, networks like the protocol described herein can be divided into smaller logical groups called "zones " Each zone runs a separate copy of the topology distπbut on algorithm, and nodes within each zone are only required to maintain information about their own zone There is no need for a zone s topology to be known outside its boundaries, and nodes within a zone need not be aware of the network's topology external to their respective zones
Nodes that attach to multiple zones are referred to herein as border nodes Border nodes are required to maintain a separate topological database, also called a link-state or connectivity database, for each of the zones they attach to Border nodes use the connectivity database(s) for intra-zone routing Border nodes are also required to maintain a separate database that describes the connectivity of the zones themselves This database, which is called the network database, is used for inter- zone routing It describes the topology of a special zone, referred to herein as the backbone, which is always assigned an ID of 0 The backbone has all the characteristics of a zone There is no need for a backbone's topology to be known outside the backbone, and its border nodes need not be aware of the topologies of other zones
A network is referred to heiein as flat if it consists of a single zone (1 e , zone 0 or the backbone zone)
Conversely, a network is referred to herein as hierarchical if it contains two or more zones, not including the backbone The resulting multi-level hierarchy (I e , nodes and one or more zones) provides the following benefits
1 The size of the link state database maintained by each network node is reduced, which allows the protocol to scale well for large networks 2 The scope of broadcast packets is limited, reducing their impact
• Broadcast packets impact bandwidth by spawning offspring exponentially - the smaller scope results in a fewer number of hops and, therefore, less traffic
• The shorter average distance between nodes also results in a much faster restoration time, especially in large networks (which are more effectively divided into zones)
3 Different sections of a long route (I e , one spanning multiple zones) can be computed separately and in parallel, speeding the calculations
4 Restricting routing to be within a zone prevents database corruption in one zone from affecting the intra-zone routing capability of other zones because routing within a zone is based solely on information maintained within the zone
As noted, the protocol routes information at two different levels inter-zone and intra-zone The former is only used when the source and destination nodes of a virtual path are located in different zones Inter-zone routing supports path restoration on an end-to-end basis from the source of the virtual path to the destination by isolating failures between zones In the latter case, the border nodes in each transit zone originate and terminate the path-restoration request on behalf of the virtual path's source and destination nodes A border node that assumes the role of a source tor destination) node during the path restoration activity is referred to herein as a proxy source (destination) node Such nodes are responsible for originating (terminating) the RPR request with their own zones Proxy nodes are also required to communicate with border nodes in other zones to establish an inter-zone path for the VP
In one embodiment, every node in a network employing the protocol is assigned a globally unique 16-bit
ID referred to herein as the node ID A node ID is divided into two parts, zone ID and node address Logically, each node ID is a pair (zone ID, node address), where the zone ID identifies a zone within the network, and the node address identifies a node within that zone To minimize overhead, the protocol defines three type:* of node IDs, each with a different size zone ID field, although a different number of zone types can be employed The network provider selects which packet type to use based on the desired network architecture
Fig 1 illustrates the layout of a node ID 100 using three types of node IDs As shown in Fig 1, a field referred to herein as type ID 1 10 is allocated either one or two bits, a zone ID 120 of between 2-6 bits in length, and a node address 130 of between about 8-13 bits in length Type 0 IDs allocate 2 bits to zone ID and 13 bits to node address, which allows up to 213 or 8192 nodes per zone As shown in Fig 1 , type 1 IDs devote 4 bits to zone ID and 10 bits to node address, which allows up to 210 (I e 1024) nodes to be placed in each zone Finally, type 2 IDs use a 6-bit zone ID and an 8-bit node address, as shown in Fig 1 This allows up to 256 nodes to be addressed within the zone It will be obvious to one skilled in the art that the node ID bits can be apportioned in several other ways to provide more levels of addressing Type 0 IDs work well for networks that contain a small number of large zones (e.g., less than about 4 zones). Type 2 IDs are well suited for networks that contain a large number of small zones (e.g.. more than about 15). Type 1 IDs provide a good compromise between zone size and number of available zones, which makes a type 1 node ID a good choice for networks that contain an average number of medium size zones (e.g., between about 4 and about 15). When zones being described herein are in a network, the node IDs of the nodes in a zone may be delineated as two decimal numbers separated by a period (e.g., ZonelD.NodeAddress).
Fig. 2 illustrates an exemplary network that has been organized into a backbone, zone 200, and four configured zones, zones 201-204, which are numbered 0-4 under the protocol, respectively. The exemplary network employs a type 0 node ID, as there are relatively few zones (4). The solid circles in each zone represent network nodes, while the numbers within the circles represent node addresses, and include network nodes 211- 217, 221-226, 231-236, and 241-247. The dashed circles represent network zones. The network depicted in Fig. 2 has four configured zones (zones 1 -4) and one backbone (zone 0). Nodes with node IDs 1.3, 1.7, 2.2, 2,4, 3.4, 3.5, 4.1 , and 4.2 (network nodes 213, 217, 222, 224, 234, 235, 241 , and 242, respectively) are border nodes because they connect to more than one zone. All other nodes are interior nodes because their links attach only to nodes within the same zone. Backbone 200 consists of 4 nodes, zones 201-204, with node IDs of 0.1, 0.2, 0.3, and 0.4, respectively.
Once a network topology has been defined, the protocol allows the user to configure one or more end-to- end connections that can span multiple nodes and zones. This operation is referred to herein as provisioning. Each set of physical connections that are provisioned creates an end-to-end connection between the two end nodes that supports a virtual point-to-point link (referred to herein as a virtual path or VP). The resulting VP has an associated capacity and an operational state, among other attributes. The end points of a VP can be configured to have a master/slave relationship. The terms source and destination are also used herein in referring to the two end- nodes. In such a relationship, the node with a numerically lower node ID assumes the role of the master (or source) node, while the other assumes the role of the slave (or destination) node. The protocol defines a convention in which the source node assumes all recovery responsibilities and that the destination node simply waits for a message from the source node informing it of the VP's new path, although the opposite convention could easily be employed.
VPs are also assigned a priority level, which determines their relative priority within the network. This quality of service (QoS) parameter is used during failure recovery procedures to determine which VPs are first to be restored. Four QoS levels (0-3) are nominally defined in the protocol, with 0 being the lowest, although a larger or smaller number of QoS levels can be used Provisioning is discussed in greater detail subsequently herein.
Initialization of network nodes
In one embodiment, network nodes use a protocol such as that referred to herein as the Hello Protocol in order to establish and maintain neighbor relationships, and to learn and distribute link-state information throughout the network The protocol relies on the periodic exchange of bi-directional packets (Hello packets) between neighbors During the adjacency establishment phase of the protocol, which involves the exchange of INIT packets, nodes learn information about their neighbors, such as that listed in Table 1
Table 1 Information regarding neighbors stored by a node
During normal protocol operation, each node constructs a structure known as a Link State Advertisement (LSA), which contains a list of the node's neighbors, links, the capacity of those links, the quality of service available on over links, one or more costs associated with each of the links, and other pertinent information The node that constructs the LSA is called the originating node Normally, the originating node is the only node allowed to modify its contents (except for the HOP_COUNT field, which is not included in the checksum and so may be modified by other nodes) The originating node retransmits the LSA when the LSA's contents change The LSA is sent in a special Hello packet that contains not only the node's own LSA in its advertisement, but also ones received from other nodes The structure, field definitions, and related information are illustrated subsequently in Fig 18 and described in the corresponding discussion Each node stores the most recently generated instance of an LSA in its database The list of stored LSAs gives the node a complete topological map of the network The topology database maintained by a given node is, therefore, nothing moie than a list of the most recent LSAs generated by its peers and received in Hello packets
In the case of a stable network, the majority of transmitted Hello packets are empty (I e , contain no topology information) because only altered LSAs are included in the Hello messages Packets containing no changes (no LSAs) are referred to herein as null Hello packets The Hello protocol requires neighbors to exchange null Hello packets periodically The Hellolnterval parameter defines the duration of this period Such packets ensure that the two neighbors are alive, and that the link that connects them is operational
Initialization message An INIT message is the first protocol transaction conducted between adjacent nodes and is performed upon network startup or when a node is added to a pre-existing network An INIT message is used by adjacent nodes to initialize and exchange adjacency parameters The packet contains parameters that identify the neighbor (the node ID of the sending node), its link bandwidth (both total and available, on a QoS3/QoSn basis), and its configured Hello protocol parameters. The structure, field definitions, and related information are illustrated subsequently in Fig. 17 and described in the text corresponding thereto.
In systems that provide two or more QoS levels, varying amounts of link bandwidth may be set aside for the exclusive use of services requiring a given QoS. For example, a certain amount of link bandwidth may be reserved for QoS3 connections. This guarantees that a given amount of link bandwidth will be available for use by these high-priority services. The remaining link bandwidth would then be available for use by all QoS levels (0-3). The Hello parameters include the Hellolnterval and HelloDeadlnterval parameters. The Hellolnterval is the number of seconds between transmissions of Hello packets. A zero in this field indicates that this parameter hasn't been configured on the sending node and that the neighbor should use its own configured interval. If both nodes send a zero in this field then a default value (e.g., 5 seconds) should be used. The HelloDeadlnterval is the number of seconds the sending node will wait before declaring a silent neighbor down. A zero in this field indicates that this parameter hasn't been configured on the sending node and that the neighbor should use its own configured value. If both nodes send a zero in this field then a default value (e.g., 30 seconds) should be used. The successful receipt and processing of an INIT packet causes a START event to be sent to the Hello State machine, as is described subsequently.
Hello Message
Once adjacency between two neighbors has been established, the nodes periodically exchange Hello packets. The interval between these transmissions is a configurable parameter that can be different for each link, and for each direction. Nodes are expected to use the Hellolnterval parameters specified in their neighbor's Hello message. A neighbor is considered dead if no Hello message is received from the neighbor within the HelloDeadlnterval period (also a configurable parameter that can be link- and direction-specific).
In one embodiment, nodes in a network continuously receive Hello messages on each of their links and save the most recent LSAs from each message. Each LSA contains, among other things, an LSID (indicating which instance of the given LSA has been received) and a HOP_COUNT. The HOP_COUNT specifies the distance, as a number of hops, between the originating node and the receiving node. The originating node always sets this field of 0 when the LSA is created. The HOP_COUNT field is incremented by one for each hop (from node to node) traversed by the LSA instance. The HOP_COUNT field is set to zero by the originating node and is incremented by one on every hop of the flooding procedure. The ID field is initialized to FIRST_LSID during node start-up and is incremented every time a new instance of the LSA is created by the originating node. The initial ID is only used once by each originating node. Preferably, an LSA carrying such an ID is always accepted as most recent. This approach allows old instances of an LSA to be quickly flushed from the network when the originating node is restarted. During normal network operation, the originating node of an LSA transmits LS update messages when the node detects activity that results in a change in its LSA. The node sets the HOP_COUNT field of the LSA to 0 and the LSID field to the LSID of the previous instance plus 1. Wraparound may be avoided by using a sufficiently-large LSID (e.g., 32 bits). When another node receives the update message, the node records the LSA in its database and schedules it for transmission to its own neighbors. The HOP_COUNT field is incremented by one and transmitted to the neighboring nodes. Likewise, when the nodes downstream of the current node receive an update message with a HOP_COUNT of H, they transmit their own update message to all of their neighbors with a HOP_COUNT of H+l , which represents the distance (in hops) to the originating node. This continues until the update message either reaches a node that has a newer instance of the LSA in its database or the hop- count field reaches MAXJHOPS.
Fig. 3 is a flow diagram illustrating the actions performed in the event of a failure. When the connection is created, the inactivity counter associated with the neighboring node is cleared (step 300). When a node receives a Hello message (null or otherwise) from a neighboring node (step 310), the receiving node clears the inactivity counter (step 300). If the neighboring node fails, or any component along the path between the node and the neighboring node fails, the receiving node stops receiving update messages from the neighboring node. This causes the inactivity counter to increase gradually (step 320) until it reaches HelloDeadlnterval (step 330). Once HelloDeadlnterval is reached, several actions are taken. First, the node changes the state of the neighboring node from ACTIVE to DOWN (step 340). Next, the HOP_COUNT field of the LSA is set to LSInfinity (step 350). A timer is then started to remove the LSA from the node's link state database mihmLSZombieTime (step 360). A copy of the LSA is then sent to all active neighbors (step 370). Next, a LINK_DOWN event is generated to cause all VP"s that use the link between the node and its neighbor to be restored (step 380). Finally, a GETJ SA request is sent to all neighbors, requesting their copy of all LSA's previously received from the now- dead neighbor (step 390).
It should be noted that those skilled in the art will recognize the boundaries between and order of operations in this and the other flow diagrams described herein are merely illustrative and alternative embodiments may merge operations, impose an alternative decomposition of functionality of operations, or reorder the operations presented therein. For example, the operations discussed herein may be decomposed into sub-operations to be executed as multiple computer processes. Moreover, alternative embodiments may combine multiple instances of particular operation or sub- operations. Furthermore, those skilled in the art will recognize that the operations described in this exemplary embodiment are for illustration only. Operations may be combined or the functionality of the operations may be distributed in additional operations in accordance with the invention.
Fig. 4 is a flow diagram illustrating the actions performed when a downstream node receives a GET LSA message. When the downstream node receives the request, it first acknowledges the request by sending back a positive response to the sending node (step 400). The downstream node then looks up the requested LSA's in its link state database (step 410) and builds two lists, list A and list B (step 420). The first list, list A, contains entries that were received from the sender of the GET_LSA request. The second list, list B, contains entries that were received from a node other than the sender of the request, and so need to be forwarded to the sender of the GET_LSA message. All entries on list A are flagged to be deleted within LSTimeToLive, unless an update is received from neighboring nodes prior to that time (step 430). The downstream node also sends a GET_LSA request to all neighbors, except the one from which the GET_LSA message was received, requesting each neighbor's version of the LSAs on list A (step 430). If list B is non-empty (step 450), entries on list B are placed in one or more Hello packets and sent to the sender of the GET_LSA message (step 460). No such request is generated if the list is empty (step 450).
The LSA of the inactive node propagates throughout the network until the hop-count reaches MAX_HOPS. Various versions of the GETJLSA request are generated by nodes along the path, each with a varying number of requested LSA entries. An entry is removed from the request when it reaches a node that has an instance of the requested LSA that meets the criteria of list B.
Al! database exchanges are expected to be reliable using the above method because received LSA's must be individually acknowledged. The acknowledgment packet contains a mask that has a "1 " in all bit positions that correspond to LSA's that were received without any errors. The low-order bit corresponds to the first LSA received in the request, while the high-order bit corresponds to the last LSA. Upon receiving the response, the sender verifies the checksum of all LSA's in its database that have a corresponding "0" bit in the response. It then retransmits all LSA's with a valid checksum and ages out all others. An incorrect checksum indicates that the contents of the given LSA has changed while being held in the node's database. This is usually the result of a memory problem. Each node is thus required to verify the checksum of al) LSA's in its database periodically.
The LS checksum is provided to ensure the integrity of LSA contents. As noted, it is used to detect data corruption of an LSA. This corruption can occur while the advertisement is being transmitted, while it is being held in a node's database, or at other points in the networking equipment. The checksum can be formed by any one of a number of methods known to those of skill in the art, such as by treating the LSA as a sequence of 16-bit integers, adding them together using one's complement arithmetic, and then taking the one's complement of the result. Preferably, the checksum doesn't include the LSA's HOP_COUNT field, in order to allow other nodes to modify the HOP_COUNT without having to update the checksum field. In such a scenario, only the originating node is allowed to modify the contents of an LSA except for those two fields, including its checksum. This simplifies the detection and tracking of data corruption.
Specific instances of an LSA are identified by the LSA's ID field, the LSID. The LSID makes it possible to detect old and duplicate LSAs. Similar to sequence numbers, the space created by the ID is circular: it starts at some value (FIRSTJ SID), increases to some maximum value (FIRST_LSID-1), and then goes back to FIRSTJLSID+1. Preferably, the initial value is only used once during the lifetime of the LSA, which helps flush old instances of the LSA quickly from the network when the originating node is restarted. Given a large enough LSID, wrap-around will never occur, in a practical sense For example, using a 32 bit LSID and a MinLSInterval of 5 seconds, wrap-around takes on the order of 680 years
LSIDs must be such that two LSIDs can be compared and the greater (or lesser) of the two identified, or a failure ol the comparison indicated Given two LSIDs x and >, x is considered to be less than Λ if either
Figure imgf000017_0001
or
Ix-yl > γLS,Dh and >
is true The comparison fails if the two LSIDs differ by more than 2iLSIDLeng"'
Sending, Receiving, and Verifying LSAs Fig 5 shows a flow diagram illustrating the actions performed in sending link state information using
LSAs As noted, each node is required to send a periodic Hello message on each of its active links Such packets are usually empty (a null Hello packet), except w hen changes are made to the database, either through local actions or received advertisements Fig 5 illustrates how a given node decides which LSAs to send, when, and to what neighbors It should be noted that each Hello message may contain several LSAs thai are acknowledged as a group by sending back an appropriate response to the node sending the Hello message
Foi each new LSA in the link state database (step 500), then, the following steps are taken If the LSA is new, several actions are performed For each node in the neighbor list (step 510), the state of the neighboring node is determined If the state of the neighboring node is set to a value of less than ACTIVE, that node is skipped (steps 520 and 530) If the state of the neighboring node is set to a value of at least ACTIVE and if the LSA was received from this neighbor (step 540), the given neighbor is again skipped (step 530) If the LSA was not received from this neighbor (step 540), the LSA is added to the list of LSAs that are waiting to be sent by adding the LSA to this neighbor's LSAsToBeSent list (step 550) Once all LSAs have been processed (step 560), requests are sent out This is accomplished by stepping through the list of LSAs to be sent (steps 570 and 580) Once all the LSAs have been sent, the process is complete
Fig 6 illustrates the steps performed by a node that is receiving LSAs As noted, LSAs are received in
Hello messages Each Hello message may contain several distinct LSAs that must be acknowledged as a group by sending back an appropriate response to the node from which the Hello packet was received The process begins at step 600, where it is determined whether the Hello message received contains any LSAs requiring acknowledgment An LSA requiring processing is first analyzed to determine if the HOP_COUNT is equal to MAX_HOPS (step 610) This indicates that HOP_COUNT was incremented past MAX_HOPS by a previous node, and implies that the originating node is too far from the receiving node to be useful If this is the case, the current LSA is skipped (step 620). Next, the LSA's checksum is analyzed to ensure that the data in the LSA is valid (step 630). If the checksum is not valid (i.e., indicates an error), the LSA is discarded (step 435).
Otherwise, the node's link state database is searched to find the current LSA (step 640), and if not found, the current LSA is written into the database (step 645). If the current LSA is found in the link state database, the current LSA and the LSA in the database are compared to determine if they were sent from the same node (step 650). If the LSAs were from the same node, the LSA is installed in the database (step 655). If the LSAs were not from the same node, the current LSA is compared to the existing LSA to determine which of the two is more recent (step 660). The process for determining which of the two LSAs is more recent is discussed in detail below in reference to Fig. 7. If the LSA stored in the database is the more recent of the two, the LSA received is simply discarded (step 665). If the LSA in the database is less recent than the received LSA, the new LSA is installed in the database, overwriting the existing LSA (step 670). Regardless of the outcome of this analysis, the LSA is then acknowledged by sending back an appropriate response to the node having transmitted the Hello message (step 675).
Fig. 7 illustrates one method of determining which of two LSAs is the more recent. An LSA is identified by the Node ID of its originating node. For two instances of the same LSA, the process of determining the more recent of the two begins at step 700 by comparing the LSAs LSIDs. In one embodiment of the protocol, the special ID FIRST_LSID is considered to be higher than any other ID. If the LSAs LSIDs are different, the LSA with the higher LSID is the more recent of the two (step 710). If the LSAs have the same LSIDs, then HOP_COUNTs are compared (step 720). If the HOP_COUNTs of the two LSAs are equal then the LSAs are identical and neither is more recent than the other (step 730). If the HOP_COUNTs are not equal, the LSA with the lower HOP_COUNT is used (step 740). Normally, however, the LSAs will have different LSIDs.
The basic flooding mechanism in which each packet is sent to all active neighbors except the one from which the packet was received can result in an exponential number of copies of each packet. This is referred to herein as a broadcast storm. The severity of broadcast storms can be limited by one or more of the following optimizations:
1. In order to prevent a single LSA from generating an infinite number of offspring, each LSA can be configured with a HOP_COUNT field. The field, which is initialized to zero by the originating node, is incremented at each hop and, when it reaches MAX_HOP, propagation of the LSA ceases.
2. Nodes can be configured to record the node ID of the neighbor from which they received a particular LSA and then never send the LSA to that neighbor.
3. Nodes can be prohibited from generating more than one new instance of an LSA every MinLSAInterval interval (a minimum period defined in the LSA that can be used to limit broadcast storms by limiting how often an LSA may be generated or accepted (See Fig. 15 and the accompanying discussion)). 4. Nodes can be prohibited from accepting more than one new instance of an LSA less than MinLSAInterval "younger" than the copy they currently have in the database.
5. Large networks can be divided into broadcast zones as previously described, where a given instance of a flooded packed isn't allowed to leave the boundary of its originating node's zone. This optimization also has the side benefit of reducing the round trip time of packets that require an acknowledgment from the target node.
Every node establishes adjacency with all of its neighbors. The adjacencies are used to exchange Hello packets with, and to determine the status of the neighbors. Each adjacency is represented by a neighbor data structure that contains information pertinent to the relationship with that neighbor. The following fields support such a relationship:
Figure imgf000019_0001
Table 2. Fields in the neighbor data structure.
Preferably, a node maintains a list of neighbors and their respective states locally. A node can detect the states of is neighbors using a set of "neighbor states," such as the following:
1. Down. This is the initial state of the adjacency. It indicates that no valid protocol packets have been received from the neighbor.
2. INIT-Sent. This state indicates that the local node has sent an INIT request to the neighbor, and that an INIT response is expected.
3. INIT-Received. This state indicates that an INIT request was received, and acknowledged by the local node. The node is still awaiting an acknowledgment for its own INIT request from the neighbor.
4. EXCHANGE. In this state the nodes are exchanging database.
5. ACTIVE. This state is entered from the Exchange State once the two databases have been synchronized. At this stage of the adjacency, both neighbors are in full sync and ready to process other protocol packets.
6. ONE-WAY. This state is entered once an initialization message has been sent and an acknowledgement of that packet received, but before an initialization message is received from the neighboring node. Fig 8 illustrates a Hello state machine (HSM) 800 according to the present invention HSM 800 keeps track of adjacencies and their states using a set of states such as those above and transitions therebetween Preferably, each node maintains a separate instance of HSM 800 for each of its neighbors HSM 800 is driven by a number of events that can be grouped into two main categories internal and external Internal events include those generated by timers and other state machines External events are the direct result of received packets and user actions Each event may produce different effects, depending on the current state of the adjacency and the event itself For example, an event may
1 Cause a tiansition into a new state
Invoke zero or more actions
Have no effect on the adjacency or its state
HSM 800 includes a Down state 805, an INIT-Sent state 810. a ONE-WAY state 815, an EXCHANGE state 820, an ACTIVE state 825, and an INIT-Received state 830 HSM 800 transitions between these states in response to a START transition 835, IACK_RECEIVED transitions 840 and 845, INIT_RECEIVED transitions 850, 855, and 860, and an EXCHANGE DONE transition 870 in the manner described in Table 3 It should be noted that the Disabled state mentioned in Table ^ is merely a fictional state representing a non-existent neighbor and, so. is not shown in Fig 8 for the sake of clarity Table 3 shows state changes, their causing events, and resulting actions
Figure imgf000020_0001
Figure imgf000021_0001
Table 3. HSM transitions.
After the successful exchange of INIT packets, the two neighbors enter the Exchange State. Exchange is a transitional state that allows both nodes to synchronize their databases before entering the Active State. Database synchronization involves exchange of one or more Hello packets that transfer the contents of one node's database to the other. A node should not send a Hello request while its awaiting the acknowledgment of another. The exchange may be made more reliable by causing each request to be transmitted repeatedly until a valid acknowledgment is received from the adjacent node.
When a Hello packet arrives at a node, it is processed as previously described. Specifically, the node compares each LSA contained in the packet to the copy it currently has in its own database. If the received copy is more recent then the node's own or advertises a better hop-count, it is written into the database, possibly replacing the current copy. The exchange process is normally considered completed when each node has received, and acknowledged, a null Hello request from its neighbor. The nodes then enter the Active State with fully synchronized databases which contain the most recent copies of all LSAs known to both neighbors. A sample exchange using the Hello protocol is described in Table 4. In the following exchange, node 1 has four LSAs in its database, while node 2 has none.
Figure imgf000022_0001
Table 4. Sample exchange.
Another example is the exchange described in table 5. In the following exchange, node 1 has four LSAs (1 through 4) in its database, and node 2 has 7 (3 and 5 through 10). Additionally, node 2 has a more recent copy of LSA3 in its database than node 1.
Figure imgf000022_0002
Table 5. Sample exchange.
At the end of the exchange, both nodes will have the most recent copy of all 10 LSAs (1 through 10) in their databases. Provisioning
For each VP that is to be configured (or, as also referred to herein, provisioned), a physical path must be selected and configured. VPs may be provisioned statically or dynamically. For example, a user can identify the nodes through which the VP will pass and manually configure each node to support the given VP. The selection of nodes may be based on any number of criteria, such as QoS, latency, cost, and the like. Alternatively, the VP may be provisioned dynamically using any one of a number of methods, such as a shortest path first technique or a distributed technique. A shortest path first technique might, for example, employ the shortest path first technique of the present invention. An example of a distributed technique is the restoration method described subsequently herein.
Failure detection, propagation, and restoration
Failure Detection and Propagation
In one embodiment of networks herein, failures are detected using the mechanisms provided by the underlying physical network. For example, when using a SONET network, a fiber cut on a given link results in a loss of signal (LOS) condition at the nodes connected by that link. The LOS condition propagated an Alarm Indication Signal (AIS) downstream, and Remote Defect Indication (RDI) upstream (if the path still exists), and an LOS defect locally. Later, the defect is upgraded to a failure 2.5 seconds later, which causes an alarm to be sent to the Operations System (OS) (per Bellcore's recommendations in GR-253 (GR-253: Synchronous Optical Network (SGNET) Transport Systems, Common Generic Criteria, Issue 2 [Bellcore, Dec. 1995], included herein by reference, in its entirety and for all purposes)). Preferably when using SONET, the handling of the LOS condition follows Bellcore's recommendations in GR-253, which allows nodes to inter-operate, and co-exist, with other network equipment (NE) in the same network and which is included by reference herein in its entirety and for all purposes. The mesh restoration protocol is invoked as soon as the LOS defect is detected by the line card, which occurs 3ms following the failure (a requirement under GR-253).
The arrival of the AIS at the downstream node causes it to send a similar alarm to its downstream neighbor and for that node to send an AIS to its own downstream neighbor. This continues from node to node until the AIS finally reaches the source node of the affected VP, or a proxy border node if the source node is located in a different zone. In the latter case, the border node restores the VP on behalf of the source node. Under GR-253, each node is allowed a maximum of 125 microseconds to forward the AIS downstream, which quickly propagates failures toward the source node.
Once a node has detected a failure on one of its links, either through a local LOS defect or a received
AIS indication, the node scans its VP table looking for entries that have the failed link in their path. When the node finds one, it releases all link bandwidth used by the VP. Then, if the node is a VP's source node or a proxy border node, the VP's state is changed to RESTORING and the VP placed on a list of VPs to be restored. Otherwise (if the node isn't the source node or a proxy border node), the state of the VP is changed to DOWN, and a timer is started to delete it from the database if a corresponding restore-path request isn't received from the origin node within a certain timeout period The VP list that was created in the previous step is ordered by quality of service (QoS), which ensures that VPs with a higher QoS setting are restored first Each entry in the list contains, among other things, the ID of the VP, its source and destination nodes, configured QoS level, and required bandwidth
Fig 9 illustrates the steps performed in response to the failure of a link As noted, the failure of a link results in a LOS condition at the nodes connected to the link and generates an AIS downstream and an RDI upstream If an AIS or RDI were received from a node, a failure has been detected (step 900) In that case, each affected node performs several actions in order to maintain accurate status information with iegard to the VPs that it currently supports The first action taken in such a case, is that the node scans its VP table looking for entries that have the failed link in their path (steps 910 and 920) If the VP does not use the failed link, the node goes to the next VP in the table and begins analyzing that entry (steo 930) If the selected VP uses the failed link the node releases all link bandwidth allocated to that VP fstep 940) The node then determines whether it is a souice node or a proxy border node for the VP (step 950) If this is the case, the node changes the VP's state to RESTORING (step 960) and stores the VP on the list of VPs to be restored (step 970) If the node is not a source node or proxy border node for the VP, the node changes the VP state to DOWN (step 980) and stai ts a deletion timer for that VP (step 990)
Failure Restoration
For each VP on the list, the node then sends an RPR to all eligible neighbors in order to restoie the
Figure imgf000024_0001
VP The network will, of couise attempt to restore all failed VPs Neighbor eligibility is determined b> the state of the neighbor, available link bandwidth, current zone topology, location of the Target node, and other parameteis One method for determining the eligibility of a particular neighbor follows
1 The origin node builds a shortest path first (SPF) tree with "self as root Prior to building the SPF tree, the link-state database is pruned of all links that either don't have enough (available) bandwidth to satisfy the request, or have been assigned a QoS level that exceeds that of the VP being restored
2 The node then selects the output lιnk(s) that can lead to the target node in less than MΛX_HOPS hops The structure and contents of the SPF tree generated simplifies this step The RPR carries information about the VP, such as:
1. The Node IDs of the origin and target nodes.
2. The ID of the VP being restored.
3. A locally unique sequence number that gets incremented by the origin node on every retransmission of the request. The 8-bit sequence number, along with the Node and VP IDs, allow specific instances of an
RPR to be identified by the nodes.
4. An 8-bit field that carries the distance, in hops, between the origin node the receiving node. This field is initially set to zero by the originating node, and is incremented by 1 by each node along the path.
5. An array of link IDs that records the path of the message on its trip from the origin node to the target node.
Due to the way RPR messages are forwarded by tandem nodes and the unconditional and periodic retransmmission of such messages by origin nodes, multiple instances of the same request are not uncommon, even multiple copies of each instance, circulating the network at any given time. To minimize the amount of broadcast traffic generated by the protocol and aid tandem nodes in allocating bandwidth fairly for competing RPRs, tandem nodes preferably execute a sequence such as that described subsequently.
The lerm "same instance," as used below, refers to messages that carry the same VP ID, origin node ID, and hop-count, and are received from the same tandem node (usually, the same input link, assuming only one link between nodes). Any two messages that meet the above criteria are guaranteed to have been sent by the same origin node, over the same link, to restore the same VP. and to have traversed the same path. The terms "copy of an instance," or more simply "copy" are used herein to refer to a retransmission of a given instance. Normally, ta.idem nodes select the first instance they receive since in oit. but not all cases, as the first RPR received normally represenis the quickest path to the origin node. A method for making such a determination was described in reference to Fig. 5. Because such information must be stored for numerous RPRs, a standard data structure is defined under a protocol of the present invention.
The Restore-Path Request Entry (RPRE) is a data stiucture that maintains information about a specific instance of a RPRE packet. Tandem nodes use the structure to store information about the request, which helps them identify and reject other instances of the request, and allows them to correlate received responses with forwarded requests. Table 6 lists an example of the fields that are preferably present in an RPRE.
Figure imgf000025_0001
Figure imgf000026_0001
Table 6 RPR Fields
When an RPR packet arrives at a tandem node, a decision is made as to which neighbor should receive a copy of the request The choice of neighbors is related to variables such as link capacity and distance Specifically, a paiticular neighbor is selected to receive a copy of the packet if
1 The output link has enough resources to satisfy the requested bandwidth Nodes maintain a separate available bandwidth" counter for each of the defined QoS levels (e g QoSO-2 and QoS3) VPs assigned to certain QoS level, say "n," are allowed to use all link resources reserved for that level and all levels below it l e , all resources reserved tor levels 0 through n, inclusive
2 The path through the neighbor is less than MAX_HOPS in length In othei words, the distance from this node to the target node is less than MAX_HOPS minus the distance from this node to the origin node
3 The node hasn't returned a Flush response for this specific instance of the RPR, or a Terminate response for this or anv other instance
The Processing of Received RPRs
Fig 10 illustrates the actions performed by tandem nodes in processing teceived RPR tests Assuming that this is the first instance of the request, the node allocates the requested bandwidth on eligible links and transmits a modified copy of the received message onto them The bandwidth remains allocated until a response (either positive or negative) is received from the neighboring node, or a positive response is received from any of the other neighbors (see Table 7 below) While awaiting a response from its neighbors, the node cannot use the allocated bandwidth to restore other VPs, regardless of their priority (l e QoS)
Processing of RPRs begins at step 1000, in which the target node's ID is compared to the local node's ID It the local node's ID is equal to the target node's ID, the local node is the target of the RPR and must process the RPR as such. This is illustrated in Fig. 10 as step 1005 and is the subject of the flow diagram illustrated in Fig. 1 1. If the local node is not the target node, the RPR's HOP_COUNT is compared to MAX_HOP in order to determine if the HOP_COUNT has exceed or will exceed the maximum number of hops allowable (step 1010). If this is the case, a negative acknowledgment (NAK) with a Flush indicator is then sent back to the originating node (step 1015). If the HOP_COUNT is still within acceptable limits, the node then determines whether this is the first instance of the RPR having been received (step 1020). If this is the case, a Restore-Path Request Entry (RPRE) is created for the request (step 1025). This is done by creating the RPRE and setting the RPRE's fields, including starting a time-to-live (TTL) or deletion timer, in the following manner:
RPRE.SourceNode = Header.Origin
RPRE.Destination Node = Header.Target
RPRE.FirstSequence Number = Hearder.SequenceNumber
RPRE. Last Sequence Number = Header.Sequence Number
RPRE.QoS = Header.Parms.RestorePath.QoS RPRE.Bandwidth = Header. Parms.RestorePath.Bandwidth
RPRE.ReceivedFrom = Node ID of the neighbor that sent us this message
StartTimer (RPRE.Timer, RPR_TTL)
The ID of the input link is then added to the path in the RPRE (e.g., Path[PatlιIndex++] = LinkID) (step 1030). Next, the local node determines whether the target node is a direct neighbor (step 1035). If the target node is not a direct neighbor of the local node, a copy of the (modified) RPR is sent to all eligible neighbors (step 1040). The PendingReplies and SentTo Fields of the corresponding RPRE are also updated accordingly at this time. If the target node is a direct neighbor of the local node, the RPR is sent only to the target node (step 1045). In either case, the RPRE corresponding to the given RPR is then updated (step 1050).
If this is not the first instance of the RPR received by the local node, the local node then attempts to determine whether this might be a different instance of the RPR (step 1055). A request is considered to be a different instance if the RPR:
1. Carries the same origin node IDs in its header;
2. Specifies the same VP ID; and
3. Was either received from a different neighbor or has a different HOP_COUNT in its header.
If this is simply a different instance of the RPR, and another instance of the same RPR has been processed, and accepted, by this node, a NAK Wrong Instance is sent to the originating neighbor (step 1060). The response follows the reverse of the path carried in the request. No broadcasting is therefore necessary in such a case. If a similar instance of the RPR has been processed and accepted by this node (step 1065), the local node determines whether a Terminate NAK has been received for this RPR (step 1070). If a Terminate NAK has been received for this RPR, the RPR is rejected by sending a Terminate response to the originating neighbor (step 1075) If a Terminate NAK was not received for this RPR, the new sequence number is recorded (step 1080) and a copy of the RPR is forwarded to all eligible neighbors that have not sent a Flush response to the local node for the same instance of this RPR (step 1085) This may include nodes that weren't previously considered by this node due to conflicts with other VPs, but does not include nodes from which a Flush response has already been received for the same instance of this RPR The local node should then save the number of sent requests in the PendmgReplies field of the corresponding RPRE The term "eligible neighbors" refers to all adjacent nodes that are connected through links that meet the link-eligibility requirements previously described Preferably, bandwidth is allocated only once for each request so that subsequent transmissions of the request do not consume any bandwidth
Note that the bandwidth allocated for a given RPR is released differently depending on the type of response received by the node and the setting of the Flush and Terminate indicators in its header Table 7 shows the action taken bv a tandem node when it receives a restore path response from one of its neighbors
Figure imgf000028_0001
Table 7 Actions taken by a tandem node upon receiving an RPR
Fig 11 illustrates the process peiformed at the target node once the RPR finally reaches that node When the RPR reaches its designated target node, the target node begins processing of the RPR by first determining whether this is the first instance of this RPR that has been received (step 1 100) If that is not the case, a NAK is sent with a Terminate indicator sent to the originating node (step 1105) If this is the first instance of the RPR received, the target node determines whether or not the VP specified in the RPR actually terminates at this node (step 1110) If the VP does not terminate at this node, the target node again sends a NAK with a Terminate to the originating node (step 1105) By sending a NAK with a Terminate indicator, resources allocated along the path are fieed by the corresponding tandem nodes
If the VP specified in the RPR terminates at this node (l e this node is indeed the target node), the target node determines whether an RPRE exists for the RPR received (step 1 115) If an RPRE already exists for this RPR, the existing RPRE is updated (e.g., the RPRE' sLastSequenceNumber field is updated) (step 1120) and the RPRE deletion timer is restarted (step 1125). If no RPRE exists for this RPR in the target node (i.e., if this is the first copy of the instance received), an RPRE is created (step 1 130), pertinent information from the RPR is copied into the RPRE (step 1135), the bandwidth requested in the RPR is allocated on the input link by the target node (step 1140) and an RPRE deletion timer is started (step 1145). In either case, once the RPRE is either updated or created, a checksum is computed for the RPR (step 1150) and written into the checksum field of the RPR (step 1155). The RPR is then returned as a positive response to the origin node (step 1160). The local (target) node then starts its own matrix configuration. It will be noted that the RPRE created is not strictly necessary, but makes the processing of RPRs consistent across nodes.
The Processing of Received RPR Responses
Figs. 12 and 13 are flow diagrams illustrating the processes performed by originating nodes that receive negative and positive RPR responses, respectively. Negative RPR responses are processed as depicted in Fig. 12. An originating node begins processing a negative RPR response by determining whether it has an RPRE associated with the RPR (step 1200). If the receiving node does not have an RPRE for the received RPR response, the RPR response is ignored (step 1205). If an associated RPRE is found, the receiving node determines whether the node sending the RPR response is listed in the RPRE (e.g., is actually in the SentTo list of the RPRE) (step 1210). If the sending node is not listed in the RPRE, again the RPR response is ignored (step 1205).
If the sending node is listed in the RPRE, the RPR sequence number is analyzed to determine whether or net it is valid (step 1215). As with the previous steps, if the RPR contains an invalid sequence number (e.g., doesn't fall between FirstSequenceN umber and LastSequence Number, inclusive), the RPR response is ignored (step 1205). If the RPR sequence number is valid, the receiving node determines whether Flush or Terminate in the RPR response (step 1220). If neither of these is specified, the RPR response sequence number is compared to that stored in the last sequence field of the RPR (step 1225). If the RPR response sequence number does not match that found in the last sequence field of the RPRE, the RPR response is again ignoied (step 1205). If the RPR response sequence number matches that found in the RPRE, or a Flush or Terminate was specified in the RPR, the input link on which the RPR response was received is compared to that listed in the RPR response path field (e.g., Response. Path[Response. Pathlndex] == InputLinkID ) (step 1230). If the input link is consistent with information in the RPR, the next hop information in the RPR is checked for consistency (e.g., Response. Path [Response. Pathlndex + 1] == RPRE.ReceivedFrom ) (step 1235). If either of the proceeding two tests are failed the RPR response is again ignored (step 1205).
If a Terminate was specified in the RPR response (step 1240), the bandwidth on all links over which the RPR was forwarded is freed (step 1245) and the Terminate and Flush bits from the RPR response are saved in the RPRE (step 1250). If a Terminate was not specified in the RPR response, bandwidth is freed only on the input link (i.e., the link from which the response was received) (step 1255), the Terminate and Flush bits are saved in the RPRE (step 1260), and the Flush bit of the RPR is cleared (step 1265). If a Terminate was not specified in the RPR, the Pending Replies field in the RPRE is decremented (step 1270). If this field remains non-zero after being decremented the process completes. If Pending Replies is equal to zero at this point, or a Terminate was not specified in the RPR, the RPR is sent to the node specified in the RPR's Received From field (i.e. the node that sent the corresponding request) (step 1280). Next, the bandwidth allocated on the link to the node specified in the RPR's Received From field is released (step 1285) and an RPR deletion timer is started (step 1290).
Fig. 13 illustrates the steps taken in processing positive RPR responses. The processing of positive RPR responses begins at step 1300 with a search of the local database to determine whether an RPRE corresponding to the RPR response is stored therein. If a corresponding RPRE cannot be found, the RPR response is ignored (step 1310). If the RPR response RPRE is found in the local database, the input link is verified as being consistent with the path stored in the RPR (step 1320). If the input link is not consistent with the RPR path, the RPR response is ignored once again (step 1310). If the input link is consistent with path information in the RPR, the next hop information specified in the RPR response path is compared with the Received From field of the RPRE (e.g , Response. Path[ Response. Pathlndex + I] != RPRE.ReceivedFrom) ^ tep 1330). If the next hop information is not consistent, the RPR response is again ignored (step 1310). However, if the RPR response's next hop information is c..r_si_.tent, bandwidth allocated on input and output links related to the RPR is committed (step 1340). Conversely, bandwidth allocated on all other input and output links for that VP is freed at this time (step 1350). Additionally, a positive response is sent to the node from which the RPR was received (step 1360). and an RPR deletion timer is started (step 1370) and the local matrix is configured (step 1380).
With regard to matrix configuration, the protocol pipelines such activity with the forwarding of RPRs in order to minimize the impact of matrix configuration overhead on the time required for restoration. While the response is making its way from node Nl to node N2, node Nl is busy configuring its matrix. In most cases, by the time the response reaches the origin node, all nodes along the path have already configured their matrices
The Terminate indicator prevents "bad" instances of an RPR from circulating around the network for extended periods of time. The indicator is propagated all the way back to the originating node and prevents it, and all other nodes along the path, from sending or forwarding other copies of the corresponding RPR instance.
Terminating RPR Packets are processed as follows. The RPR continues along the path until it encounters any one of the following four conditions:
1. Its HOP_COUNT reaches the maximum allowed (i.e. MAX_HOPS). 2. The request reaches a node that doesn't have enough bandwidth on any of its output links to satisfy the request.
3. The request reaches a node that had previously accepted a different instance of the same request from another neighbor. 4. The request reaches its ultimate destination: the target node, which is either the Destination node of the VP, or a proxy border node if the Source and Destination nodes are located in difference zones.
Conditions 1, 2 and 3 cause a negative response to be sent back to the originating node, flowing along the path carried in the request, but in the reverse direction.
Further optimizations of the protocol can easily be envisioned by one of skill in the art, and are intended to be within the scope of this specification. For example in one embodiment, a mechanism is defined to further reduce the amount of broadcast traffic generated for any given VP. In order to prevent an upstream neighbor from sending the same instance of an RPR every T milliseconds, a tandem node can immediately return a no- commit positive response to that neighbor, which prevents it from sending further copies of the instance. The response simply acknowledges the receipt of the request, and doesn't commit the sender to any of the requested resources. Preferably, however, the sender (of the positive response) periodically transmits the acknowledged request until a valid response is received from its downstream neighbor(s). This mechanism implements a piece- wise, or hop-by-hop, acknowledgment strategy that limits the scope of retransmitted packets to a region that gets progressively smaller as the request gets closer to its target node.
Optimizations
However, it is prudent to provide some optimizations for efficiently handling errors. Communication protocols often handle link errors by starling a timer after every transmission and, if a valid response isn't received within the timeout period, the message is retransmitted. If a response isn't received after a certain number of ;etransmιssion, the sender generates a local error and disables the connection. The timeout period is usually a configurable parameter, but in some cases it is computed dynamically, and continuously, by the two end points. The simplest form of this uses some multiple of the average round trip time as a timeout period, while others use complex mathematical formulas to determine this value. Depending on the distance between the two nodes, the speed of link that connects them, and the latency of the equipment along the path, the timeout period can range anywhere from millisecond to seconds.
The above strategy is not the preferred method of handling link errors in the present invention. This is because the fast restoration times required dictates that 2-way, end-tc-end communication be carried out in less than 50ms. A drawback of the above-described solution is the time wasted while waiting for an acknowledgment to come back from the receiving node. A safe timeout period for a 2000 mile span, for instance, is over 35ms, which doesn't leave enough time for a retransmission in case of an error.
This problem is addressed in one embodiment by taking advantage of the multiple communication channels, i.e. OC-48's that exist between nodes to:
1 Send N copies (N >= 1) of the same request over as many channels, and 2. Re-send the request every T milliseconds (1ms < 10ms) until a valid response is received from the destination node.
The protocol can further improve link efficiency by using small packets during the restoration procedure. Empirical testing in a simulated 40-node SONET network spanning the entire continental United States, showed that an N of 2 and a T of 15ms provide a good balance between bandwidth utilization and path restorability. Other values can be used, of course, to improve bandwidth utilization or path restorability to the desired level. Additionally, the redeemed number of resends eliminates broadcast storms and the waste of bandwidth in the network.
Fig. 14 illustrates an exemplary network 1400. Network 1400 includes a pair of computers (computers
1405 and 1410) and a number of nodes (nodes 1415-1455). In the protocol, the nodes also have a node ID which is indicated inside circles depicting the node which range from zero to eight successively. The node IDs are assigned by the network provider. Node 1415 (node ID 0) is referred to herein as a source node, and node 1445 (node ID 6) is referred to herein as a destination node for a VP 0 (not shown). As previously noted, this adheres to the protocol's convention of having the node with the lower ID be the source node for the virtual path and the node with the higher node ID be the destination node for the VP.
Network 1400 is flat, meaning that all nodes belong to the same zone, zone 0 or the backbone zone. This also implies that Node IDs and Node Addresses are one and the same, and that the upper three bits of the Node ID (address) arc always zeroes using the aforementioned node ID configuration. Table 8 shows link information for network 1400. Source nodes are listed in the first column, and the destination nodes are listed in the first row of Table 8. The second row of Table 8 lists the link ID (L), the available bandwidth (B), and distance (D) associated with each of the links. In this example, no other metrics (e.g., QoS) are used in provisioning the VPs listed subsequently.
Figure imgf000032_0001
Figure imgf000033_0001
Table 8. Link information for network 1400.
Table 9A shows a list of exemplary configured VPs, and Table 9B shows the path selected for each VP by a shortest-path algorithm according to the present invention. The algorithm allows a number of metrics, e.g. distance, cost, delay, and the like to be considered during the path selection process, which makes it possible to route VPs based on user preference. Here, the QoS metric is used to determine which VP has priority.
Figure imgf000033_0002
Table 9A. Configured VPs.
Figure imgf000033_0003
Table 9B. Initial routes.
Reachability algorithm
Routes are computed using a QoS-based shortest-path algorithm. The route selection process relies on configured metrics and an up-to-date view of network topology to find the shortest paths for configured VPs. The topology database contains information about all network nodes, their links, and available capacity. All node IDs are assigned by the user and must be globally unique. This gives the user control over the master/slave relationship between nodes. Duplicate IDs are detected by the network during adjacency establishment. All nodes found with a duplicate ID are disabled by the protocol, and an appropriate alarm is generated to notify the network operations center of the problem so that proper action can be taken.
The algorithm uses the following variables.
1. Ready - A queue that holds a list of nodes, or vertices, that need to be processed.
2. Database - The pruned copy of the topology database, which is acquired automatically by the node using the Hello protocol. The computing node removes all vertices and or links that do not meet the specified QoS and bandwidth requirements of the route. 3. Neighbors [A] - An array of "A" neighbors. Each entry contains a pointer to a neighbor data structure as previously described.
4. Path [N][H] - A two dimensional array (N rows by H columns, where N is the number of nodes in the network and H is the maximum hop count). Position (n. h) of the array contains a pointer to the following structure (R is the root node, i.e., the computing node):
Figure imgf000034_0001
The algorithm proceeds as follows (again, R is the root node, i.e. the one computing the routes):
1. Fill column 1 of the array as follows: for each node n know t". R, initialize entry Path [n][l] as follows:
If n is a neighbor of R then,
Cost = Neighbors [n].LinkCost NextHop - n
PrevHop = R Place n in Ready
Else (n is not a neighbor of R)
Cost = MAX_COST
NextHop = INVALID._NODE_ID
PrevHop = INVALID. NODE D 2. For all other columns ( h = 2 through H) proceed as follows: a. If Ready is empty, go to 3 (done). b. Else, copy column h-1 to column h c. For each node n in Ready (do not include nodes added during this iteration of the loop): i. For each neighbor m of n (as listed in n's LSA):
Add the cost of the path from R to n to the cost of the link between n and m. If computed cost is lower than the cost of the path from R to m, then change entry
Path[m][h] as follows:
Cost = Computed cost NextHop = Path [n][h-l].NextHop PrevHop = n
Add m to Ready.
(It will be processed on the next iteration of h.)
3. Done. Save h in a global variable called LastHop. Fig. 15 illustrates a flow diagram of the above QoS-based shortest path route selection process (referred to herein as a QSPF process) that can be used in one embodiment of the protocol. The process begins at step 1500 by starting with the first column of the array that the QSPF process generates. The process initializes the first column in the array for each node n known to node R. Thus, node R first determines if the current node is a neighbor (step 1505). If the node is the neighbor, several variables are set and the representation of node n is placed in the Ready queue (step 1510). If node n is not a neighbor of node R, those variables are set to indicate that such is the case (step 1515). In either case, node R continues through the list of possible node n's (step 1520). Node R then goes on to fill other columns of the array (step 1525) until the Ready queue which holds a list of nodes waiting to be processed is empty (step 1530). Assuming that nodes remain to be processed, the column preceding the current column is copied into the current column (step 1535) and a new cost is generated (step
1540). If this new cost is greater than the cost from node R to node m (step 1545) then the entry is updated with new information then m is placed on the Ready queue (step 1550). Once this has been accomplished or if the new cost is less'than the current cost from node R to node m, the process loops if all neighbors m of node n have not been processed (steps 1555 and 1560). If more nodes await processing in the Ready queue (step 1565). they are processed in order (step 1570). but if all nodes have been processed, the Last Hop variable is set to the number of columns in the array (step 1575) and the process is at an end.
For any given hop-count (1 through LastHop), Path [] ultimately contains the best route from R to all other nodes in the network. To find the shortest path (in terms of hops, not distance) from R to n, row n of the array is searched until an entry with a cost not equal to MAX_COST is found. To find the least-cost path between R and n, regardless of the hop-count, entries 1 through LastHop of row n are scanned, and the entry with the lowest cost selected.
Format and usage of protocol messages
Protocol messages (or packets) preferably begin with a standard header to facilitate their processing. Such a header preferably contains the information necessary to determine the type, origin, destination, and identity of the packet. Normally, the header is then followed by some sort of command-specific data (e.g., zero or more bytes of information).
Fig. 16 illustrates the layout of a header 1600 Shown therein is a request response indicator (RRI) 1610, a negative response indicator (NRI), a terminate/commit path indicator (TPI) 1630, a flush path indicator (FPI) 1640, a command field 1650, a sequence number (1660). an origin node ID (1670) and a target node ID (1680). A description of these fields is provided below in Table 10. It will be notes that although the terms "origin" and "target" are used in describing header 1600, their counterparts (source and destination, respectively) can be used in their stead. Preferably, packets sent using a protocol according to the present invention employ a header layout such as that shown as header 1600. Header 1600 is then followed by zero or more bytes of command specific data, the format of which, for certain commands, is shown in Figs. 17-21 below.
Figure imgf000036_0001
Table 10. The layout of exemplary header 1600.
The protocol can be configured to use a number of different commands. For example, seven commands may be used with room in the header for 9 more. Table 11 lists those commands and provides a brief description of each, with detailed description of the individual commands following.
Figure imgf000036_0002
Table 11. Exemplary protocol commands. The Initialization packet
Fig 17 illustrates the layout of command specific data for an initialization packet 1700 which in turn causes a START event to be sent to the Hello State Machine of the receiving node Initialization packet 1700 includes a node ID field 1710, a link cost field 1720, one or more QoS capacity fields (as exemplified by QoS3 capacity (Q3C) field 1730 and a QoSn capacity (QnC) field 1740), a Hello interval field 1750 and a time-out interval field 1760 It should be noted that although certain fields are described as being included in the command-specific data of initialization packet 1700, more or less information could easily be provided, and the infoimation illustrated in Fig 17 could be sent using two or more types of packets
The initialization (or INIT) packet shown in Fig 17 is used by adjacent nodes to initialize and exchange adjacency parameters The packet contains parameters that identify the neighbor, its link bandwidth (both total and available), and its configured Hello protocol parameters The INIT packet is normally the first protocol packet exchanged by adjacent nodes As noted previously, the successful receipt and processing of the INIT packet causes a START event to be sent to the Hello State machine The field definitions appear in Table 12
Figure imgf000037_0001
Table 12 Field definitions foi an initialization packet
The Hello packet
Fig 18 illustrates the command-specific data foi a Hello packet 1800 The command-specific data of Hello packet 1800 includes a node ID field 1805, an LS count field 1810, an advertising node field 1820. a checksum field 1825, an LSID field 1830, a HOP_COUNT field 1835, a neighbor count field 1840, a neighbor node ID field 1845, a link ID field 1850, a link cost field 1855, a Q3C field 1860, and a QnC field 1865
Hello packets are sent periodically by nodes in order to maintain neighbor relationships, and to acquire and propagate topology information throughout the network The interval between Hello packets is agreed upon during adjacency initialization Link state information is included in the packet in several situations, such as when the database at the sending nodes changes, either due to provisioning activity, port failure, or recent updates received from one or more originating nodes. Preferably, only modified LS entries are included in the advertisement. A null Hello packet, also sent periodically, is one that has a zero in its LSCount field and contains no LSAs. Furthermore, it should be noted that a QoSn VP is allowed to use any bandwidth reserved for QoS levels 0 through n. Table 13 describes the fields that appear first in the Hello packet. These fields appear only once.
NodelD Node ID of the node that sent this packet, i.e. our neighbor
LSCount Number of link state advertisements contained in this packet
Table 13. Field definitions for the first two fields of a Hello packet.
Table 14 describes information carried for each LSA and so is repeated LSCount times:
Figure imgf000038_0001
Table 14. Field definitions for information carried for each LSA.
Table 15 describes information carried for each neighbor and so is repeated NeighborCount times:
Figure imgf000038_0002
Table 15. Field definitions for information carried for each neighbor.
The GET LSA packet
Fig. 19 illustrates the layout of command-specific data for a GET_LSA packet 1900 of a protocol according to the present invention. GET_LSA packet 1900 has its first byte set to zero (exemplified by a zero byte 1905). GET LSA packet 1900 includes an LSA count 1910 that indicates the number of LSAs being sought and a node ID list 1920 that reflects one or more of the node IDs for which an LSA is being sought. Node ID list 1920 includes node IDs 1930(1 )-(N). The GETJLSA response contains a mask that contains a "1" in each position for which the target node possesses an LSA. The low-order bit corresponds to the first node ID specified in the request, while the highest-order bit corresponds to the last possible node ID. The response is then followed by one or more Hello messages that contain the actual LSAs requested.
Table 16 provides the definitions for the fields shown in Fig. 19.
Count The number of node IP's contained in the packet.
NodelDO- The node IDs for which the sender is seeking an LSA. Unused fields need not be NodelDn included in the packet and should be ignored by the receiver.
Table 16. Field definitions for a GET_LSA packet.
The Restore Path packet
Fig. 20 illustrates the layout of command-specific data for an RPR packet 2000 of a protocol according to the present invention, RPR packet 2000 includes a virtual path identifier (VPID) field 2010, a checksum field 2020, a path iength field 2030, a HOP_COUNT field 2040, and an array of path lengths (exemplified by a path field 2050). Path field 2050 may be further subdivided into hop fields (exemplified by hop fields 2060 (l )-(N), where N may assume a value no largei than MAX._HOPS).
The Restore Path packet is sent by source nodes (or proxy border nodes), to obtain an end-to-end path for a VP. The packet is usually sent during failure recovery procedures but can also be used for provisioning new VPs. The node sending the RPR is called the origin or source node. The node that terminates the request is called (he target or destination node. A restore Path instance is uniquely identified by its origin and target nodes, and VP ID. Multiple copies of the same restore-path instance are identified by the unique sequence number assigned to each of them. Only the sequence number need be unique across multiple copies of the same instance of a restore-path packet. Table 17 provides the definitions for the fields shown in Fig. 20.
Figure imgf000039_0001
Table 17. Field definitions for a Restore Path packet. The Create Path packet
Fig 21 illustrates the layout of command-specific data for a CREATE_PATH (CP) packet 2100 CP packet 2100 includes a virtual path identifier (VPID) field 21 10, a checksum field 2120, a path length field 2130, a HOP_COUNT field 2140, and an array of path lengths (exemplified by a path field 2150) Path field 2150 may be further subdivided into hop fields (exemplified by hop fields 2160 (l )-(N), where N may assume a value no larger than MAX_HOPS)
The CP packet is sent by source nodes (or proxy border nodes), to obtain an end-to-end path for a VP The node sending the CP is called the origin or souice node The node that terminates the request is called the target or destination node A CP instance is uniquely identified by its origin and target nodes, and VP ID Multiple copies of the same CP instance are identified by the unique sequence number assigned to each of them Only the sequence number need be unique across multiple copies of the same instance of a Create-Path packet Table 18 provides the definitions for the fields shown in Fig 21
Figure imgf000040_0001
Table 18 Field definitions for a Restore Path packet
The Delete Path Packet
The Delete Path packed is used to delete an existing path and leleases all of its allocated link resources It can use the same packet format as the Restore Path packet The origin node is lesponsible tor initializing the Path [J, PathLength, and Checksum fields to the packet, which should include the full path of the VP being deleted It also sets Pathlndex to zero Tandem nodes should release link resources allocated tor the VP after they have received a valid response from the target node Tne target node should set the Pathlndex field to zero prior to computing the checksum of packet The TestPath Packet
The TestPath packet is used to test the integrity of an existing virtual path. It uses the same packet format as the RestorePath packet. The originating node is responsible for initializing the Path [], PathLength, and Checksum fields of the packet, which should include the full path of the span being tested. It also sets Pathlndex to zero. The target node should set the Pathlndex field to zero prior to computing the checksum of packet. The TestPath packet may be configured to test functionality, or may test a path based on criteria chosen by the user, such as latency, error rate, and the like.
The Link-Down Packet The Link-Down packet is used when master nodes are present in the network. It is used by slave nodes to inform the master node of link failures. This message is provided for instances in which the alarms associated with such failures (AIS and RDI) do not reach the master node.
While particular embodiments of the present invention have been shown and described, it will be obvious to those skilled in the art that, based upon the teachings herein, changes and modifications may be made without departing from this invention and its broader aspects and, therefore the appended claims are to encompass within their scope all such changes and modifications as are within the true spirit and scope of this invention. Furthermore, it is to be understood that the invention is solely defined by the appended claims.

Claims

WE CLAIM:
1 A method of operating a network, the network comprising a plurality of nodes coupled by a plurality of optical links, comprising provisioning a virtual path between a first node and a second node of said plurality of nodes, wherein provisioning comprises identifying said first node and said second node of said plurality of nodes, discovering a physical path from said first node to said second node by automatically identifying any intermediary nodes comprising said physical path, and establishing said virtual path by configuring a set of connections between said first node, said second node, and said intermediary nodes, if any, using intermediary links of said plurality of links
2 The method of claim 1 , further comprising testing said virtual path by testing each one of said intermediary nodes and said intermediary links as a «ιngle circuit
3 The method of claim 1, further comprising allocating said intermediary links between said first, said second and said intermediary nodes
4 The method of claim 3, further comprising terminating said virtual path by automatically deallocating said intermediary links
5 The method of claim 4, wherein said intermediary links are available for re-use upon deallocation
6 The method of claim 3, fuither comprising tteeiimr inating said virtual path by sending a termination message from one of said first and said second nodes to the other of said first and said second nodes, wherein said termination message is sent along said physical path and each one of said intermediary links is deallocated by a respective one of said nodes as said termination message is sent to each of said nodes
7 The method of claim 6, wherein said intermediary links are available for re-use upon deallocation
8 The method of claim 6, wherein said intermediary links are deallocated substantially simultaneously upon reception of a broadcasted termination message
9 The method of claim 1 , further comprising restoring said virtual path in response to a failure along said physical path by discovering an alternate physical path from said first node to said second node by automatically identifying intermediary nodes of said alternate physical path, and re-establishing said virtual path by configuring a set of connections between said nodes of said alternate physical path
10 The method of claim 9, wherein at least one of said intermediary nodes of said physical path is also one of said intermediary nodes forming said alternate physical path
1 1 The method of claim 1 , further comprising sending messages to maintain knowledge of a topology of the netwoik and to determine if neighboring nodes have failed
12 The method of claim 1 1, wherein each one of saiα plurality of nodes obtains information on neighboring ones of said plurality of nodes such that each one of said plurality of nodes is able to maintain a database representing a topology of the network
13 The method of claim 12, wherein use of said database in said discovering said physical path allows said discovering said physical path t proceed more quickly
14 A method of restoring a virtual path in an optical network comprising discovering an alternate physical path from said first node to said second node by automatically identifying nodes of said alternate physical path, wherein said optical network comprises a plurality of nodes coupled by a plurality of optical links, said virtual path is provisioned on a physical path between said first and said second node of said optical network, and re-establishing said virtual path by configuring a set of connections between said nodes of said alternate physical path
15 The method of claim 14, wherein said discovering and said re-establishing are performed in less than one second
16 The method of claim 14, wherein said discovering and said re-establishing are performed in less than 200ms
17. The method of claim 14, wherein said discovering and said re-establishing are performed in less than 50 ms.
18. The method of claim 14, wherein said virtual path is restored in response to a failure along said physical path, the method further comprising: detecting said failure, wherein said detecting, said discovering, and said re-establishing are performed in less than one second.
19. The method of claim 14, wherein said virtual path is restored in response to a failure along said physical path, the method further comprising: detecting said failure, wherein said detecting, said discovering, and said re-establishing are performed in less than 200 ms.
20. The method of claim 14, wherein said virtual path is restored in response io a failure along said physical path, the method further comprising: detecting said failure, wherein said detecting, said discovering, and said re-establishing are performed in less than 50 ms.
21. The method of claim 14. wherein each one of said plurality of nodes obtains information on neighboring ones of said plurality of nodes such that each one of said plurality of nodes is able to maintain a database representing a topology of the optical network and use of said database in said discovering said alternate physical path allows said discovering to otherwise proceed more quickly.
22. The method of claim 14, wherein at least one of said nodes of said physical path is also one of said nodes of said alternate physical path.
23. A method of operating an optical network, the optical network comprising a plurality of nodes coupled by a plurality of links, wherein each one of said plurality of nodes obtains information on neighboring ones of said plurality of nodes such that each one of said plurality of nodes is able to maintain a database representing a topology of the optical network.
24. A method of operating an optical network, the optical network comprising a plurality of nodes coupled by a plurality of links, comprising: for each one of said plurality of nodes: obtaining information from neighboring nodes, said information regarding a state of at least one of said plurality of links, and using said information to maintain a database representing a topology of the optical network.
1 25. A method of testing a virtual path in an optical network, said virtual path provisioned
2 on a physical path between a first and a second node of said optical network, said network comprising a
3 plurality of nodes coupled by a plurality of links, comprising:
4 testing said virtual path by testing each one of a plurality of nodes and a plurality of links in
5 said physical path as a single circuit.
1 26. A computer program product encoded in computer readable media, the computer
2 program product comprising:
3 first instructions, executable by a first processor, for identifying a first node and a second node
4 of a plurality of nodes, said plurality of nodes being coupled by a plurality of links to
5 form an optical network;
6 second instructions, executable by said first processor, for discovering a physical path from
7 said first node to said second node by automatically identifying intermediary nodes of
8 said physical path; and
9 third instructions, executable by said first processor, for establishing said virtual path by 0 causing a second processor to configure a set of connections between said nodes of 1 said physical path.
27. The computer program product of claim 26, further comprising a graphical user
> interface for displaying a topology of said optical network.
\ 28. The computer program product of claim 26, further comprising:
2 fourth instructions, executable by said first processor, for testing said virtual path by testing
3 each one of said plurality of nodes and said plurality of links of said physical path as a single circuit.
1 29. The computer program pioduct of claim 26, further comprising: fourth instructions, executable by said first processor, for terminating said virtual path by
3 sending a termination message from one of said first and second nodes to the other of said first and second nodes, wherein said termination message is sent along said physical path and each one of said intermediary nodes is deallocated by a respective one of said nodes forming said physical path as said termination message is sent to a next one of said nodes.
30. The computer program product of claim 26, further comprising: fourth instructions, executable by said first processor, for restoring said virtual path in response to a failure along said physical path by discovering an alternate physical path from said first node to said second node by automatically identifying nodes forming said alternate physical path, and re-establishing said virtual path by configuring a set of connections between said nodes of said alternate physical path.
31. The computer program product of claim 26, wherein the computer readable media includes any of magnetic storage media, including disk and tape storage media; optical storage media, including compact disk memory and digital video disk storage media; nonvolatile memory storage memory; volatile storage media; and data transmission media including computer network, point-to- point telecommunication, and carrier wave transmission media.
32. A computer system comprising: a display device; a processor coupled to the display device; computer readable medium coupled to the processor; and computer code, encoded in the computer readable medium, for generating a graphical user interface, wherein the graphical user interface includes a first plurality of screen objects representing nodes of an optical network, a second plurality of screen objects representing optical links between said nodes, wherein: a first one and a second one of said first plurality of screen objects are highlighted to indicate a source node and a destination node, respectively, and certain ones of said first plurality of screen objects and certain ones of said second plurality of screen objects are highlighted by said computer code to indicate a virtual path selected by said computer code.
33. An optical network comprising: a plurality of optical links; a plurality of nodes, each one of said plurality of nodes coupled to at least one other of said plurality of nodes by at least one of said plurality of optical links, wherein said nodes are configured to provision a virtual path between a first node and a second node of said plurality of nodes by virtue of being configured to: identify said first node and said second node of said plurality of nodes, discover a physical path from said node to said second node by virtue of being configured to automatically identify any intermediary nodes of said physical path, and establish said virtual path by virtue of being configured to configure a set of connections between said nodes of said physical path.
34. An optical network comprising: a plurality of optical links; a plurality of nodes, each one of said plurality of nodes coupled to at least one other of said plurality of nodes by at least one of said plurality of optical links, wherein said nodes are configured to restore a virtual path in said optical network, said virtual path being provisioned on a physical path between a first and a second node of said plurality of nodes by virtue of being configured to: discover an alternate physical path from said first node to said second node by virtue of being configured to automatically identify nodes of said alternate physical path, and re-establish said virtual path by virtue of being configured to configure a set of connections between said nodes of said alternate physical path.
35. A network comprising: a plurality of nodes coupled by a plurality of optical links, wherein said plurality of nodes are configured to provision a virtual path between a first node and a second node of said plurality of nodes, wherein each of said plurality of nodes comprises: identifying means for identifying said first node and said second node of said plurality of nodes, discovering means for discovering a physical path from said node to said second node by automatically identifying any intermediary nodes of said physical path, and establishing means for establishing said virtual path by configuring a set of connections between said nodes of said physical path.
36. The network of claim 35, wherein seaid each one of said plurality of nodes further comprises: restoring means for restoring said virtual path in response to a failure along said physical path comprising: alternate discovering means for discovering an alternate physical path from said first node to said second node by automatically identifying intermediary nodes of said alternate physical path, and re-establishing means for re-establishing said virtual path by configuring a set of connections between said nodes of said alternate physical path.
37. An optical network comprising: a plurality of nodes coupled by a plurality of optical links, wherein said plurality of nodes are configured to restore a virtual path in an optical network, said virtual path being provisioned on a physical path between a first and a second node of said plurality of nodes, wherein each one of said plurality of nodes comprises: discovering means for discovering an alternate physical path from said first node to said second node by automatically identifying nodes of said alternate physical path, and re-establishing means for re-establishing said virtual path by configuring a set of connections between said nodes of said alternate physical path.
PCT/US2000/000971 1999-01-15 2000-01-14 A method for routing information over a network WO2000042746A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU35820/00A AU3582000A (en) 1999-01-15 2000-01-14 A method for routing information over a network

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/232,397 1999-01-15
US09/232,397 US6856627B2 (en) 1999-01-15 1999-01-15 Method for routing information over a network

Publications (1)

Publication Number Publication Date
WO2000042746A1 true WO2000042746A1 (en) 2000-07-20

Family

ID=22872933

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/000971 WO2000042746A1 (en) 1999-01-15 2000-01-14 A method for routing information over a network

Country Status (3)

Country Link
US (11) US6856627B2 (en)
AU (1) AU3582000A (en)
WO (1) WO2000042746A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2815799A1 (en) * 2000-10-23 2002-04-26 Cit Alcatel Method to advise on a specific processing capacity of a node in a telecommunication network
WO2002039484A2 (en) * 2000-11-09 2002-05-16 Telefonaktiebolaget Lm Ericsson (Publ) Intelligent bluetooth inquiry procedure
WO2004068801A1 (en) * 2003-01-30 2004-08-12 International Business Machines Corporation Preemptive retransmission of buffered data in a network
EP1716500A2 (en) * 2004-01-21 2006-11-02 Cisco Technology, Inc. System and method for controlling the flooding of information in a network environment
CN106664214A (en) * 2015-04-17 2017-05-10 华为技术有限公司 Failure recovery method and device for virtual network

Families Citing this family (399)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6606297B1 (en) 1998-05-29 2003-08-12 Tellabs Operations, Inc. Bi-directional ring network having minimum spare bandwidth allocation and corresponding connection admission control
US6487600B1 (en) * 1998-09-12 2002-11-26 Thomas W. Lynch System and method for supporting multimedia communications upon a dynamically configured member network
US6724757B1 (en) * 1999-01-15 2004-04-20 Cisco Technology, Inc. Configurable network router
US6856627B2 (en) * 1999-01-15 2005-02-15 Cisco Technology, Inc. Method for routing information over a network
US6631134B1 (en) * 1999-01-15 2003-10-07 Cisco Technology, Inc. Method for allocating bandwidth in an optical network
US7200110B1 (en) * 1999-03-24 2007-04-03 Alcatel Canada Inc. Method and apparatus for prioritized release of connections in a communications network
US6980524B1 (en) * 1999-05-20 2005-12-27 Polytechnic University Methods and apparatus for routing in a mobile ad hoc network
US6707815B1 (en) * 1999-07-02 2004-03-16 Cisco Technology, Inc. Minimum bandwidth guarantee for input-buffered packet switch
US7457233B1 (en) * 1999-07-15 2008-11-25 Juniper Networks, Inc. Method and apparatus for fast reroute in a connection-oriented network
US6947376B1 (en) * 1999-10-21 2005-09-20 At&T Corp. Local information-based restoration arrangement
US6366561B1 (en) * 1999-11-03 2002-04-02 Qualcomm Inc. Method and apparatus for providing mobility within a network
US8199646B1 (en) 1999-12-07 2012-06-12 Nortel Networks Limited System, device, and method for distributing link state information in a communication network
US7577958B1 (en) * 1999-12-09 2009-08-18 Nortel Networks Limited Expediting an operation in a computer system
US7266617B1 (en) * 2000-01-18 2007-09-04 Apple Inc. Method and apparatus for border node behavior on a full-duplex bus
US8396950B1 (en) * 2000-03-02 2013-03-12 Rockstar Consortium Us Lp Method and apparatus for the fast detection of connectivity loss between devices in a network
US20140211604A1 (en) * 2013-01-31 2014-07-31 Rockstar Consortium Us Lp Method and Apparatus for the Fast Detection of Connectivity Loss Between Devices in a Network
US7916723B2 (en) * 2000-03-03 2011-03-29 Adtran, Inc. Automatic network topology identification by nodes in the network
US7545755B2 (en) * 2000-03-03 2009-06-09 Adtran Inc. Routing switch detecting change in session identifier before reconfiguring routing table
US6795403B1 (en) * 2000-03-31 2004-09-21 Cisco Technology, Inc. Automatic discovery of switch devices in a network
US7190896B1 (en) * 2000-05-04 2007-03-13 Nortel Networks Limited. Supervisory control plane over wavelength routed networks
WO2001091022A2 (en) * 2000-05-19 2001-11-29 Enron Broadband Services, Inc. Commodity trading of bandwidth
US7120119B2 (en) * 2000-06-08 2006-10-10 International Business Machines Corporation Management of protocol information in PNNI hierarchical networks
US6862430B1 (en) * 2000-07-05 2005-03-01 Echelon Corporation System and method for selecting repeaters
JP3654158B2 (en) * 2000-08-09 2005-06-02 日本電気株式会社 Packet transfer path control apparatus and packet transfer path control method used therefor
US6914912B1 (en) * 2000-08-11 2005-07-05 Nortel Networks Limited Route selection for alternate paths in connection-oriented networks
US7840692B1 (en) * 2000-08-15 2010-11-23 Ciena Corporation System, device, and method for bandwidth management in an optical communication system
US6823381B1 (en) * 2000-08-17 2004-11-23 Trendium, Inc. Methods, systems and computer program products for determining a point of loss of data on a communication network
US7031288B2 (en) * 2000-09-12 2006-04-18 Sri International Reduced-overhead protocol for discovering new neighbor nodes and detecting the loss of existing neighbor nodes in a network
US8677016B1 (en) * 2000-10-16 2014-03-18 Packet Design, Llc System and method for identifying network topology information
US7756032B2 (en) 2000-10-17 2010-07-13 Avaya Inc. Method and apparatus for communicating data within measurement traffic
AU2002213287A1 (en) 2000-10-17 2002-04-29 Routescience Technologies Inc Method and apparatus for performance and cost optimization in an internetwork
US7720959B2 (en) * 2000-10-17 2010-05-18 Avaya Inc. Method and apparatus for characterizing the quality of a network path
US7487237B2 (en) * 2000-10-17 2009-02-03 Avaya Technology Corp. Load optimization
US7349994B2 (en) 2000-10-17 2008-03-25 Avaya Technology Corp. Method and apparatus for coordinating routing parameters via a back-channel communication medium
US8023421B2 (en) 2002-07-25 2011-09-20 Avaya Inc. Method and apparatus for the assessment and optimization of network traffic
KR100657120B1 (en) * 2000-11-04 2006-12-12 주식회사 케이티 A Method for Routing for Balancing Load in Packet-Switched network
US7583796B2 (en) * 2000-11-30 2009-09-01 Fujitsu Limited Apparatus and method for generating a data distribution route
US7234001B2 (en) * 2000-12-20 2007-06-19 Nortel Networks Limited Dormant backup link for OSPF network protection
US7203768B2 (en) * 2000-12-22 2007-04-10 Intel Corporation Managing network traffic using hashing functions
NO20006691L (en) * 2000-12-29 2002-07-01 Ericsson Telefon Ab L M Controlled remote end handling by equipment failure in an MSP1 + 1 single-directional configuration
DE60111083T2 (en) * 2001-01-04 2006-05-04 International Business Machines Corp. MANAGEMENT OF PROTOCOL INFORMATION IN HERNARCH PNNI NETWORKS
US7068663B1 (en) * 2001-01-23 2006-06-27 Cisco Technology, Inc. Path routing and provisioning method and apparatus
GB0102349D0 (en) * 2001-01-30 2001-03-14 Marconi Comm Ltd Partially interconnected networks
GB0102348D0 (en) * 2001-01-30 2001-03-14 Marconi Comm Ltd Partially interconnected networks
US20020131418A1 (en) * 2001-03-14 2002-09-19 Michael Raftelis Method and apparatus for establishing a path identifier in a communication network
US7130926B1 (en) * 2001-03-29 2006-10-31 Nortel Networks Limited Control plane failure recovery in a network
US20030009598A1 (en) * 2001-04-12 2003-01-09 Gunluk Oktay Necip Method for designing demand-sensitive rings
US7068595B2 (en) * 2001-04-13 2006-06-27 Sun Microsystems, Inc. Method and apparatus for facilitating instant failover during packet routing
US7110364B1 (en) * 2001-04-19 2006-09-19 Fujitsu Limited Optical link adjacency discovery protocol and an optical network therefor
US7174387B1 (en) * 2001-04-26 2007-02-06 Cisco Technology Inc. Methods and apparatus for requesting link state information
US7308198B1 (en) 2001-05-16 2007-12-11 Tellabs Operations, Inc. Method for allocating protection bandwidth in a telecommunications mesh network
US7477594B2 (en) * 2001-05-16 2009-01-13 Cisco Technology, Inc. Method for restoring a virtual path in an optical network using 1:N protection
US7860024B1 (en) * 2001-05-21 2010-12-28 At&T Intellectual Property Ii, L.P. Network monitoring method and system
US7200120B1 (en) * 2001-05-21 2007-04-03 At&T Corp. Packet-switched network topology tracking method and system
FI115271B (en) * 2001-05-28 2005-03-31 Nokia Corp Procedure and system for implementing a rapid rescue process in a local area network
US7031253B1 (en) * 2001-06-01 2006-04-18 Cisco Technology, Inc. Method and apparatus for computing a path through specified elements in a network
US6975588B1 (en) 2001-06-01 2005-12-13 Cisco Technology, Inc. Method and apparatus for computing a path through a bidirectional line switched
US6590868B2 (en) * 2001-06-02 2003-07-08 Redback Networks Inc. Method and apparatus for restart communication between network elements
US7359377B1 (en) * 2001-06-19 2008-04-15 Juniper Networks, Inc. Graceful restart for use in nodes employing label switched path signaling protocols
US6904462B1 (en) * 2001-07-06 2005-06-07 Ciena Corporation Method and system for allocating protection path resources
US8762568B1 (en) 2001-07-06 2014-06-24 Cisco Technology, Inc. Method and apparatus for inter-zone restoration
US7536546B2 (en) * 2001-08-28 2009-05-19 Acme Packet, Inc. System and method for providing encryption for rerouting of real time multi-media flows
US7362707B2 (en) * 2001-07-23 2008-04-22 Acme Packet, Inc. System and method for determining flow quality statistics for real-time transport protocol data flows
US7031311B2 (en) * 2001-07-23 2006-04-18 Acme Packet, Inc. System and method for providing rapid rerouting of real-time multi-media flows
US6950427B1 (en) * 2001-08-09 2005-09-27 Cisco Technology, Inc. Technique for resynchronizing LSDB in OSPF after a software reload in a non-stop forwarding intermediate node of a computer network
US7065059B1 (en) * 2001-08-09 2006-06-20 Cisco Technology, Inc. Technique for restoring adjacencies in OSPF in a non-stop forwarding intermediate node of a computer network
EP1433076B1 (en) * 2001-08-30 2017-10-25 Cisco Technology, Inc. Protecting against distributed denial of service attacks
US20030048501A1 (en) * 2001-09-12 2003-03-13 Michael Guess Metropolitan area local access service system
US7127180B1 (en) * 2001-09-14 2006-10-24 Nortel Networks Limited System, device, and method for supporting cut-through paths in an optical communication system
EP1436957B1 (en) * 2001-10-17 2017-07-05 BRITISH TELECOMMUNICATIONS public limited company Network location management system
US8532127B2 (en) * 2001-10-19 2013-09-10 Juniper Networks, Inc. Network routing using indirect next hop data
US7203162B2 (en) * 2001-10-30 2007-04-10 Lucent Technologies Inc. Link state retransmission mechanism
US7580349B1 (en) * 2001-11-02 2009-08-25 Nortel Networks Limited Content-aware dynamic network resource allocation
US20030088620A1 (en) * 2001-11-05 2003-05-08 Microsoft Corporation Scaleable message dissemination system and method
US7042850B2 (en) * 2001-11-09 2006-05-09 Fujitsu Limited Focused link state advertisements
US7187648B1 (en) * 2001-11-26 2007-03-06 Ranch Networks, Inc. Redundancy in packet routing devices
US20030101253A1 (en) * 2001-11-29 2003-05-29 Takayuki Saito Method and system for distributing data in a network
US7325069B1 (en) * 2001-12-07 2008-01-29 Cisco Technology, Inc. Method of establishing bi-directional connectivity of a network element in a network
US7013348B1 (en) * 2001-12-21 2006-03-14 Nortel Networks Limited Switch subtending in a synchronous transmission system
US7168612B2 (en) * 2001-12-24 2007-01-30 Axalto Inc Method and apparatus for processing transactions in a data processing system
US7146000B2 (en) * 2002-01-25 2006-12-05 Level (3) Communications Routing engine for telecommunications network
JP3823837B2 (en) * 2002-01-31 2006-09-20 日本電気株式会社 Optical communication network and optical communication network design method used therefor
US7983182B2 (en) 2002-02-01 2011-07-19 Tellabs Operations, Inc. Methods and apparatus for exchanging network connectivity and capability information
US7889675B2 (en) 2003-01-31 2011-02-15 Tellabs Operations, Inc. Method and system for multi-layer network routing
EP1470679B1 (en) 2002-02-01 2010-11-24 Tellabs Operations, Inc. Method and apparatus for multi-layer network in sonet /sdh
US6918063B2 (en) * 2002-02-04 2005-07-12 International Business Machines Corporation System and method for fault tolerance in multi-node system
JP2003284114A (en) * 2002-03-20 2003-10-03 Nec Corp Wireless transmission apparatus, path control method used therefor, and program thereof
AU2003220600A1 (en) * 2002-03-27 2003-10-13 Uraxs Communications, Inc. Remote ultrawide band communication system with short messaging and other functions
US7117257B2 (en) * 2002-03-28 2006-10-03 Nortel Networks Ltd Multi-phase adaptive network configuration
KR100474677B1 (en) * 2002-04-18 2005-03-08 삼성전자주식회사 Method for detecting failure of routing protocol module in distributed architecture router
GB2388745A (en) * 2002-04-30 2003-11-19 Hewlett Packard Co Mobile communication system with service quality feedback
ITTO20020441A1 (en) * 2002-05-24 2003-11-24 Telecom Italia Lab Spa METHOD FOR DETERMINING THE INSTALLATION OF MINIMUM COST FOR THE EQUIPMENT OF A FIXED TELECOMMUNICATION NETWORK.
CN1192564C (en) * 2002-06-06 2005-03-09 华为技术有限公司 Method for opening grouping updating of fifth group link state notice of shortest route priority procotol
JP4009494B2 (en) * 2002-06-17 2007-11-14 富士通株式会社 Protection control method and RPR device in communication network
US7289450B2 (en) * 2002-06-25 2007-10-30 Lucent Technologies Inc. Flood signaling architecture and process for provisioning communication paths
US8675493B2 (en) * 2002-07-02 2014-03-18 Alcatel Lucent Routing bandwidth guaranteed paths with local restoration in label switched networks
US20040027384A1 (en) * 2002-08-12 2004-02-12 Gilbert Levesque End-to-end tracing of wavelength parameters in a wavelength division multiplexing span of a fiber optic network
US7031304B1 (en) * 2002-09-11 2006-04-18 Redback Networks Inc. Method and apparatus for selective packet Mirroring
CN100459534C (en) * 2002-10-07 2009-02-04 日本电信电话株式会社 Layer network node and network constituted throuth said nodes, the node and layer network thereof
US8199636B1 (en) * 2002-10-18 2012-06-12 Alcatel Lucent Bridged network system with traffic resiliency upon link failure
CN1254052C (en) * 2002-11-02 2006-04-26 华为技术有限公司 Transmission network restraint path calculating method
US7289520B2 (en) * 2002-11-20 2007-10-30 Hewlett-Packard Development Company, L.P. Method, apparatus, and system for expressway routing among peers
ATE297627T1 (en) * 2002-12-09 2005-06-15 Ericsson Telefon Ab L M METHOD FOR OPTIMIZING THE DISTRIBUTION OF A SERVICE FROM A SOURCE TO MULTIPLE SERVICE RECIPIENTS IN A NETWORK
US7242671B2 (en) * 2002-12-11 2007-07-10 Itt Manufacturing Enterprises, Inc. System and method for link-state based proxy flooding of messages in a network
US7561526B2 (en) * 2002-12-17 2009-07-14 Nortel Networks Limited Communication network route determination
US7653059B1 (en) * 2002-12-20 2010-01-26 Symantec Operating Corporation Communication sessions for a computer network
US7164888B2 (en) * 2002-12-23 2007-01-16 Qwest Communications International Inc. Systems and methods for analyzing critical circuits and associated telecommunication resources
US7469282B2 (en) 2003-01-21 2008-12-23 At&T Intellectual Property I, L.P. Method and system for provisioning and maintaining a circuit in a data network
US7379444B2 (en) * 2003-01-27 2008-05-27 International Business Machines Corporation Method to recover from node failure/recovery incidents in distributed systems in which notification does not occur
US8015266B1 (en) * 2003-02-07 2011-09-06 Netapp, Inc. System and method for providing persistent node names
GB2398684A (en) * 2003-02-22 2004-08-25 Alps Electric Optical line of sight (LOS) mesh network
US7457286B2 (en) * 2003-03-31 2008-11-25 Applied Micro Circuits Corporation Accelerating the shortest path problem
US8867333B2 (en) 2003-03-31 2014-10-21 Alcatel Lucent Restoration path calculation considering shared-risk link groups in mesh networks
US7689693B2 (en) * 2003-03-31 2010-03-30 Alcatel-Lucent Usa Inc. Primary/restoration path calculation in mesh networks based on multiple-cost criteria
US8296407B2 (en) * 2003-03-31 2012-10-23 Alcatel Lucent Calculation, representation, and maintenance of sharing information in mesh networks
US7646706B2 (en) * 2003-03-31 2010-01-12 Alcatel-Lucent Usa Inc. Restoration time in mesh networks
US7643408B2 (en) * 2003-03-31 2010-01-05 Alcatel-Lucent Usa Inc. Restoration time in networks
US7606237B2 (en) * 2003-03-31 2009-10-20 Alcatel-Lucent Usa Inc. Sharing restoration path bandwidth in mesh networks
US7451340B2 (en) * 2003-03-31 2008-11-11 Lucent Technologies Inc. Connection set-up extension for restoration path establishment in mesh networks
US7545736B2 (en) * 2003-03-31 2009-06-09 Alcatel-Lucent Usa Inc. Restoration path calculation in mesh networks
JP4080366B2 (en) * 2003-04-01 2008-04-23 シャープ株式会社 Network terminal, network system, and network terminal control method
US8103753B2 (en) * 2003-04-22 2012-01-24 Microsoft Corporation Distributing membership information for multi-party application layer sessions
DE60307230T2 (en) * 2003-04-22 2007-07-05 Alcatel Lucent A method of using total resource capacity in an SDH network with an antiskid mechanism, in the presence of a packet-oriented data network, and associated apparatus for performing the method
US7433597B2 (en) * 2003-04-28 2008-10-07 The Hong Kong Polytechnic University Deflection routing address method for all-optical packet-switched networks with arbitrary topologies
US7415472B2 (en) * 2003-05-13 2008-08-19 Cisco Technology, Inc. Comparison tree data structures of particular use in performing lookup operations
US7415463B2 (en) * 2003-05-13 2008-08-19 Cisco Technology, Inc. Programming tree data structures and handling collisions while performing lookup operations
US7313087B2 (en) * 2003-06-20 2007-12-25 Ericsson Ab Distributed protection switching
DE10334632A1 (en) * 2003-07-29 2005-03-03 Siemens Ag Method for fast fault detection in IP networks
US7336617B1 (en) * 2003-08-01 2008-02-26 Verizon Laboratories Inc. Bit-field-encoded resource record for determining a transmission path in a communications network
US7602726B1 (en) * 2003-08-11 2009-10-13 Cisco Technology, Inc. Method and system for optimizing link aggregation usage during failures
US20050047353A1 (en) * 2003-08-25 2005-03-03 Susan Hares Systems and methods for routing employing link state and path vector techniques
US7386606B2 (en) * 2003-09-12 2008-06-10 Microsoft Corporation Self-organizing overlay networks
US8554947B1 (en) * 2003-09-15 2013-10-08 Verizon Laboratories Inc. Network data transmission systems and methods
US8150998B2 (en) * 2003-09-25 2012-04-03 Alcatel Lucent System and method for increasing optimal alternative network route convergence speed and border gateway router incorporating the same
GB0322494D0 (en) * 2003-09-25 2003-10-29 British Telecomm Computer networks
GB0322491D0 (en) * 2003-09-25 2003-10-29 British Telecomm Virtual networks
US20050097196A1 (en) * 2003-10-03 2005-05-05 Wronski Leszek D. Network status messaging
DE60314883T2 (en) * 2003-10-09 2008-04-10 Alcatel Lucent Method and frame signal for in-band detection and localization of a path failure in an SDH / SONET network domain
US7551552B2 (en) 2003-10-17 2009-06-23 Microsoft Corporation Method for providing guaranteed distributed failure notification
US7221870B2 (en) * 2003-10-21 2007-05-22 Futurewei Technologies, Inc. Ring map discovery and validation method and system for optical network applications
US8099481B2 (en) * 2003-12-16 2012-01-17 Alcatel Lucent System and method for resolving hubs and like devices in network topology
US7580418B2 (en) * 2003-12-17 2009-08-25 Nec Corporation Network, router device, route updating suppression method used for the same, and program thereof
US8203933B2 (en) * 2003-12-23 2012-06-19 At&T Intellectual Property I, L.P. Method and system for automatically identifying a logical circuit failure in a data network
US8223632B2 (en) 2003-12-23 2012-07-17 At&T Intellectual Property I, L.P. Method and system for prioritized rerouting of logical circuit data in a data network
US7646707B2 (en) 2003-12-23 2010-01-12 At&T Intellectual Property I, L.P. Method and system for automatically renaming logical circuit identifiers for rerouted logical circuits in a data network
US8218550B2 (en) * 2003-12-23 2012-07-10 Telefonaktiebolaget Lm Ericsson (Publ) Method and system for routing traffic in ad hoc networks
US8199638B2 (en) 2003-12-23 2012-06-12 At&T Intellectual Property I, L.P. Method and system for automatically rerouting logical circuit data in a data network
US7609623B2 (en) 2003-12-23 2009-10-27 At&T Intellectual Property I, L.P. Method and system for automatically rerouting data from an overbalanced logical circuit in a data network
US7639623B2 (en) 2003-12-23 2009-12-29 At&T Intellectual Property I, L.P. Method and system for real time simultaneous monitoring of logical circuits in a data network
US7639606B2 (en) * 2003-12-23 2009-12-29 At&T Intellectual Property I, L.P. Method and system for automatically rerouting logical circuit data in a virtual private network
WO2005062554A1 (en) * 2003-12-23 2005-07-07 Telefonaktiebolaget Lm Ericsson (Publ) Method and system for efficient routing in ad hoc networks
WO2005062552A1 (en) * 2003-12-23 2005-07-07 Telefonaktiebolaget Lm Ericsson (Publ) Predictive ad-hoc
JP4398263B2 (en) * 2004-01-13 2010-01-13 富士通株式会社 Route design method
US7420954B2 (en) * 2004-01-13 2008-09-02 General Motors Corporation Efficient lightweight information dissemination algorithm for mobile wireless ad hoc networks
US7697454B2 (en) * 2004-01-14 2010-04-13 Avaya, Inc. Method and apparatus for controlling the dissemination of routing information on a communication network
US20050240797A1 (en) * 2004-01-23 2005-10-27 Fredrik Orava Restoration mechanism for network topologies
KR100555749B1 (en) * 2004-01-27 2006-03-03 삼성전자주식회사 Apparatus and method for data transmission path setting in ad-hoc network
US7225117B1 (en) * 2004-02-05 2007-05-29 Cisco Technology, Inc. Method for generating a simulated network using a graphical user interface
KR100612447B1 (en) * 2004-02-16 2006-08-16 삼성전자주식회사 Method for management of network information in access router and the same
US20050249215A1 (en) * 2004-02-19 2005-11-10 Kelsey Richard A Directing packets in a mesh network
JP2005236767A (en) * 2004-02-20 2005-09-02 Ntt Docomo Inc Communication apparatus, repeater, communication system, and communicating method
US7940648B1 (en) * 2004-03-02 2011-05-10 Cisco Technology, Inc. Hierarchical protection switching framework
US8111612B2 (en) 2004-04-02 2012-02-07 Alcatel Lucent Link-based recovery with demand granularity in mesh networks
US7500013B2 (en) * 2004-04-02 2009-03-03 Alcatel-Lucent Usa Inc. Calculation of link-detour paths in mesh networks
US20050226212A1 (en) * 2004-04-02 2005-10-13 Dziong Zbigniew M Loop avoidance for recovery paths in mesh networks
US7418376B1 (en) * 2004-04-08 2008-08-26 Cisco Systems, Inc. Method for generating a simulated network based on an actual managed network
US7460468B2 (en) 2004-04-22 2008-12-02 At&T Intellectual Property I, L.P. Method and system for automatically tracking the rerouting of logical circuit data in a data network
US7466646B2 (en) 2004-04-22 2008-12-16 At&T Intellectual Property I, L.P. Method and system for automatically rerouting logical circuit data from a logical circuit failure to dedicated backup circuit in a data network
US7768904B2 (en) * 2004-04-22 2010-08-03 At&T Intellectual Property I, L.P. Method and system for fail-safe renaming of logical circuit identifiers for rerouted logical circuits in a data network
US8339988B2 (en) 2004-04-22 2012-12-25 At&T Intellectual Property I, L.P. Method and system for provisioning logical circuits for intermittent use in a data network
US9210073B2 (en) * 2004-04-30 2015-12-08 Hewlett-Packard Development Company, L.P. System and method for message routing in a network
US7627627B2 (en) 2004-04-30 2009-12-01 Hewlett-Packard Development Company, L.P. Controlling command message flow in a network
US7440458B2 (en) * 2004-04-30 2008-10-21 Hewlett-Packard Development Company, L.P. System for determining network route quality using sequence numbers
US7801029B2 (en) * 2004-04-30 2010-09-21 Hewlett-Packard Development Company, L.P. System for selecting routes for retransmission in a network
US8090806B1 (en) * 2004-06-10 2012-01-03 Cisco Technology, Inc. Two-stage network device configuration process
US8149731B2 (en) * 2004-06-24 2012-04-03 Cisco Technology, Inc. Technique for transferring data over a packet switched network
WO2006003241A1 (en) * 2004-06-30 2006-01-12 Nokia Corporation Failure detection of path information corresponding to a transmission path
US8179784B2 (en) * 2004-07-16 2012-05-15 Hewlett-Packard Development Company, L.P. Method and apparatus for recovering a communications connection
US7525981B2 (en) * 2004-07-19 2009-04-28 Ciena Corporation Glare resolution
US7391730B1 (en) * 2004-07-21 2008-06-24 Cisco Technology System and method for synchronizing link state databases in a network environment
WO2006029399A2 (en) * 2004-09-09 2006-03-16 Avaya Technology Corp. Methods of and systems for network traffic security
WO2006035265A1 (en) * 2004-09-29 2006-04-06 Telefonaktiebolaget L M Ericsson (Publ) Maintaining a view of a cluster's membership
JP4345972B2 (en) * 2004-10-08 2009-10-14 富士通株式会社 Network control method, transmission apparatus, and program
US20060087964A1 (en) * 2004-10-21 2006-04-27 International Business Machines Corporation Method and apparatus for switching among different network paths while suppressing ghost packets
US8098571B2 (en) * 2004-10-28 2012-01-17 Alcatel Lucent Stack manager protocol with automatic set up mechanism
US7756009B1 (en) * 2004-11-01 2010-07-13 Ciena Corporation Method and apparatus for priority call setup and restoration in an optical communications system
US8549176B2 (en) 2004-12-01 2013-10-01 Cisco Technology, Inc. Propagation of routing information in RSVP-TE for inter-domain TE-LSPs
US7583593B2 (en) * 2004-12-01 2009-09-01 Cisco Technology, Inc. System and methods for detecting network failure
US20060140123A1 (en) * 2004-12-29 2006-06-29 Intel Corporation Methods and apparatus for distributing link-state information associated with a wireless mesh network
US20060168320A1 (en) * 2004-12-30 2006-07-27 Kidd Nelson F Network topology discovery service
US9306831B2 (en) * 2005-02-14 2016-04-05 Cisco Technology, Inc. Technique for efficient load balancing of TE-LSPs
US7940652B1 (en) 2005-02-14 2011-05-10 Brixham Solutions Ltd. Pseudowire protection using a standby pseudowire
US7519700B1 (en) * 2005-02-18 2009-04-14 Opnet Technologies, Inc. Method and system for topological navigation of hierarchical data groups
US7990888B2 (en) * 2005-03-04 2011-08-02 Cisco Technology, Inc. System and methods for network reachability detection
US20060215673A1 (en) * 2005-03-11 2006-09-28 Interdigital Technology Corporation Mesh network configured to autonomously commission a network and manage the network topology
JP2006262391A (en) * 2005-03-18 2006-09-28 Fujitsu Ltd Packet transmission method and station device in packet type network
JP4687176B2 (en) * 2005-03-22 2011-05-25 富士通株式会社 Packet relay device
US20060215577A1 (en) * 2005-03-22 2006-09-28 Guichard James N System and methods for identifying network path performance
US20060215567A1 (en) * 2005-03-25 2006-09-28 Arun Raghunath Method and apparatus for monitoring path statistics
JP4760101B2 (en) * 2005-04-07 2011-08-31 ソニー株式会社 Content providing system, content reproducing apparatus, program, and content reproducing method
US7606175B1 (en) * 2005-04-15 2009-10-20 Nvidia Corporation Extended service set mesh path selection
US7835301B1 (en) 2005-04-15 2010-11-16 Nvidia Corporation Extended service set mesh topology representation
WO2006119454A1 (en) * 2005-05-04 2006-11-09 Mediacell Licensing Corp Enclosure with ground plane
US20060268879A1 (en) * 2005-05-11 2006-11-30 Texas Instruments Incorporated Quality of service aware robust link state routing for mesh networks
EP1891554A4 (en) * 2005-05-19 2011-10-19 Texas Instruments Inc Routing switch for parameterized routing in mesh networks
US20060268679A1 (en) * 2005-05-25 2006-11-30 Mei Deng Local information-based restoration arrangement
US7586841B2 (en) 2005-05-31 2009-09-08 Cisco Technology, Inc. System and method for protecting against failure of a TE-LSP tail-end node
CN101189837B (en) * 2005-05-31 2015-05-06 日本电气株式会社 Packet ring network system, packet transfer method, and node
US7995464B1 (en) * 2005-06-27 2011-08-09 At&T Intellectual Property Ii, L.P. Method and apparatus for measuring quality of service levels
US9160658B1 (en) 2005-07-12 2015-10-13 Brixham Solutions Ltd. Proxies for pseudo-wire allocation and distribution
US7515544B2 (en) * 2005-07-14 2009-04-07 Tadaaki Chigusa Method and system for providing location-based addressing
WO2007011632A1 (en) * 2005-07-14 2007-01-25 Sandwave Ip, Llc Virtual cells for wireless networks
CN100369419C (en) * 2005-07-14 2008-02-13 广东省电信有限公司研究院 Method for realizing connected reinforced main-apparatus protection in automatic exchange optical network
US20070014230A1 (en) * 2005-07-14 2007-01-18 Fujitsu Limited Automatically provisioning a network element
EP1746784A1 (en) * 2005-07-22 2007-01-24 Siemens Aktiengesellschaft Ethernet ring protection-resource usage optimisation methods
US7760738B1 (en) * 2005-07-28 2010-07-20 Verizon Services Corp. Admission control for services
CN100362810C (en) * 2005-07-28 2008-01-16 华为技术有限公司 Method for implementing fast switching of virtual special LAN service
US7903662B2 (en) * 2005-07-28 2011-03-08 Cisco Technology, Inc. Virtual concatenation sequence mismatch defect detection
US7787361B2 (en) * 2005-07-29 2010-08-31 Cisco Technology, Inc. Hybrid distance vector protocol for wireless mesh networks
US7995461B2 (en) * 2005-08-24 2011-08-09 Cisco Technology, Inc. Efficient constrained shortest path first optimization technique
US7624447B1 (en) 2005-09-08 2009-11-24 Cisco Technology, Inc. Using threshold lists for worm detection
US7660318B2 (en) * 2005-09-20 2010-02-09 Cisco Technology, Inc. Internetworking support between a LAN and a wireless mesh network
JP4704171B2 (en) * 2005-09-30 2011-06-15 富士通株式会社 COMMUNICATION SYSTEM, TRANSMISSION DEVICE, AND RESERVED BAND SETTING METHOD
US8588061B2 (en) 2005-10-07 2013-11-19 Brixham Solutions Ltd. Application wire
US7974185B2 (en) * 2005-10-18 2011-07-05 Wipro Limited Three fiber line switched ring
US20070110024A1 (en) * 2005-11-14 2007-05-17 Cisco Technology, Inc. System and method for spanning tree cross routes
EP1956764A1 (en) * 2005-11-24 2008-08-13 NEC Corporation Communication system, communication device, and method for controlling transmission line thereof
US7693047B2 (en) * 2005-11-28 2010-04-06 Cisco Technology, Inc. System and method for PE-node protection
US7845016B2 (en) * 2005-11-28 2010-11-30 Cisco Technology, Inc. Methods and apparatus for verifying modules from approved vendors
US7818340B1 (en) * 2005-12-01 2010-10-19 Peter Warren Computer-implemented method and system for enabling network communication using sponsored chat links
US8732186B2 (en) 2005-12-01 2014-05-20 Peter Warren Computer-implemented method and system for enabling communication between networked users based on common characteristics
US7894447B2 (en) 2005-12-06 2011-02-22 Lippershy Celestial Llc Digital object routing
US9686183B2 (en) 2005-12-06 2017-06-20 Zarbaña Digital Fund Llc Digital object routing based on a service request
US7720073B2 (en) * 2005-12-06 2010-05-18 Shabbir Khan System and/or method for bidding
US20070130046A1 (en) * 2005-12-06 2007-06-07 Shabbir Khan Quality of service for transmission of digital content
US8055897B2 (en) * 2005-12-06 2011-11-08 Lippershy Celestial Llc Digital object title and transmission information
US8014389B2 (en) 2005-12-06 2011-09-06 Lippershy Celestial Llc Bidding network
US8194701B2 (en) 2005-12-06 2012-06-05 Lippershy Celestial Llc System and/or method for downstream bidding
US7983174B1 (en) 2005-12-19 2011-07-19 Cisco Technology, Inc. Method and apparatus for diagnosing a fault in a network path
JP4659611B2 (en) * 2005-12-28 2011-03-30 富士通株式会社 Path protection method and layer 2 switch
US20070155403A1 (en) * 2005-12-30 2007-07-05 Mediacell Licensing Corp Rogue Detection Using Geophysical Information
US20070167171A1 (en) * 2005-12-30 2007-07-19 Mediacell Licensing Corp Determining the Location of a Device Having Two Communications Connections
US8504678B2 (en) * 2005-12-30 2013-08-06 Sandwave Ip, Llc Traffic routing based on geophysical location
US8406220B2 (en) * 2005-12-30 2013-03-26 Honeywell International Inc. Method and system for integration of wireless devices with a distributed control system
CN100413258C (en) * 2006-01-09 2008-08-20 华为技术有限公司 Pre-alarming method
US7912934B1 (en) 2006-01-09 2011-03-22 Cisco Technology, Inc. Methods and apparatus for scheduling network probes
US8441919B2 (en) 2006-01-18 2013-05-14 Cisco Technology, Inc. Dynamic protection against failure of a head-end node of one or more TE-LSPs
JP4583312B2 (en) * 2006-01-30 2010-11-17 富士通株式会社 Communication status determination method, communication status determination system, and determination device
US8072879B2 (en) 2006-02-03 2011-12-06 Cisco Technology, Inc. Technique for determining whether to reestablish fast rerouted primary tunnels based on backup tunnel path quality feedback
US8693308B2 (en) 2006-02-10 2014-04-08 Aviat U.S., Inc. System and method for resilient wireless packet communications
ITTO20060149A1 (en) * 2006-03-01 2007-09-02 Cisco Tech Inc TECHNIQUE FOR THE OPTIMIZED FLOW OF DATA FLOWS ON AN IP DORSAL IN A COMPUTER NETWORK.
US8582498B2 (en) * 2006-03-07 2013-11-12 Sandwave Ip, Llc Service subscription using geophysical location
US8036213B1 (en) 2006-03-30 2011-10-11 Cisco Technology, Inc. System and method for enhancing network stability by selectively controlling adjacency formation
US8886831B2 (en) * 2006-04-05 2014-11-11 Cisco Technology, Inc. System and methodology for fast link failover based on remote upstream failures
CN101047700B (en) * 2006-05-01 2010-05-12 华为技术有限公司 Method and device for raising reliability of LMP control channel
US20070258445A1 (en) * 2006-05-02 2007-11-08 Harris Corporation Systems and methods for protocol filtering for quality of service
US7756134B2 (en) * 2006-05-02 2010-07-13 Harris Corporation Systems and methods for close queuing to support quality of service
JP5065618B2 (en) * 2006-05-16 2012-11-07 株式会社日立製作所 Memory module
US8295162B2 (en) * 2006-05-16 2012-10-23 At&T Intellectual Property I, L.P. System and method to achieve sub-second routing performance
US7894509B2 (en) 2006-05-18 2011-02-22 Harris Corporation Method and system for functional redundancy based quality of service
US8208372B2 (en) * 2006-06-02 2012-06-26 Cisco Technology, Inc. Technique for fast activation of a secondary head-end node TE-LSP upon failure of a primary head-end node TE-LSP
US20070291656A1 (en) * 2006-06-16 2007-12-20 Harris Corporation Method and system for outbound content-based QoS
US20070291768A1 (en) * 2006-06-16 2007-12-20 Harris Corporation Method and system for content-based differentiation and sequencing as a mechanism of prioritization for QOS
US7856012B2 (en) * 2006-06-16 2010-12-21 Harris Corporation System and methods for generic data transparent rules to support quality of service
US8064464B2 (en) * 2006-06-16 2011-11-22 Harris Corporation Method and system for inbound content-based QoS
US8516153B2 (en) * 2006-06-16 2013-08-20 Harris Corporation Method and system for network-independent QoS
US7990860B2 (en) * 2006-06-16 2011-08-02 Harris Corporation Method and system for rule-based sequencing for QoS
US7916626B2 (en) * 2006-06-19 2011-03-29 Harris Corporation Method and system for fault-tolerant quality of service
US8730981B2 (en) * 2006-06-20 2014-05-20 Harris Corporation Method and system for compression based quality of service
US20070291765A1 (en) * 2006-06-20 2007-12-20 Harris Corporation Systems and methods for dynamic mode-driven link management
US7769028B2 (en) * 2006-06-21 2010-08-03 Harris Corporation Systems and methods for adaptive throughput management for event-driven message-based data
US20080008137A1 (en) * 2006-07-05 2008-01-10 Motorola, Inc. Method and system of communication among a plurality of mobile nodes
US7986640B2 (en) 2006-07-05 2011-07-26 Cisco Technology, Inc. Technique for efficiently determining acceptable link-based loop free alternates in a computer network
ATE418228T1 (en) * 2006-07-20 2009-01-15 Alcatel Lucent DISTRIBUTED ATTENDANCE MANAGEMENT IN PEER-TO-PEER NETWORKS
WO2008011898A1 (en) * 2006-07-27 2008-01-31 Telefonaktiebolaget Lm Ericsson (Publ) Hierarchical broadcast transmission via multiple transmitters
US8300653B2 (en) * 2006-07-31 2012-10-30 Harris Corporation Systems and methods for assured communications with quality of service
US20080025318A1 (en) * 2006-07-31 2008-01-31 Harris Corporation Systems and methods for dynamically customizable quality of service on the edge of a network
US8848711B1 (en) 2006-08-04 2014-09-30 Brixham Solutions Ltd. Global IP-based service-oriented network architecture
US20080127214A1 (en) * 2006-10-05 2008-05-29 Holt John M Contention detection with counter rollover
US7710902B2 (en) * 2006-11-27 2010-05-04 Cisco Technology, Inc. Path diversity for customer-to-customer traffic
US8160096B1 (en) * 2006-12-06 2012-04-17 Tadaaki Chigusa Method and system for reserving bandwidth in time-division multiplexed networks
US9229933B2 (en) * 2006-12-19 2016-01-05 International Business Machines Corporation System, method and program for managing file downloads
US8156557B2 (en) * 2007-01-04 2012-04-10 Cisco Technology, Inc. Protection against reflection distributed denial of service attacks
JP5266258B2 (en) 2007-02-06 2013-08-21 エントロピック・コミュニケーションズ・インコーポレイテッド Layer 2 management entity messaging framework in the network
US20080195586A1 (en) * 2007-02-09 2008-08-14 Sap Ag Ranking search results based on human resources data
CA2623805A1 (en) * 2007-03-02 2008-09-02 Robert A. Hubbs Quality of service based preemptive routing
JP4623030B2 (en) * 2007-03-27 2011-02-02 ブラザー工業株式会社 Tree-type broadcasting system, connection destination determination method, connection management device, connection management processing program, etc.
US7796537B2 (en) * 2007-04-17 2010-09-14 Cisco Technology, Inc. Creating non-transit nodes in a link network
US7756029B2 (en) * 2007-05-24 2010-07-13 Harris Stratex Networks Operating Corporation Dynamic load balancing for layer-2 link aggregation
JP2008301147A (en) * 2007-05-31 2008-12-11 Fujitsu Ltd Transmission apparatus and route verifying method
US8072951B2 (en) * 2007-06-15 2011-12-06 Silver Spring Networks, Inc. Method and system for providing routing protocols in a frequency hopping spread spectrum network
US8130700B2 (en) * 2007-06-15 2012-03-06 Silver Spring Networks, Inc. Method and system for providing network and routing protocols for utility services
US7940669B2 (en) * 2007-06-15 2011-05-10 Silver Spring Networks, Inc. Route and link evaluation in wireless mesh communications networks
US8233905B2 (en) 2007-06-15 2012-07-31 Silver Spring Networks, Inc. Load management in wireless mesh communications networks
JP5061748B2 (en) * 2007-06-21 2012-10-31 日本電気株式会社 Packet ring network system and packet transfer method
US8111627B2 (en) * 2007-06-29 2012-02-07 Cisco Technology, Inc. Discovering configured tunnels between nodes on a path in a data communications network
US7830784B2 (en) * 2007-06-29 2010-11-09 Verizon Patent And Licensing Inc. Intelligent network restoration
US7715417B2 (en) * 2007-07-10 2010-05-11 Avaya Inc. Creating a telecommunications channel from multiple channels that have differing signal-quality guarantees
EP2179367B1 (en) 2007-08-15 2017-10-04 Cisco Technology, Inc. Stream reservation protocol for bridged networks
KR100903217B1 (en) 2007-08-30 2009-06-18 한국전자통신연구원 Apparatus and Method for Protection switching of optical channel
US8280057B2 (en) 2007-09-04 2012-10-02 Honeywell International Inc. Method and apparatus for providing security in wireless communication networks
US8264953B2 (en) 2007-09-06 2012-09-11 Harris Stratex Networks, Inc. Resilient data communications with physical layer link aggregation, extended failure detection and load balancing
US7756038B2 (en) * 2007-09-27 2010-07-13 Cisco Technology, Inc. Service advertisement framework (SAF) in a communications network
CN101425961B (en) * 2007-10-31 2012-04-04 华为技术有限公司 Method for implementing link state database synchronization, router, circuit board and main control board
US8085768B1 (en) 2007-11-01 2011-12-27 Cisco Technology Inc. System and method for managing a list of entries containing routing information
US8670325B1 (en) 2007-11-01 2014-03-11 Cisco Technology, Inc. System and method for providing route information
US8953486B2 (en) * 2007-11-09 2015-02-10 Cisco Technology, Inc. Global auto-configuration of network devices connected to multipoint virtual connections
US8667095B2 (en) * 2007-11-09 2014-03-04 Cisco Technology, Inc. Local auto-configuration of network devices connected to multipoint virtual connections
US7889691B2 (en) * 2007-11-13 2011-02-15 Telcordia Technologies, Inc. Method of broadcasting packets in ad-hoc network
US8370937B2 (en) * 2007-12-03 2013-02-05 Cisco Technology, Inc. Handling of DDoS attacks from NAT or proxy devices
CN101179453B (en) * 2007-12-06 2010-09-29 华为技术有限公司 Link status detecting method and system
US20090147723A1 (en) * 2007-12-07 2009-06-11 Hong Kong Applied Science and Technology Research Institute Company Limited Method and Device for Data Routing and Bandwidth Reservation in Small Scale Distributed Networks
KR100982015B1 (en) * 2007-12-10 2010-09-14 한국전자통신연구원 Method for protection switching of ring network and apparatus thereof
EP3419224B1 (en) * 2008-01-23 2022-01-19 Telefonaktiebolaget LM Ericsson (publ) Selection of an edge node in a fixed access communication network
US8578054B2 (en) 2008-03-07 2013-11-05 Cisco Technology, Inc. Computing disjoint paths for reactive routing mesh networks
GB2458952B (en) * 2008-04-04 2012-06-13 Micron Technology Inc Queue processing method
US8300523B2 (en) * 2008-07-28 2012-10-30 Cisco Technology, Inc. Multi-chasis ethernet link aggregation
US8208407B2 (en) * 2008-08-15 2012-06-26 Cisco Technology, Inc. Optimized flush operation in response to topology changes for spanning tree protocols
US8155026B2 (en) * 2008-09-11 2012-04-10 Verizon Patent And Licensing Inc. Method and system for identifying network paths
US8908502B2 (en) * 2008-10-03 2014-12-09 Nec Corporation Communication system, node device, communication method in the communication system, and program
US8565075B2 (en) * 2008-10-30 2013-10-22 Verizon Patent And Licensing Inc. Method and system for determining alternate paths
US8219706B2 (en) * 2008-11-14 2012-07-10 At&T Intellectual Property I, Lp Interdomain network aware peer-to-peer protocol
US7902973B2 (en) * 2008-11-17 2011-03-08 Cisco Technology, Inc. Alarm reordering to handle alarm storms in large networks
US8078712B2 (en) * 2008-11-26 2011-12-13 Red Hat, Inc. Systems and methods for network command delegation using auto-discovered pathways
WO2010069384A1 (en) * 2008-12-18 2010-06-24 Telefonaktiebolaget Lm Ericsson (Publ) Network node and method for controlling resources in a communication network
JP5459226B2 (en) * 2008-12-26 2014-04-02 日本電気株式会社 Route control device, route control method, route control program, network system
US8064360B2 (en) 2009-01-23 2011-11-22 Empire Technology Development Llc Wireless home network routing protocol
US8320361B2 (en) * 2009-02-27 2012-11-27 Cisco Technology, Inc. Advertising alternate paths at border gateway protocol route reflectors
US8189588B2 (en) * 2009-03-13 2012-05-29 Cisco Technology, Inc. Flow resiliency
WO2010124355A1 (en) * 2009-05-01 2010-11-04 Nortel Networks Limited E-spring support of ethernet protection
US8351429B2 (en) * 2009-05-13 2013-01-08 Avaya Inc. Method and apparatus for providing fast reroute of a packet that may be forwarded on one of a plurality of equal cost multipath routes through a network
US8385335B2 (en) * 2009-05-13 2013-02-26 Avaya Inc. Method and apparatus for providing fast reroute of a unicast packet within a network element to an available port associated with a multi-link trunk
CN101577844B (en) * 2009-06-05 2012-05-23 中兴通讯股份有限公司 Wave division multiplexing (WDM) network path search method and system
US8769654B2 (en) * 2009-06-23 2014-07-01 Cisco Technology, Inc. Counterfeit prevention strategy for pluggable modules
EP2296324A1 (en) 2009-09-14 2011-03-16 Thomson Licensing, Inc. Distributed flow mechanism for peer-to-peer streaming
US8411684B1 (en) * 2009-10-26 2013-04-02 Mcafee, Inc. System, method, and computer program product for determining a hop count between network devices utilizing a binary search
US20110158163A1 (en) * 2009-12-28 2011-06-30 University Of Calcutta Energy efficient integrated routing protocol
US9710595B2 (en) * 2010-02-24 2017-07-18 International Business Machines Corporation Multi-view user interface for server cabling display
US9923995B1 (en) 2010-02-27 2018-03-20 Sitting Man, Llc Methods, systems, and computer program products for sharing information for detecting an idle TCP connection
US20110246692A1 (en) * 2010-03-31 2011-10-06 International Business Machines Corporation Implementing Control Using A Single Path In A Multiple Path Interconnect System
KR101136375B1 (en) * 2010-07-12 2012-04-18 아주대학교산학협력단 Method and apparatus for establishing a routing path on a multi-hop network
US8964566B2 (en) * 2010-08-19 2015-02-24 Cisco Technology, Inc. Creating balanced link-disjoint topologies in a computer network
US8498201B2 (en) 2010-08-26 2013-07-30 Honeywell International Inc. Apparatus and method for improving the reliability of industrial wireless networks that experience outages in backbone connectivity
US8773992B2 (en) * 2010-10-11 2014-07-08 At&T Intellectual Property I, L.P. Methods and apparatus for hierarchical routing in communication networks
US8924498B2 (en) 2010-11-09 2014-12-30 Honeywell International Inc. Method and system for process control network migration
US8634419B2 (en) * 2010-12-01 2014-01-21 Violin Memory Inc. Reliable and fast method and system to broadcast data
JP5621668B2 (en) * 2011-03-15 2014-11-12 富士通株式会社 Transmission system, redundant section setting method and connection node
US8553688B2 (en) 2011-07-28 2013-10-08 Cisco Technology, Inc. Dynamic allocation of context identifiers for header compression
US8612583B2 (en) 2011-07-29 2013-12-17 Cisco Technology, Inc. Network management system scheduling for low power and lossy networks
US8913485B2 (en) 2011-09-16 2014-12-16 Telefonaktiebolaget L M Ericsson (Publ) Open shortest path first (OSPF) nonstop routing (NSR) with link derivation
US8717935B2 (en) * 2011-09-16 2014-05-06 Telefonaktiebolaget L M Ericsson (Publ) OSPF non-stop routing with reliable flooding
US8964758B2 (en) 2011-09-29 2015-02-24 Telefonaktiebolaget L M Ericsson (Publ) OSPF nonstop routing (NSR) synchronization reduction
US8923312B2 (en) 2011-09-29 2014-12-30 Telefonaktiebolaget L M Ericsson (Publ) OSPF nonstop routing synchronization nack
US8958430B2 (en) 2011-09-29 2015-02-17 Telefonaktiebolaget L M Ericsson (Publ) OSPF non-stop routing frozen standby
US8976711B2 (en) * 2011-10-07 2015-03-10 Futurewei Technologies, Inc. Simple topology transparent zoning in network communications
EP2769504B1 (en) * 2011-10-17 2017-04-19 Telefonaktiebolaget LM Ericsson (publ) Reconnection in a transmission tree
US9331931B2 (en) 2012-02-28 2016-05-03 Cisco Technology, Inc. Path selection based on hop metric distributions
US8892936B2 (en) * 2012-03-20 2014-11-18 Symantec Corporation Cluster wide consistent detection of interconnect failures
US9515899B2 (en) 2012-12-19 2016-12-06 Veritas Technologies Llc Providing optimized quality of service to prioritized virtual machines and applications based on quality of shared resources
US9146791B2 (en) * 2013-03-11 2015-09-29 International Business Machines Corporation Communication failure source isolation in a distributed computing system
US9237024B2 (en) 2013-03-15 2016-01-12 Cooper Technologies Company Informational broadcast messages and its uses in wireless multihop networks
CN104125590B (en) * 2013-04-26 2017-10-03 富士通株式会社 link failure diagnosis device and method
US9444675B2 (en) 2013-06-07 2016-09-13 Cisco Technology, Inc. Determining the operations performed along a service path/service chain
US9110838B2 (en) 2013-07-31 2015-08-18 Honeywell International Inc. Apparatus and method for synchronizing dynamic process data across redundant input/output modules
KR101505624B1 (en) 2014-01-03 2015-03-24 아주대학교산학협력단 Mobility prediction scheme based on Relative Mobile Characteristics
US9654396B2 (en) 2014-01-15 2017-05-16 Cisco Technology, Inc. Controller-less peer-to-peer distributed switch
US9553797B2 (en) * 2014-03-12 2017-01-24 International Business Machines Corporation Message path selection within a network
US9720404B2 (en) 2014-05-05 2017-08-01 Honeywell International Inc. Gateway offering logical model mapped to independent underlying networks
US10042330B2 (en) 2014-05-07 2018-08-07 Honeywell International Inc. Redundant process controllers for segregated supervisory and industrial control networks
US11088937B1 (en) 2014-05-08 2021-08-10 Google Llc System and method for synchronized route update
US10536526B2 (en) 2014-06-25 2020-01-14 Honeywell International Inc. Apparatus and method for virtualizing a connection to a node in an industrial control and automation system
US9699022B2 (en) 2014-08-01 2017-07-04 Honeywell International Inc. System and method for controller redundancy and controller network redundancy with ethernet/IP I/O
US10148485B2 (en) 2014-09-03 2018-12-04 Honeywell International Inc. Apparatus and method for on-process migration of industrial control and automation system across disparate network types
US10742718B1 (en) * 2014-12-23 2020-08-11 Amazon Technologies, Inc. Distributed computing system node management
US10826971B1 (en) 2014-12-23 2020-11-03 Amazon Technologies, Inc. Distributed computing system node management
US10243870B1 (en) 2014-12-23 2019-03-26 Amazon Technologies, Inc. Distributed computing system node management
US9645872B1 (en) * 2015-03-27 2017-05-09 EMC IP Holding Company LLC Method to use multipath to reduce IO error handle duration
US10162827B2 (en) 2015-04-08 2018-12-25 Honeywell International Inc. Method and system for distributed control system (DCS) process data cloning and migration through secured file system
US10409270B2 (en) 2015-04-09 2019-09-10 Honeywell International Inc. Methods for on-process migration from one type of process control device to different type of process control device
US9913195B2 (en) * 2015-06-19 2018-03-06 Terranet Ab Mesh path selection
US9813287B2 (en) * 2015-07-30 2017-11-07 Huawei Technologies Co., Ltd. Connectivity-aware virtual network embedding
US10608908B2 (en) * 2016-02-10 2020-03-31 Nicira, Inc. On-demand connection ping
US10296482B2 (en) 2017-03-07 2019-05-21 Honeywell International Inc. System and method for flexible connection of redundant input-output modules or other devices
US10749692B2 (en) 2017-05-05 2020-08-18 Honeywell International Inc. Automated certificate enrollment for devices in industrial control systems or other systems
US10359960B1 (en) * 2017-07-14 2019-07-23 EMC IP Holding Company LLC Allocating storage volumes between compressed and uncompressed storage tiers
US10401816B2 (en) 2017-07-20 2019-09-03 Honeywell International Inc. Legacy control functions in newgen controllers alongside newgen control functions
US11553499B2 (en) 2017-11-15 2023-01-10 Lenovo (Beijing) Limited Exchange of UL interference detection related information
CN108712345B (en) * 2018-05-17 2021-07-27 山西大学 Distributed load balancing method based on hop-by-hop calculation
CN108924673B (en) * 2018-06-12 2021-12-03 中国电力科学研究院有限公司 Method and system for self-healing multipoint faults of optical channel
CN110779524A (en) * 2018-07-31 2020-02-11 阿里巴巴集团控股有限公司 Path planning method, device, equipment and storage medium
US10979447B2 (en) 2018-08-30 2021-04-13 Ordr Inc. Presenting, at a graphical user interface, device photos and risk categories associated with devices in a network
US10742687B2 (en) 2018-08-30 2020-08-11 Ordr Inc. Determining a device profile and anomalous behavior associated with a device in a network
US10756996B2 (en) * 2018-09-19 2020-08-25 Ciena Corporation Systems and methods for capturing packet loss and disruption duration information during service restoration
CN111200506B (en) * 2018-11-19 2023-08-29 中兴通讯股份有限公司 Fault sensing method and device and controller
US10656795B1 (en) 2019-01-07 2020-05-19 Ordr Inc. Presenting, at a graphical user interface (GUI), a constellation view of communications associated with node groups in a network
US11824762B2 (en) * 2019-06-17 2023-11-21 Nippon Telegraph And Telephone Corporation Transmission path design apparatus, transmission network topology design method, and transmission path design program for designing a communication path topology optimized in view of reducing amount of equipment needed
US11159424B2 (en) * 2019-10-29 2021-10-26 Dell Products L.P. Networking aggregation link provisioning system
US11777863B2 (en) * 2020-12-21 2023-10-03 Landis+ Gyr Innovations Optimized route for time-critical traffic in mesh network
US11863401B2 (en) 2021-02-22 2024-01-02 Ordr Inc. Visualization system for private networks and devices

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5093824A (en) * 1990-03-27 1992-03-03 Bell Communications Research, Inc. Distributed protocol for improving the survivability of telecommunications trunk networks
EP0781068A1 (en) * 1995-12-20 1997-06-25 International Business Machines Corporation Method and system for adaptive bandwidth allocation in a high speed data network
US5646936A (en) * 1995-06-22 1997-07-08 Mci Corporation Knowledge based path set up and spare capacity assignment for distributed network restoration
EP0841824A2 (en) * 1996-11-08 1998-05-13 Nec Corporation Failure restoration system suitable for a large-scale network
US5805578A (en) * 1995-10-27 1998-09-08 International Business Machines Corporation Automatic reconfiguration of multipoint communication channels

Family Cites Families (196)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4074072A (en) 1976-05-24 1978-02-14 Bell Telephone Laboratories, Incorporated Multiprocessor control of a partitioned switching network by control communication through the network
US4470139A (en) 1981-12-28 1984-09-04 Northern Telecom Limited Switching network for use in a time division multiplex system
US4683564A (en) 1982-11-22 1987-07-28 Data Switch Corporation Matrix switch system
US4654654A (en) * 1983-02-07 1987-03-31 At&T Bell Laboratories Data network acknowledgement arrangement
US5049871A (en) 1987-01-20 1991-09-17 American Magnetics Corporation Loop communication system
US4914571A (en) 1987-06-15 1990-04-03 International Business Machines Corporation Locating resources in computer networks
IT1219054B (en) 1988-02-29 1990-04-24 Cselt Centro Studi Lab Telecom NODE FOR FAST SWITCHING NETWORK OF PACKAGE IN OPTICAL ELECTRIC TECHNOLOGY
JPH0624366B2 (en) * 1988-11-24 1994-03-30 日本電気株式会社 Network failure recovery method
US5023864A (en) 1989-05-08 1991-06-11 At&T Bell Laboratories Crossover network utilizing two-dimensional arrays of nodes
US5455865A (en) * 1989-05-09 1995-10-03 Digital Equipment Corporation Robust packet routing over a distributed network containing malicious failures
US5086428A (en) * 1989-06-09 1992-02-04 Digital Equipment Corporation Reliable broadcast of information in a wide area network
US5235599A (en) * 1989-07-26 1993-08-10 Nec Corporation Self-healing network with distributed failure restoration capabilities
US5084891A (en) 1989-09-08 1992-01-28 Bell Communications Research, Inc. Technique for jointly performing bit synchronization and error detection in a TDM/TDMA system
GB8925454D0 (en) 1989-11-10 1989-12-28 British Telecomm Generalised connection network
US5128926A (en) * 1990-03-21 1992-07-07 Digital Equipment Corporation Updating link state information in networks
US5214778A (en) 1990-04-06 1993-05-25 Micro Technology, Inc. Resource management in a multiple resource system
JP2666533B2 (en) 1990-08-06 1997-10-22 日本電気株式会社 Switch module
JP3083540B2 (en) 1990-08-20 2000-09-04 株式会社東芝 Switching control method using multiprocessor
US5251205A (en) * 1990-09-04 1993-10-05 Digital Equipment Corporation Multiple protocol routing
US5197127A (en) * 1990-09-24 1993-03-23 International Business Machines Corporation Expert system method for performing window protocol-based data flow analysis within a data communication network
JPH04154242A (en) * 1990-10-17 1992-05-27 Nec Corp Network failure recovery system
US5412376A (en) 1990-11-09 1995-05-02 Fujitsu Limited Method for structuring communications network based on asynchronous transfer mode
US5182744A (en) * 1991-01-03 1993-01-26 At&T Bell Laboratories Telecommunications network restoration architecture
US5168492A (en) 1991-04-11 1992-12-01 Northern Telecom Limited Rotating-access ATM-STM packet switch
US6374311B1 (en) * 1991-10-01 2002-04-16 Intermec Ip Corp. Communication network having a plurality of bridging nodes which transmit a beacon to terminal nodes in power saving state that it has messages awaiting delivery
US5307342A (en) 1991-08-30 1994-04-26 International Business Machines Corporation Heterogeneous ports switch
US5357249A (en) 1991-10-21 1994-10-18 Trw Inc. Apparatus and method for high speed flexible multiplexing for fiber optic data transmissions
JP3071007B2 (en) 1991-10-22 2000-07-31 富士通株式会社 Communication network control method
US5410600A (en) 1991-11-18 1995-04-25 Broadband Communications Products, Inc. Pre-scramble encoding method and apparatus for digital communication
JPH05260081A (en) * 1992-01-17 1993-10-08 Nec Corp Communication network management system
JP2766119B2 (en) 1992-04-20 1998-06-18 日本電気株式会社 Space switch circuit
US5664107A (en) * 1992-10-13 1997-09-02 Bay Networks, Inc. Method for providing for automatic topology discovery in an ATM network or the like
JP2500743B2 (en) 1993-04-23 1996-05-29 日本電気株式会社 Digital cross connect device
US5612950A (en) * 1993-05-27 1997-03-18 Rockwell International Corporation Managing communication on an unstable error-prone channel
GB9311106D0 (en) 1993-05-28 1993-07-14 Plessey Telecomm Switch plane maintenance
US6298371B1 (en) 1993-07-08 2001-10-02 Bmc Software, Inc. Method of dynamically adjusting NCP program memory allocation of SNA network
US5495484A (en) 1993-10-12 1996-02-27 Dsc Communications Corporation Distributed telecommunications switching system
JP2856050B2 (en) * 1993-11-30 1999-02-10 日本電気株式会社 Routing control method
US5495471A (en) 1994-03-09 1996-02-27 Mci Communications Corporation System and method for restoring a telecommunications network based on a two prong approach
JP3438105B2 (en) * 1994-03-18 2003-08-18 富士通株式会社 Detour route search method
AU692797B2 (en) 1994-04-29 1998-06-18 At & T Corporation Telecommunications signaling arrangement for terminals without signaling capability
US6314103B1 (en) 1994-05-05 2001-11-06 Sprint Communications Company, L.P. System and method for allocating bandwidth for a call
EP0699008A1 (en) 1994-08-23 1996-02-28 BELL TELEPHONE MANUFACTURING COMPANY Naamloze Vennootschap Method for rerouting a data stream
US5524154A (en) 1994-08-31 1996-06-04 At&T Corp. Hybrid architecture for an optical switching fabric implemented with 1×2 switching devices
US5530575A (en) 1994-09-09 1996-06-25 The Trustees Of Columbia University Systems and methods for employing a recursive mesh network with extraplanar links
US6026095A (en) 1994-09-27 2000-02-15 3Com Corporation Method and apparatus for controlling latency and jitter in shared CSMA/CD (repeater) environment
DE4437325A1 (en) 1994-10-19 1996-04-25 Bosch Gmbh Robert Optical switch with coupler, esp. for digital optical switch
EP0714192A1 (en) 1994-11-24 1996-05-29 International Business Machines Corporation Method for preempting connections in high speed packet switching networks
JPH08195745A (en) * 1995-01-13 1996-07-30 Fujitsu Ltd Path changeover device and path changeover method
DE19504404C1 (en) * 1995-02-10 1996-06-20 Pilz Gmbh & Co System architecture
US5596722A (en) 1995-04-03 1997-01-21 Motorola, Inc. Packet routing system and method for achieving uniform link usage and minimizing link load
US5570370A (en) 1995-04-28 1996-10-29 Industrial Technology Research Institute Frame timing acquisition method and system for cordless TDMA systems
US6026094A (en) * 1995-05-24 2000-02-15 Thomson Consumer Electronics, Inc. Digital data bus system including arbitration
US5781537A (en) 1995-07-07 1998-07-14 International Business Machines Corporation Setting up, taking down and maintaining connections in a communications network
JP2723084B2 (en) * 1995-07-19 1998-03-09 日本電気株式会社 Link state routing device
US5754320A (en) 1995-08-18 1998-05-19 Nippon Telegraph And Telephone Corporation Optical cross-connect system
US5590119A (en) * 1995-08-28 1996-12-31 Mci Communications Corporation Deterministic selection of an optimal restoration route in a telecommunications network
US5781615A (en) 1995-08-30 1998-07-14 Lucent Technologies Inc. Fully distributed message storage facilities in a distributed switching system
US5805593A (en) 1995-09-26 1998-09-08 At&T Corp Routing method for setting up a service between an origination node and a destination node in a connection-communications network
US5856627A (en) * 1995-11-01 1999-01-05 George; Michael Thumb mounted striking device for stringed musical instruments
US5684800A (en) * 1995-11-15 1997-11-04 Cabletron Systems, Inc. Method for establishing restricted broadcast groups in a switched network
US5699347A (en) 1995-11-17 1997-12-16 Bay Networks, Inc. Method and apparatus for routing packets in networks having connection-oriented subnetworks
JP2836552B2 (en) 1995-11-20 1998-12-14 日本電気株式会社 Distributed network failure recovery device
US5835696A (en) 1995-11-22 1998-11-10 Lucent Technologies Inc. Data router backup feature
US6094431A (en) * 1995-11-30 2000-07-25 Kabushiki Kaisha Toshiba Node device and network resource reservation method for data packet transfer using ATM networks
JP2723097B2 (en) 1995-12-04 1998-03-09 日本電気株式会社 QOS routing device
EP0781007B1 (en) 1995-12-21 2003-03-12 Siemens Aktiengesellschaft Method for creating routing information in an ATM communications network
US5777761A (en) 1995-12-22 1998-07-07 Mci Communications Corporation System and method for photonic facility and line protection switching using wavelength translation
US5884017A (en) 1995-12-29 1999-03-16 Mci Communications Corporation Method and system for optical restoration tributary switching in a fiber network
US5884297A (en) 1996-01-30 1999-03-16 Telefonaktiebolaget L M Ericsson (Publ.) System and method for maintaining a table in content addressable memory using hole algorithms
CA2243359A1 (en) * 1996-01-31 1997-08-07 Ipsilon Networks, Inc. Improved method and apparatus for dynamically shifting between routing and switching packets in a transmission network
US5850526A (en) * 1996-02-07 1998-12-15 Kingston Technology Co. LAN station for determining the destination LAN station is capable of decompressing by comparing destination address to block of addresses assigned by a LAN manufacturer
JP3432664B2 (en) * 1996-02-14 2003-08-04 富士通株式会社 Communication node, failure recovery method, and communication network
US5726979A (en) 1996-02-22 1998-03-10 Mci Corporation Network management system
US6108304A (en) * 1996-03-08 2000-08-22 Abe; Hajime Packet switching network, packet switching equipment, and network management equipment
US5805571A (en) 1996-03-19 1998-09-08 Zwan; Bryan J. Dynamic communication line analyzer apparatus and method
JPH09270793A (en) 1996-04-03 1997-10-14 Sony Corp Communication control method
JP3639383B2 (en) 1996-04-15 2005-04-20 富士通株式会社 Optical transmission system
US5737319A (en) * 1996-04-15 1998-04-07 Mci Corporation Dynamic network topology determination
US5771320A (en) 1996-04-30 1998-06-23 Wavefront Research, Inc. Optical switching and routing system
US5854899A (en) * 1996-05-09 1998-12-29 Bay Networks, Inc. Method and apparatus for managing virtual circuits and routing packets in a network/subnetwork environment
JPH09307587A (en) * 1996-05-09 1997-11-28 Fujitsu Ltd Exchange
JP3058252B2 (en) 1996-05-30 2000-07-04 日本電気株式会社 Connection data management method in the network
US5995503A (en) 1996-06-12 1999-11-30 Bay Networks, Inc. Method and apparatus for providing quality of service routing in a network
US5881246A (en) 1996-06-12 1999-03-09 Bay Networks, Inc. System for generating explicit routing advertisements to specify a selected path through a connectionless network to a destination by a specific router
US6400681B1 (en) 1996-06-20 2002-06-04 Cisco Technology, Inc. Method and system for minimizing the connection set up time in high speed packet switching networks
US5748611A (en) * 1996-06-27 1998-05-05 Mci Corporation System and method for restoring a telecommunications network using conservative bandwidth reservation and selective message rebroadcast
US5754543A (en) * 1996-07-03 1998-05-19 Alcatel Data Networks, Inc. Connectivity matrix-based multi-cost routing
CA2261933A1 (en) * 1996-07-25 1998-02-05 Hybrid Networks, Inc. Two-way asymmetric communication system
US5838924A (en) 1996-08-06 1998-11-17 Lucent Technologies Inc Asynchronous transfer mode (ATM) connection protection switching apparatus and method
JP2980031B2 (en) 1996-08-12 1999-11-22 日本電気株式会社 Reconfigurable network
GB2316573B (en) 1996-08-14 2001-04-18 Fujitsu Ltd Switching apparatus
JP2806374B2 (en) 1996-08-19 1998-09-30 日本電気株式会社 ATM virtual path switching node
JP2933021B2 (en) 1996-08-20 1999-08-09 日本電気株式会社 Communication network failure recovery method
US6229787B1 (en) * 1996-09-11 2001-05-08 Nortel Networks Limited Mechanism to achieve very fast failover in ATM backbone networks using multi-homed circuits
US6167025A (en) * 1996-09-11 2000-12-26 Telcordia Technologies, Inc. Methods and apparatus for restoring connections in an ATM network
US6304549B1 (en) * 1996-09-12 2001-10-16 Lucent Technologies Inc. Virtual path management in hierarchical ATM networks
JP3077600B2 (en) 1996-09-26 2000-08-14 日本電気株式会社 Optical network system path monitoring device
US6055561A (en) 1996-10-02 2000-04-25 International Business Machines Corporation Mapping of routing traffic to switching networks
US5835517A (en) 1996-10-04 1998-11-10 W. L. Gore & Associates, Inc. WDM multiplexer-demultiplexer using Fabry-Perot filter array
JPH10117197A (en) 1996-10-11 1998-05-06 Fujitsu Ltd Exchange station for processing fixed length cell and selection right confirmation method and selection right confirmation correction method for virtual path connection in exchange station for processing fixed length cell
JP3302578B2 (en) 1996-10-21 2002-07-15 富士通株式会社 OAM processing equipment
US5881048A (en) * 1996-11-25 1999-03-09 Mci Communication Corporation Method and apparatus for determining maximum network failure spans forrestoration
US6075766A (en) * 1996-11-26 2000-06-13 Mci Communications Corporation Method and apparatus for identifying restoral routes in a network
GB9625020D0 (en) * 1996-11-29 1997-01-15 Northern Telecom Ltd Network restoration
GB9625019D0 (en) * 1996-11-29 1997-01-15 Northern Telecom Ltd Network restoration routing optimisation
US6275492B1 (en) 1996-12-03 2001-08-14 Nortel Networks Limited Method and apparatus for routing data using router identification information
US5953338A (en) 1996-12-13 1999-09-14 Northern Telecom Limited Dynamic control processes and systems for asynchronous transfer mode networks
US6097722A (en) 1996-12-13 2000-08-01 Nortel Networks Corporation Bandwidth management processes and systems for asynchronous transfer mode networks using variable virtual paths
US5906646A (en) 1996-12-19 1999-05-25 Caterpillar Inc. System and method for managing access to a resource shared by a plurality of mobile machines
US5961560A (en) 1996-12-19 1999-10-05 Caterpillar Inc. System and method for managing access of a fleet of mobile machines to a service resource
US5883881A (en) * 1996-12-30 1999-03-16 Mci Communications Corporation Method for selecting preferred nodes for distributed network restoration
US5999286A (en) * 1997-01-09 1999-12-07 Alcatel Method and system for restoring a distributed telecommunications network
DE69735084T2 (en) 1997-02-18 2006-08-31 Matsushita Electric Industrial Co., Ltd., Kadoma Routing methods in hierarchical structured networks
US6047331A (en) * 1997-02-19 2000-04-04 Massachusetts Institute Of Technology Method and apparatus for automatic protection switching
US5918020A (en) * 1997-02-28 1999-06-29 International Business Machines Corporation Data processing system and method for pacing information transfers in a communications network
CA2284184A1 (en) 1997-03-12 1998-09-17 Paul T. Baniewicz Telecommunications network distributed restoration method and system
JPH10262058A (en) * 1997-03-18 1998-09-29 Fujitsu Ltd Control method for fixed connection
US6160813A (en) 1997-03-21 2000-12-12 Brocade Communications Systems, Inc. Fibre channel switching system and method
US6041057A (en) * 1997-03-24 2000-03-21 Xylan Corporation Self-configuring ATM network
JP3175630B2 (en) 1997-04-02 2001-06-11 日本電気株式会社 Optical communication node and wavelength-division multiplexing optical transmission device having ring configuration formed therefrom
US6041049A (en) 1997-05-06 2000-03-21 International Business Machines Corporation Method and apparatus for determining a routing table for each node in a distributed nodal system
US6011780A (en) 1997-05-23 2000-01-04 Stevens Institute Of Technology Transparant non-disruptable ATM network
US5959972A (en) 1997-05-27 1999-09-28 3Com Corporation Method of port/link redundancy in an ATM switch
JPH10336195A (en) 1997-06-02 1998-12-18 Nec Corp Selective vp terminal switching system
JPH10340243A (en) 1997-06-06 1998-12-22 Hitachi Ltd Input/output data transfer system
US6134671A (en) * 1997-07-31 2000-10-17 Mci Communications Corporation System and method for dynamically generating restoration routes within a communications network
US6604137B2 (en) * 1997-07-31 2003-08-05 Mci Communications Corporation System and method for verification of remote spares in a communications network when a network outage occurs
US5920257A (en) * 1997-07-31 1999-07-06 Mci Communications Corporation System and method for isolating an outage within a communications network
US6457050B1 (en) * 1997-08-01 2002-09-24 Mci Communications Corporation System and method for dynamically restoring communications within a network
JP3662097B2 (en) 1997-08-12 2005-06-22 Kddi株式会社 Route selection method
US5941992A (en) * 1997-08-13 1999-08-24 Mci Communications Corporation Distributed method and system for excluding components from a restoral route in a communications network
US6347074B1 (en) * 1997-08-13 2002-02-12 Mci Communications Corporation Centralized method and system for excluding components from a restoral route in a communications network
EP1010346B1 (en) 1997-08-22 2003-10-15 Nortel Networks Limited Protection switching trigger generation
US6347078B1 (en) 1997-09-02 2002-02-12 Lucent Technologies Inc. Multiple path routing
US6292464B1 (en) 1997-09-17 2001-09-18 Nortel Networks Limited Apparatus and method for self routing control mechanism for restoring fiber optic communications network connections
JP2002505533A (en) 1997-09-19 2002-02-19 フジツウ ネットワーク コミュニケーションズ,インコーポレイテッド Constant phase crossbar switch
US6130876A (en) 1997-09-24 2000-10-10 At&T Corp Method and apparatus for restoring a network
US6256295B1 (en) * 1997-09-25 2001-07-03 Nortel Networks Limited Method and apparatus for determining multiple minimally-overlapping paths between nodes in a network
US6151304A (en) 1997-10-29 2000-11-21 Lucent Technologies Inc. Distributed precomputation of network signal paths with improved performance through parallelization
US6496510B1 (en) * 1997-11-14 2002-12-17 Hitachi, Ltd. Scalable cluster-type router device and configuring method thereof
US6463062B1 (en) 1997-11-19 2002-10-08 At&T Corp. Integrating switching and facility networks using ATM
JP3286584B2 (en) * 1997-11-20 2002-05-27 株式会社日立製作所 Multiplexed router device
JP3191754B2 (en) * 1997-12-08 2001-07-23 日本電気株式会社 Congestion avoidance system
US6088329A (en) 1997-12-11 2000-07-11 Telefonaktiebolaget Lm Ericsson Fault tolerant subrate switching
US6504845B1 (en) 1997-12-19 2003-01-07 Telefonaktiebolaget Lm Ericsson (Publ) Centralized queuing for ATM node
US6111881A (en) 1997-12-29 2000-08-29 Nortel Networks Corporation Signaling protocol for rerouting ATM connections in PNNI environments
CA2262046C (en) 1998-02-24 2002-10-22 At&T Corp. Optical layer quasi-centralized restoration
US6370119B1 (en) 1998-02-27 2002-04-09 Cisco Technology, Inc. Computing the widest shortest path in high-speed networks
US6092086A (en) * 1998-03-31 2000-07-18 Bmc Software System and method for handling backout processing during capture of changed data in an enterprise computer system
US5987526A (en) 1998-04-06 1999-11-16 At&T Corp. Asynchronous transfer mode layer automatic protection switching mechanism for ATM permanent virtual connections
US6466985B1 (en) * 1998-04-10 2002-10-15 At&T Corp. Method and apparatus for providing quality of service using the internet protocol
US6130881A (en) 1998-04-20 2000-10-10 Sarnoff Corporation Traffic routing in small wireless data networks
US6865160B1 (en) * 1998-05-04 2005-03-08 Hewlett-Packard Development Company, L.P. Broadcast tree determination in load balancing switch protocols
JP3111986B2 (en) 1998-06-05 2000-11-27 日本電気株式会社 ATM communication network node device and failure alarm notification method
US6272107B1 (en) 1998-05-12 2001-08-07 3Com Corporation Method of path restoration in an ATM network utilizing point to point switched virtual circuits
US6154778A (en) 1998-05-19 2000-11-28 Hewlett-Packard Company Utility-based multi-category quality-of-service negotiation in distributed systems
US6222820B1 (en) 1998-05-28 2001-04-24 3Com Corporation Method of VCC/VPC redundancy for asynchronous transfer mode networks
US6266333B1 (en) 1998-06-02 2001-07-24 Lucent Technologies Inc. Network-independent routing of communication signals
US6324162B1 (en) 1998-06-03 2001-11-27 At&T Corp. Path-based restoration mesh networks
US6633544B1 (en) * 1998-06-24 2003-10-14 At&T Corp. Efficient precomputation of quality-of-service routes
US6418476B1 (en) * 1998-06-29 2002-07-09 Nortel Networks, Limited Method for synchronizing network address translator (NAT) tables using the open shortest path first opaque link state advertisement option protocol
US6292463B1 (en) * 1998-07-06 2001-09-18 Alcatel Canada Inc. Method and apparatus for recovering from a signalling failure in a switched connection data transmission network
US6262820B1 (en) 1998-07-15 2001-07-17 Lucent Technologies Inc. Optical transmission system including optical restoration
US6111673A (en) 1998-07-17 2000-08-29 Telcordia Technologies, Inc. High-throughput, low-latency next generation internet networks using optical tag switching
US6266698B1 (en) 1998-07-31 2001-07-24 Compaq Computer Corporation Logging of transaction branch information for implementing presumed nothing and other protocols
JP3751755B2 (en) 1998-08-06 2006-03-01 富士通株式会社 ATM network PVC rerouting method and network management system
JP3036524B2 (en) * 1998-08-14 2000-04-24 日本電気株式会社 VP protection system and method
US6295275B1 (en) * 1998-08-19 2001-09-25 Mci Communications Corporation Dynamic route generation for real-time network restoration using pre-plan route generation methodology
US6385489B1 (en) 1998-09-25 2002-05-07 Ep Medsystems, Inc. Triple array defibrillation catheter and method of using the same
US6487170B1 (en) * 1998-11-18 2002-11-26 Nortel Networks Limited Providing admission control and network quality of service with a distributed bandwidth broker
US6219355B1 (en) 1998-11-30 2001-04-17 Qwest Communications International Inc. Video and data communication system
US6301244B1 (en) 1998-12-11 2001-10-09 Nortel Networks Limited QoS-oriented one-to-all route selection method for communication networks
US6493317B1 (en) 1998-12-18 2002-12-10 Cisco Technology, Inc. Traffic engineering technique for routing inter-class traffic in a computer network
US6714549B1 (en) * 1998-12-23 2004-03-30 Worldcom, Inc. High resiliency network infrastructure
US6990068B1 (en) 1999-01-15 2006-01-24 Cisco Technology, Inc. Virtual path restoration scheme using fast dynamic mesh restoration in an optical network
US6982974B1 (en) 1999-01-15 2006-01-03 Cisco Technology, Inc. Method and apparatus for a rearrangeably non-blocking switching matrix
US6801496B1 (en) 1999-01-15 2004-10-05 Cisco Technology, Inc. Network addressing scheme for reducing protocol overhead in an optical network
US6631134B1 (en) 1999-01-15 2003-10-07 Cisco Technology, Inc. Method for allocating bandwidth in an optical network
US6912221B1 (en) 1999-01-15 2005-06-28 Cisco Technology, Inc. Method of providing network services
US6856627B2 (en) 1999-01-15 2005-02-15 Cisco Technology, Inc. Method for routing information over a network
US6724757B1 (en) 1999-01-15 2004-04-20 Cisco Technology, Inc. Configurable network router
US6307653B1 (en) 1999-03-24 2001-10-23 Tellium, Inc Optical matrix protection system
JP3871467B2 (en) 1999-03-25 2007-01-24 富士通株式会社 Communication path failure recovery device
JP2001053753A (en) 1999-08-09 2001-02-23 Fujitsu Ltd Method for switching active/reserve line and atm exchange using the same
US6600581B1 (en) 1999-08-31 2003-07-29 Lucent Technologies Inc. Connection verification in optical cross-connect arrangements
AU7078500A (en) 1999-09-14 2001-04-17 Megaxess, Inc. Method and apparatus for prevention of congestion in atm networks through atm protection switching
JP4190114B2 (en) 1999-11-10 2008-12-03 株式会社ルネサステクノロジ Microcomputer
US6856600B1 (en) 2000-01-04 2005-02-15 Cisco Technology, Inc. Method and apparatus for isolating faults in a switching matrix
US6829215B2 (en) 2000-10-31 2004-12-07 Marconi Intellectual Property (Ringfence) Inc. IP multi-homing
US20020118636A1 (en) 2000-12-20 2002-08-29 Phelps Peter W. Mesh network protection using dynamic ring
US20020191247A1 (en) * 2001-04-30 2002-12-19 Xiang Lu Fast restoration in optical mesh network
US7477594B2 (en) 2001-05-16 2009-01-13 Cisco Technology, Inc. Method for restoring a virtual path in an optical network using 1:N protection
US6952395B1 (en) 2001-06-01 2005-10-04 Calix Networks, Inc. Optical network restoration
US6687168B2 (en) * 2002-01-18 2004-02-03 Hewlett-Packard Development Company, L.P. Method for writing data bits to a memory array
US7043250B1 (en) 2003-04-16 2006-05-09 Verizon Corporate Services Group Inc. Systems and methods for forming and operating a communications network

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5093824A (en) * 1990-03-27 1992-03-03 Bell Communications Research, Inc. Distributed protocol for improving the survivability of telecommunications trunk networks
US5646936A (en) * 1995-06-22 1997-07-08 Mci Corporation Knowledge based path set up and spare capacity assignment for distributed network restoration
US5805578A (en) * 1995-10-27 1998-09-08 International Business Machines Corporation Automatic reconfiguration of multipoint communication channels
EP0781068A1 (en) * 1995-12-20 1997-06-25 International Business Machines Corporation Method and system for adaptive bandwidth allocation in a high speed data network
EP0841824A2 (en) * 1996-11-08 1998-05-13 Nec Corporation Failure restoration system suitable for a large-scale network

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
BARUCH AWERBUCH ET AL: "DISTRIBUTED CONTROL FOR PARIS", PROC. ANNUAL ACM SYMP. ON PRINCIPLES OF DISTRIBUTED COMPUTING,XX,XX, 22 August 1990 (1990-08-22), pages 145 - 159, XP000561763 *
HAJELA S: "HP OEMF: ALARM MANAGEMENT IN TELECOMMUNICATION NETWORKS", HEWLETT-PACKARD JOURNAL,US,HEWLETT-PACKARD CO. PALO ALTO, vol. 47, no. 5, 1 October 1996 (1996-10-01), pages 22 - 30, XP000631663 *
HIDEKI SAKAUCHI ET AL: "A SELF-HEALING NETWORK WITH AN ECONOMICAL SPARE-CHANNEL ASSIGNMENT", PROCEEDINGS OF THE GLOBAL TELECOMMUNICATIONS CONFERENCE AND EXHIBITION(GLOBECOM),US,NEW YORK, IEEE, vol. -, 1991, pages 438 - 443, XP000218768, ISBN: 0-87942-632-2 *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2815799A1 (en) * 2000-10-23 2002-04-26 Cit Alcatel Method to advise on a specific processing capacity of a node in a telecommunication network
EP1202506A1 (en) * 2000-10-23 2002-05-02 Alcatel A method for informing of the specific data handling capacity of a telecommunications network node
WO2002039484A2 (en) * 2000-11-09 2002-05-16 Telefonaktiebolaget Lm Ericsson (Publ) Intelligent bluetooth inquiry procedure
WO2002039484A3 (en) * 2000-11-09 2002-07-11 Ericsson Telefon Ab L M Intelligent bluetooth inquiry procedure
KR100702460B1 (en) * 2003-01-30 2007-04-04 인터내셔널 비지네스 머신즈 코포레이션 Preemptive retransmission of buffered data in a network
WO2004068801A1 (en) * 2003-01-30 2004-08-12 International Business Machines Corporation Preemptive retransmission of buffered data in a network
US7680129B2 (en) 2003-01-30 2010-03-16 International Business Machines Corporation Preemptive retransmission of buffered data in a network
EP1716500A2 (en) * 2004-01-21 2006-11-02 Cisco Technology, Inc. System and method for controlling the flooding of information in a network environment
EP1716500A4 (en) * 2004-01-21 2010-01-06 Cisco Tech Inc System and method for controlling the flooding of information in a network environment
US7821956B2 (en) 2004-01-21 2010-10-26 Cisco Technology, Inc. System and method for controlling the flooding of information in a network environment
CN106664214A (en) * 2015-04-17 2017-05-10 华为技术有限公司 Failure recovery method and device for virtual network
EP3280092A4 (en) * 2015-04-17 2018-03-28 Huawei Technologies Co. Ltd. Failure recovery method and device for virtual network
CN106664214B (en) * 2015-04-17 2020-04-28 华为技术有限公司 Fault recovery method and device for virtual network
US10892943B2 (en) 2015-04-17 2021-01-12 Huawei Technologies Co., Ltd. Failure recovery method and apparatus for virtual network

Also Published As

Publication number Publication date
US7200104B2 (en) 2007-04-03
US8537836B2 (en) 2013-09-17
US20050201380A1 (en) 2005-09-15
US20010048660A1 (en) 2001-12-06
US20080225696A1 (en) 2008-09-18
US6850486B2 (en) 2005-02-01
US20060153066A1 (en) 2006-07-13
US20030179700A1 (en) 2003-09-25
AU3582000A (en) 2000-08-01
US6856627B2 (en) 2005-02-15
US7002917B1 (en) 2006-02-21
US20030058804A1 (en) 2003-03-27
US20020054572A1 (en) 2002-05-09
US7729337B2 (en) 2010-06-01
US20080310299A1 (en) 2008-12-18
US20010033548A1 (en) 2001-10-25
US7301895B2 (en) 2007-11-27
US7424035B2 (en) 2008-09-09
US7633854B2 (en) 2009-12-15
US7502313B2 (en) 2009-03-10
US20050135234A1 (en) 2005-06-23
US8064481B2 (en) 2011-11-22

Similar Documents

Publication Publication Date Title
US6856627B2 (en) Method for routing information over a network
US6973023B1 (en) Method for routing information over a network employing centralized control
US7724655B2 (en) Network addressing scheme for reducing protocol overhead in an optical network
US6950391B1 (en) Configurable network router
US7933266B2 (en) Configurable network router
US6912221B1 (en) Method of providing network services
Yuan et al. Distributed control protocols for wavelength reservation and their performance evaluation
EP0752795B1 (en) Link reservation in communications networks
US7660238B2 (en) Mesh with protection channel access (MPCA)
US6990068B1 (en) Virtual path restoration scheme using fast dynamic mesh restoration in an optical network
US7269177B2 (en) Logical star topologies for non-star networks
US7414985B1 (en) Link aggregation
US7181534B2 (en) Address resolution protocol to map internet protocol addresses to a node transport identifier
CA2440515A1 (en) Constraint based routing with non-transitive exceptions
Zhong et al. Optical resilient Ethernet rings for high-speed MAN networks

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AU CA JP

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
122 Ep: pct application non-entry in european phase