WO1998027662A2 - High speed variable length best match look-up in a switching device - Google Patents

High speed variable length best match look-up in a switching device Download PDF

Info

Publication number
WO1998027662A2
WO1998027662A2 PCT/US1997/023287 US9723287W WO9827662A2 WO 1998027662 A2 WO1998027662 A2 WO 1998027662A2 US 9723287 W US9723287 W US 9723287W WO 9827662 A2 WO9827662 A2 WO 9827662A2
Authority
WO
WIPO (PCT)
Prior art keywords
node
route
key
bit
trie
Prior art date
Application number
PCT/US1997/023287
Other languages
French (fr)
Other versions
WO1998027662A3 (en
Inventor
Dennis C. Ferguson
Pradeep S. Sindhu
Rajiv N. Patel
Original Assignee
Juniper Networks
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US08/767,576 external-priority patent/US5909440A/en
Priority claimed from US08/844,171 external-priority patent/US5905725A/en
Application filed by Juniper Networks filed Critical Juniper Networks
Priority to CA002274962A priority Critical patent/CA2274962C/en
Priority to EP97951733A priority patent/EP0948849A4/en
Priority to JP52794798A priority patent/JP3453148B2/en
Publication of WO1998027662A2 publication Critical patent/WO1998027662A2/en
Publication of WO1998027662A3 publication Critical patent/WO1998027662A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00Digital computers in general; Data processing equipment in general
    • G06F15/16Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • G06F15/163Interprocessor communication
    • G06F15/167Interprocessor communication using a common memory, e.g. mailbox
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/54Store-and-forward switching systems 
    • H04L12/56Packet switching systems
    • H04L12/5601Transfer mode dependent, e.g. ATM
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/72Routing based on the source address
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/74Address processing for routing
    • H04L45/745Address table lookup; Address filtering
    • H04L45/74591Address table lookup; Address filtering using content-addressable memories [CAM]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/50Queue scheduling
    • H04L47/62Queue scheduling characterised by scheduling criteria
    • H04L47/622Queue service order
    • H04L47/6225Fixed service order, e.g. Round Robin
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/10Packet switching elements characterised by the switching fabric construction
    • H04L49/104Asynchronous transfer mode [ATM] switching fabrics
    • H04L49/105ATM switching elements
    • H04L49/108ATM switching elements using shared central buffer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/15Interconnection of switching modules
    • H04L49/1515Non-blocking multistage, e.g. Clos
    • H04L49/153ATM switching fabrics having parallel switch planes
    • H04L49/1538Cell slicing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/20Support for services
    • H04L49/201Multicast operation; Broadcast operation
    • H04L49/203ATM switching fabrics with multicast or broadcast capabilities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/25Routing or path finding in a switch fabric
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/30Peripheral units, e.g. input or output ports
    • H04L49/3072Packet splitting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/30Peripheral units, e.g. input or output ports
    • H04L49/3081ATM peripheral units, e.g. policing, insertion or extraction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/60Software-defined switches
    • H04L49/608ATM switches adapted to switch variable length packets, e.g. IP packets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/90Buffering arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/90Buffering arrangements
    • H04L49/901Buffering arrangements using storage descriptor, e.g. read or write pointers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/90Buffering arrangements
    • H04L49/9042Separate storage for different parts of the packet, e.g. header and payload
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/90Buffering arrangements
    • H04L49/9047Buffering arrangements including multiple buffers, e.g. buffer pools
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/90Buffering arrangements
    • H04L49/9057Arrangements for supporting packet reassembly or resequencing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q11/00Selecting arrangements for multiplex systems
    • H04Q11/04Selecting arrangements for multiplex systems for time-division multiplexing
    • H04Q11/0428Integrated services digital network, i.e. systems for transmission of different types of digitised signals, e.g. speech, data, telecentral, television signals
    • H04Q11/0478Provisions for broadband connections
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/54Store-and-forward switching systems 
    • H04L12/56Packet switching systems
    • H04L12/5601Transfer mode dependent, e.g. ATM
    • H04L2012/5638Services, e.g. multimedia, GOS, QOS
    • H04L2012/5646Cell characteristics, e.g. loss, delay, jitter, sequence integrity
    • H04L2012/5652Cell construction, e.g. including header, packetisation, depacketisation, assembly, reassembly
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/54Store-and-forward switching systems 
    • H04L12/56Packet switching systems
    • H04L12/5601Transfer mode dependent, e.g. ATM
    • H04L2012/5678Traffic aspects, e.g. arbitration, load balancing, smoothing, buffer management
    • H04L2012/5679Arbitration or scheduling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/54Store-and-forward switching systems 
    • H04L12/56Packet switching systems
    • H04L12/5601Transfer mode dependent, e.g. ATM
    • H04L2012/5678Traffic aspects, e.g. arbitration, load balancing, smoothing, buffer management
    • H04L2012/5681Buffer or queue management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/10Packet switching elements characterised by the switching fabric construction
    • H04L49/103Packet switching elements characterised by the switching fabric construction using a shared central buffer; using a shared memory
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/25Routing or path finding in a switch fabric
    • H04L49/252Store and forward routing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/22Parsing or analysis of headers

Definitions

  • the present invention relates generally to data routing systems, and more particularly to a method and apparatus for routing packets through a high speed data switch .
  • a router In packet switched communication systems, a router (switch or packet forwarding engine) is a switching device which receives packets on one port, and based on destination information contained within the packet, routes the packet to the destination (or intermediary destination) via another port.
  • Prior art routers perform this routing function by evaluating header information associated with a first data block in the packet in order to determine the proper output port for a particular packet.
  • the evaluation process involves two basic steps performed sequentially: key extraction and route look-up.
  • Each packet contains a header and data field.
  • the header field contains control information associated with the routing of the packet, including source and destination information.
  • the data field contains information which may include embedded headers for higher level protocols.
  • the first step of the routing process is the identification of the key.
  • the key contains the information that is used to look-up the route for an incoming packet.
  • the router Upon identifying the key associated with an incoming packet, the router next must determine which port provides the best path to the destination.
  • a route table Associated with the router is a route table.
  • the route table includes entries having a route and destination associated therewith. After a key for a packet has been determined, the router performs a look-up in the route table for the destination associated with that key to determine the output port for the packet.
  • the key may match multiple routes in the route table. Assuming the router located a match of the key in the route table, the entire packet is thereafter routed to the destination via the indicated output port.
  • the invention provides a method of looking up a key associated with a packet to determine a route through a routing device including upon receipt of a key, forward traversing one or more nodes which make up a trie stored in a memory by evaluating at each node traversed a bit in the key as indicated by a bit-to-test indicator associated with each node. A value of the bit in the key determining the path traversed along the trie.
  • the method includes locating an end node having a route and comparing the route to the key. If they match, destination information associated with the end node is outputted to guide the transfer of the packet through the routing device. If they do not match, the trie is traversed backwards to locate a best match for the key.
  • Forward traversing includes storing on a stack for each node having an attached route the bit-to-test indicator and a pointer to the attached route.
  • Traversing the trie backwards includes comparing the key with the route to determine a first dissimilar bit location, popping entries off the stack to determine when the bit-to-test indicator associated with a first node in the backward traversal is less than or equal to the first dissimilar bit location, and outputting destination information associated with the first node to guide the transfer of the packet through the routing device .
  • the first node includes a route and statistical information for each packet is calculated and stored in memory with the route for the end node and the first node. The statistical information is transferred along with the destination information to an output port in the routing device for transfer to a destination.
  • a root table Prior to a forward traversal of the trie, a root table is searched for a match of a predetermined number of bits in the key where the root table is indexed by the predetermined number of bits and each entry includes a pointer to a start node in the trie to begin the forward traversal .
  • the forward traversal of the trie includes loading node information for each node traversed in the trie until the end node is reached, the node information including a bit-to-test indicator, a left child pointer, a right child pointer and an attached route.
  • the nodes in the trie include left child pointers and right child pointers with each pointer including a bit-to-test indicator for indicating a bit to be tested in the key associated with a child node to which the left or right child pointer indicates.
  • Memory accesses are minimized in the forward traversal of the trie by requiring the loading of a single pointer at each node until the end node .
  • the invention provides a method of routing a packet through a switch including upon receipt of a packet, extracting a key from the packet. Thereafter a trie is forward traversed by evaluating at each node a bit in the key as indicated by a bit-to-test indicator associated with each node. A value of the bit in the key located at a position indicated by the bit-to-test indicator determining the path traversed along the trie at each node. Thereafter, an end node having a route is located. The route is compared to the key. If they match, destination information associated with the end node is retrieved. If they do not match, the trie is traversed backwards to locate a best match for the key having a route and destination information associated therewith. The packet is routed through the switch according to the destination information.
  • Preferred embodiments of the invention include the following features.
  • Statistical information associated with each route is calculated and stored in memory with an associated route.
  • the statistical information is forwarded along with the packet to a destination.
  • the statistical information includes transaction statistics associated with numbers or types of packets routed to a particular destination or billing information.
  • Quality of service information is assigned to each route.
  • the quality of service information determining a priority of a transfer of the packet out of the routing device .
  • the invention provides a method of inserting a route in a route table where the route table is stored as a trie in a memory of a routing device.
  • the route table defining the path by which a packet is transferred through the routing device.
  • the method includes traversing a trie to determine an insertion point, creating a new node, and determining if the insertion point for the new node is between existing nodes in the trie. If so, a child pointer is set in the new node to indicate a node directly beneath the insertion point.
  • the new node is stored in memory. Thereafter, a child pointer in a node directly above the insertion point is updated to indicate a starting address in memory for the new node.
  • the invention provides a router for routing packets in a packet switched network including one or more input ports for receiving packets, a packet memory, an input switch coupled to each input port and the memory.
  • the input switch including a transfer engine for transferring packets from an input port to the packet memory and a key extraction engine for extracting a key from each packet.
  • the router further including a controller coupled to the input switch.
  • the controller including a key look-up engine and a route memory.
  • the route memory for storing a route table where the route table includes a trie.
  • the key look-up engine traversing the trie to determine a best match to the key. Upon determining the best match for the key the controller generates notification information.
  • the router further including one or more output ports, an output switch coupled to the controller, the packet memory and the output port for transferring packets from packet memory to an appropriate output port based on the notification information received from the controller.
  • Preferred embodiments include the following features.
  • the key look-up engine forward traverses the trie by evaluating at each node traversed a bit in the key as indicated by a bit-to-test indicator associated with each node. A value of the bit in the key determining the path traversed along the trie.
  • the route memory is divided into a plurality of banks, and where parent and children nodes in the trie are stored in different banks.
  • Each node in the trie includes a bit-to-test indicator, a left child pointer, a right child pointer and an attached route.
  • the left child pointer indicating a child node to be traversed in the forward traversal when a value of a bit in the key as indicated by the bit- to-test indicator is a first value.
  • the right child pointer indicating a child node to be traversed in the forward traversal when a value of a bit in the key indicated by the bit-to-test indicator is a second value.
  • the left child pointer, right child pointer and attached route are stored in contiguous locations in the route memory.
  • the invention provides a route look-up engine for locating a best match for a key in a route table.
  • the route table including a trie stored in a memory associated with a routing device.
  • the trie including one or more entries defining a path through a routing device for transferring a packet in a packet switched network from a source to a destination.
  • the route look-up engine including a stack for storing stack entries including a bit-to-test indicator and a pointer to a destination and a look-up engine including a buffer, a bit comparison engine and a key comparison engine.
  • the buffer for storing node information that is retrieved from the memory.
  • the node information including a bit- to-test indicator.
  • the invention provides a trie for storing routes in a routing device to allow for efficient routing of packets through the routing device including a start node including a bit-to-test indicator, a left child pointer, a right child pointer and an attached route.
  • the left and right child pointers pointing to internal nodes.
  • the trie includes an internal node including a bit-to-test indicator, a right child pointer, a left child pointer and an attached route.
  • the left and right child pointers pointing to a route node or another internal node.
  • the trie including a route node having a bit-to-test indicator and an attached route .
  • Preferred embodiments include the following features.
  • the attached route includes statistical and quality of service information.
  • the invention provides a computer program, tangibly stored on a computer-readable medium, comprising instructions for causing a computer to, upon receipt of a key, forward traverse a trie stored in a memory by evaluating at each node traversed a bit in the key as indicated by a bit-to-test indicator associated with each node. A value of the bit in the key determining the path traversed along the trie.
  • the computer caused to locate an end node in the trie having a route and compare the route to the key. If they match, destination information associated with the end node is outputted to guide a transfer of a packet through a routing device. If they do not match, the trie is traversed backwards to locate a best match for the key and destination information associated therewith.
  • One advantage of the invention is that routes may be simply added to existing route tables without requiring the disruption of the look-up process.
  • Another advantage of the invention is that additional information including that needed for multicast and flow identification (ID) may be stored in a single route table without affecting the performance of the look-up.
  • ID multicast and flow identification
  • the present invention provides a single unified mechanism for performing efficient best-match look-up for unicast, multicast and flow based routing in the presence of extremely large route tables.
  • Another advantage of the present invention is that line rate route look-ups may be performed on the whole route table without requiring route caching.
  • Another advantage of the present invention is that large route tables may be efficiently searched at line rates .
  • Figure 1 is a schematic block diagram of a packet switching system according to one embodiment of the present invention.
  • Figure 2 is a schematic block diagram of a router according to one embodiment of the present invention.
  • Figure 3 is a schematic block diagram of a route trie according to one embodiment of the present invention.
  • Figure 4a is a schematic block diagram of a data structure for an internal node with an attached route according to one embodiment of the present invention.
  • Figure 4b is a schematic block diagram of a data structure for a start node according to one embodiment of the present invention.
  • Figure 4c is a schematic block diagram of a data structure for a route node according to one embodiment of the present invention.
  • Figure 4d is a schematic block diagram of a data structure for a internal node according to one embodiment of the present invention.
  • Figures 5a-5g collectively are a flow chart for a populating a trie according to one embodiment of the present invention.
  • Figures 6a and 6b collectively are a process for routing data through the router according to one embodiment of the present invention.
  • Figure 7a is a schematic block diagram of a data structure for a internal node according to an alternative embodiment of the present invention.
  • Figure 7b is a schematic block diagram of a data structure for a internal node with an attached route according to an alternative embodiment of the present invention.
  • Figure 7c is a schematic block diagram of a data structure for a route node according to an alternative embodiment of the present invention.
  • Figures 8a and 8b collectively are a process for routing data through the router according to an alternative embodiment of the present invention.
  • a source 10 is connected to one or more routers 20 for transmitting packets to one or more destinations 30.
  • Each router includes a plurality of ports that are connected to various sources and destinations. Accordingly, a packet from source 10 may pass through more than one router 20 prior to arriving at its destination.
  • each router 20 includes an input switch 100, an output switch 102, a memory 104, a controller 106 and a plurality of input ports 107 and output ports 108.
  • controller 106 Associated with the controller 106 is a memory element 109 for storing controller data.
  • Each switch 100 and 102 is connected to each input and output port 107 and 108 respectively in router 20.
  • router 20 includes eight input and output ports 107 and 108, respectively. In this embodiment, the number of input ports and output ports is equal, however, other applications may necessitate greater numbers of one or the other.
  • controller memory 109 is a four bank static random access memory (SRAM) that requires thirty two route look-up engines 110 to service at full bandwidth.
  • the present invention is scalable with respect to performance. That is, the number of route look-up engines 110 included within the controller may be increased to provide higher performance without requiring an increase in memory size. In one embodiment, the number of route look-up engines is eight times as great as the number of memory banks in controller memory 109. Alternatively, lesser cost and performance units may use lesser numbers of route look-up engines 110.
  • packets are received at an input port 107, transferred to input switch 100 and stored temporarily in memory 104.
  • a key extraction engine reads the key from the first data block in the packet and transfers the key to controller 106.
  • the input switch also includes a transfer engine for transferring packets received from an input port 107 to memory 104.
  • the key includes at least destination information and may also include source information, a flow identifier and physical source information (input port ID) .
  • the key is located in the header field associated with the first block of data in a packet.
  • the header may contain other information (ISO layer 2 and layer 3 headers) , such information is passed to memory for storage.
  • ISO layer 2 and layer 3 headers ISO layer 2 and layer 3 headers
  • the process of reading key information from a packet is known in the art.
  • the present invention accommodates keys of various types. For example, keys for various protocols may be designated (IPV4, IPV6, etc.) .
  • the length of the key is user definable.
  • the key is derived from the header, but portions may also be derived from the payload (data field associated with the packet) .
  • the controller When the controller receives the key information, it must determine a key type.
  • a plurality of key types are defined.
  • the user may define up to 4 types of keys, each having variable length.
  • the key type is defined by a two bit field in the header. A look-up of the two bit field is used to determine the appropriate trie to search.
  • route look-up engine 110 performs a trie based search for the best variable length match of the key, with each key type defining a particular trie for searching.
  • a trie is a data structure that is used to locate the best (longest) matching route for a given key. The process of the trie based search will be described in greater detail below in reference to Figure 6.
  • the route lookup engine returns a result which includes the output port associated with the destination.
  • the result and other information for routing the packet through the router combine to form a notification.
  • the notification is transferred from the controller 106 to the output switch 102.
  • the output switch 102 Upon receiving the notification, the output switch 102 initiates the transfer of the packet from memory 104 to the respective output port 108 associated with the result.
  • Route look-up engine 110 performs the best match variable length look-up based on a modified radix trie search routine.
  • a route table is stored in memory 109 in the form of one or more tries.
  • Each trie is comprised of one or more nodes including a start node 300, and may include internal nodes (without an attached route) 302, internal nodes with an attached route 304 and route nodes 306 as is shown in Figure 3.
  • the starting node includes an attached route that is guaranteed to match any key having a type associated with this particular trie. In this way, the attached route provides a default path m the event no other match is located in the trie for a particular key.
  • Nodes are the decision points in the look-up process.
  • a key associated with a packet has various ones of its bits tested at nodes along the trie, and depending on the value of the indicated bit in the key being tested, will result in the traversal down a particular branch of the trie.
  • the bits of a key are numbered left to right.
  • Associated with each node is a bit-to-test indicator. The value of the bit-to-test indicator in a trie branch increases until a leaf (route node) is reached.
  • Internal nodes may be of two types, those with and those without attached routes .
  • An internal node with an attached route 304 may be a match for a key. Internal nodes without attached routes are never a match for a key.
  • Route nodes 306 are nodes which have no children and, accordingly, only contain route information. The traversal along the trie will be described in greater detail below in reference to Figure 6.
  • each internal node in a trie is shown in Figure 4a.
  • Associated with each node is a bit-to-test indicator field 400, a left child pointer 402, a right child pointer 404 and an attached route 406.
  • the bit-to-test indicator field indicates the bit in the key which is to be tested at this node in order to determine which branch (left child or right child) in the trie should be traversed in the look-up process.
  • the left child pointer 402 points to a left child in the trie structure while the right child pointer 404 points to a right child in the trie structure.
  • a left child is the next node in the trie to be traversed when the bit tested for the present node has a value of 0.
  • the attached route 406 indicates a result which is associated with this particular node.
  • the attached route is two words and includes both output port and prefix information.
  • the attached route may also include other data such as quality of service and statistical information.
  • the attached route includes fields associated with the route (destination) which are updated each time a packet is processed for the given route. The information is stored along with the attached route and may be downloaded in response to a query from a user or the destination. Alternatively, a portion or all of the information may be downloaded with each packet transferred to a destination as part of the notification.
  • controller 106 includes statistical modules for calculating statistical information related to each packet transferred through the router. As each packet is processed by the controller, statistical modules update the statistical information stored with the destination route determined in the look-up process. In addition, quality of service information may be stored with an attached route to speed the routing of certain packets through the switch structure. A quality of service value may be set for each route to allow for the prioritization of packets transferred out a particular output port.
  • the data structure of an attached route is comprised of a prefix length, a prefix (the portion that is left justified and matched against the key) , a result field, a statistics field and a quality of service field.
  • Prefix length indicates the length of the prefix in bits.
  • the prefix is a pattern (portion of a key) that is compared against a key to determine a best match.
  • the result field stores the output port (destination port) associated with the particular route (prefix) .
  • the attached route indicates the output port to which the packet is to be routed.
  • the attached route is a pointer which points to the location in memory where the attached route is stored. Alternatively, the attached route may be stored in consecutive memory locations with the rest of the node information as described above.
  • FIG. 4b The data structure for the start node according to one embodiment of the present invention is shown in Figure 4b. Associated with the start node are a left child pointer 402, a right child pointer 404 and an attached route 406.
  • no bit-to-test indicator field is stored in memory for the start node. This is because, typically the bit-to-test indicator for the start node is set to bit zero. Alternatively, another bit in the key may be the first bit-to-test. If another bit is the first bit- to-test, then the associated bit identifier is stored in a bit-to-test indicator field for the start node.
  • each route node has only an attached route 406.
  • a route table is not fully populated. That is, not all of the possible key values are mapped to a particular output port. Accordingly, some bits in the key are "don't care" values, and are not required to be tested during the route look-up process, because they do not affect the determination of the output port.
  • the look-up of keys in the route table required the comparison of each bit in the key with entries in the route table. Such systems were inefficient. With a trie structure, not every bit in a key needs to be tested in order to determine the best match associated with a particular packet. By testing only the smallest number of bits that allow the discrimination between a key and existing routes, the speed of determining a match is improved.
  • a route table is created in trie format.
  • a start node is created for the trie (500) .
  • the start node is assigned an attached route (502) .
  • the left and right child pointers are assigned a null value (a binary 511 in one embodiment of the present invention) indicating that no left or right child exists (504) .
  • the four word start node including left child pointer (1), right child pointer (1) and attached route (2) is stored in memory 108 (506) .
  • a check is made to determine if any other routes are needed to be placed in the trie (508) . If not then, the process ends (510) . Else, the next route is loaded (512) .
  • the first route in the trie is added as a route node (514) .
  • An associated route is assigned based on the destination for the particular prefix (516).
  • the attached route and prefix information is stored in memory (518).
  • the appropriate pointer in the start node (left child pointer or right child pointer) is updated based on the value of the zero bit of the first prefix (520) . If the value of the zero bit in the first prefix (route) loaded is a "0", then the left child pointer is updated to reflect the starting address in memory where the route node for this prefix is stored.
  • the right child pointer is updated to reflect the starting address in memory where the route node for this prefix is stored.
  • a check is made to determine if any other prefixes are needed to be placed in the trie (522) . If so, the next prefix is loaded (523) . The next prefix will be placed in the trie as either a route node, an internal node, an internal node with an attached route, or as an attached route to an existing internal node.
  • a prefix search is performed in the existing trie (524) . The search entails traversing the trie by testing the new prefix based on the bit indicated by the bit-to-test indicator for each node.
  • the bit in the new prefix designated by the bit-to-test indicator for the node is checked in order to determine the next node in the search.
  • the prefix search continues until an end route is determined (526).
  • An end route will be found either at a route node or at an internal node having an attached route.
  • An end route is either the route associated with a route node or the first route located on the trie after the bit-to-test indicator associated with the current node on the trie exceeds the number of bits in the prefix being searched.
  • the first route located may be an attached route to an internal node, or a route node.
  • the search must terminate at a node which has an associated route in order to determine where (and how) the new prefix will be inserted into the trie.
  • the search will come to an end as described above.
  • the search is diminimus, and may end at either the start node (if the new prefix being searched has a value in the zero bit different from the prefix associated with the route node) or at the route node .
  • a comparison is made between the prefix being searched and the end route to determine the first dissimilar bit (BIT Dis ) in the new prefix (528) .
  • BIT Dis the first dissimilar bit
  • an EXCLUSIVE OR operation on the two prefixes is performed to reveal the first dissimilar bit. If a dissimilar bit is found, then branch A in the process is performed (529) . If no dissimilar bits are found, then all of the bits of the new prefix match the end route and branch B in the process is performed.
  • a dissimilar bit has been determined, and the new prefix will be inserted into the trie as route node pointed to by a new internal node which is to be inserted into the existing trie.
  • a new route node is created and stored in memory indicating the destination associated with the new prefix (530).
  • a new internal node is created (532) .
  • the bit-to-test indicator for the new internal node is assigned to be the first dissimilar bit (BIT Di3 ) discovered above (534) .
  • One of the child pointers (either the left child or the right child) of the new internal node is assigned the address of the new route node depending on the value of the bit-to-test indicator in the new prefix (536) .
  • the trie is traversed in reverse to locate the first node (the parent node) having a bit-to-test indicator which is less than the first dissimilar bit (BIT Dis ) (538) .
  • the node immediately beneath the parent node in the original trie is referred to as the grand-child node.
  • the new internal node is inserted into the trie between the parent and the grand-child nodes by assigning the remaining child pointer in the new internal node the starting address associated with the grand-child node (540).
  • the address of the pointer in the parent node which previously pointed to the grand-child node is updated to indicate the starting address in memory of the new internal node (542) . Branch A is complete.
  • branch B no dissimilar bits were determined, necessitating a comparison of the length of the new prefix with the length of the end route (545) . If the length of the new prefix is longer than the length of end route then branch Bl is traversed (546) . If the length of the new prefix is shorter than the length of end route, then branch B2 will be traversed (547) . Finally, if the length of the new prefix is the same as the length of end route, branch B3 will be traversed.
  • the new prefix will be inserted into the trie below the node associated with the end route as a new route node.
  • a new route node is created and stored in memory indicating the destination associated with the new prefix (550). Thereafter, a determination is made of the type of node associated with the end route (552) . If the node associated with the end route is an internal node with an associated route, then the appropriate child pointer (based on the value of the bit in the new prefix of the bit-to-test indicator associated with the internal node) is assigned the starting address of the new route node (554) . Else, a new internal node is created (556) .
  • the bit-to-test indicator for the new internal node is assigned to be the last bit in the end route (558) .
  • One of the child pointers (either the left child or the right child) of the new internal node is assigned the address of the new route node depending on the value of the bit in the new prefix of the bit-to-test indicator associated with the new internal node (560).
  • the address of the pointer in the parent node (the node immediately preceding the route node associated with the end route and whose pointer previously indicated the starting address of the route node associated with the end route) is updated to indicate the starting address in memory of the new internal node (562) .
  • Branch Bl is complete.
  • the new prefix is shorter than the end route.
  • the new prefix is inserted into the trie above the node associated with the end route, as either a new route or as an internal node with a route attached. Specifically, starting at the node associated with the end route, the trie is traversed backwards until a node (the parent node) is found having a bit-to-test indicator less than or equal to the index (length) of the new prefix (570) . The node immediately beneath the parent node in the original trie is referred to as the grandchild node. If the bit-to-test indicator is less than the index of the new prefix (571), then a new internal node is inserted below the parent node (572) . The bit-to-test indicator for the new internal node is assigned the value of the index (length) of the new prefix (574) .
  • the new internal node tests the first bit after the end of the new prefix.
  • the new internal node is inserted into the trie between the parent and the grand-child nodes by assigning one of the child pointers (as indicated by the value of the bit-to-test indicator of the new internal node) the starting address associated with the grand-child node (576) .
  • the other child pointer (either the left child or the right child) of the new internal node is assigned a null value (binary 511 in one embodiment) (578) .
  • the address of the pointer in the parent node which previously pointed to the grand-child node is updated to indicate the starting address in memory of the new internal node (580).
  • the new prefix is inserted as an attached route for the node (590) . Specifically, the attached route associated with the node determined in the search is updated to reflect the destination of the new prefix. Branch B2 is complete.
  • the new prefix is the same length as the end route.
  • the new prefix is inserted into the trie as an update to the end route (592) .
  • the route associated with the end node is updated to reflect the destination of the new prefix.
  • the process of constructing a trie is performed for each type of key based on an initial set of prefixes and associated destination information.
  • each trie may be updated dynamically by a routing protocol associated with the controller 106 ( Figure 2).
  • the routing protocol services the tries, and may insert new prefixes as necessary.
  • the process for inserting a new prefix is identical to the process described above for inserting a next prefix after the first prefix in the trie has been installed as a route node (steps 522-592).
  • the updating process advantageously does not require the shutting down of the route look-up process. As was described above, the insertion of a route is accomplished off line, and only the final step in the process affects the trie.
  • the final step in any insertion process requires writing in memory the address for a new node to the new node's parent. Accordingly, searches in a trie may be performed the entire time that an insertion process is operated to insert new entries or make changes to existing entries. The trie is never invalid, thus never requiring the shutting down of the look-up process for trie maintenance.
  • the router is ready to process packets.
  • a key is copied from an inbound packet by input switch 100 ( Figure 2) and transferred to route look-up engine 110 (Figure 2) in the controller 106 ( Figure 2) .
  • route look-up engine 110 Figure 2 in the controller 106 ( Figure 2) .
  • a key type is determined for a new key to identify the particular trie that must be traversed in the look-up process (600).
  • the look-up process includes a forward and backward traversal of the trie to determine the best match associated with a given key.
  • the forward search begins at the start node.
  • route look-up engine 110 determines the value of the bit in the new key indicated by the bit-to- test indicator (as defined by the bit-to-test indicator field retrieved in step (602)) (604). Thereafter, the route look-up engine determines if the pointer indicated by the bit value (either the left child pointer or right child pointer) indicates a child node (606) . If no child is indicated, then route look-up engine 110 performs a key comparison as is shown in branch C.
  • the route look-up engine stores the starting address in memory for the attached route (or the starting address associated with the contiguous memory locations associated with the start node) and the bit-to-test indicator associated therewith on a forward search stack in the route look-up engine (610) . If no attached route exists, the process continues at branch G. The route look-up engine thereafter loads the data words associated with the next node indicated by the respective child pointer (612) .
  • the loading process of a node entails loading all of the data blocks associated with a given node (5 for internal nodes or 2 for route nodes) . Alternatively, a lesser number of data words may be loaded as will be described below.
  • the route look-up engine determines if the new node is a route node (614) . If so, then a route has been determined and the process continues at branch C. If not, then the route look-up engine (bit comparison engine) determines the bit value in the new key of the bit indicated by the bit-to-test indicator associated with the new node (node loaded in step 612), where the bit-to-test is defined by the bit-to-test indicator field retrieved as part of the load in step 612 (616) . Thereafter, the route look-up engine determines if the pointer indicated by the bit value (either the left child pointer or right child pointer) indicates a child node (618) .
  • the route look-up engine performs a key comparison as is shown in branch C. Alternatively, the route look-up engine checks to determine if the new node has an attached route (620) . If so, then the process continues at branch F resulting in the storage of the address associated with the attached route onto the stack (or the pointer indicating the starting address in memory for the attached route) prior to the loading of a next route. Alternatively, the process continues at branch G and the next node is loaded for processing. The route look up engine repeats this process for each node (steps 610-620) until an end node has been located.
  • An end node may be a route node or an internal node having an attached route.
  • An internal node with an attached route will only be an end node if the value of the bit indicated by the bit-to-test indicator in the key being tested indicates a child pointer associated with the internal node that points nowhere (null) .
  • the route look-up engine performs branch C. Specifically, if the pointer indicated by a bit-to-test value in the new key points to a route, then the forward search portion of the process ends when the route is retrieved. If however, the pointer indicates a null, the search ends with the internal node.
  • Branch C can be characterized as follows: the forward search has terminated at an internal node (the end node) having a pointer to a left child or a pointer to a right child which has no data, and, this "no-data" pointer is indicated by the bit value in the new key of the bit-to-test bit of the end node; or, the search has terminated at a route node.
  • the backward portion of the search begins by comparing the route associated with the current node (either an attached route for an internal node or a route associated with a route node) and the new key.
  • a key comparison engine in route look-up engine 110 compares the key being searched and the end route (the route associated with the end node) to determine the first dissimilar bit (BIT Dls ) in the new key (630) .
  • BIT Dls the first dissimilar bit
  • an EXCLUSIVE OR operation on the new key and prefix (route) is performed to reveal the first dissimilar bit. If a dissimilar bit is found, then branch D in the process is performed (632) . If no dissimilar bits are found, then all of the bits of the new key match the end route and branch E in the process is performed.
  • branch D a dissimilar bit has been determined, and the end route is not a match for the new key.
  • the trie is traversed in reverse to locate the first node (the best match node) having a bit-to-test indicator which is less than or equal to the bit number of the first dissimilar bit (BIT D s ) (640).
  • this is performed by popping off entries from the forward search stack in the route look-up engine (each entry associated with nodes that have attached routes and have been traversed as part of the forward search) , until an entry is located which has a bit-to- test indicator value that is less than or equal to the bit number of the first dissimilar bit.
  • the process continues at branch E.
  • a best match route has been determined either by discovering no dissimilar bits when comparing the new key to the end route, or by traversing the trie and locating the route associated with the best match node.
  • the route look-up engine loads the best match route from memory (650) .
  • no load is required, such load having already been accomplished as part of the loading of the end node in the forward search of the trie.
  • the route information is loaded based on the pointer stored on the stack.
  • the route look-up engine transfers the best match route information to the output switch 102 ( Figure 2) (652) (652) . Thereafter the process ends (654) .
  • the trie structure guarantees a best match for each key transmitted through the switch.
  • each route stored in the trie has a prefix associated therewith.
  • a prefix is a left justified subset of a key. Accordingly, a key may match many prefixes in a trie.
  • the best match is the matching prefix having the longest length.
  • the system of the present invention provides for a best (longest) match for a key.
  • ALTERNATIVE EMBODIMENTS In one embodiment of the invention, numerous techniques are employed to speed the look-up process and minimize the number of memory accesses. Specifically, the following techniques are employed: minimized data word loads, multiple memory banks, spread data structures across memory banks and root table.
  • Minimized Data Word Loads As was described above in conjunction with the forward traversal of a trie, a load operation is performed of the data words associated with each node in the forward search. This requires the loading of up to five words per node (bit-to-test indicator, left child pointer, right child pointer, and attached route (2 words)) . Alternatively, lesser number of words may be loaded.
  • only the bit-to-test indicator and child pointers are loaded for a given node.
  • the node is determined to be the end node in a forward search, then the attached route information can be loaded as required.
  • only the bit-to-test indicator is loaded initially for a given node.
  • the bit value of the new key is used to determine which child should be loaded for this node, if any. For example, if the bit value of the bit in the new key indicated by the bit-to-test indicator is a "0", the left child only is loaded. If the bit value in the bit in the new key is a "1", then only the right child is loaded.
  • an alternative data structure associated with the nodes is used to minimize memory accesses.
  • FIG 7a a data structure for an internal node without an attached route is shown.
  • Each internal node without an attached route includes a left child pointer 700, and a right child pointer 702.
  • the left and right child pointers include two status bits 704 and 706 (little "r" and big "R", respectively) , a pointer field 708 which points to the starting address of an associated child, and a bit-to-test indicator field 710 which indicates the bit-to-test in the child node indicated by the pointer field 708.
  • the first status bit (little "r") 704 indicates whether the pointer stored in the pointer field 708 points to a route node or an internal node.
  • the second status bit (big “R”) 706 indicates whether an attached route exists for this node.
  • Each internal node with an attached route includes a left child pointer 700, a right child pointer 702 and an attached route 720.
  • the left and right child pointers include two status bits 704 and 706 (little "r" and big "R", respectively), a pointer field 708 which points to the starting address of an associated child, and a bit-to-test indicator field 710 which indicates the bit-to-test in the child node indicated by the pointer field 708.
  • the attached route 720 contains an index 722, a prefix 724, a result 726 (destination port) , a statistics field 728 and quality of service field 730, the functions of which have been described above.
  • the data structure for a route node is shown in Figure 7c. Each route node includes an attached route 720.
  • the process of performing a best match variable length look-up of a route begins with determining the type of key for a new key received at the controller (800) .
  • the starting address of an appropriate start node is determined based on the trie type (802) .
  • a check is made of the value of the bit in the new key indicated by the bit-to-test indicator associated with the start node (typically bit zero) (804) . If the value of bit in the new key is a "0”, then the route look-up engine retrieves the left child pointer associated with the start node which will be located at the starting address determined above in step 802 (806) . If the value of bit in the new key is a "1", the route look-up engine will increment by one the starting address received in step 802 (807) and retrieve the right child pointer associated with the start node (808).
  • the route look-up engine will retrieve the left child associated with the address indicated by the pointer (816). Specifically, the route look-up engine will retrieve the data word which is indicated by the address indicated by the left or right child pointer.
  • the route look-up engine will retrieve the right child associated with the address indicated by the pointer (818). Specifically, the route look-up engine will retrieve the data word which is indicated by the address indicated by the child pointer incremented by one . This process repeats (steps 814-822) until an end route is located. Specifically, if the pointer indicated by a bit-to-test value in the new key points to a route (820), then the forward search portion of the process ends when the route is retrieved (812) . If however, the pointer retrieved indicates a null value (822), a check is made to determine if the node has an attached route (824) .
  • the forward search portion of the process ends and the associated internal route is retrieved in step 812. If no attached route exists, a check is made to determine if the stack is empty (825) . If so, an error condition occurs and the route look-up terminates (826) . If the stack is not empty, then the last entry on the stack is retrieved (828) and the process continues at step 830. The route retrieved from the route node, the internal node with attached route, or the route indicated by the stack entry will become the end route for the purposes of performing the backward portion of the look-up process.
  • the route look-up engine compares the key being searched and the end route to determine the first dissimilar bit (BIT D1S ) in the new key (830) . If a dissimilar bit is found (832), then starting at the end node, the trie is traversed in reverse to locate the first node (the best match node) having a bit-to-test indicator stored on the stack which is less than or equal to the bit number of the first dissimilar bit (BIT Dls ) (840) .
  • this is performed by popping off entries from the forward search stack in the route look-up engine, each entry associated with nodes that have been traversed as part of the forward search, until a entry is located which has a bit-to-test indicator value that is less than or equal to the bit number of the first dissimilar bit.
  • the route look-up engine loads the best match route, either the route associated with the best match node or the end route from memory (850) . If the best match route is the end route, no memory load is required, such load having been accomplished as part of the comparison above. Alternatively, the route information is loaded by incrementing the memory address retrieved from the stack node by two (if the starting address for the node is stored on the stack as opposed to the address for the attached route) , and loading the appropriate route information. Thereafter, the route look-up engine transfers the best match route to the output switch 102 (852) .
  • the memory 108 attached to controller 106 is a bank of four static RAMs (SRAMs) .
  • SRAMs static RAMs
  • parents and children are distributed among the SRAM banks such that no parent and child are stored in the same bank of static RAM. Accordingly, when a route look-up engine accesses a particular memory location in memory 108, it is guaranteed to not to have to access the same memory bank in order to traverse to the next node in a given path.
  • the use of multiple memory banks is useful to increase the number of simultaneous read operations which can be performed in the look-up process. Distribution of parent and children nodes across the memory banks helps to avoid bank conflicts.
  • Another memory saving technique included in one embodiment of the present invention is the attachment of routes sequentially in memory for a given node. As was described above in reference to the node data structures as described in reference to Figures 4 and 7, if an internal node has an attached route, then the route is placed by design immediately following the associated right child pointer in memory. Accordingly, when the best match is located for a given node, the destination information associated therewith is known precisely, and may be retrieved directly from memory (as opposed to indirect retrieval if a pointer system is used) .
  • This organization technique saves on memory accesses. For example, upon a match condition, the route look-up engine must load the result which includes the output port associated with the particular switch.
  • Root Table In one embodiment of the present invention, a root table is used as a preliminary screen for matching the most significant bits in a key. A root table may be used to perform a quick match of the most significant bits in a key so as to avoid having to perform many memory accesses in the trie search.
  • the root table is stored in controller 106 ( Figure 2). Each entry in the route table includes an address to the start node in memory at which the look-up is to begin and a stack entry. The stack entry includes a bit-to-test indicator and a pointer to an attached route.
  • the table is indexed according to the first N bits of the key. In one embodiment of the present invention, the first eight bits of the key are indexed.

Abstract

A method and apparatus for looking up a key associated with a packet to determine a route through a routing device, the method including, upon receipt of a key, forward traversing one or more nodes which make up a trie stored in a memory by evaluating at each node traversed a bit in the key as indicated by a bit-to-test indicator associated with each node. A value of the bit in the key determining the path traversed along the trie. The method includes locating an end node having a route and comparing the route to the key (528). If they match, destination information associated with the end node is outputted to guide the transfer of the packet through the routing device (529). If they do not match, the trie is traversed backwards to locate a best match for the key.

Description

HIGH SPEED VARIABLE LENGTH BEST MATCH LOOK-UP IN A SWITCHING DEVICE
Background The present invention relates generally to data routing systems, and more particularly to a method and apparatus for routing packets through a high speed data switch .
In packet switched communication systems, a router (switch or packet forwarding engine) is a switching device which receives packets on one port, and based on destination information contained within the packet, routes the packet to the destination (or intermediary destination) via another port. Prior art routers perform this routing function by evaluating header information associated with a first data block in the packet in order to determine the proper output port for a particular packet. The evaluation process involves two basic steps performed sequentially: key extraction and route look-up. Each packet contains a header and data field. The header field contains control information associated with the routing of the packet, including source and destination information. The data field contains information which may include embedded headers for higher level protocols. The first step of the routing process is the identification of the key. The key contains the information that is used to look-up the route for an incoming packet. Upon identifying the key associated with an incoming packet, the router next must determine which port provides the best path to the destination. Associated with the router is a route table. The route table includes entries having a route and destination associated therewith. After a key for a packet has been determined, the router performs a look-up in the route table for the destination associated with that key to determine the output port for the packet. The key may match multiple routes in the route table. Assuming the router located a match of the key in the route table, the entire packet is thereafter routed to the destination via the indicated output port.
In the prior art, the process of performing the look-up in a large route table was a very time consuming process. In order to speed the look-up process, caching of the most recent route matches was often performed. However, caching is minimally effective, providing an advantage only if the same key patterns are repeated.
In addition, the process of changing a route in an existing route table was difficult in prior art systems, often requiring the disruption of the look-up process. Finally, prior art route tables typically provide only route and destination information. The size of the route tables were often minimized to include only minimal information for route look-up. Typically, separate tables were required for unicast and multicast routing. Pejorative information relating to flow identification, packet routing or accounting was not stored in the route tables so as not to slow down the already under- performing look-up engines. Summary of the Invention In general, in one aspect, the invention provides a method of looking up a key associated with a packet to determine a route through a routing device including upon receipt of a key, forward traversing one or more nodes which make up a trie stored in a memory by evaluating at each node traversed a bit in the key as indicated by a bit-to-test indicator associated with each node. A value of the bit in the key determining the path traversed along the trie. The method includes locating an end node having a route and comparing the route to the key. If they match, destination information associated with the end node is outputted to guide the transfer of the packet through the routing device. If they do not match, the trie is traversed backwards to locate a best match for the key.
Preferred embodiments include the following features. Forward traversing includes storing on a stack for each node having an attached route the bit-to-test indicator and a pointer to the attached route.
Traversing the trie backwards includes comparing the key with the route to determine a first dissimilar bit location, popping entries off the stack to determine when the bit-to-test indicator associated with a first node in the backward traversal is less than or equal to the first dissimilar bit location, and outputting destination information associated with the first node to guide the transfer of the packet through the routing device . The first node includes a route and statistical information for each packet is calculated and stored in memory with the route for the end node and the first node. The statistical information is transferred along with the destination information to an output port in the routing device for transfer to a destination.
Prior to a forward traversal of the trie, a root table is searched for a match of a predetermined number of bits in the key where the root table is indexed by the predetermined number of bits and each entry includes a pointer to a start node in the trie to begin the forward traversal .
The forward traversal of the trie includes loading node information for each node traversed in the trie until the end node is reached, the node information including a bit-to-test indicator, a left child pointer, a right child pointer and an attached route. The nodes in the trie include left child pointers and right child pointers with each pointer including a bit-to-test indicator for indicating a bit to be tested in the key associated with a child node to which the left or right child pointer indicates. Memory accesses are minimized in the forward traversal of the trie by requiring the loading of a single pointer at each node until the end node .
In another aspect, the invention provides a method of routing a packet through a switch including upon receipt of a packet, extracting a key from the packet. Thereafter a trie is forward traversed by evaluating at each node a bit in the key as indicated by a bit-to-test indicator associated with each node. A value of the bit in the key located at a position indicated by the bit-to-test indicator determining the path traversed along the trie at each node. Thereafter, an end node having a route is located. The route is compared to the key. If they match, destination information associated with the end node is retrieved. If they do not match, the trie is traversed backwards to locate a best match for the key having a route and destination information associated therewith. The packet is routed through the switch according to the destination information.
Preferred embodiments of the invention include the following features. Statistical information associated with each route is calculated and stored in memory with an associated route. The statistical information is forwarded along with the packet to a destination. The statistical information includes transaction statistics associated with numbers or types of packets routed to a particular destination or billing information.
Quality of service information is assigned to each route. The quality of service information determining a priority of a transfer of the packet out of the routing device .
In another aspect the invention provides a method of inserting a route in a route table where the route table is stored as a trie in a memory of a routing device. The route table defining the path by which a packet is transferred through the routing device. The method includes traversing a trie to determine an insertion point, creating a new node, and determining if the insertion point for the new node is between existing nodes in the trie. If so, a child pointer is set in the new node to indicate a node directly beneath the insertion point. The new node is stored in memory. Thereafter, a child pointer in a node directly above the insertion point is updated to indicate a starting address in memory for the new node.
In another aspect the invention provides a router for routing packets in a packet switched network including one or more input ports for receiving packets, a packet memory, an input switch coupled to each input port and the memory. The input switch including a transfer engine for transferring packets from an input port to the packet memory and a key extraction engine for extracting a key from each packet. The router further including a controller coupled to the input switch. The controller including a key look-up engine and a route memory. The route memory for storing a route table where the route table includes a trie. The key look-up engine traversing the trie to determine a best match to the key. Upon determining the best match for the key the controller generates notification information. The router further including one or more output ports, an output switch coupled to the controller, the packet memory and the output port for transferring packets from packet memory to an appropriate output port based on the notification information received from the controller. Preferred embodiments include the following features. The key look-up engine forward traverses the trie by evaluating at each node traversed a bit in the key as indicated by a bit-to-test indicator associated with each node. A value of the bit in the key determining the path traversed along the trie. The route memory is divided into a plurality of banks, and where parent and children nodes in the trie are stored in different banks.
Each node in the trie includes a bit-to-test indicator, a left child pointer, a right child pointer and an attached route. The left child pointer indicating a child node to be traversed in the forward traversal when a value of a bit in the key as indicated by the bit- to-test indicator is a first value. The right child pointer indicating a child node to be traversed in the forward traversal when a value of a bit in the key indicated by the bit-to-test indicator is a second value. The left child pointer, right child pointer and attached route are stored in contiguous locations in the route memory.
In another aspect the invention provides a route look-up engine for locating a best match for a key in a route table. The route table including a trie stored in a memory associated with a routing device. The trie including one or more entries defining a path through a routing device for transferring a packet in a packet switched network from a source to a destination. The route look-up engine including a stack for storing stack entries including a bit-to-test indicator and a pointer to a destination and a look-up engine including a buffer, a bit comparison engine and a key comparison engine. The buffer for storing node information that is retrieved from the memory. The node information including a bit- to-test indicator.
In another aspect the invention provides a trie for storing routes in a routing device to allow for efficient routing of packets through the routing device including a start node including a bit-to-test indicator, a left child pointer, a right child pointer and an attached route. The left and right child pointers pointing to internal nodes. The trie includes an internal node including a bit-to-test indicator, a right child pointer, a left child pointer and an attached route. The left and right child pointers pointing to a route node or another internal node. The trie including a route node having a bit-to-test indicator and an attached route . Preferred embodiments include the following features. The attached route includes statistical and quality of service information.
In another aspect the invention provides a computer program, tangibly stored on a computer-readable medium, comprising instructions for causing a computer to, upon receipt of a key, forward traverse a trie stored in a memory by evaluating at each node traversed a bit in the key as indicated by a bit-to-test indicator associated with each node. A value of the bit in the key determining the path traversed along the trie. The computer caused to locate an end node in the trie having a route and compare the route to the key. If they match, destination information associated with the end node is outputted to guide a transfer of a packet through a routing device. If they do not match, the trie is traversed backwards to locate a best match for the key and destination information associated therewith.
One advantage of the invention is that routes may be simply added to existing route tables without requiring the disruption of the look-up process.
Another advantage of the invention is that additional information including that needed for multicast and flow identification (ID) may be stored in a single route table without affecting the performance of the look-up. The present invention provides a single unified mechanism for performing efficient best-match look-up for unicast, multicast and flow based routing in the presence of extremely large route tables. Another advantage of the present invention is that line rate route look-ups may be performed on the whole route table without requiring route caching. Another advantage of the present invention is that large route tables may be efficiently searched at line rates .
Other advantages and features will be apparent from the following description and claims.
Brief Description of the Drawings Figure 1 is a schematic block diagram of a packet switching system according to one embodiment of the present invention. Figure 2 is a schematic block diagram of a router according to one embodiment of the present invention.
Figure 3 is a schematic block diagram of a route trie according to one embodiment of the present invention. Figure 4a is a schematic block diagram of a data structure for an internal node with an attached route according to one embodiment of the present invention.
Figure 4b is a schematic block diagram of a data structure for a start node according to one embodiment of the present invention.
Figure 4c is a schematic block diagram of a data structure for a route node according to one embodiment of the present invention.
Figure 4d is a schematic block diagram of a data structure for a internal node according to one embodiment of the present invention.
Figures 5a-5g collectively are a flow chart for a populating a trie according to one embodiment of the present invention. Figures 6a and 6b collectively are a process for routing data through the router according to one embodiment of the present invention. Figure 7a is a schematic block diagram of a data structure for a internal node according to an alternative embodiment of the present invention.
Figure 7b is a schematic block diagram of a data structure for a internal node with an attached route according to an alternative embodiment of the present invention.
Figure 7c is a schematic block diagram of a data structure for a route node according to an alternative embodiment of the present invention.
Figures 8a and 8b collectively are a process for routing data through the router according to an alternative embodiment of the present invention.
Detailed Description Referring to Figure 1, in a packet switched network, a source 10 is connected to one or more routers 20 for transmitting packets to one or more destinations 30. Each router includes a plurality of ports that are connected to various sources and destinations. Accordingly, a packet from source 10 may pass through more than one router 20 prior to arriving at its destination.
Referring to Figure 2, each router 20 includes an input switch 100, an output switch 102, a memory 104, a controller 106 and a plurality of input ports 107 and output ports 108. Associated with the controller 106 is a memory element 109 for storing controller data. Each switch 100 and 102 is connected to each input and output port 107 and 108 respectively in router 20. In one embodiment, router 20 includes eight input and output ports 107 and 108, respectively. In this embodiment, the number of input ports and output ports is equal, however, other applications may necessitate greater numbers of one or the other.
Associated with the controller 106 is a route look-up engine 110. In one embodiment of the present invention a plurality of route look-up engines 110 are included in controller 106, each receiving look-up requests in round-robin fashion so as to speed the routing process. In one embodiment, controller memory 109 is a four bank static random access memory (SRAM) that requires thirty two route look-up engines 110 to service at full bandwidth.
The present invention is scalable with respect to performance. That is, the number of route look-up engines 110 included within the controller may be increased to provide higher performance without requiring an increase in memory size. In one embodiment, the number of route look-up engines is eight times as great as the number of memory banks in controller memory 109. Alternatively, lesser cost and performance units may use lesser numbers of route look-up engines 110.
In operation, packets are received at an input port 107, transferred to input switch 100 and stored temporarily in memory 104. When the packet is received by switch 100, a key extraction engine reads the key from the first data block in the packet and transfers the key to controller 106. The input switch also includes a transfer engine for transferring packets received from an input port 107 to memory 104.
The key includes at least destination information and may also include source information, a flow identifier and physical source information (input port ID) . The key is located in the header field associated with the first block of data in a packet. The header may contain other information (ISO layer 2 and layer 3 headers) , such information is passed to memory for storage. The process of reading key information from a packet is known in the art. The present invention accommodates keys of various types. For example, keys for various protocols may be designated (IPV4, IPV6, etc.) . The length of the key is user definable. In general, the key is derived from the header, but portions may also be derived from the payload (data field associated with the packet) .
When the controller receives the key information, it must determine a key type. In one embodiment of the present invention, a plurality of key types are defined. The user may define up to 4 types of keys, each having variable length. In one embodiment, the key type is defined by a two bit field in the header. A look-up of the two bit field is used to determine the appropriate trie to search.
Thereafter, route look-up engine 110 performs a trie based search for the best variable length match of the key, with each key type defining a particular trie for searching. A trie is a data structure that is used to locate the best (longest) matching route for a given key. The process of the trie based search will be described in greater detail below in reference to Figure 6. At the completion of the trie search, the route lookup engine returns a result which includes the output port associated with the destination. The result and other information (source ID, flow ID, packet length, quality of service and statistical information) for routing the packet through the router combine to form a notification. The notification is transferred from the controller 106 to the output switch 102. Upon receiving the notification, the output switch 102 initiates the transfer of the packet from memory 104 to the respective output port 108 associated with the result.
Route look-up engine 110 performs the best match variable length look-up based on a modified radix trie search routine. Specifically, in one embodiment of the invention, a route table is stored in memory 109 in the form of one or more tries. Each trie is comprised of one or more nodes including a start node 300, and may include internal nodes (without an attached route) 302, internal nodes with an attached route 304 and route nodes 306 as is shown in Figure 3. In one embodiment, the starting node includes an attached route that is guaranteed to match any key having a type associated with this particular trie. In this way, the attached route provides a default path m the event no other match is located in the trie for a particular key.
Nodes are the decision points in the look-up process. A key associated with a packet has various ones of its bits tested at nodes along the trie, and depending on the value of the indicated bit in the key being tested, will result in the traversal down a particular branch of the trie. The bits of a key are numbered left to right. Associated with each node is a bit-to-test indicator. The value of the bit-to-test indicator in a trie branch increases until a leaf (route node) is reached. Internal nodes may be of two types, those with and those without attached routes . An internal node with an attached route 304, may be a match for a key. Internal nodes without attached routes are never a match for a key. Route nodes 306 are nodes which have no children and, accordingly, only contain route information. The traversal along the trie will be described in greater detail below in reference to Figure 6.
The data structure for each internal node in a trie according to one embodiment of the present invention is shown in Figure 4a. Associated with each node is a bit-to-test indicator field 400, a left child pointer 402, a right child pointer 404 and an attached route 406. The bit-to-test indicator field indicates the bit in the key which is to be tested at this node in order to determine which branch (left child or right child) in the trie should be traversed in the look-up process. The left child pointer 402 points to a left child in the trie structure while the right child pointer 404 points to a right child in the trie structure. A left child is the next node in the trie to be traversed when the bit tested for the present node has a value of 0. Conversely the right child is the next node in the trie to traverse when the bit tested associated with the present node has a value of 1. The attached route 406 indicates a result which is associated with this particular node. In one embodiment, the attached route is two words and includes both output port and prefix information. Alternatively, the attached route may also include other data such as quality of service and statistical information. In one embodiment, the attached route includes fields associated with the route (destination) which are updated each time a packet is processed for the given route. The information is stored along with the attached route and may be downloaded in response to a query from a user or the destination. Alternatively, a portion or all of the information may be downloaded with each packet transferred to a destination as part of the notification. Often it is desirable to attach information to a route that indicates statistical information associated with a given route (destination) . Examples of statistical information that may be transferred to a destination include number of packets (in a given time period), frequency of packets, average size of packets, and time since the last packet. Other statistical information including accounting information may also be stored with the attached route and may be incorporated into the notification. For example, billing information for a particular transfer or cumulative billing information may also be incorporated into the notification. In one embodiment of the present invention, controller 106 (Figure 2) includes statistical modules for calculating statistical information related to each packet transferred through the router. As each packet is processed by the controller, statistical modules update the statistical information stored with the destination route determined in the look-up process. In addition, quality of service information may be stored with an attached route to speed the routing of certain packets through the switch structure. A quality of service value may be set for each route to allow for the prioritization of packets transferred out a particular output port.
In one embodiment, the data structure of an attached route is comprised of a prefix length, a prefix (the portion that is left justified and matched against the key) , a result field, a statistics field and a quality of service field. Prefix length indicates the length of the prefix in bits. The prefix is a pattern (portion of a key) that is compared against a key to determine a best match. The result field stores the output port (destination port) associated with the particular route (prefix) . In the event that the prefix associated with a particular node is itself the best match for a given key, then the attached route indicates the output port to which the packet is to be routed. In one embodiment of the present invention, the attached route is a pointer which points to the location in memory where the attached route is stored. Alternatively, the attached route may be stored in consecutive memory locations with the rest of the node information as described above.
The data structure for the start node according to one embodiment of the present invention is shown in Figure 4b. Associated with the start node are a left child pointer 402, a right child pointer 404 and an attached route 406. In one embodiment of the present invention, no bit-to-test indicator field is stored in memory for the start node. This is because, typically the bit-to-test indicator for the start node is set to bit zero. Alternatively, another bit in the key may be the first bit-to-test. If another bit is the first bit- to-test, then the associated bit identifier is stored in a bit-to-test indicator field for the start node.
The data structure for each route node according to one embodiment of the present invention is shown in Figure 4c. Each route node has only an attached route 406.
Internal nodes without routes attached have a data structure as shown in Figure 4d. Specifically, no space is set aside for an attached route. Otherwise, the data structure is identical to that shown in Figure 4a.
In a typical router implementation, a route table is not fully populated. That is, not all of the possible key values are mapped to a particular output port. Accordingly, some bits in the key are "don't care" values, and are not required to be tested during the route look-up process, because they do not affect the determination of the output port. In some prior art systems, the look-up of keys in the route table required the comparison of each bit in the key with entries in the route table. Such systems were inefficient. With a trie structure, not every bit in a key needs to be tested in order to determine the best match associated with a particular packet. By testing only the smallest number of bits that allow the discrimination between a key and existing routes, the speed of determining a match is improved. Accordingly, for each key type, a route table is created in trie format. Referring now to Figure 5, in a method of creating a trie, a start node is created for the trie (500) . The start node is assigned an attached route (502) . The left and right child pointers are assigned a null value (a binary 511 in one embodiment of the present invention) indicating that no left or right child exists (504) . Finally, the four word start node including left child pointer (1), right child pointer (1) and attached route (2) is stored in memory 108 (506) . A check is made to determine if any other routes are needed to be placed in the trie (508) . If not then, the process ends (510) . Else, the next route is loaded (512) . The first route in the trie is added as a route node (514) . An associated route is assigned based on the destination for the particular prefix (516). The attached route and prefix information is stored in memory (518). Thereafter, the appropriate pointer in the start node (left child pointer or right child pointer) is updated based on the value of the zero bit of the first prefix (520) . If the value of the zero bit in the first prefix (route) loaded is a "0", then the left child pointer is updated to reflect the starting address in memory where the route node for this prefix is stored. Alternatively, if the value of the zero bit in the first prefix loaded is a "1", then the right child pointer is updated to reflect the starting address in memory where the route node for this prefix is stored. A check is made to determine if any other prefixes are needed to be placed in the trie (522) . If so, the next prefix is loaded (523) . The next prefix will be placed in the trie as either a route node, an internal node, an internal node with an attached route, or as an attached route to an existing internal node. A prefix search is performed in the existing trie (524) . The search entails traversing the trie by testing the new prefix based on the bit indicated by the bit-to-test indicator for each node. At a given node, the bit in the new prefix designated by the bit-to-test indicator for the node is checked in order to determine the next node in the search. The prefix search continues until an end route is determined (526). An end route will be found either at a route node or at an internal node having an attached route. An end route is either the route associated with a route node or the first route located on the trie after the bit-to-test indicator associated with the current node on the trie exceeds the number of bits in the prefix being searched. The first route located may be an attached route to an internal node, or a route node. The search must terminate at a node which has an associated route in order to determine where (and how) the new prefix will be inserted into the trie. That is, at the start node, the value of the zero bit is checked in the new prefix to determine if the search should proceed down a left child or the right child. At each subsequent node in the trie, the bit indicated by the bit-to-test indicator associated with the node is checked to determine a next node in the traversal. Eventually, the search will come to an end as described above. In our initial two node trie (start node and a route node), the search is diminimus, and may end at either the start node (if the new prefix being searched has a value in the zero bit different from the prefix associated with the route node) or at the route node .
At the end of the search, a comparison is made between the prefix being searched and the end route to determine the first dissimilar bit (BITDis) in the new prefix (528) . In one embodiment of the present invention, an EXCLUSIVE OR operation on the two prefixes is performed to reveal the first dissimilar bit. If a dissimilar bit is found, then branch A in the process is performed (529) . If no dissimilar bits are found, then all of the bits of the new prefix match the end route and branch B in the process is performed.
In branch A, a dissimilar bit has been determined, and the new prefix will be inserted into the trie as route node pointed to by a new internal node which is to be inserted into the existing trie. Specifically, a new route node is created and stored in memory indicating the destination associated with the new prefix (530). Thereafter, a new internal node is created (532) . The bit-to-test indicator for the new internal node is assigned to be the first dissimilar bit (BITDi3) discovered above (534) . One of the child pointers (either the left child or the right child) of the new internal node is assigned the address of the new route node depending on the value of the bit-to-test indicator in the new prefix (536) . Starting at the node associated with the end route identified above, the trie is traversed in reverse to locate the first node (the parent node) having a bit-to-test indicator which is less than the first dissimilar bit (BITDis) (538) . The node immediately beneath the parent node in the original trie is referred to as the grand-child node. The new internal node is inserted into the trie between the parent and the grand-child nodes by assigning the remaining child pointer in the new internal node the starting address associated with the grand-child node (540). Finally, the address of the pointer in the parent node which previously pointed to the grand-child node is updated to indicate the starting address in memory of the new internal node (542) . Branch A is complete.
In branch B, no dissimilar bits were determined, necessitating a comparison of the length of the new prefix with the length of the end route (545) . If the length of the new prefix is longer than the length of end route then branch Bl is traversed (546) . If the length of the new prefix is shorter than the length of end route, then branch B2 will be traversed (547) . Finally, if the length of the new prefix is the same as the length of end route, branch B3 will be traversed.
In branch Bl (the new prefix is longer than the length of end route) , the new prefix will be inserted into the trie below the node associated with the end route as a new route node. Specifically, a new route node is created and stored in memory indicating the destination associated with the new prefix (550). Thereafter, a determination is made of the type of node associated with the end route (552) . If the node associated with the end route is an internal node with an associated route, then the appropriate child pointer (based on the value of the bit in the new prefix of the bit-to-test indicator associated with the internal node) is assigned the starting address of the new route node (554) . Else, a new internal node is created (556) . The bit-to-test indicator for the new internal node is assigned to be the last bit in the end route (558) . One of the child pointers (either the left child or the right child) of the new internal node is assigned the address of the new route node depending on the value of the bit in the new prefix of the bit-to-test indicator associated with the new internal node (560). Finally, the address of the pointer in the parent node (the node immediately preceding the route node associated with the end route and whose pointer previously indicated the starting address of the route node associated with the end route) is updated to indicate the starting address in memory of the new internal node (562) . Branch Bl is complete.
In branch B2 the new prefix is shorter than the end route. The new prefix is inserted into the trie above the node associated with the end route, as either a new route or as an internal node with a route attached. Specifically, starting at the node associated with the end route, the trie is traversed backwards until a node (the parent node) is found having a bit-to-test indicator less than or equal to the index (length) of the new prefix (570) . The node immediately beneath the parent node in the original trie is referred to as the grandchild node. If the bit-to-test indicator is less than the index of the new prefix (571), then a new internal node is inserted below the parent node (572) . The bit-to-test indicator for the new internal node is assigned the value of the index (length) of the new prefix (574) .
Accordingly, the new internal node tests the first bit after the end of the new prefix. The new internal node is inserted into the trie between the parent and the grand-child nodes by assigning one of the child pointers (as indicated by the value of the bit-to-test indicator of the new internal node) the starting address associated with the grand-child node (576) . The other child pointer (either the left child or the right child) of the new internal node is assigned a null value (binary 511 in one embodiment) (578) . Finally, the address of the pointer in the parent node which previously pointed to the grand-child node is updated to indicate the starting address in memory of the new internal node (580). If the bit-to-test indicator of the node discovered in the backwards search is equal to the index of the new prefix, then the new prefix is inserted as an attached route for the node (590) . Specifically, the attached route associated with the node determined in the search is updated to reflect the destination of the new prefix. Branch B2 is complete.
In branch B3 the new prefix is the same length as the end route. The new prefix is inserted into the trie as an update to the end route (592) . Specifically, the route associated with the end node is updated to reflect the destination of the new prefix.
At the completion of branches A and B (and the various sub-branches of branch B including Bl, B2 and B3), a check is performed to determine if any more prefixes need to be inserted into the trie (598) . If so, then the process continues at step (523) . Else, the process ends (510) .
In one embodiment of the present invention, the process of constructing a trie is performed for each type of key based on an initial set of prefixes and associated destination information. In addition, each trie may be updated dynamically by a routing protocol associated with the controller 106 (Figure 2). The routing protocol services the tries, and may insert new prefixes as necessary. The process for inserting a new prefix is identical to the process described above for inserting a next prefix after the first prefix in the trie has been installed as a route node (steps 522-592). The updating process advantageously does not require the shutting down of the route look-up process. As was described above, the insertion of a route is accomplished off line, and only the final step in the process affects the trie. The final step in any insertion process requires writing in memory the address for a new node to the new node's parent. Accordingly, searches in a trie may be performed the entire time that an insertion process is operated to insert new entries or make changes to existing entries. The trie is never invalid, thus never requiring the shutting down of the look-up process for trie maintenance.
Having created a route table including one or more tries which are stored in memory as described above, the router is ready to process packets. A key is copied from an inbound packet by input switch 100 (Figure 2) and transferred to route look-up engine 110 (Figure 2) in the controller 106 (Figure 2) . Referring to Figures 2 and 6, in a best variable length match look-up method, a key type is determined for a new key to identify the particular trie that must be traversed in the look-up process (600). The look-up process includes a forward and backward traversal of the trie to determine the best match associated with a given key. The forward search begins at the start node. Specifically, the four word data block associated with the first node in the appropriate trie type is loaded into a buffer in the route look-up engine 110 from memory 108 (602) . A bit test engine in route look-up engine 110 determines the value of the bit in the new key indicated by the bit-to- test indicator (as defined by the bit-to-test indicator field retrieved in step (602)) (604). Thereafter, the route look-up engine determines if the pointer indicated by the bit value (either the left child pointer or right child pointer) indicates a child node (606) . If no child is indicated, then route look-up engine 110 performs a key comparison as is shown in branch C.
If the pointer indicates a child, then a check is made to determine if the start node has an attached route (608) . If an attached route is associated with the start node, the route look-up engine stores the starting address in memory for the attached route (or the starting address associated with the contiguous memory locations associated with the start node) and the bit-to-test indicator associated therewith on a forward search stack in the route look-up engine (610) . If no attached route exists, the process continues at branch G. The route look-up engine thereafter loads the data words associated with the next node indicated by the respective child pointer (612) . For example, where the start node bit-to- test indicator is set to the "zero'th" bit, and if the zero'th bit in the new key location has a value of "0", then the route look-up engine will load the node indicated by the left child pointer. Alternatively, if the zero'th bit has a value of "1", the route look-up engine will load the node indicated by the right child pointer. In one embodiment of the present invention, the loading process of a node entails loading all of the data blocks associated with a given node (5 for internal nodes or 2 for route nodes) . Alternatively, a lesser number of data words may be loaded as will be described below. Thereafter the route look-up engine determines if the new node is a route node (614) . If so, then a route has been determined and the process continues at branch C. If not, then the route look-up engine (bit comparison engine) determines the bit value in the new key of the bit indicated by the bit-to-test indicator associated with the new node (node loaded in step 612), where the bit-to-test is defined by the bit-to-test indicator field retrieved as part of the load in step 612 (616) . Thereafter, the route look-up engine determines if the pointer indicated by the bit value (either the left child pointer or right child pointer) indicates a child node (618) . If no child is indicated then the route look-up engine performs a key comparison as is shown in branch C. Alternatively, the route look-up engine checks to determine if the new node has an attached route (620) . If so, then the process continues at branch F resulting in the storage of the address associated with the attached route onto the stack (or the pointer indicating the starting address in memory for the attached route) prior to the loading of a next route. Alternatively, the process continues at branch G and the next node is loaded for processing. The route look up engine repeats this process for each node (steps 610-620) until an end node has been located.
An end node may be a route node or an internal node having an attached route. An internal node with an attached route will only be an end node if the value of the bit indicated by the bit-to-test indicator in the key being tested indicates a child pointer associated with the internal node that points nowhere (null) . When an end node is reached, the route look-up engine performs branch C. Specifically, if the pointer indicated by a bit-to-test value in the new key points to a route, then the forward search portion of the process ends when the route is retrieved. If however, the pointer indicates a null, the search ends with the internal node. Branch C can be characterized as follows: the forward search has terminated at an internal node (the end node) having a pointer to a left child or a pointer to a right child which has no data, and, this "no-data" pointer is indicated by the bit value in the new key of the bit-to-test bit of the end node; or, the search has terminated at a route node. The backward portion of the search begins by comparing the route associated with the current node (either an attached route for an internal node or a route associated with a route node) and the new key.
At this point, the best match for the new key will be at the end node or is guaranteed to be somewhere backup stream (along the path from the end node back to the start node) . Accordingly, in order to determine the best match, a key comparison engine in route look-up engine 110 compares the key being searched and the end route (the route associated with the end node) to determine the first dissimilar bit (BITDls) in the new key (630) . In one embodiment of the present invention, an EXCLUSIVE OR operation on the new key and prefix (route) is performed to reveal the first dissimilar bit. If a dissimilar bit is found, then branch D in the process is performed (632) . If no dissimilar bits are found, then all of the bits of the new key match the end route and branch E in the process is performed.
In branch D, a dissimilar bit has been determined, and the end route is not a match for the new key. Starting at the end node, the trie is traversed in reverse to locate the first node (the best match node) having a bit-to-test indicator which is less than or equal to the bit number of the first dissimilar bit (BITD s) (640). In one embodiment of the present invention, this is performed by popping off entries from the forward search stack in the route look-up engine (each entry associated with nodes that have attached routes and have been traversed as part of the forward search) , until an entry is located which has a bit-to- test indicator value that is less than or equal to the bit number of the first dissimilar bit. When the best match node has been located, then the process continues at branch E.
In branch E, a best match route has been determined either by discovering no dissimilar bits when comparing the new key to the end route, or by traversing the trie and locating the route associated with the best match node. The route look-up engine loads the best match route from memory (650) . In one embodiment, if the end route associated with the end node matches the new key, no load is required, such load having already been accomplished as part of the loading of the end node in the forward search of the trie. Alternatively, if the trie is required to be traversed backwards, the route information is loaded based on the pointer stored on the stack. The route look-up engine transfers the best match route information to the output switch 102 (Figure 2) (652) . Thereafter the process ends (654) .
One of the advantages of the present invention is that the trie structure guarantees a best match for each key transmitted through the switch. As is described above, each route stored in the trie has a prefix associated therewith. A prefix is a left justified subset of a key. Accordingly, a key may match many prefixes in a trie. The best match is the matching prefix having the longest length. The system of the present invention provides for a best (longest) match for a key.
In addition, only a single key comparison is required in the entire matching process. The key is compared to a single prefix (at the end node) and thereafter the best match may be determined without performing any additional comparisons of the key to prefixes stored in the route look-up table.
ALTERNATIVE EMBODIMENTS In one embodiment of the invention, numerous techniques are employed to speed the look-up process and minimize the number of memory accesses. Specifically, the following techniques are employed: minimized data word loads, multiple memory banks, spread data structures across memory banks and root table.
Minimized Data Word Loads As was described above in conjunction with the forward traversal of a trie, a load operation is performed of the data words associated with each node in the forward search. This requires the loading of up to five words per node (bit-to-test indicator, left child pointer, right child pointer, and attached route (2 words)) . Alternatively, lesser number of words may be loaded.
Specifically, in one embodiment of the invention, only the bit-to-test indicator and child pointers are loaded for a given node. In the event that the node is determined to be the end node in a forward search, then the attached route information can be loaded as required.
In another embodiment of the present invention, only the bit-to-test indicator is loaded initially for a given node. After the bit-to-test indicator is loaded for a given node, the bit value of the new key is used to determine which child should be loaded for this node, if any. For example, if the bit value of the bit in the new key indicated by the bit-to-test indicator is a "0", the left child only is loaded. If the bit value in the bit in the new key is a "1", then only the right child is loaded.
In another embodiment of the present invention, an alternative data structure associated with the nodes is used to minimize memory accesses. Referring to Figure 7a, a data structure for an internal node without an attached route is shown. Each internal node without an attached route includes a left child pointer 700, and a right child pointer 702. The left and right child pointers include two status bits 704 and 706 (little "r" and big "R", respectively) , a pointer field 708 which points to the starting address of an associated child, and a bit-to-test indicator field 710 which indicates the bit-to-test in the child node indicated by the pointer field 708. The first status bit (little "r") 704 indicates whether the pointer stored in the pointer field 708 points to a route node or an internal node. The second status bit (big "R") 706 indicates whether an attached route exists for this node.
The data structure for an internal node with an attached route is shown in Figure 7b. Each internal node with an attached route includes a left child pointer 700, a right child pointer 702 and an attached route 720. The left and right child pointers include two status bits 704 and 706 (little "r" and big "R", respectively), a pointer field 708 which points to the starting address of an associated child, and a bit-to-test indicator field 710 which indicates the bit-to-test in the child node indicated by the pointer field 708. The attached route 720 contains an index 722, a prefix 724, a result 726 (destination port) , a statistics field 728 and quality of service field 730, the functions of which have been described above. The data structure for a route node is shown in Figure 7c. Each route node includes an attached route 720.
With this data structure, a single word per node is required to be loaded in order to traverse the trie. Only minor variations in the creation of the trie and in the traversal of the trie are required, yet the memory accesses required have been reduced substantially.
During the look-up operation, the benefits of the data structure proposed above are readily apparent. Referring to Figure 8, the process of performing a best match variable length look-up of a route begins with determining the type of key for a new key received at the controller (800) . The starting address of an appropriate start node is determined based on the trie type (802) . Thereafter, a check is made of the value of the bit in the new key indicated by the bit-to-test indicator associated with the start node (typically bit zero) (804) . If the value of bit in the new key is a "0", then the route look-up engine retrieves the left child pointer associated with the start node which will be located at the starting address determined above in step 802 (806) . If the value of bit in the new key is a "1", the route look-up engine will increment by one the starting address received in step 802 (807) and retrieve the right child pointer associated with the start node (808).
A check is made to determine if the pointer retrieved points to a route (node) or to another internal node (810) . If the pointer points to a route node (as indicated by the status of the little "r" status bit 704) then the route indicated by the pointer (the first left or right child pointer) is retrieved (812) . If the pointer points to an internal node, then the route look- up engine will store the pointer retrieved on a stack if the "R" status bit is set (814) . Specifically, the route look-up engine stores the bit-to-test indicator associated with the given node and the pointer retrieved in step 812. Thereafter, the route look-up engine (bit comparison engine) will test the bit of the new key indicated by the bit-to-test indicator field in the pointer retrieved in steps 806 or 808.
If the bit indicated by the bit-to-test indicator has a value of "0" in the new key, then the route look-up engine will retrieve the left child associated with the address indicated by the pointer (816). Specifically, the route look-up engine will retrieve the data word which is indicated by the address indicated by the left or right child pointer.
If the bit (in step 812) has a value of "1" in th new key, then the route look-up engine will retrieve the right child associated with the address indicated by the pointer (818). Specifically, the route look-up engine will retrieve the data word which is indicated by the address indicated by the child pointer incremented by one . This process repeats (steps 814-822) until an end route is located. Specifically, if the pointer indicated by a bit-to-test value in the new key points to a route (820), then the forward search portion of the process ends when the route is retrieved (812) . If however, the pointer retrieved indicates a null value (822), a check is made to determine if the node has an attached route (824) . If so, then the forward search portion of the process ends and the associated internal route is retrieved in step 812. If no attached route exists, a check is made to determine if the stack is empty (825) . If so, an error condition occurs and the route look-up terminates (826) . If the stack is not empty, then the last entry on the stack is retrieved (828) and the process continues at step 830. The route retrieved from the route node, the internal node with attached route, or the route indicated by the stack entry will become the end route for the purposes of performing the backward portion of the look-up process.
In order to determine the best match, the route look-up engine (key comparison engine) compares the key being searched and the end route to determine the first dissimilar bit (BITD1S) in the new key (830) . If a dissimilar bit is found (832), then starting at the end node, the trie is traversed in reverse to locate the first node (the best match node) having a bit-to-test indicator stored on the stack which is less than or equal to the bit number of the first dissimilar bit (BITDls) (840) . In one embodiment of the present invention, this is performed by popping off entries from the forward search stack in the route look-up engine, each entry associated with nodes that have been traversed as part of the forward search, until a entry is located which has a bit-to-test indicator value that is less than or equal to the bit number of the first dissimilar bit.
If no dissimilar bits are found or if the best match node has been determined in step 840, then the route look-up engine loads the best match route, either the route associated with the best match node or the end route from memory (850) . If the best match route is the end route, no memory load is required, such load having been accomplished as part of the comparison above. Alternatively, the route information is loaded by incrementing the memory address retrieved from the stack node by two (if the starting address for the node is stored on the stack as opposed to the address for the attached route) , and loading the appropriate route information. Thereafter, the route look-up engine transfers the best match route to the output switch 102 (852) .
Multiple Memory Banks Referring again to Figure 2, in one embodiment of the invention, the memory 108 attached to controller 106 is a bank of four static RAMs (SRAMs) . In the construction of the route table, parents and children are distributed among the SRAM banks such that no parent and child are stored in the same bank of static RAM. Accordingly, when a route look-up engine accesses a particular memory location in memory 108, it is guaranteed to not to have to access the same memory bank in order to traverse to the next node in a given path. The use of multiple memory banks is useful to increase the number of simultaneous read operations which can be performed in the look-up process. Distribution of parent and children nodes across the memory banks helps to avoid bank conflicts.
Spread Data Structures across Memory Banks Another memory saving technique included in one embodiment of the present invention is the attachment of routes sequentially in memory for a given node. As was described above in reference to the node data structures as described in reference to Figures 4 and 7, if an internal node has an attached route, then the route is placed by design immediately following the associated right child pointer in memory. Accordingly, when the best match is located for a given node, the destination information associated therewith is known precisely, and may be retrieved directly from memory (as opposed to indirect retrieval if a pointer system is used) . This organization technique saves on memory accesses. For example, upon a match condition, the route look-up engine must load the result which includes the output port associated with the particular switch. With the memory structure described above, the result may be loaded directly by incrementing the pointer information popped off the stack during the backward traversal of the trie (by adding 2 or 3 address locations to the stack pointers depending on the type of node) . Root Table In one embodiment of the present invention, a root table is used as a preliminary screen for matching the most significant bits in a key. A root table may be used to perform a quick match of the most significant bits in a key so as to avoid having to perform many memory accesses in the trie search. The root table is stored in controller 106 (Figure 2). Each entry in the route table includes an address to the start node in memory at which the look-up is to begin and a stack entry. The stack entry includes a bit-to-test indicator and a pointer to an attached route. The table is indexed according to the first N bits of the key. In one embodiment of the present invention, the first eight bits of the key are indexed.
The present invention has been described in terms of specific embodiments, which are illustrative of the invention and not to be construed as limiting. Other embodiments are within the scope of the following claims.
What is claimed is:

Claims

1. A method of looking up a key associated with a packet to determine a route through a routing device comprising: upon receipt of a key, forward traversing one or more nodes which make up a trie stored in a memory by evaluating at each node traversed a bit in the key as indicated by a bit-to-test indicator associated with each node, a value of the bit in the key determining the path traversed along the trie; locating an end node in the trie, the end node having a route; comparing the route to the key; if they match, outputting destination information associated with the end node to guide the transfer of the packet through the routing device; and if they do not match, traversing the trie backwards to locate a best match for the key.
2. The method of claim 1 wherein the step of forward traversing includes storing on a stack for each node having an attached route the bit-to-test indicator and a pointer to the attached route.
3. The method of claim 2 wherein the step of traversing the trie backwards includes: comparing the key with the route to determine a first dissimilar bit location; popping entries off the stack to determine when the bit-to-test indicator associated with a first node in the backward traversal is less than or equal to the first dissimilar bit location; and outputting destination information associated with the first node to guide the transfer of the packet through the routing device.
4. The method of claim 3 wherein the first node includes a route, the method further including calculating statistical information for each packet and storing in memory the statistical information with the route for the end node and the first node.
5. The method of claim 4 further including transferring the statistical information along with the destination information to an output port in the routing device for transfer to a destination.
6. The method of claim 1 further including the step of prior to a forward traversal of the trie, searching a root table for a match of a predetermined number of bits in the key, the root table indexed by the predetermined number of bits where each entry includes a pointer to a start node in the trie to begin the forward traversal .
7. The method of claim 1 wherein the forward traversal of the trie includes loading node information for each node traversed in the trie until the end node is reached, the node information including a bit-to-test indicator, a left child pointer, a right child pointer and an attached route.
8. The method of claim 1 where the nodes in the trie include left child pointers, and right child pointers, each pointer including a bit-to-test indicator for indicating a bit to be tested in the key associated with a child node to which the left or right child pointer indicates, whereby memory accesses are minimized in the forward traversal of the trie by requiring loading of a single pointer at each node until the end node.
9. A method of routing a packet through a switch comprising: upon receipt of a packet, extracting a key from the packet; forward traversing a trie by evaluating at each node a bit in the key as indicated by a bit-to-test indicator associated with each node, a value of the bit in the key located at a position indicated by the bit-to- test indicator determining the path traversed along the trie at each node; locating an end node in the trie, the end node having a route; comparing the route to the key; if they match, retrieving destination information associated with the end node; if they do not match, traversing the trie backwards to locate a best match for the key having a route and destination information associated therewith; and routing the packet through the switch according to the destination information.
10. The method of claim 9 further including calculating statistical information associated with each route and storing the statistical information in memory with an associated route.
11. The method of claim 10 wherein the statistical information is forwarded along with the packet to a destination.
12. The method of claim 10 wherein the statistical information includes transaction statistics associated with numbers or types of packets routed to a particular destination.
13. The method of claim 10 wherein the statistical information includes billing information.
14. The method of claim 9 further including assigning quality of service information to each route, the quality of service information determining a priority of a transfer of the packet out of the routing device.
15. A method of inserting a route in a route table where the route table is stored as a trie m a memory of a routing device, the route table defining the path by which a packet is transferred through the routing device, the method comprising: traversing the trie to determine an insertion point; creating a new node; determining if the insertion point for the new node is between existing nodes in the trie; if so, setting a child pointer in the new node to indicate a node directly beneath the insertion point; storing the new node in memory; and updating a child pointer in a node directly above the insertion point to indicate a starting address in memory for the new node.
16. A router for routing packets in a packet switched network comprising: one or more input ports for receiving packets; a packet memory; an input switch coupled to each input port and the memory, the input switch including a transfer engine for transferring packets from an input port to the packet memory and a key extraction engine for extracting a key from each packet; a controller coupled to the input switch, the controller including a key look-up engine and a route memory, the route memory for storing a route table where the route table includes a trie, the key look-up engine traversing the trie to determine a best match to the key, upon determining the best match for the key generating notification information; one or more output ports; an output switch coupled to the controller, the packet memory and the output port for transferring packets from packet memory to an appropriate output port based on the notification information received from the controller .
17. The apparatus of claim 16 wherein the key look-up engine forward traverses the trie by evaluating at each node traversed a bit in the key as indicated by a bit-to-test indicator associated with each node, a value of the bit in the key determining the path traversed along the trie; the key look-up engine locating an end node having a route and comparing the route to the key; if they match, the key look-up engine outputs destination information associated with the end node to guide transfer of a packet through the routing device; and if they do not match, the key look-up engine traverses the trie backwards to locate a best match for the key.
18. The apparatus of claim 17 further including a stack and where forward traversing includes, for each node having an attached route, storing on the stack a bit-to-test indicator for the node and a pointer to the attached route.
19. The apparatus of claim 18 where traversing the trie backwards includes the key look-up engine comparing the key with the route to determine a first dissimilar bit location, popping entries off the stack to determine when a bit-to-test indicator associated with a first node in the backward traversal is less than or equal to the first dissimilar bit location, and outputting destination information associated with the first node to guide a transfer of a packet through the router .
20. The apparatus of claim 16 further including a statistical engine for calculating statistical information for each data packet and outputting the statistical information with destination information for transfer to a destination port.
21. The apparatus of claim 16 where the route memory is divided into a plurality of banks, and where parent and children nodes in the trie are stored in different banks.
22. The apparatus of claim 16 where each node in the trie includes a bit-to-test indicator, a left child pointer, a right child pointer and an attached route, the left child pointer indicating a child node to be traversed in the forward traversal when a value of a bit in the key as indicated by the bit-to-test indicator is a first value, the right child pointer indicating a child node to be traversed in the forward traversal when a value of a bit in the key indicated by the bit-to-test indicator is a second value.
23. The apparatus of claim 22 where the left child pointer, right child pointer and attached route are stored in contiguous locations in the route memory.
24. A route look-up engine for locating a best match for a key in a route table, the route table including a trie stored in a memory associated with a routing device, the trie including one or more entries defining a path through a routing device for transferring a packet in a packet switched network from a source to a destination, the route look-up engine comprising: a stack for storing stack entries including a bit- to-test indicator and a pointer to a destination; and a look-up engine including a buffer, a bit comparison engine and a key comparison engine, the buffer for storing node information that is retrieved from the memory, the node information including a bit-to-test indicator, wherein responsive to receiving a key associated with a packet, the look-up engine forward traverses the trie, the bit comparison engine evaluating at each node traversed a bit in the key as indicated by a bit-to-test indicator associated with each node, a value of the bit in the key determining the path traversed along the trie, the look-up engine storing stack entries on the stack for each node traversed having an attached route, the look-up engine locating an end node having a route, the key comparison engine performing a singular key comparison for each packet routed through the routing device by comparing the key with the route, if they match, the look-up engine outputting destination information associated with the end node to guide the transfer of the packet through the routing device and if they do not match, the look-up engine traverses the trie backwards popping entries off the stack to locate a best match for the key and destination information associated therewith.
25. A trie for storing routes in a routing device to allow for efficient routing of packets through the routing device, comprising: a start node including a bit-to-test indicator, a left child pointer, a right child pointer and an attached route, the left and right child pointers pointing to internal nodes; an internal node including a bit-to-test indicator, a right child pointer, a left child pointer and an attached route, the left and right child pointers pointing to a route node or another internal node; a route node including a bit-to-test indicator and an attached route.
26. The trie of claim 25 wherein the attached route includes statistical and quality of service information .
27. A computer program, tangibly stored on a computer-readable medium, comprising instructions for causing a computer to: upon receipt of a key, forward traverse a trie stored in a memory by evaluating at each node traversed a bit in the key as indicated by a bit-to-test indicator associated with each node, a value of the bit in the key determining the path traversed along the trie; locate an end node in the trie, the end node having a route; compare the route to the key; if they match, output destination information associated with the end node to guide a transfer of a packet through a routing device; and if they do not match, traverse the trie backwards to locate a best match for the key and destination information associated therewith.
28. The apparatus of claim 27 wherein the forward traverse includes instructions to cause the computer to: store on a stack for each node having an attached route the bit-to-test indicator for the node and a pointer to the attached route.
29. The apparatus of claim 27 wherein the backward traverse includes instructions to cause the computer to: compare the key with the route to determine a first dissimilar bit location; pop entries off the stack to determine when the bit-to-test indicator associated with a first node in the backward traversal is less than or equal to the first dissimilar bit location; and output destination information associated with the first node to guide a transfer of the packet through the routing device.
PCT/US1997/023287 1996-12-16 1997-12-16 High speed variable length best match look-up in a switching device WO1998027662A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CA002274962A CA2274962C (en) 1996-12-16 1997-12-16 High speed variable length best match look-up in a switching device
EP97951733A EP0948849A4 (en) 1996-12-16 1997-12-16 High speed variable length best match look-up in a switching device
JP52794798A JP3453148B2 (en) 1996-12-16 1997-12-16 Fast Variable Length Best Match Lookup in Switching Devices

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US08/767,576 US5909440A (en) 1996-12-16 1996-12-16 High speed variable length best match look-up in a switching device
US08/767,576 1996-12-16
US08/844,171 US5905725A (en) 1996-12-16 1997-04-18 High speed switching device
US08/844,171 1997-04-18
US08/901,061 US6493347B2 (en) 1996-12-16 1997-07-24 Memory organization in a switching device
US08/901,061 1997-07-24

Publications (2)

Publication Number Publication Date
WO1998027662A2 true WO1998027662A2 (en) 1998-06-25
WO1998027662A3 WO1998027662A3 (en) 1998-09-03

Family

ID=27419639

Family Applications (3)

Application Number Title Priority Date Filing Date
PCT/US1997/023287 WO1998027662A2 (en) 1996-12-16 1997-12-16 High speed variable length best match look-up in a switching device
PCT/US1997/023407 WO1998027697A1 (en) 1996-12-16 1997-12-16 Memory organization in a switching device
PCT/US1997/023285 WO1998027660A2 (en) 1996-12-16 1997-12-16 High speed switching device

Family Applications After (2)

Application Number Title Priority Date Filing Date
PCT/US1997/023407 WO1998027697A1 (en) 1996-12-16 1997-12-16 Memory organization in a switching device
PCT/US1997/023285 WO1998027660A2 (en) 1996-12-16 1997-12-16 High speed switching device

Country Status (6)

Country Link
US (11) US6493347B2 (en)
EP (3) EP0947078B1 (en)
JP (3) JP3459652B2 (en)
CA (3) CA2274962C (en)
DE (2) DE69737357T2 (en)
WO (3) WO1998027662A2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2783618A1 (en) * 1998-09-23 2000-03-24 France Telecom METHOD FOR UPDATING AN ASSOCIATIVE MEMORY OF THE TRIE TYPE, AND ROUTER USING SUCH A METHOD
FR2789778A1 (en) * 1999-02-12 2000-08-18 France Telecom METHOD FOR ASSOCIATING ROUTING REFERENCES WITH DATA PACKETS BY MEANS OF A SORTED MEMORY, AND PACKET ROUTER APPLYING THIS METHOD
JP2000324172A (en) * 1999-05-11 2000-11-24 Nec Corp Method for storing prefix concerning address
US7412454B2 (en) 2003-09-03 2008-08-12 International Business Machines Corporation Data structure supporting random delete and timer function

Families Citing this family (215)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6046999A (en) * 1996-09-03 2000-04-04 Hitachi, Ltd. Router apparatus using ATM switch
US6791947B2 (en) * 1996-12-16 2004-09-14 Juniper Networks In-line packet processing
US6493347B2 (en) 1996-12-16 2002-12-10 Juniper Networks, Inc. Memory organization in a switching device
JPH11167560A (en) * 1997-12-03 1999-06-22 Nec Corp Data transfer system, switching circuit used to the transfer system, adapter, integrated circuit having the transfer system and data transfer method
US6590901B1 (en) * 1998-04-01 2003-07-08 Mosaid Technologies, Inc. Method and apparatus for providing a packet buffer random access memory
US6430527B1 (en) * 1998-05-06 2002-08-06 Avici Systems Prefix search circuitry and method
US6580721B1 (en) * 1998-08-11 2003-06-17 Nortel Networks Limited Routing and rate control in a universal transfer mode network
US6608816B1 (en) * 1998-11-18 2003-08-19 Nortel Networks Limited Method and apparatus for providing differentiated services using a multi-level queuing mechanism
JP3704438B2 (en) * 1998-12-09 2005-10-12 株式会社日立製作所 Variable-length packet communication device
US6650637B1 (en) * 1998-12-14 2003-11-18 Lucent Technologies Inc. Multi-port RAM based cross-connect system
US7382736B2 (en) 1999-01-12 2008-06-03 Mcdata Corporation Method for scoring queued frames for selective transmission through a switch
JP4294142B2 (en) * 1999-02-02 2009-07-08 株式会社日立製作所 Disk subsystem
US6757791B1 (en) * 1999-03-30 2004-06-29 Cisco Technology, Inc. Method and apparatus for reordering packet data units in storage queues for reading and writing memory
US6748481B1 (en) * 1999-04-06 2004-06-08 Microsoft Corporation Streaming information appliance with circular buffer for receiving and selectively reading blocks of streaming information
US6788701B1 (en) * 1999-05-14 2004-09-07 Dunti Llc Communication network having modular switches that enhance data throughput
US7778259B1 (en) 1999-05-14 2010-08-17 Dunti Llc Network packet transmission mechanism
US6618390B1 (en) * 1999-05-21 2003-09-09 Advanced Micro Devices, Inc. Method and apparatus for maintaining randomly accessible free buffer information for a network switch
GB9912129D0 (en) * 1999-05-26 1999-07-28 3Com Corp Communication device with forwarding database having having a trie search facility
US7996670B1 (en) * 1999-07-08 2011-08-09 Broadcom Corporation Classification engine in a cryptography acceleration chip
GB2352145A (en) * 1999-07-16 2001-01-17 Texas Instruments Ltd Prevention of bottlenecking in data transfers
JP2001060967A (en) * 1999-08-23 2001-03-06 Fujitsu Ltd Packet switch device
US7102999B1 (en) 1999-11-24 2006-09-05 Juniper Networks, Inc. Switching device
US6681270B1 (en) * 1999-12-07 2004-01-20 Texas Instruments Incorporated Effective channel priority processing for transfer controller with hub and ports
US6643257B1 (en) 2000-01-04 2003-11-04 International Business Machines Corporation Verifying performance of a buffering and selection network device
US7657727B2 (en) * 2000-01-14 2010-02-02 Hitachi, Ltd. Security for logical unit in storage subsystem
JP4651230B2 (en) * 2001-07-13 2011-03-16 株式会社日立製作所 Storage system and access control method to logical unit
US6684209B1 (en) * 2000-01-14 2004-01-27 Hitachi, Ltd. Security method and system for storage subsystem
JP4294821B2 (en) * 2000-01-26 2009-07-15 株式会社日立製作所 Network relay device
EP1264430B1 (en) * 2000-03-10 2005-05-11 Tellabs Operations, Inc. Non-consecutive data readout scheduler
US6947430B2 (en) * 2000-03-24 2005-09-20 International Business Machines Corporation Network adapter with embedded deep packet processing
US7050437B2 (en) * 2000-03-24 2006-05-23 International Business Machines Corporation Wire speed reassembly of data frames
JP2001292164A (en) * 2000-04-06 2001-10-19 Nec Corp Packet switch and its switching method
US7215637B1 (en) 2000-04-17 2007-05-08 Juniper Networks, Inc. Systems and methods for processing packets
US7688727B1 (en) 2000-04-17 2010-03-30 Juniper Networks, Inc. Filtering and route lookup in a switching device
US6798777B1 (en) 2000-04-17 2004-09-28 Juniper Networks, Inc. Filtering and route lookup in a switching device
US7023864B2 (en) * 2000-05-01 2006-04-04 Riverdelta Networks, Inc Data packet discarding
US7106728B1 (en) 2000-05-01 2006-09-12 Industrial Technology Research Institute Switching by multistage interconnection of concentrators
JP4719957B2 (en) * 2000-05-24 2011-07-06 株式会社日立製作所 Storage control device, storage system, and storage system security setting method
US6957272B2 (en) * 2000-05-24 2005-10-18 Alcatel Internetworking (Pe), Inc. Stackable lookup engines
US6591285B1 (en) * 2000-06-16 2003-07-08 Shuo-Yen Robert Li Running-sum adder networks determined by recursive construction of multi-stage networks
US7111071B1 (en) * 2000-06-29 2006-09-19 Intel Corporation Longest prefix match for IP routers
KR100454336B1 (en) * 2000-07-07 2004-10-26 엘지전자 주식회사 Apparatus and Method of Managing Cells in the ATM Switch
US7035267B1 (en) * 2000-08-11 2006-04-25 Marconi Intellectual Property (Ringfence), Inc. Transferring and queueing length and data as one stream
US7224693B1 (en) 2000-08-11 2007-05-29 Ericsson Ab Long packet handling
US6640233B1 (en) * 2000-08-18 2003-10-28 Network Appliance, Inc. Reserving file system blocks
JP3646638B2 (en) * 2000-09-06 2005-05-11 日本電気株式会社 Packet switching apparatus and switch control method used therefor
US6965615B1 (en) * 2000-09-18 2005-11-15 Cisco Technology, Inc. Packet striping across a parallel header processor
JP2002109885A (en) * 2000-09-28 2002-04-12 Toshiba Corp Semiconductor storage device
US6745277B1 (en) * 2000-10-04 2004-06-01 Force10 Networks, Inc. Intelligent interleaving scheme for multibank memory
US7006505B1 (en) * 2000-10-23 2006-02-28 Bay Microsystems, Inc. Memory management system and algorithm for network processor architecture
US7596139B2 (en) 2000-11-17 2009-09-29 Foundry Networks, Inc. Backplane interface adapter with error control and redundant fabric
US7356030B2 (en) 2000-11-17 2008-04-08 Foundry Networks, Inc. Network switch cross point
US7236490B2 (en) * 2000-11-17 2007-06-26 Foundry Networks, Inc. Backplane interface adapter
US6735218B2 (en) * 2000-11-17 2004-05-11 Foundry Networks, Inc. Method and system for encoding wide striped cells
US6876657B1 (en) * 2000-12-14 2005-04-05 Chiaro Networks, Ltd. System and method for router packet control and ordering
US6741562B1 (en) * 2000-12-15 2004-05-25 Tellabs San Jose, Inc. Apparatus and methods for managing packets in a broadband data stream
US7002980B1 (en) 2000-12-19 2006-02-21 Chiaro Networks, Ltd. System and method for router queue and congestion management
US20020159437A1 (en) * 2001-04-27 2002-10-31 Foster Michael S. Method and system for network configuration discovery in a network manager
US7206283B2 (en) 2001-05-15 2007-04-17 Foundry Networks, Inc. High-performance network switch
US7103059B2 (en) * 2001-06-15 2006-09-05 Industrial Technology Research Institute Scalable 2-stage interconnections
US7609695B2 (en) * 2001-06-15 2009-10-27 Industrial Technology Research Institute Optimizing switching element for minimal latency
US7418536B2 (en) * 2001-07-30 2008-08-26 Cisco Technology, Inc. Processor having systolic array pipeline for processing data packets
US7382787B1 (en) 2001-07-30 2008-06-03 Cisco Technology, Inc. Packet routing and switching device
US6987775B1 (en) * 2001-08-15 2006-01-17 Internet Machines Corp. Variable size First In First Out (FIFO) memory with head and tail caching
US8213322B2 (en) * 2001-09-24 2012-07-03 Topside Research, Llc Dynamically distributed weighted fair queuing
US7362751B2 (en) * 2001-10-03 2008-04-22 Topside Research, Llc Variable length switch fabric
US7046660B2 (en) * 2001-10-03 2006-05-16 Internet Machines Corp. Switching apparatus for high speed channels using multiple parallel lower speed channels while maintaining data rate
US6735604B2 (en) * 2001-10-09 2004-05-11 Arthur O. Miller Method for storing and retrieving data objects
US20030088694A1 (en) * 2001-11-02 2003-05-08 Internet Machines Corporation Multicasting method and switch
US7389360B1 (en) 2001-11-05 2008-06-17 Juniper Networks, Inc. Context switched route lookup key engine
WO2003043272A1 (en) * 2001-11-13 2003-05-22 Transwitch Corporation Overcoming access latency inefficiency in memories for packet switched networks
US7203203B2 (en) * 2001-12-05 2007-04-10 Internet Machines Corp. Message ring in a switching network
US7161950B2 (en) * 2001-12-10 2007-01-09 Intel Corporation Systematic memory location selection in Ethernet switches
JP4153201B2 (en) * 2001-12-19 2008-09-24 富士通株式会社 Communication control method, communication system, and computer program
US7106740B1 (en) * 2002-01-02 2006-09-12 Juniper Networks, Inc. Nexthop to a forwarding table
US6967951B2 (en) * 2002-01-11 2005-11-22 Internet Machines Corp. System for reordering sequenced based packets in a switching network
US7420987B1 (en) * 2002-01-17 2008-09-02 Juniper Networks, Inc. Arbiter for multiple mutually exclusive vectors
US7135508B2 (en) * 2002-02-20 2006-11-14 The University Of Chicago Coatings and films derived from clay/wax nanocomposites
US7009989B2 (en) * 2002-03-05 2006-03-07 Hewlett-Packard Development Company, L.P. Forwarding ordered data packets with less delay
US7352766B2 (en) * 2002-03-12 2008-04-01 Alcatel Lucent High-speed memory having a modular structure
US7266117B1 (en) 2002-05-06 2007-09-04 Foundry Networks, Inc. System architecture for very fast ethernet blade
US20120155466A1 (en) 2002-05-06 2012-06-21 Ian Edward Davis Method and apparatus for efficiently processing data packets in a computer network
US7187687B1 (en) 2002-05-06 2007-03-06 Foundry Networks, Inc. Pipeline method and system for switching packets
US7649885B1 (en) * 2002-05-06 2010-01-19 Foundry Networks, Inc. Network routing system for enhanced efficiency and monitoring capability
US7468975B1 (en) 2002-05-06 2008-12-23 Foundry Networks, Inc. Flexible method for processing data packets in a network routing system for enhanced efficiency and monitoring capability
US20030214949A1 (en) * 2002-05-16 2003-11-20 Nadim Shaikli System for reordering sequenced based packets in a switching network
KR100442627B1 (en) * 2002-05-20 2004-08-02 삼성전자주식회사 Method for redirecting packet on network processor
US7525904B1 (en) 2002-06-20 2009-04-28 Cisco Technology, Inc. Redundant packet routing and switching device and method
US7450438B1 (en) 2002-06-20 2008-11-11 Cisco Technology, Inc. Crossbar apparatus for a forwarding table memory in a router
US7710991B1 (en) 2002-06-20 2010-05-04 Cisco Technology, Inc. Scalable packet routing and switching device and method
WO2004002081A1 (en) * 2002-06-21 2003-12-31 Thomson Licensing S.A. Routing engine for a broadcast router
US8937964B2 (en) * 2002-06-27 2015-01-20 Tellabs Operations, Inc. Apparatus and method to switch packets using a switch fabric with memory
US7363347B2 (en) * 2002-11-07 2008-04-22 Hewlett-Packard Development Company, L.P. Method and system for reestablishing connection information on a switch connected to plural servers in a computer network
US8051176B2 (en) 2002-11-07 2011-11-01 Hewlett-Packard Development Company, L.P. Method and system for predicting connections in a computer network
US20040098509A1 (en) * 2002-11-14 2004-05-20 Vic Alfano System for reordering sequenced based packet segments in a switching network
US20040103086A1 (en) * 2002-11-26 2004-05-27 Bapiraju Vinnakota Data structure traversal instructions for packet processing
US7782885B1 (en) * 2002-12-10 2010-08-24 Cisco Technology, Inc. System and method for queue management using queue sets
US20040123123A1 (en) * 2002-12-18 2004-06-24 Buer Mark L. Methods and apparatus for accessing security association information in a cryptography accelerator
US7434043B2 (en) 2002-12-18 2008-10-07 Broadcom Corporation Cryptography accelerator data routing unit
US7568110B2 (en) 2002-12-18 2009-07-28 Broadcom Corporation Cryptography accelerator interface decoupling from cryptography processing cores
US7536476B1 (en) 2002-12-20 2009-05-19 Cisco Technology, Inc. Method for performing tree based ACL lookups
CN1689284B (en) * 2003-01-20 2010-04-28 富士通微电子株式会社 Network switch apparatus and network switch method
US20050216770A1 (en) * 2003-01-24 2005-09-29 Mistletoe Technologies, Inc. Intrusion detection system
JP2004287475A (en) * 2003-01-27 2004-10-14 Fujitsu Ten Ltd Electronic controller and electronic driving device
US7242684B2 (en) * 2003-02-07 2007-07-10 Fujitsu Limited Architecture for switching packets in a high-speed switching environment
US7990987B2 (en) 2003-02-25 2011-08-02 Topside Research, Llc Network processor having bypass capability
US20040206470A1 (en) * 2003-04-18 2004-10-21 William Marsh Rice University Containerless infiltration with electromagnetic levitation
US8861515B2 (en) * 2003-04-22 2014-10-14 Agere Systems Llc Method and apparatus for shared multi-bank memory in a packet switching system
US6901072B1 (en) 2003-05-15 2005-05-31 Foundry Networks, Inc. System and method for high speed packet transmission implementing dual transmit and receive pipelines
JP2004364109A (en) * 2003-06-06 2004-12-24 Canon Inc Temporary address communication apparatus, program, recording medium and method
US7167942B1 (en) * 2003-06-09 2007-01-23 Marvell International Ltd. Dynamic random access memory controller
US7149842B2 (en) * 2003-07-17 2006-12-12 Sun Microsystems, Inc. Efficient utilization of shared buffer memory and method for operating the same
US7584454B1 (en) 2003-09-10 2009-09-01 Nextaxiom Technology, Inc. Semantic-based transactional support and recovery for nested composite software services
US7483901B1 (en) * 2003-09-10 2009-01-27 Nextaxiom Technology, Inc. System and method for data transfer between two or more connected software services
US7533387B1 (en) 2003-09-10 2009-05-12 Nextaxiom Technology, Inc. Guaranteed invocation/consumption of nested, composite software services
US7581205B1 (en) 2003-09-30 2009-08-25 Nextaxiom Technology, Inc. System and method of implementing a customizable software platform
US7421532B2 (en) * 2003-11-18 2008-09-02 Topside Research, Llc Switching with transparent and non-transparent ports
US7454552B2 (en) * 2003-11-18 2008-11-18 Topside Research, Llc Switch with transparent and non-transparent ports
US8225282B1 (en) 2003-11-25 2012-07-17 Nextaxiom Technology, Inc. Semantic-based, service-oriented system and method of developing, programming and managing software modules and software solutions
US20050141434A1 (en) * 2003-12-24 2005-06-30 Linden Cornett Method, system, and program for managing buffers
US20050198361A1 (en) * 2003-12-29 2005-09-08 Chandra Prashant R. Method and apparatus for meeting a given content throughput using at least one memory channel
US7539190B2 (en) * 2004-01-05 2009-05-26 Topside Research, Llc Multicasting in a shared address space
US7426602B2 (en) * 2004-01-08 2008-09-16 Topside Research, Llc Switch for bus optimization
US7817659B2 (en) 2004-03-26 2010-10-19 Foundry Networks, Llc Method and apparatus for aggregating input data streams
US8161270B1 (en) 2004-03-30 2012-04-17 Extreme Networks, Inc. Packet data modification processor
US7292591B2 (en) * 2004-03-30 2007-11-06 Extreme Networks, Inc. Packet processing system architecture and method
US7385984B2 (en) * 2004-03-30 2008-06-10 Extreme Networks, Inc. Packet processing system architecture and method
US8730961B1 (en) 2004-04-26 2014-05-20 Foundry Networks, Llc System and method for optimizing router lookup
US7769756B2 (en) 2004-06-07 2010-08-03 Sling Media, Inc. Selection and presentation of context-relevant supplemental content and advertising
US7917932B2 (en) 2005-06-07 2011-03-29 Sling Media, Inc. Personal video recorder functionality for placeshifting systems
US7975062B2 (en) 2004-06-07 2011-07-05 Sling Media, Inc. Capturing and sharing media content
US9998802B2 (en) * 2004-06-07 2018-06-12 Sling Media LLC Systems and methods for creating variable length clips from a media stream
US8458453B1 (en) 2004-06-11 2013-06-04 Dunti Llc Method and apparatus for securing communication over public network
US7660310B1 (en) * 2004-06-23 2010-02-09 Emc Corporation Index processing
US20060045083A1 (en) * 2004-08-25 2006-03-02 Meshnetworks, Inc. System and method for enabling the coexistence of non-802.11 waveforms in the presence of 802.11 compliant waveforms in a communication network
US7657703B1 (en) 2004-10-29 2010-02-02 Foundry Networks, Inc. Double density content addressable memory (CAM) lookup scheme
US8050280B2 (en) * 2004-12-02 2011-11-01 Electronics And Telecommunications Research Institute Efficient switching device and method for fabricating the same using multiple shared memories
JP4622490B2 (en) * 2004-12-02 2011-02-02 株式会社日立製作所 Data transfer device
US20060136717A1 (en) 2004-12-20 2006-06-22 Mark Buer System and method for authentication via a proximate device
US8295484B2 (en) 2004-12-21 2012-10-23 Broadcom Corporation System and method for securing data from a remote input device
US7889712B2 (en) 2004-12-23 2011-02-15 Cisco Technology, Inc. Methods and apparatus for providing loop free routing tables
US7555681B2 (en) * 2005-05-13 2009-06-30 Texas Instruments Incorporated Multi-port trace receiver
US7672304B2 (en) * 2005-06-16 2010-03-02 Samsung Electronics Co., Ltd. Method and system for switching frames in a switching system
US20070041392A1 (en) * 2005-08-22 2007-02-22 Aaron Kunze Adaptive message buffering
US7609707B2 (en) 2005-08-31 2009-10-27 Alcatel Lucent Communication traffic management systems and methods
US7747833B2 (en) * 2005-09-30 2010-06-29 Mosaid Technologies Incorporated Independent link and bank selection
US7652922B2 (en) 2005-09-30 2010-01-26 Mosaid Technologies Incorporated Multiple independent serial link memory
KR101260632B1 (en) 2005-09-30 2013-05-03 모사이드 테크놀로지스 인코퍼레이티드 Memory with output control
US8448162B2 (en) 2005-12-28 2013-05-21 Foundry Networks, Llc Hitless software upgrades
US8020006B2 (en) * 2006-02-10 2011-09-13 Cisco Technology, Inc. Pipeline for high-throughput encrypt functions
CA2644139A1 (en) 2006-03-31 2007-11-10 Qualcomm Incorporated Memory management for high speed media access control
JP4992296B2 (en) * 2006-05-30 2012-08-08 株式会社日立製作所 Transfer processing device
JP2008042504A (en) * 2006-08-04 2008-02-21 Nec Corp Switching apparatus, switch method, and program
US7903654B2 (en) 2006-08-22 2011-03-08 Foundry Networks, Llc System and method for ECMP load sharing
US8238255B2 (en) 2006-11-22 2012-08-07 Foundry Networks, Llc Recovering from failures without impact on data traffic in a shared bus architecture
US20090279441A1 (en) 2007-01-11 2009-11-12 Foundry Networks, Inc. Techniques for transmitting failure detection protocol packets
US7680117B1 (en) * 2007-03-30 2010-03-16 Juniper Networks, Inc. Forwarding packets using next-hop information
CA2636833C (en) * 2007-06-21 2011-08-30 Maged E. Beshai Large-scale packet switch
US7822915B2 (en) * 2007-06-30 2010-10-26 Alcatel-Lucent Usa Inc. Memory controller for packet applications
US8271859B2 (en) * 2007-07-18 2012-09-18 Foundry Networks Llc Segmented CRC design in high speed networks
US8037399B2 (en) 2007-07-18 2011-10-11 Foundry Networks, Llc Techniques for segmented CRC design in high speed networks
US8149839B1 (en) 2007-09-26 2012-04-03 Foundry Networks, Llc Selection of trunk ports and paths using rotation
US8190881B2 (en) 2007-10-15 2012-05-29 Foundry Networks Llc Scalable distributed web-based authentication
US9178785B1 (en) 2008-01-24 2015-11-03 NextAxiom Technology, Inc Accounting for usage and usage-based pricing of runtime engine
US8683572B1 (en) 2008-01-24 2014-03-25 Dunti Llc Method and apparatus for providing continuous user verification in a packet-based network
US7852486B2 (en) * 2008-02-07 2010-12-14 Board Of Regents, The University Of Texas System Wavelength and intensity monitoring of optical cavity
GB2458952B (en) * 2008-04-04 2012-06-13 Micron Technology Inc Queue processing method
US8195774B2 (en) 2008-05-23 2012-06-05 Vmware, Inc. Distributed virtual switch for virtualized computer systems
US8625624B1 (en) * 2008-06-13 2014-01-07 Cisco Technology, Inc. Self-adjusting load balancing among multiple fabric ports
JP4988674B2 (en) * 2008-09-08 2012-08-01 株式会社日立製作所 Network monitoring device, network monitoring method, and network monitoring program
JP5332430B2 (en) * 2008-09-11 2013-11-06 富士通株式会社 Shared memory system
US8171148B2 (en) 2009-04-17 2012-05-01 Sling Media, Inc. Systems and methods for establishing connections between devices communicating over a network
US8090901B2 (en) 2009-05-14 2012-01-03 Brocade Communications Systems, Inc. TCAM management approach that minimize movements
US8179898B2 (en) * 2009-06-11 2012-05-15 Alcatel Lucent Packet processing using braided tries
US8599850B2 (en) 2009-09-21 2013-12-03 Brocade Communications Systems, Inc. Provisioning single or multistage networks using ethernet service instances (ESIs)
US8621099B2 (en) * 2009-09-21 2013-12-31 Sling Media, Inc. Systems and methods for formatting media content for distribution
US9015225B2 (en) 2009-11-16 2015-04-21 Echostar Technologies L.L.C. Systems and methods for delivering messages over a network
US9178923B2 (en) 2009-12-23 2015-11-03 Echostar Technologies L.L.C. Systems and methods for remotely controlling a media server via a network
US9275054B2 (en) 2009-12-28 2016-03-01 Sling Media, Inc. Systems and methods for searching media content
US8208484B2 (en) * 2010-01-11 2012-06-26 Telefonaktiebolaget L M Ericsson (Publ) Forwarding a packet within a router using fragments over an interconnect
WO2011136796A1 (en) * 2010-04-30 2011-11-03 Hewlett-Packard Development Company, L.P. Management data transfer between processors
US8665727B1 (en) * 2010-06-21 2014-03-04 Xilinx, Inc. Placement and routing for a multiplexer-based interconnection network
US9113185B2 (en) 2010-06-23 2015-08-18 Sling Media Inc. Systems and methods for authorizing access to network services using information obtained from subscriber equipment
US8954664B1 (en) 2010-10-01 2015-02-10 Western Digital Technologies, Inc. Writing metadata files on a disk
US8756361B1 (en) * 2010-10-01 2014-06-17 Western Digital Technologies, Inc. Disk drive modifying metadata cached in a circular buffer when a write operation is aborted
US8565092B2 (en) * 2010-11-18 2013-10-22 Cisco Technology, Inc. Dynamic flow redistribution for head of line blocking avoidance
US8605732B2 (en) 2011-02-15 2013-12-10 Extreme Networks, Inc. Method of providing virtual router functionality
US8646013B2 (en) 2011-04-29 2014-02-04 Sling Media, Inc. Identifying instances of media programming available from different content sources
US8756382B1 (en) 2011-06-30 2014-06-17 Western Digital Technologies, Inc. Method for file based shingled data storage utilizing multiple media types
US8769533B2 (en) * 2011-07-18 2014-07-01 International Business Machines Corporation Check-point based high availability: network packet buffering in hardware
US8944159B2 (en) * 2011-08-05 2015-02-03 Cameron International Corporation Horizontal fracturing tree
US20130060795A1 (en) * 2011-09-07 2013-03-07 Unisys Corp. Prepared statements to improve performance in database interfaces
US8706736B2 (en) * 2011-09-30 2014-04-22 Broadcom Corporation Extended width entries for hash tables
WO2013068862A1 (en) * 2011-11-11 2013-05-16 International Business Machines Corporation Memory module and memory controller for controlling a memory module
US8612706B1 (en) 2011-12-21 2013-12-17 Western Digital Technologies, Inc. Metadata recovery in a disk drive
US8923298B2 (en) * 2012-05-04 2014-12-30 Futurewei Technoligies, Inc. Optimized trie-based address lookup
US9037670B2 (en) 2012-09-18 2015-05-19 Cisco Technology, Inc. Ultra low latency network buffer storage
US9552327B2 (en) 2015-01-29 2017-01-24 Knuedge Incorporated Memory controller for a network on a chip device
US10061531B2 (en) 2015-01-29 2018-08-28 Knuedge Incorporated Uniform system wide addressing for a computing system
US20170017419A1 (en) 2015-07-15 2017-01-19 Innovium, Inc. System And Method For Enabling High Read Rates To Data Element Lists
US20170017420A1 (en) 2015-07-15 2017-01-19 Innovium, Inc. System And Method For Enabling High Read Rates To Data Element Lists
US20170017567A1 (en) * 2015-07-15 2017-01-19 Innovium, Inc. System And Method For Implementing Distributed-Linked Lists For Network Devices
US20170017414A1 (en) * 2015-07-15 2017-01-19 Innovium, Inc. System And Method For Implementing Hierarchical Distributed-Linked Lists For Network Devices
US11288447B2 (en) 2015-10-14 2022-03-29 Dr Holdco 2, Inc. Step editor for data preparation
US11169978B2 (en) 2015-10-14 2021-11-09 Dr Holdco 2, Inc. Distributed pipeline optimization for data preparation
US10642815B2 (en) * 2015-10-14 2020-05-05 Paxata, Inc. Step editor for data preparation
US10027583B2 (en) 2016-03-22 2018-07-17 Knuedge Incorporated Chained packet sequences in a network on a chip architecture
US10346049B2 (en) 2016-04-29 2019-07-09 Friday Harbor Llc Distributed contiguous reads in a network on a chip architecture
CN106027422B (en) 2016-05-13 2020-05-08 上海兆芯集成电路有限公司 Exchanger and data access method
US9832072B1 (en) * 2016-05-31 2017-11-28 128 Technology, Inc. Self-configuring computer network router
US10659353B2 (en) 2016-11-03 2020-05-19 International Business Machines Corporation Dynamic scriptable routing
US10680977B1 (en) * 2017-09-26 2020-06-09 Amazon Technologies, Inc. Splitting data into an information vector and a control vector and processing, at a stage of a control pipeline, the control vector and a data block of the information vector extracted from a corresponding stage of a data pipeline
US11270032B1 (en) * 2018-12-27 2022-03-08 Thales E-Security, Inc. Tamper switch assembly and installation method thereof
EP3942757A4 (en) 2019-05-23 2023-05-31 Hewlett Packard Enterprise Development LP System and method for facilitating data-driven intelligent network with flow control of individual applications and traffic flows
US11252030B2 (en) * 2019-10-02 2022-02-15 Cisco Technology, Inc. Network scale emulator

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5130983A (en) * 1990-03-27 1992-07-14 Heffner Iii Horace W Method of polling to determine service needs and the like
US5384568A (en) * 1993-12-02 1995-01-24 Bell Communications Research, Inc. Data compression

Family Cites Families (75)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5870474A (en) * 1995-12-04 1999-02-09 Scientific-Atlanta, Inc. Method and apparatus for providing conditional access in connection-oriented, interactive networks with a multiplicity of service providers
US4058672A (en) 1976-11-10 1977-11-15 International Telephone And Telegraph Corporation Packet-switched data communications system
US4596010A (en) 1984-05-03 1986-06-17 At&T Bell Laboratories Distributed packet switching arrangement
US5199106A (en) * 1986-09-19 1993-03-30 International Business Machines Corporation Input output interface controller connecting a synchronous bus to an asynchronous bus and methods for performing operations on the bus
EP0260392A3 (en) * 1986-09-19 1992-03-11 International Business Machines Corporation An input output interface controller connecting a synchronous bus to an asynchronous bus and methods for performing operations on the buses
US5293597A (en) * 1987-03-09 1994-03-08 At&T Bell Laboratories Concurrent context memory management unit
ZA883232B (en) * 1987-05-06 1989-07-26 Dowd Research Pty Ltd O Packet switches,switching methods,protocols and networks
FR2616604B1 (en) 1987-06-15 1989-09-22 Lespagnol Albert EQUIPMENT FOR RECONSTRUCTING AND MULTIPLEXING FRAMES OF VARIOUS ORIGINS CONSISTING OF PACKETS OF FIXED LENGTH IN VARIABLE NUMBER
FR2618624B1 (en) 1987-07-24 1992-04-30 Michel Servel HYBRID TIME MULTIPLEX SWITCHING SYSTEM WITH OPTIMIZED BUFFER MEMORY
DE3742939A1 (en) 1987-12-18 1989-07-06 Standard Elektrik Lorenz Ag METHOD FOR HYBRID PACKING AND DEVICES THEREFOR
FR2625392B1 (en) 1987-12-24 1993-11-26 Quinquis Jean Paul CIRCUIT FOR MANAGING BUFFER WRITE POINTERS IN PARTICULAR FOR SELF-ROUTING PACKET TIME SWITCH
US5155834A (en) * 1988-03-18 1992-10-13 Wang Laboratories, Inc. Reference and change table storage system for virtual memory data processing system having a plurality of processors accessing common memory
JP2667868B2 (en) 1988-04-06 1997-10-27 株式会社日立製作所 Cell switching system
DE3824849A1 (en) * 1988-07-21 1990-01-25 Kempten Elektroschmelz Gmbh PRESSURIZED POLYCRYSTALLINE MIXING MATERIALS BASED ON HEXAGONAL BORNITRIDE, OXIDES AND CARBIDES
US5860136A (en) * 1989-06-16 1999-01-12 Fenner; Peter R. Method and apparatus for use of associated memory with large key spaces
US5490258A (en) * 1991-07-29 1996-02-06 Fenner; Peter R. Associative memory for very large key spaces
WO1991002420A1 (en) 1989-08-09 1991-02-21 Alcatel N.V. Communication switching element and method for transmitting variable length cells
EP0422910A3 (en) * 1989-10-10 1991-11-06 American Telephone And Telegraph Company High capacity memory based packet switches
US5265207A (en) * 1990-10-03 1993-11-23 Thinking Machines Corporation Parallel computer system including arrangement for transferring messages from a source processor to selected ones of a plurality of destination processors and combining responses
US5367643A (en) * 1991-02-06 1994-11-22 International Business Machines Corporation Generic high bandwidth adapter having data packet memory configured in three level hierarchy for temporary storage of variable length data packets
US5168492A (en) * 1991-04-11 1992-12-01 Northern Telecom Limited Rotating-access ATM-STM packet switch
EP0520116A1 (en) * 1991-06-28 1992-12-30 International Business Machines Corporation Method and apparatus for performing pattern search functions
US5623489A (en) * 1991-09-26 1997-04-22 Ipc Information Systems, Inc. Channel allocation system for distributed digital switching network
US5241536A (en) * 1991-10-03 1993-08-31 Northern Telecom Limited Broadband input buffered atm switch
JP2839060B2 (en) * 1992-03-02 1998-12-16 インターナショナル・ビジネス・マシーンズ・コーポレイション Data processing system and data processing method
IL101623A (en) * 1992-04-16 1997-06-10 Fortress U & T 2000 Ltd Digital signature device
AU4661793A (en) * 1992-07-02 1994-01-31 Wellfleet Communications Data packet processing method and apparatus
CA2144953A1 (en) * 1992-09-29 1994-04-14 Paul Baran Cell based wide area network alternative access telephone and data system
FR2701180B1 (en) * 1993-01-29 1995-03-10 Cit Alcatel Cellulization device and device for decellulizing synchronous digital channels, switching center for synchronous digital channels, and switching center for asynchronous digital channels.
US5448702A (en) 1993-03-02 1995-09-05 International Business Machines Corporation Adapters with descriptor queue management capability
US5530902A (en) * 1993-06-14 1996-06-25 Motorola, Inc. Data packet switching system having DMA controller, service arbiter, buffer type managers, and buffer managers for managing data transfer to provide less processor intervention
FR2707775B1 (en) * 1993-07-12 1996-04-12 Duret Chrsitian Method and device for analyzing information contained in data structures.
US5515376A (en) * 1993-07-19 1996-05-07 Alantec, Inc. Communication apparatus and methods
US5408469A (en) * 1993-07-22 1995-04-18 Synoptics Communications, Inc. Routing device utilizing an ATM switch as a multi-channel backplane in a communication network
US5457687A (en) 1993-09-02 1995-10-10 Network Equipment Technologies, Inc. Method and apparatus for backward explicit congestion notification (BECN) in an ATM network
JPH0795525A (en) * 1993-09-17 1995-04-07 Canon Inc Digital signal recorder
CA2134061A1 (en) * 1993-10-28 1995-04-29 Aaron William Ogus Frame buffering of network packets
US5485455A (en) 1994-01-28 1996-01-16 Cabletron Systems, Inc. Network having secure fast packet switching and guaranteed quality of service
GB2291561B (en) * 1994-05-21 1998-09-23 Northern Telecom Ltd Communications system
JP3059639B2 (en) * 1994-07-14 2000-07-04 古河電気工業株式会社 Route selection information search device
US5627970A (en) * 1994-08-08 1997-05-06 Lucent Technologies Inc. Methods and apparatus for achieving and maintaining optimum transmission rates and preventing data loss in a processing system nework
JP3224963B2 (en) * 1994-08-31 2001-11-05 株式会社東芝 Network connection device and packet transfer method
JP3269273B2 (en) * 1994-09-02 2002-03-25 三菱電機株式会社 Cell switching device and cell switching system
US5537403A (en) * 1994-12-30 1996-07-16 At&T Corp. Terabit per second packet switch having distributed out-of-band control of circuit and packet switching communications
US5539815A (en) 1995-02-24 1996-07-23 At&T Corp. Network call routing controlled by a management node
US5956751A (en) * 1995-06-28 1999-09-21 Industrial Technology Research Institute Computer memory management system using physical segmentation space allocation
US5796944A (en) 1995-07-12 1998-08-18 3Com Corporation Apparatus and method for processing data frames in an internetworking device
US5719864A (en) * 1995-08-11 1998-02-17 International Business Machines Corp. Logical channel resolution in asynchronous transmission mode communication systems
US5745837A (en) * 1995-08-25 1998-04-28 Terayon Corporation Apparatus and method for digital data transmission over a CATV system using an ATM transport protocol and SCDMA
JPH0983535A (en) * 1995-09-14 1997-03-28 Toshiba Corp Cell data exchange method/device
US6085233A (en) * 1995-12-29 2000-07-04 Pankosmion, Inc. System and method for cellular network computing and communications
US5689505A (en) * 1996-01-16 1997-11-18 Lucent Technologies Inc. Buffering of multicast cells in switching networks
US5859835A (en) * 1996-04-15 1999-01-12 The Regents Of The University Of California Traffic scheduling system and method for packet-switched networks
US5872787A (en) * 1996-05-15 1999-02-16 Gte Laboratories Incorporated Distributed switch buffer utilizing cascaded modular switch chips
US6308148B1 (en) * 1996-05-28 2001-10-23 Cisco Technology, Inc. Network flow data export
US5946716A (en) * 1996-05-30 1999-08-31 Hewlett-Packard Company Sectored virtual memory management system and translation look-aside buffer (TLB) for the same
US5802052A (en) 1996-06-26 1998-09-01 Level One Communication, Inc. Scalable high performance switch element for a shared memory packet or ATM cell switch fabric
US5802054A (en) * 1996-08-15 1998-09-01 3Com Corporation Atomic network switch with integrated circuit switch nodes
US5924091A (en) * 1996-08-28 1999-07-13 Sybase, Inc. Database system with improved methods for radix sorting
US5987034A (en) * 1996-08-30 1999-11-16 Cisco Technology, Inc. ATM cells within frame relay technology
US6101543A (en) * 1996-10-25 2000-08-08 Digital Equipment Corporation Pseudo network adapter for frame capture, encapsulation and encryption
US5912889A (en) * 1996-11-21 1999-06-15 Xerox Corporation ATM switch with output port clustering for dynamically allocating bandwidth between ports
US6493347B2 (en) 1996-12-16 2002-12-10 Juniper Networks, Inc. Memory organization in a switching device
US5909440A (en) * 1996-12-16 1999-06-01 Juniper Networks High speed variable length best match look-up in a switching device
US5905725A (en) * 1996-12-16 1999-05-18 Juniper Networks High speed switching device
US6091705A (en) * 1996-12-20 2000-07-18 Sebring Systems, Inc. Method and apparatus for a fault tolerant, software transparent and high data integrity extension to a backplane bus or interconnect
DE69719934T2 (en) * 1996-12-20 2003-11-27 Ibm Method and device for fast and secure data collection
US5999441A (en) * 1997-02-14 1999-12-07 Advanced Micro Devices, Inc. Random access memory having bit selectable mask for memory writes
US6229821B1 (en) * 1997-04-22 2001-05-08 At&T Corp. Serial data transmission of variable length mini packets using statistical multiplexing
US6075787A (en) * 1997-05-08 2000-06-13 Lucent Technologies Inc. Method and apparatus for messaging, signaling, and establishing a data link utilizing multiple modes over a multiple access broadband communications network
US6151638A (en) * 1997-06-25 2000-11-21 Unisys Corp. System and method for performing external procedure calls from a client program to a server program to a server program and back to the client program while both are running in a heterogenous computer
US6201813B1 (en) * 1997-06-30 2001-03-13 Cisco Technology, Inc. Method and apparatus for using ATM queues for segmentation and reassembly of data frames
US6014380A (en) * 1997-06-30 2000-01-11 Sun Microsystems, Inc. Mechanism for packet field replacement in a multi-layer distributed network element
US6212183B1 (en) * 1997-08-22 2001-04-03 Cisco Technology, Inc. Multiple parallel packet routing lookup
US6553002B1 (en) * 1997-08-29 2003-04-22 Ascend Communications, Inc. Apparatus and method for routing data packets through a communications network

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5130983A (en) * 1990-03-27 1992-07-14 Heffner Iii Horace W Method of polling to determine service needs and the like
US5384568A (en) * 1993-12-02 1995-01-24 Bell Communications Research, Inc. Data compression

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP0948849A2 *

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2783618A1 (en) * 1998-09-23 2000-03-24 France Telecom METHOD FOR UPDATING AN ASSOCIATIVE MEMORY OF THE TRIE TYPE, AND ROUTER USING SUCH A METHOD
EP0989502A1 (en) * 1998-09-23 2000-03-29 France Telecom Trie type associative memory updating method, and router for implementing such a method
JP2000231792A (en) * 1998-09-23 2000-08-22 Fr Telecom Method for updating trie type associative memory, and router for executing the method
US6425099B1 (en) 1998-09-23 2002-07-23 France Telecom Method of updating an associative memory of the TRIE type, and router implementing such a method
FR2789778A1 (en) * 1999-02-12 2000-08-18 France Telecom METHOD FOR ASSOCIATING ROUTING REFERENCES WITH DATA PACKETS BY MEANS OF A SORTED MEMORY, AND PACKET ROUTER APPLYING THIS METHOD
EP1030493A1 (en) * 1999-02-12 2000-08-23 France Telecom Method for associating distribution references with data packets using a Trie type memory and data processing system executing this method
US6704313B1 (en) 1999-02-12 2004-03-09 France Telecom Method of associating forwarding references with data packets by means of a TRIE memory, and packet processing device applying such method
JP2000324172A (en) * 1999-05-11 2000-11-24 Nec Corp Method for storing prefix concerning address
US7412454B2 (en) 2003-09-03 2008-08-12 International Business Machines Corporation Data structure supporting random delete and timer function
US7792873B2 (en) 2003-09-03 2010-09-07 International Business Machines Corporation Data structure supporting random delete and timer function

Also Published As

Publication number Publication date
EP0947078A2 (en) 1999-10-06
US7903659B2 (en) 2011-03-08
CA2274962C (en) 2002-08-06
US7116660B2 (en) 2006-10-03
US20110164618A1 (en) 2011-07-07
US8681796B2 (en) 2014-03-25
US8477784B2 (en) 2013-07-02
US8761180B2 (en) 2014-06-24
US7545808B2 (en) 2009-06-09
EP0948849A2 (en) 1999-10-13
EP0940025A4 (en) 2001-08-29
JP2000516423A (en) 2000-12-05
US20030108056A1 (en) 2003-06-12
CA2274964C (en) 2003-08-19
JP2001509978A (en) 2001-07-24
US20140181235A1 (en) 2014-06-26
US6493347B2 (en) 2002-12-10
US6917620B1 (en) 2005-07-12
EP0947078A4 (en) 2001-08-29
CA2274964A1 (en) 1998-06-25
EP0948849A4 (en) 2006-06-14
US20090109975A1 (en) 2009-04-30
US20120219001A1 (en) 2012-08-30
US20060023719A1 (en) 2006-02-02
WO1998027660A3 (en) 1998-10-15
US20050201396A1 (en) 2005-09-15
US9411776B2 (en) 2016-08-09
JP3459652B2 (en) 2003-10-20
US20130215886A1 (en) 2013-08-22
DE69737361D1 (en) 2007-03-29
DE69737361T2 (en) 2007-06-21
EP0940025A1 (en) 1999-09-08
US8189605B2 (en) 2012-05-29
US20090268740A1 (en) 2009-10-29
EP0940025B1 (en) 2007-02-14
CA2274966A1 (en) 1998-06-25
JP3453148B2 (en) 2003-10-06
WO1998027662A3 (en) 1998-09-03
DE69737357D1 (en) 2007-03-29
WO1998027660A2 (en) 1998-06-25
JP3459653B2 (en) 2003-10-20
US20010010692A1 (en) 2001-08-02
US7489699B2 (en) 2009-02-10
WO1998027697A1 (en) 1998-06-25
JP2000516424A (en) 2000-12-05
EP0947078B1 (en) 2007-02-14
CA2274966C (en) 2003-10-28
DE69737357T2 (en) 2007-06-21
CA2274962A1 (en) 1998-06-25

Similar Documents

Publication Publication Date Title
US5909440A (en) High speed variable length best match look-up in a switching device
CA2274962C (en) High speed variable length best match look-up in a switching device
US6526055B1 (en) Method and apparatus for longest prefix address lookup
EP1808987B1 (en) Longest prefix matching using tree bitmap data structures
US10389633B2 (en) Hash-based address matching
US6553002B1 (en) Apparatus and method for routing data packets through a communications network
US7281085B1 (en) Method and device for virtualization of multiple data sets on same associative memory
US6775281B1 (en) Method and apparatus for a four-way hash table
EP1486040B1 (en) Vlan table management system for memory efficient lookups and inserts in hardware-based packet switches
US6956858B2 (en) Network routing table and packet routing method
US7111071B1 (en) Longest prefix match for IP routers
US7415472B2 (en) Comparison tree data structures of particular use in performing lookup operations
US20020046291A1 (en) Network unit with address cache for frequently occurring network conversations
US20040254909A1 (en) Programming routes and access control lists in comparison tree data structures and their use such as in performing lookup operations
US20050243827A1 (en) Lookup engine
US20020131432A1 (en) Method and apparatus for ternary content addressable memory (TCAM) table management
CN111937360B (en) Longest prefix matching
US6804230B1 (en) Communication device with forwarding database having a trie search facility
WO2001005116A2 (en) Routing method and apparatus
US6201755B1 (en) Method and system for storing and retrieving information in a communications node
US6925503B2 (en) Method and system for performing a longest prefix match search

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): CA JP

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE

AK Designated states

Kind code of ref document: A3

Designated state(s): CA JP

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 1997951733

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2274962

Country of ref document: CA

Ref country code: CA

Ref document number: 2274962

Kind code of ref document: A

Format of ref document f/p: F

WWP Wipo information: published in national office

Ref document number: 1997951733

Country of ref document: EP