|Número de publicación||US6314488 B1|
|Tipo de publicación||Concesión|
|Número de solicitud||US 09/076,244|
|Fecha de publicación||6 Nov 2001|
|Fecha de presentación||12 May 1998|
|Fecha de prioridad||12 May 1998|
|Número de publicación||076244, 09076244, US 6314488 B1, US 6314488B1, US-B1-6314488, US6314488 B1, US6314488B1|
|Inventores||Brian R. Smith|
|Cesionario original||Crossroads Systems, Inc.|
|Exportar cita||BiBTeX, EndNote, RefMan|
|Citas de patentes (4), Otras citas (2), Citada por (50), Clasificaciones (22), Eventos legales (6)|
|Enlaces externos: USPTO, Cesión de USPTO, Espacenet|
The present invention relates to fibre channel communication systems and, more particularly, to a method and system for segmenting a fibre channel arbitrated loop that achieves improved performance and manageability over prior art methods and systems.
In recent years several technical developments have converged to a bigger than ever need for extremely fast data links. High performance computers have become the focus of much attention in the data communications industry. Performance improvements have spawned increasingly data-intensive and high-speed networking applications, such as multimedia and scientific visualization. However, the existing network interconnects between computers and I/O devices are unable to run at the speeds needed.
One approach to provide fast data links, called fibre channel, provides a practical, inexpensive, yet expandable means of quickly transferring data between workstations, mainframes, supercomputers, desktop computers, storage devices, displays and other peripherals. Fibre channel is the general name of an integrated set of standards being developed by the American National Standards Institute (ANSI). Fibre channel attempts to combine the best of channel and network methods of communication into a new I/O interface that meets the needs of both channel users and network users.
Fibre channel allows for an active intelligent interconnection scheme, called a fabric, to connect devices. In a fibre channel system a port simply manages a simple point-to-point connection between itself and the fabric. Since a fibre channel system relies on ports logging in with each other and the fabric, it is irrelevant whether the fabric is a circuit switch, an active hub or a loop. The topology can be selected depending on system performance requirements or packaging options. Possible fibre channel topologies include point-to-point, crosspoint switched or arbitrated loop.
In a fibre channel arbitrated loop, a shared media exists amongst participating end stations and storage devices, for example. In the fibre channel arbitrated loop, a switched media device enables multiple end stations to have simultaneous conversations. To date however, no fibre channel arbitrated loop provides multiple conversations in the arbitrated loops. In these loops with the shared media device, only one pair may have a conversation at a given time.
Existing fibre channel arbitrated loop technologies have limited bandwidth because the bandwidths are shared among all of the participants in the loop. This limits the conversations to only one conversation at a time. As a result, latency occurs within the fibre channel arbitrated loop, which latency can be detrimental to various applications.
A problem associated with latency can be seen in the example of a database application. For example, if a database application is to scale, in the sense that there are more processors in the loop to achieve performance, there is a latency of somewhere in the vicinity of 10-100 microseconds. In a fibre channel arbitrated loop, if one frame time is 20 microseconds, there may be the need to wait for five frames in front of a given frame in order to conduct a conversation. If this occurs, latency extending beyond the 100 microseconds rule occurs, which violates the database application latency limit.
During arbitrated in a fibre channel arbitrated loop, when one individual arbitrates and wins a loop, it sends data to another end station. As long as an end station sends data, it owns the arbitrated loop and no other end station may use the loop. Depending on the amount of data being sent and its data flow rate, the sending station could continuously consume loop resources. This would prevent other end stations from using the loop until the transmission from the end station consuming loop resources was completed. This idea of “fairness” has both to do with how long an end station uses the loop and how frequently the user has access to the loop.
With existing fibre channel arbitrated loop technology, up to 126 devices may be used. This, in most cases, does not occur. Instead most systems use on the order of eight to ten devices. There is no system, however, that practically provides the ability to have multiples of eight to ten devices within an arbitrated loop. Nor is there a device that permits the aggregation of arbitrated loop stations or stations. With the current technology, arbitrated operates only within one loop.
In light of the above, a need exists for a method and system for segmenting a fibre channel arbitrated loop communications network that eliminates or substantially reduces latency and unfairness, as well as provides increased performance and overall flexibility relative to prior art fibre channel arbitrated loop operational methods and systems.
According to one aspect of the present invention, there is provided a segmented storage and communication system for a fibre channel communications system that includes a segmentation router comprising a plurality of ports. Control instructions associate with the segmentation router to establish the segmentation router as a master router. This occurs by initializing each of at least a predetermined subset of the plurality of ports on the fibre channel arbitrated loop that are part of the segmentation router. This causes the segmentation router to win the LISM process performed by the fibre channel arbitrated loop. The control instructions further include instructions for transmitting loop initialization frames to the fibre channel arbitrated loop from each of the ports, beginning with LIPA frames. In the LIPA frames, all but the LIPA frame range of address bits are set to 1. This prevents other network loop ports attached to a router other than the master router from acquiring a duplicate address. This establishes a plurality of sub-loops each associated with a predetermined set of physical addresses.
A technical advantage that the present invention provides is the ability to segment a given fibre channel arbitrated loop into a number of separate loops. This permits users on end stations at separate segments to have conversations within a local segment and receive, for example, the benefit of 100 megabytes per second data flow, i.e., full band width operation in the fibre channel at the different segmented loops. Thus, as long as a given segment is not crossed it is possible, using the present invention, to provide multiplicative bandwidth within a single channel fibre channel arbitrated loop. This overcomes the latency problem that exists in current fibre channel arbitrated loop technology.
Another technical advantage that the present invention provides is the ability to segment the fibre channel arbitrated loop so that multiple conversations may occur simultaneously. This allows end stations that otherwise would not have access to the loop to have access to their defined subsegment. Thus, even in the instance of an unfair station consuming a disproportionate amount of time in the fibre channel arbitrated loop, other stations may communicate using the segmented loop.
The present invention also provides the technical advantage of permitting a topology that supports a wide array of infrastructure components making the segmentation transparent to the user while at the same time increasing the fairness and reducing latency among devices.
The present invention provides the technical advantage of a much less expensive solution than using a switchboard for multiple simultaneous conversations. Moreover, the installed base of infrastructure components in an arbitrated loop cannot readily employ switchboards or other switches. Segmenting the fibre channel arbitrated loop according to the teachings of the present invention provides a topology supporting all the infrastructure components that is completely transparent to the user.
For a more complete understanding of the present invention and the advantages thereof, reference is now made to the following description which is to be taken in conjunction with the accompanying drawings in which like reference numerals indicate like features and wherein:
FIG. 1 shows a prior art fibre channel arbitrated loop network;
FIG. 2 illustrates one implementation of the fibre channel arbitrated loop system and method according to the teachings of the present invention; and
FIG. 3 depicts the segmentation that the master router of the present invention uses to achieve the purposes of the present invention.
Preferred embodiments of the present invention are illustrated in the FIGUREs. like numerals being used to refer to like and corresponding parts of the various drawings.
FIG. 1 illustrates a prior art fibre channel arbitrated loop network 10 that includes fibre channel arbitrated loop 12 which serves as a common access point. End stations 14 through 24 communicate via fibre channel arbitrated loop 12 with storage devices 26 through 36. All devices including end stations 14 through 24 and storage devices 26 through 36 share the bandwidth available on one arbitrated loop. The devices have access to the 100 megabytes per second data flow. During fibre channel arbitrated loop 12 initialization, each end station 14, for example, must acquire an address as described in the fibre channel arbitrated loop (revision 4.5) ANSI standard. During the address acquiring phase, a “select master” is chosen to facilitate and control the initialization process of sending LIPA, LIHA, and LISA frames.
There are 126 addresses that can be taken during the initialization according to a 128 bit map. The LIPA, LIHA, LISA frames are frames in fibre channel that contain 8 bytes, or 128 bytes. Each byte position represents an available or taken arbitrated loop physical address. A taken arbitrated loop physical address is one in which the byte position has a 1. Available arbitrated loop physical addresses are defined as those where the byte position is currently 0. When a network router port receives the initialization sequence, it finds the desired arbitrated loop physical address byte position and if available, sets the byte in the frame and acquires its arbitrated loop physical address. If not available, it selects the next available arbitrated loop physical address and sets that byte.
Current fibre channel arbitrated loop architectures support multiple devices on one fibre channel arbitrated loop. However, the bandwidth is shared amongst all the workstations and storage elements on the loop. The present invention segments the loop such that multiple conversations may occur simultaneously and bandwidth multiplication is possible. This process may be facilitated by a segmenting router to divide the available arbitrated loop physical addresses into a number of “sub-loops”. The devices on the “sub-loops” operate as though they are one contiguous loop, although they are not.
The method of doing this is that each port on its own subloop, the segmenting router performs initialization on fibre channel arbitrated loop. The segmentation router, therefore, becomes the “select master” and wins the loop initialization select master (LISM) process. After winning, each port on its own segmenting router sends around the LIPA, LIHA, LISA frames. When sending the frames, the select master begins the LIPA frame with all but the range of address bits set to 1. Therefore, no other network loop port attached to another router port can acquire a duplicated address. Once each router port has completed the process, all addresses attached to the select master are unique and the router can route frames from one “sub-loop” to another.
FIG. 2 illustrates how this might work in one embodiment of the invention as part of segmented fibre channel arbitrated loop 40. In segmented fibre channel loop 40, segmenting router 42 serves as a master router controlling communication among four segmented fibre channel arbitrated loops 44, 46, 48 and 50. Segmented fibre channel arbitrated loop with communication between work stations 14 and 16 via fibre channel arbitrated loop 52 to storage devices 26 and 28. Similar communications occur in the segmented fibre channel arbitrated loops via fibre channel arbitrated loop 54 for segmented network 46, fibre channel arbitrated loop 56 for segmented network 48, and via fibre channel arbitrated loop 58 for segmented network 50.
In FIG. 2, therefore, segmented end stations and storage devices form their own sub-arbitrated loop. The segmentation router allows conversations on the four separate loops to occur simultaneously and between each other without reducing the flowrate through the segmentation router. The result, in this example, is a multiple of four times improvement in fibre channel bandwidth. This may be scaled, for example, to up to 63 sub-segments or segmented loops in a loop having 126 addresses. However, in practice, it is probably the case that 4, 8, 16, or some similar grouping may be used for the segmented loops.
In the example of FIG. 2, workstations 14 and 16 have the ability to communicate with storage devices 26 and 28 independent of events or data flow requirements occurring at different subsegments. This permits devices within the same segmented loop to communicate immediately and essentially eliminate both the latency and unfairness associated with communications occurring elsewhere on fibre channel arbitrated loop 40.
The present invention also takes advantage of a phenomenon of communications known as “locality.” The concept of locality means that most of the time, for example, 80% of the time, a given end station will access storage and servers that are close to that end station. Infrequently, for example 20% of the time or less, the same end station will access storage or servers that are far from the end station. By using locality as a principle of design, servers and storage systems may be organized so as to access each other frequently on the same segmented loop, i.e., with closer physical addresses, and then others far away, i.e., with remote physical addresses, may be accessed through the segmentation router.
Loop Initialization generally occurs according to the Fibre Channel Standards as promulgated by the American National Standards Institution's National Committee for Information Standards Technical Committee T11:I/O Interface document entitled “Fibre Channel Standards X.3230-1994-Fibre Channel Physical and Signalling Standard (FC-PH) and related publications. More particularly and with reference to these documents it becomes clear how the LISM frame establishes the segmentation router as the select master. As a result of operating the router as the select master, each port on the router becomes the select master port.
FIG. 3 illustrates two bit maps including 128 bit map 70 where each byte represents an arbitrated loop physical address. Bit map 72 also includes 128 bytes, which allows for 126 addresses. The 128 bytes, however, are segmented into segments zero through segment N. FIG. 3, therefore, shows a mapping of the bytes that are available in a loop.
In the present embodiment, the segmentation router wins the LISM process and sends out all ones in the address bit of all the remaining segments. Thus, only the available end addresses which have zeros in the addresses will be the ones forwarded or given segment. As an example, in a 4-segment router, segment zero was set to zero. Bytes zero through 31 would be set to zero so that the router would own that segment. Then all bytes 31-127 would be set to one. This would prevent any other device on that loop from gaining access to the addresses. Then segment one would set bytes 0-31 to one. Bytes 32-63 would be set to zero and bytes 63-121 would be set to one. This establishes the segment window for the arbitrated loops segmentation.
FIG. 3 shows that there may be up to n different segments. The router would come configured with the number of segments that is going to segment the loop into. The number n may be 4, 8, or 16, for example. At the end of this process there are unique identifiers across the entire loop of devices that are on the loop. Each of the devices in the given segment operate as though they were on a single and separate loop. However, the segmented devices may operate on their own segments and operate on other segments without knowing whether the master router is available. This permits operation of a segmented loop seamlessly and transparently.
Although the invention has been described in detail herein with reference to the illustrative embodiments, it is to be understood that this description is by way of example only and is not to be construed in a limiting sense. It is to be further understood, therefore, that numerous changes in the details of the embodiments of the invention and additional embodiments of the invention, will be apparent to, and may be made by, persons of ordinary skill in the art having reference to this description. It is contemplated that all such changes and additional embodiments are within the spirit and true scope of the invention as claimed below.
|Patente citada||Fecha de presentación||Fecha de publicación||Solicitante||Título|
|US5751715 *||8 Ago 1996||12 May 1998||Gadzoox Microsystems, Inc.||Accelerator fiber channel hub and protocol|
|US5768551 *||29 Sep 1995||16 Jun 1998||Emc Corporation||Inter connected loop channel for reducing electrical signal jitter|
|US6055228 *||23 Dic 1996||25 Abr 2000||Lsi Logic Corporation||Methods and apparatus for dynamic topology configuration in a daisy-chained communication environment|
|US6118776 *||7 Ago 1997||12 Sep 2000||Vixel Corporation||Methods and apparatus for fiber channel interconnection of private loop devices|
|1||*||InterOperability Lab-Fibre Channel Tutorials and Resources [online], May 4, 1998 [retrieved on Oct. 31, 2000]. Retrieved from the Internet:<URL: http://www.iol.unh.edu/training/fc/fc_tutorial.html>.|
|2||InterOperability Lab—Fibre Channel Tutorials and Resources [online], May 4, 1998 [retrieved on Oct. 31, 2000]. Retrieved from the Internet:<URL: http://www.iol.unh.edu/training/fc/fc_tutorial.html>.|
|Patente citante||Fecha de presentación||Fecha de publicación||Solicitante||Título|
|US6983363 *||5 Mar 2002||3 Ene 2006||Richmount Computers Limited||Reset facility for redundant processor using a fiber channel loop|
|US6999460 *||16 Oct 2000||14 Feb 2006||Storage Technology Corporation||Arbitrated loop port switching|
|US7009985 *||21 Ene 2003||7 Mar 2006||Broadcom Corporation||Fibre channel arbitrated loop bufferless switch circuitry to increase bandwidth without significant increase in cost|
|US7012914 *||18 Jul 2002||14 Mar 2006||Emulex Design & Manufacturing Corporation||Methods and apparatus for fibre channel interconnection of private loop devices|
|US7346674 *||7 Jun 2001||18 Mar 2008||Emc Corporation||Configurable fibre channel loop system|
|US7519693 *||18 Nov 2004||14 Abr 2009||International Business Machines Corporation||Apparatus, system, and method for integrating an enclosure|
|US7522619||13 Mar 2006||21 Abr 2009||Emulex Design & Manufacturing Corporation||Methods and apparatus for fibre channel interconnection of private loop devices|
|US7630300 *||10 Jul 2003||8 Dic 2009||Emulex Design & Manufacturing Corporation||Methods and apparatus for trunking in fibre channel arbitrated loop systems|
|US7660316||10 Jul 2003||9 Feb 2010||Emulex Design & Manufacturing Corporation||Methods and apparatus for device access fairness in fibre channel arbitrated loop systems|
|US7664018||1 Jul 2003||16 Feb 2010||Emulex Design & Manufacturing Corporation||Methods and apparatus for switching fibre channel arbitrated loop devices|
|US7688735||11 Jun 1999||30 Mar 2010||Emulex Design And Manufacturing Corporation||Fibre channel switching system|
|US7801117||6 Jun 2005||21 Sep 2010||Emulex Design & Manufacturing Corporation||Fibre channel switching fabric router|
|US7801118||6 Jun 2005||21 Sep 2010||Emulex Design & Manufacturing Corporation||Fibre channel switching fabric port control|
|US7881213 *||5 Nov 2002||1 Feb 2011||Emulex Design & Manufacturing Corporation||Methods and apparatus for fibre channel interconnection of private loop devices|
|US8121137||10 Abr 2009||21 Feb 2012||Emulex Design & Manufacturing Corporation||Methods and apparatus for fibre channel interconnection of private loop devices|
|US8134918||6 Jun 2005||13 Mar 2012||Emulex Design & Manufacturing Corporation||Fibre channel switching fabric hub|
|US8204045||29 Mar 2010||19 Jun 2012||Emulex Design & Manufacturing Corporation||Fibre channel switching system|
|US8204068||12 Jun 2008||19 Jun 2012||Emulex Design & Manufacturing Corporation||Methods and apparatus for fibre channel interconnection of private loop devices|
|US8270396||20 Sep 2010||18 Sep 2012||Emulex Desigh & Manufacturing Corporation||Fibre Channel switching fabric port control|
|US8270397||20 Sep 2010||18 Sep 2012||Emulex Design & Manufacturing Corporation||Fibre channel switching fabric port control|
|US8675639||15 Jun 2012||18 Mar 2014||Emulex Design And Manufacturing Corporation||Interconnect system and method for ethernet networks|
|US8750320||21 Ene 2003||10 Jun 2014||Broadcom Corporation||Fibre channel arbitrated loop bufferless switch circuitry to increase bandwidth without significant increase in cost|
|US8767756||19 Nov 2008||1 Jul 2014||Broadcom Corporation||Fibre channel arbitrated loop bufferless switch circuitry to increase bandwidth without significant increase in cost|
|US8774199||21 Ene 2003||8 Jul 2014||Broadcom Corporation|
|US8780912||28 Ene 2011||15 Jul 2014||Emulex Corporation||Systems and method for routing data|
|US8798091||30 Abr 2008||5 Ago 2014||Broadcom Corporation|
|US8831022 *||15 Jun 2012||9 Sep 2014||Emulex Corporation||System and method for interconnecting multiple communication interfaces|
|US8902911||21 Feb 2012||2 Dic 2014||Emulex Corporation||System and method for interconnecting ethernet and fibre channel|
|US9013981||12 Mar 2012||21 Abr 2015||Emulex Corporation||System and method for routing data|
|US9077653||29 Ene 2014||7 Jul 2015||Emulex Corporation||Interconnect system and method for ethernet networks|
|US9137149||18 Sep 2012||15 Sep 2015||Emulex Corporation||System and method for routing data|
|US9137177||29 Oct 2014||15 Sep 2015||Emulex Corporation||System and method for interconnecting physical channels|
|US20020129232 *||5 Mar 2002||12 Sep 2002||Coffey Aedan Diarmuid Cailean||Reset facility for redundant processor using a fibre channel loop|
|US20020196773 *||18 Jul 2002||26 Dic 2002||Vixel Corporation||Methods and apparatus for fibre channel interconnection of private loop devices|
|US20030086377 *||5 Nov 2002||8 May 2003||Vixel Corporation||Methods and apparatus for Fibre Channel interconnection of private loop devices|
|US20030095549 *||5 Nov 2002||22 May 2003||Vixel Corporation||Methods and apparatus for fibre channel interconnection of private loop devices|
|US20030108060 *||21 Ene 2003||12 Jun 2003||Black Alistair D.|
|US20030174720 *||21 Ene 2003||18 Sep 2003||Black Alistair D.|
|US20040081186 *||1 Jul 2003||29 Abr 2004||Vixel Corporation||Methods and apparatus for switching Fibre Channel Arbitrated Loop devices|
|US20040085972 *||10 Jul 2003||6 May 2004||Vixel Corporation||Methods and apparatus for trunking in fibre channel arbitrated loop systems|
|US20040085994 *||10 Jul 2003||6 May 2004||Vixel Corporation||Methods and apparatus for device access fairness in fibre channel arbitrated loop systems|
|US20050226259 *||6 Jun 2005||13 Oct 2005||Emulux Design & Manufacturing Corporation||Fibre channel switching fabric hub|
|US20050226260 *||6 Jun 2005||13 Oct 2005||Emulux Design & Manufacturing Corporation||Fibre channel switching fabric port control|
|US20050286551 *||6 Jun 2005||29 Dic 2005||Emulux Design & Manufacturing Corporation||Fibre channel switching fabric router|
|US20060106952 *||18 Nov 2004||18 May 2006||Bomhoff Matthew D||Apparatus, system, and method for integrating an enclosure|
|US20060176889 *||13 Mar 2006||10 Ago 2006||Berman Stuart B||Methods and apparatus for fibre channel interconnection of private loop devices|
|US20080205421 *||30 Abr 2008||28 Ago 2008||Broadcom Corporation|
|US20110007738 *||13 Ene 2011||Berman Stuart B||Fibre channel switching fabric port control|
|US20110103244 *||5 May 2011||Berman Stuart B||Fibre channel switching fabric port control|
|US20130016969 *||17 Ene 2013||Berman Stuart B||Methods and apparatus for fibre channel interconnection of private loop devices|
|Clasificación de EE.UU.||710/240, 370/398, 710/241, 709/238, 710/316, 709/249, 370/462|
|Clasificación internacional||H04L12/433, H04L12/46, G06F3/06|
|Clasificación cooperativa||G06F3/0635, G06F3/067, H04L12/4637, H04L12/433, G06F3/0611, G06F3/0632|
|Clasificación europea||G06F3/06A6D, G06F3/06A2P2, G06F3/06A4C2, G06F3/06A4C6, H04L12/433, H04L12/46R|
|12 May 1998||AS||Assignment|
Owner name: CROSSROADS SYSTEMS, INC., TEXAS
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SMITH, BRIAN R.;REEL/FRAME:009181/0566
Effective date: 19980507
|9 Mar 2005||FPAY||Fee payment|
Year of fee payment: 4
|10 Feb 2009||FPAY||Fee payment|
Year of fee payment: 8
|1 May 2013||FPAY||Fee payment|
Year of fee payment: 12
|1 Ago 2013||AS||Assignment|
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CROSSROADS SYSTEMS, INC.;REEL/FRAME:030935/0916
Effective date: 20130722
Owner name: KIP CR P1 LP, NEW YORK
Effective date: 20130722
Free format text: SECURITY AGREEMENT;ASSIGNOR:CROSSROADS SYSTEMS, INC.;REEL/FRAME:030935/0910
Owner name: FORTRESS CREDIT CO LLC, NEW YORK
Owner name: FORTRESS CREDIT CO LLC, NEW YORK
Effective date: 20130722
Free format text: SECURITY AGREEMENT;ASSIGNOR:KIP CR P1 LP;REEL/FRAME:030935/0937
|9 Sep 2014||AS||Assignment|
Owner name: CF DB EZ LLC, NEW YORK
Effective date: 20140904
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FORTRESS CREDIT CO LLC;REEL/FRAME:033706/0340