WO2002005072A2 - Method of and system for, processing email - Google Patents

Method of and system for, processing email Download PDF

Info

Publication number
WO2002005072A2
WO2002005072A2 PCT/GB2001/003036 GB0103036W WO0205072A2 WO 2002005072 A2 WO2002005072 A2 WO 2002005072A2 GB 0103036 W GB0103036 W GB 0103036W WO 0205072 A2 WO0205072 A2 WO 0205072A2
Authority
WO
WIPO (PCT)
Prior art keywords
email
virus
emails
database
message
Prior art date
Application number
PCT/GB2001/003036
Other languages
French (fr)
Other versions
WO2002005072A3 (en
Inventor
Alexander Shipp
Original Assignee
Messagelabs Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Messagelabs Limited filed Critical Messagelabs Limited
Priority to US10/332,552 priority Critical patent/US7877807B2/en
Priority to EP01949640A priority patent/EP1299791B1/en
Priority to DE60128227T priority patent/DE60128227T2/en
Priority to AU2001270763A priority patent/AU2001270763A1/en
Priority to DK01949640T priority patent/DK1299791T3/en
Publication of WO2002005072A2 publication Critical patent/WO2002005072A2/en
Publication of WO2002005072A3 publication Critical patent/WO2002005072A3/en
Priority to CY20071101022T priority patent/CY1106782T1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/21Monitoring or handling of messages
    • H04L51/234Monitoring or handling of messages for tracking messages
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/50Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
    • G06F21/55Detecting local intrusion or implementing counter-measures
    • G06F21/56Computer malware detection or handling, e.g. anti-virus arrangements
    • G06F21/562Static detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • G06Q10/107Computer-aided management of electronic mailing [e-mailing]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/21Monitoring or handling of messages
    • H04L51/212Monitoring or handling of messages using filtering or selective blocking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/14Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
    • H04L63/1408Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic by monitoring network traffic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/14Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
    • H04L63/1441Countermeasures against malicious traffic
    • H04L63/145Countermeasures against malicious traffic the attack involving the propagation of malware through the network, e.g. viruses, trojans or worms

Definitions

  • the present invention relates to a method of, and system for, processing email in particular to detect virus outbreaks.
  • the invention is particularly, but not exclusively, applicable to processing of email by ISPs (Internet Service Providers).
  • virus in a narrow sense as relating to software having particular characteristics in terms of propagation, possibly also multiplication, and effect which are distinct from other forms such as “trojan horses", “worms”, etc.
  • virus is used in the general sense of any software which by malice (or accident) causes undesired effects.
  • Conventional virus checkers find viruses by looking for known patterns in files, by checking for new or changed files in a file system or by running suspicious programs in a sandbox emulator environment to detect virus-like activity.
  • This tactic can propagate between continents in a matter of minutes and result in a geometric "explosion" of the number of instances of it.
  • the present invention seeks to reduce the problem of dealing with new viruses borne by email.
  • the invention provides a method of processing email to detect the spread of previously unknown viruses which comprises monitoring email traffic passing through one or more nodes of a network for patterns of email traffic which are indicative of, or suggestive of, the spread of an email-borne virus and, once such a pattern is detected, initiating automatic remedial action, alerting an operator, or both.
  • the invention also provides a system for processing email to detect the spread of previously unknown viruses which comprises monitoring email traffic passing through one or more nodes of a network for patterns of email traffic which are indicative of, or suggestive of, the spread of an email-borne virus and, once such a pattern is detected, initiating automatic remedial action, alerting an operator, or both.
  • the invention treats emails being processed as an "ensemble" and looks for patterns in the traffic of email which are characteristic of viruses being propagated via email. It has been found that such characteristic patterns are relatively easy to define, and to identify once they occur.
  • each email is analysed by reference to a number of criteria which indicate that the email may contain a virus. Any email which meets any of these criteria may then be logged to a database.
  • the decision whether or not to log a particular email can be taken on the basis of whether it meets one or more criteria indicating that it is possible for the email to contain a virus.
  • the criteria chosen to decide whether to log an email can be ones which indicate that it is possible for the email to contain a virus, regardless of whether it actually does, on the basis that emails which cannot possibly contain a virus need not be individually logged.
  • the invention does not exclude the possibility that one or more criteria seek to determine whether an email actually does contain a virus, by any suitable scanning, or other analytical, technique.
  • a user reports that a particular email contained a virus as an attachment, and that this is one of a number of emails that has been recently processed by the system.
  • the database will have in it entries recording items such as the sender and recipient, email subject, attachment names and sizes. It is possible, automatically (i.e. in software) or with human intervention to identify the relevant stored attributes of these messages and use them as the basis for taking the corrective action in relation to subsequently processed, matching, emails. It is also possible to notify recipients of matching emails which have already been processed to take corrective action of their own, e.g. to delete the email unread and unopened, assuming the system stores the recipient name in plaintext.
  • Figure 1 illustrates the process of sending an email over the Internet
  • Figure 2 is a block diagram of one embodiment of the invention.
  • a user 1 A with an email ID "asender” has his account at “asource.com” wishes to send an email to someone IB with an account “arecipient” at “adestination.com”, and that these .com domains are maintained by respective ISPs (Internet Service Providers).
  • ISPs Internet Service Providers
  • Each of the domains has a mail server 2A,2B which includes one or more SMTP servers 3 A,3B for outbound messages and one or more POP3 servers 4A,4B for inbound ones.
  • These domains form part of the Internet which for clarity is indicated separately at 5. The process proceeds as follows:
  • Asender prepares the email message using email client software 1 A such as Microsoft Outlook Express and addresses it to "arecipient@adestination.com".
  • asender's email client 1 A uses a dial-up modem connection or similar, asender's email client 1 A connects to the email server 2 A at "mail.asource.com". 3. Asender's email client 1 A conducts a conversation with the SMTP server 3 A, in the course of which it tells the SMTP server 3 A the addresses of the sender and recipient and sends it the body of the message (including any attachments) thus transferring the email 10 to the server 3 A.
  • the SMTP server 3 A parses the TO field of the email envelope into a) the recipient and b) the recipient's domain name. It is assumed for the present purposes that the sender's and recipients' ISPs are different, otherwise the SMTP server 3 A could simply route the email through to its associated POP3 server(s) 4A for subsequent collection.
  • the SMTP server 3 A locates an Internet Domain Name server and obtains an IP address for the destination domain's mail server. 6.
  • the SMTP server 3A connects to the SMTP server 3B at
  • the SMTP server 3B recognises that the domain name refers to itself, and passes the message to "adestination'"s POP3 server 4B, which puts the message in "arecipienf's mailbox for collection by the recipients email client IB.
  • email can be used to malicious effect, probably the most widely known being a virus which travels with the email as an attachment.
  • the recipient "opening" the attachment, as by double-clicking it, allows the virus which may be a binary executable or scripting code written to an interpreter hosted by the email client or the operating system, to execute.
  • the virus may be a binary executable or scripting code written to an interpreter hosted by the email client or the operating system, to execute.
  • Neither the problem of malicious intent, nor the present invention's solution to it, is restricted to viruses of this type.
  • other malicious attacks may involve exploiting weaknesses of the delivery system (SMTP + POP3) or the email client, as by deliberately formatting an email header field in a way which is known to cause misoperation of software which processes it.
  • FIG. 2 shows in block form the key sub-systems of an embodiment of the present invention.
  • these subsystems are implemented by software executing on the ISP's computer(s).
  • These computers operate one or more email gateways 20A ... 20N passing email messages such as 10.
  • a logger 22 which prepares a database entry for each message selected as a logging candidate by the decomposer/analyser 21;
  • a database 23 which stores the entries prepared by logger 22; - a searcher 24 which scans new entries in the database 23 looking for signs of virus-bearing traffic;
  • the stopper 25 which signals the results from the searcher 24 and optionally stops the passage of emails which conform to criteria of the decomposer/analyser 21 as indicating a virus threat.
  • the stopper 25 can be implemented in such a way that emails which are processed by the system and are not considered to be infected with a virus can have a text notification inserted in them, e.g. appended to the message text, saying that the email has been scanned by the system, so that the recipient will be able to see that it has.
  • Viruses that spread by email can be detected by examining the traffic patterns of the emails they create.
  • the illustrated embodiment applies a set of heuristics to identify email viruses.
  • the following is a non-exhaustive list of criteria by which emails may be assessed to implement these heuristics.
  • Other criteria may be used as well or instead: - They contain the same or similar subject lines;
  • Each of the above criteria is assigned a numerical score.
  • Each email that passes through the system is analysed by the decomposer/analyser 21, and logged in a database 23 by logger 22.
  • a search routine executed by searcher 24 continually analyses the new information being stored in the database to see if similar messages are being sent. If they are, then the 'suspiciousness' of the email is calculated using an algorithm which takes into account how similar the messages are, and also how many of them have been received recently. Once a threshold has been passed, all new messages that match the criteria are stopped as potential viruses by stopper 25, and an alarm is raised.
  • the system may generate a message digest, at least for those messages which are logged in the database.
  • Message digests are a convenient and efficient means of identifying messages with the same message text and as a "handle" by which to retrieve a collection of log entries which represent the same message text being sent in multiple emails.
  • the digest may be stored in the database in addition to, or instead of, the message list.
  • a message digest is typically created by applying a one way hashing algorithm (such as MD5 or Message-Digest-5) to a series of characters (in the present case, for example, the characters of a message).
  • a one way hashing algorithm such as MD5 or Message-Digest-5
  • the MD5 digest of "The rain in Spain falls mainly on the plain” is 6f7f4c35a219625efc5a9ebad8fa8527 and of "The rain in Spain falls mainly on the plain” is b417b67704f2dd2b5a812f99ade30e00.
  • These two messages differ only by one bit (the 's' is Spain, since a capital S is one bit different to a lowercase s in the ASCII character set), but the digests are totally different.
  • Structural quirks Most emails are generated by tried and tested applications.
  • Non-standard ordering of header elements Subject: Tower fault tolerance
  • Mime-Version 1.0
  • the Mime- Version header normally comes before the Content-Type header.
  • X-Mailer QUALCOMM Windows Eudora Pro Version 3.0.5 (32) Date: Mon, 03 Jul 2000 12:24:17 +0100 Eudora normally also includes an X-Sender header
  • the X-mailer header says the mail is generated by Eudora, but the message-id format is an
  • X-Mailer Microsoft Outlook 8.5, Build 4.71 .2173.0
  • IP address of the originator is, of course, known and hence can be used to determine whether this criterion is met.
  • Email contains specialised constructs
  • HTML script to encrypt the message content. This is intended to defeat linguistic analysers.
  • the text is immediately decrypted and displayed. It would be unusual for a normal email to do this.
  • An email normally indicates the originator in the Sender text field and spam originators will often put a bogus entry in that field to disguise the fact that the email is infected.
  • the Sender identity is also supposed to be specified in the protocol under which SMTP processes talk to one another in the transfer of email, and this criterion is concerned with the absence of the sender identification from the relevant protocol slot, namely the Mail From protocol slot.
  • Invalid message sender email addresses This is complementary to item 8 and involves consideration of both the sender field of the message and the sender protocol slot, as to whether it is invalid.
  • the email may come from a domain which does not exist or does not follow the normal rules for the domain. For instance, a HotMail address of "123@hotmail.com" is invalid because HotMail addresses cannot be all numbers.
  • a number of fields of the email may be examined for invalid entries, including "Sender”, “From”, and "Errors-to".
  • the local mail server knows, or at least can find out from the protocol, the address of the mail sender, and so a determination can be made of whether this matches the sender address in the mail text.
  • a network of email gateways 20 is preferred, so that email can be processed on the required scale.
  • use of a number of email gateways is not an essential component of the system; the system is able to recognise and detect new viruses even if only one email gateway is used, and if even a small amount of email passes through it.
  • a component normally considered part of the message A component normally considered as an attachment. Each part is then further analysed to see if it has the possibility of containing potential threats.
  • Email header/mime headers Overlong lines, or lines with unusual syntax may be used to crash particular browsers, causing either a denial of service attack or an exploit which can cause a security breach or spread a virus.
  • a component normally considered part of the message These may contain embedded executable code. For instance, an HTML message may contain scripting code in various computer languages, or it may contain elements (such as ⁇ frameset> or ⁇ object> tags) which have been shown to be exploitable.
  • a component normally considered as an attachment These may be directly executable, such as an EXE file.
  • the attachment may contain embedded executable code, such as a Microsoft Word document containing a macro. They may contain archive file or other container files, which themselves may contain other dangerous components. For instance, a ZIP file may contain an executable. Normally, the attachment must contain some executable element to be viewed as a potential threat. However, the system is capable of being toggled into a mode where it views all attachments as a potential threat. This is to cater for two possibilities such as:
  • a document such as a .jpg picture, may contain illegal formatting that crashes the application used to view the attachment. This can cause either a denial of service attack, or an exploit which can cause a security breach or spread a virus.
  • the message body may contain instructions which, if followed, turn the attachment into a dangerous form, e.g. 'rename picture.jpg to picture.exe'.
  • the message is logged by the logger 22 in the database 23. Otherwise, the message is not logged.
  • the logger 22 is programmed so that the system logs components of each message so that similar messages can be detected. The following are logged:
  • Subject line and digest of subject line are subjects and digest of subject line
  • Structural format indicators Structural quirk indicators
  • the database 23 logs details about messages, and allows querying of the details to find patterns of duplicate or similar emails.
  • logging may be a one tier or several tier operation. For instance, messages may be logged locally in a database geographically near to the email servers, and analysed locally. This gives a quick response to local traffic patterns. However, the logs may also be copied back to a central database to perform global analysis. This will be slower to react, but will be able to react on global, rather than local patterns.
  • Old log entries are automatically deleted from the database 23 since they are no longer needed - the system is designed to provide an early warning of new viruses.
  • the searcher 24 periodically queries the database searching for recent similar messages and generating a score by analysing the components. Depending on the score, the system may identify a 'definite' threat or a 'potential' threat.
  • a definite threat causes a signature to be sent back to the stopper so that all future messages with that characteristic are stopped.
  • a potential threat causes an alert to be sent to an operator who can then decide to treat as if it were a definite threat, to flag as a false alarm so no future occurrences are reported, or to wait and see.
  • the searcher can be configured with different parameters, so that it can be more sensitive if searching logs from a single email gateway, and less sensitive if processing a database of world- wide information. Each criterion can be associated a different score.
  • the time between searches can be adjusted.
  • the time span each search covers can be adjusted and multiple time spans accommodated.
  • the stopper 25 takes signatures from the searcher 24.
  • the signature identifies characteristics of emails which must be stopped. On receiving the signature, all future matching emails are treated as viruses, and stopped.
  • the stopping action can take a number of forms, including - Disposing of the infected emails without sending them to their addressed recipients.
  • an automated mail server 30 may notify other sites of the relevant characteristics of the infected emails, either to alert human operators or to supply embodiments of the invention at remote sites with the characteristics of the emails necessary for their stoppers 25 to stop them.
  • an email under consideration has a number of attributes which can be represented as data values in a computer program, with the data type depending on the nature of the attribute.
  • the length of the message and number of attachments are integers
  • the various text headers e.g. To, SendTo, Subject
  • character strings are character strings, as are digests such as the message digest.
  • emails are considered to be equal according to a given criterion if the corresponding attributes are equal in the cases of integers and character strings.
  • equality can be determined by a case-insensitive comparison; case-insensitive comparisons are appropriate for the textual fields of an email, but not necessarily for other character strings.
  • Multiply X from step 310 by an importance factor C for criterion A (320).
  • Each criterion has a respective importance factor which depends on the nature of the criterion, since some criteria, e.g. the name of a file attachment may be more significant than others so far as assessing the likelihood of a vims threat is concerned; similar comments apply to the other factors mentioned below)
  • X from step 350 is greater than threshold O (each time interval B has a respective threshold O), where O is less than V, then flag as needing operator assistance (370). The operator can then assess whether a virus threat is present or not and instruct the software to proceed accordingly
  • Next sample set (380) Next interval (210) Next criterion (120)
  • the three "importance" factors C, D, E, the spread factor and thresholds are numeric values which may be set empirically and may be adjusted dynamically.
  • the algorithm may be carried out using one or more different values for the time interval B, e.g. 5 minutes, 30 minutes and 180 minutes.
  • the time interval B e.g. 5 minutes, 30 minutes and 180 minutes.
  • Some things may be more suspicious than others - for instance we may choose to allocate a higher score if we see emails with the same named attachment, than if we see emails with the same subject line.
  • the invention has been described by reference to its application to Internet email, it is not restricted to such email; the invention is equally applicable to other private or public, local- or wide-area network or combinations of such networks with one another and with the Internet, as well as to email over WAP (Wireless Access Protocol) and SMS (Simple Messaging Service) for mobile telephones and similar devices.
  • WAP Wireless Access Protocol
  • SMS Simple Messaging Service

Abstract

A system for processing emails incorporates means for dealing with previously unknown viruses. The system monitors email traffic patterns to identify patterns characteristic of a virus outbreak and takes corrective action when an outbreak is detected. Individual emails are analysed and, if any one of the constituent parts contains content in which is possible to contain a virus, characteristic data derived from the email is logged to a database which is scanned for outbreak-indicating traffic patterns.

Description

METHOD OF AND SYSTEM FOR, PROCESSING EMAIL
Introduction
The present invention relates to a method of, and system for, processing email in particular to detect virus outbreaks. The invention is particularly, but not exclusively, applicable to processing of email by ISPs (Internet Service Providers).
Background of the invention
It should be noted that some discussions of malicious software use the term "virus" in a narrow sense as relating to software having particular characteristics in terms of propagation, possibly also multiplication, and effect which are distinct from other forms such as "trojan horses", "worms", etc. However, in this specification, including the appended claims, the term virus is used in the general sense of any software which by malice (or accident) causes undesired effects. Conventional virus checkers find viruses by looking for known patterns in files, by checking for new or changed files in a file system or by running suspicious programs in a sandbox emulator environment to detect virus-like activity.
The increasing use of email, over both the Internet and private networks, increases the exposure of individual end users and operations to malicious disruption. Recently there have been email-borne virus outbreaks which have spread across the world in a matter of hours. Some degree of protection can be achieved by scanning emails and their attachments for viruses and obviously this is best done on a centralised basis, e.g. by ISPs and others who operate email gateways, rather than leaving it to end users who may or may not have the resources, knowledge or inclination to take their own anti-virus measures. However, even with centralised scanning there is still a problem with new viruses. Leaving aside the question of how a new virus is first detected, whether by measures taken by an ISP or similar, or at an end user's machine, the steps necessary to mitigate the effect of an outbreak of it take time to put into effect, and by the time that they have been, the worst effects of the outbreak may already have occurred, all across the world. These steps typically include identifying a characteristic string of bytes or other "signature" which identifies the virus, disseminating this information to virus-scanning sites, and programming the scanners with this information, all of which takes time, and meanwhile the outbreak is free to spread. This has become particularly problematic recently with the type of virus which can effectively multiply itself by generating and sending copies of the email which contains it, e.g. by accessing an email address book (e.g. that available to an end user's email client) and then using services available on the machine to send a copy of the email and itself to any or all of the addresses found. This tactic can propagate between continents in a matter of minutes and result in a geometric "explosion" of the number of instances of it.
Object of the invention The present invention seeks to reduce the problem of dealing with new viruses borne by email.
Summary of the Invention
The invention provides a method of processing email to detect the spread of previously unknown viruses which comprises monitoring email traffic passing through one or more nodes of a network for patterns of email traffic which are indicative of, or suggestive of, the spread of an email-borne virus and, once such a pattern is detected, initiating automatic remedial action, alerting an operator, or both.
The invention also provides a system for processing email to detect the spread of previously unknown viruses which comprises monitoring email traffic passing through one or more nodes of a network for patterns of email traffic which are indicative of, or suggestive of, the spread of an email-borne virus and, once such a pattern is detected, initiating automatic remedial action, alerting an operator, or both.
Thus, rather than monitoring individual emails, the invention treats emails being processed as an "ensemble" and looks for patterns in the traffic of email which are characteristic of viruses being propagated via email. It has been found that such characteristic patterns are relatively easy to define, and to identify once they occur.
To assist in the identification of relevant patterns of email traffic, each email is analysed by reference to a number of criteria which indicate that the email may contain a virus. Any email which meets any of these criteria may then be logged to a database.
Examination of recent additions to this database can then be used to identify traffic patterns indicative or suggestive of a virus outbreak. The decision whether or not to log a particular email can be taken on the basis of whether it meets one or more criteria indicating that it is possible for the email to contain a virus. In other words, the criteria chosen to decide whether to log an email can be ones which indicate that it is possible for the email to contain a virus, regardless of whether it actually does, on the basis that emails which cannot possibly contain a virus need not be individually logged. However, the invention does not exclude the possibility that one or more criteria seek to determine whether an email actually does contain a virus, by any suitable scanning, or other analytical, technique.
Suppose a user reports that a particular email contained a virus as an attachment, and that this is one of a number of emails that has been recently processed by the system. The database will have in it entries recording items such as the sender and recipient, email subject, attachment names and sizes. It is possible, automatically (i.e. in software) or with human intervention to identify the relevant stored attributes of these messages and use them as the basis for taking the corrective action in relation to subsequently processed, matching, emails. It is also possible to notify recipients of matching emails which have already been processed to take corrective action of their own, e.g. to delete the email unread and unopened, assuming the system stores the recipient name in plaintext.
Description of the drawings The invention will be further described by way of non-limitative example with reference to the accompanying drawings, in which: -
Figure 1 illustrates the process of sending an email over the Internet; and Figure 2 is a block diagram of one embodiment of the invention.
Illustrated embodiment
Before describing the illustrated embodiment of the invention, a typical process of sending an email over the Internet will briefly be described with reference to Figure 1. This is purely for illustration; there are several methods for delivering and receiving email on the Internet, including, but not limited to: end-to-end SMTP, IMAP4 and UCCP. There are also other ways of achieving SMTP to POP3 email, including for instance, using an ISDN or leased line connection instead of a dial-up modem connection.
Suppose a user 1 A with an email ID "asender" has his account at "asource.com" wishes to send an email to someone IB with an account "arecipient" at "adestination.com", and that these .com domains are maintained by respective ISPs (Internet Service Providers). Each of the domains has a mail server 2A,2B which includes one or more SMTP servers 3 A,3B for outbound messages and one or more POP3 servers 4A,4B for inbound ones. These domains form part of the Internet which for clarity is indicated separately at 5. The process proceeds as follows:
1. Asender prepares the email message using email client software 1 A such as Microsoft Outlook Express and addresses it to "arecipient@adestination.com".
2. Using a dial-up modem connection or similar, asender's email client 1 A connects to the email server 2 A at "mail.asource.com". 3. Asender's email client 1 A conducts a conversation with the SMTP server 3 A, in the course of which it tells the SMTP server 3 A the addresses of the sender and recipient and sends it the body of the message (including any attachments) thus transferring the email 10 to the server 3 A.
4. The SMTP server 3 A parses the TO field of the email envelope into a) the recipient and b) the recipient's domain name. It is assumed for the present purposes that the sender's and recipients' ISPs are different, otherwise the SMTP server 3 A could simply route the email through to its associated POP3 server(s) 4A for subsequent collection.
5. The SMTP server 3 A locates an Internet Domain Name server and obtains an IP address for the destination domain's mail server. 6. The SMTP server 3A connects to the SMTP server 3B at
"adestination.com" via SMTP and sends it the sender and recipient addresses and message body similarly to Step 3.
7. The SMTP server 3B recognises that the domain name refers to itself, and passes the message to "adestination'"s POP3 server 4B, which puts the message in "arecipienf's mailbox for collection by the recipients email client IB.
There are various ways in which email can be used to malicious effect, probably the most widely known being a virus which travels with the email as an attachment. Typically, the recipient "opening" the attachment, as by double-clicking it, allows the virus which may be a binary executable or scripting code written to an interpreter hosted by the email client or the operating system, to execute. Neither the problem of malicious intent, nor the present invention's solution to it, is restricted to viruses of this type. For example other malicious attacks may involve exploiting weaknesses of the delivery system (SMTP + POP3) or the email client, as by deliberately formatting an email header field in a way which is known to cause misoperation of software which processes it.
Referring now to Figure 2, this shows in block form the key sub-systems of an embodiment of the present invention. In the example under consideration, i.e. the processing of email by an ISP, these subsystems are implemented by software executing on the ISP's computer(s). These computers operate one or more email gateways 20A ... 20N passing email messages such as 10.
The various subsystems of the embodiment will be described in more detail below but briefly comprise; - a message decomposer/analyser 21 which decomposes emails into their constituent parts and analyses them to assess whether they are candidates for logging;
- a logger 22 which prepares a database entry for each message selected as a logging candidate by the decomposer/analyser 21;
- a database 23 which stores the entries prepared by logger 22; - a searcher 24 which scans new entries in the database 23 looking for signs of virus-bearing traffic;
- a stopper 25 which signals the results from the searcher 24 and optionally stops the passage of emails which conform to criteria of the decomposer/analyser 21 as indicating a virus threat. The stopper 25 can be implemented in such a way that emails which are processed by the system and are not considered to be infected with a virus can have a text notification inserted in them, e.g. appended to the message text, saying that the email has been scanned by the system, so that the recipient will be able to see that it has.
Overall, the system of Figure 2 works on the following principles. Viruses that spread by email can be detected by examining the traffic patterns of the emails they create.
The illustrated embodiment applies a set of heuristics to identify email viruses. The following is a non-exhaustive list of criteria by which emails may be assessed to implement these heuristics. Other criteria may be used as well or instead: - They contain the same or similar subject lines;
They contain the same or similar body texts; They contain the same named attachment; They contain an attachment with the same message digest; They are addressed to many recipients;
They are addressed to recipients in alphabetical, or reverse alphabetical order;
They are sent to a particular email address, and then exit multiply from the same email address, and/or similar email addresses; They contain the same structural format;
They contain the same structural quirks;
They contain the same unusual message headers.
The above criteria should be self-explanatory, except possibly those which refer to "message digest" and "structural quirks"; those expressions are explained below. Each of the above criteria is assigned a numerical score. Each email that passes through the system is analysed by the decomposer/analyser 21, and logged in a database 23 by logger 22. A search routine executed by searcher 24 continually analyses the new information being stored in the database to see if similar messages are being sent. If they are, then the 'suspiciousness' of the email is calculated using an algorithm which takes into account how similar the messages are, and also how many of them have been received recently. Once a threshold has been passed, all new messages that match the criteria are stopped as potential viruses by stopper 25, and an alarm is raised.
The system may generate a message digest, at least for those messages which are logged in the database. Message digests are a convenient and efficient means of identifying messages with the same message text and as a "handle" by which to retrieve a collection of log entries which represent the same message text being sent in multiple emails. The digest may be stored in the database in addition to, or instead of, the message list.
A message digest is typically created by applying a one way hashing algorithm (such as MD5 or Message-Digest-5) to a series of characters (in the present case, for example, the characters of a message). The advantages of using a digest in this application are:
• They are typically smaller than the original message, and are of fixed length, so they can be stored in a database more easily;
• They are typically one-way functions, so the original message cannot be recreated, thus preserving customer confidentiality; • A small change in the message will result in a completely different digest.
For instance, the MD5 digest of "The rain in Spain falls mainly on the plain" is 6f7f4c35a219625efc5a9ebad8fa8527 and of "The rain in Spain falls mainly on the plain" is b417b67704f2dd2b5a812f99ade30e00. These two messages differ only by one bit (the 's' is Spain, since a capital S is one bit different to a lowercase s in the ASCII character set), but the digests are totally different.
Some examples of the criteria by which emails may be assessed will now be given: Structural quirks: Most emails are generated by tried and tested applications.
These applications will always generate email in a particular way. It is often possible to identify which application generated a particular email by examining the email headers and also be examining the format of the different parts. It is then possible to identify emails which contain quirks which either indicate that the email is attempting to look as if it was generated by a known emailer, but was not, or that it was generated by a new and unknown mailer, or by an application (which could be a virus or worm). All are suspicious.
Examples:
Inconsistent capitalisation from: alex@star.co.uk
To: alex@star.co.uk The from and to have different capitalisation
Non-standard ordering of header elements Subject: Tower fault tolerance
Content-type: multipart/mixed; boundary="======_962609498==_"
Mime-Version: 1.0 The Mime- Version header normally comes before the Content-Type header.
Missing or additional header elements
X-Mailer: QUALCOMM Windows Eudora Pro Version 3.0.5 (32) Date: Mon, 03 Jul 2000 12:24:17 +0100 Eudora normally also includes an X-Sender header
Message ID Format
Message-ID: < 00270ibfe4elSb37dbdcOS9264010a@tomkins.int.star.co.uk> X-Mailer: QUALCOMM Windows Eudora Pro Version 3.0.5 (32)
The X-mailer header says the mail is generated by Eudora, but the message-id format is an
Outlook message-id, not a Eudora message-id. Bo ndary format
X-Mailer: Microsoft Outlook 8.5, Build 4.71 .2173.0
Content-Type: multipart/mixed; boundary = "======_962609498—_" The X-mailer header says the mail is generated by Outlook, but the boundary format is a Eudora boundary, not an Outlook boundary.
Line break and other white space composition in message header
To: "Andrew Webley" <awebley@messagelabs.com>, "Matt Cave" <MCave@messagelabs.com>,
"Alex at MessageLabs" ashipp@messagelabs.com X-Mailer: QUALCOMM Windows Eudora Pro Version 3.0.5 (32) The e-mailer (Eudora) normally uses a single space, and no tabs for continuation lines.
It originates from particular IP addresses or IP address ranges.
The IP address of the originator is, of course, known and hence can be used to determine whether this criterion is met.
It contains specialised constructs Some email uses HTML script to encrypt the message content. This is intended to defeat linguistic analysers. When the mail is viewed in a mail client such as Outlook, the text is immediately decrypted and displayed. It would be unusual for a normal email to do this.
Empty message sender envelopes
An email normally indicates the originator in the Sender text field and spam originators will often put a bogus entry in that field to disguise the fact that the email is infected. However, the Sender identity is also supposed to be specified in the protocol under which SMTP processes talk to one another in the transfer of email, and this criterion is concerned with the absence of the sender identification from the relevant protocol slot, namely the Mail From protocol slot.
Invalid message sender email addresses This is complementary to item 8 and involves consideration of both the sender field of the message and the sender protocol slot, as to whether it is invalid. The email may come from a domain which does not exist or does not follow the normal rules for the domain. For instance, a HotMail address of "123@hotmail.com" is invalid because HotMail addresses cannot be all numbers.
A number of fields of the email may be examined for invalid entries, including "Sender", "From", and "Errors-to".
Message sender addresses which do not match the mail server from which the mail is sent.
The local mail server knows, or at least can find out from the protocol, the address of the mail sender, and so a determination can be made of whether this matches the sender address in the mail text.
In an actual implementation of the system of Figure 2 a network of email gateways 20 is preferred, so that email can be processed on the required scale. The more widespread this network, and the more email processed, then the greater the chances of being able to intercept new viruses, recognise the symptoms, and stop further occurrences before the virus becomes too widespread. However, use of a number of email gateways is not an essential component of the system; the system is able to recognise and detect new viruses even if only one email gateway is used, and if even a small amount of email passes through it.
All email is passed through the analyser/decomposer 21 in which email is broken into its constituent parts. For the purposes of traffic heuristics, each part is classified as: The email header/mime headers;
A component normally considered part of the message; A component normally considered as an attachment. Each part is then further analysed to see if it has the possibility of containing potential threats. Email header/mime headers: Overlong lines, or lines with unusual syntax may be used to crash particular browsers, causing either a denial of service attack or an exploit which can cause a security breach or spread a virus. A component normally considered part of the message: These may contain embedded executable code. For instance, an HTML message may contain scripting code in various computer languages, or it may contain elements (such as <frameset> or <object> tags) which have been shown to be exploitable. A component normally considered as an attachment: These may be directly executable, such as an EXE file. They may contain embedded executable code, such as a Microsoft Word document containing a macro. They may contain archive file or other container files, which themselves may contain other dangerous components. For instance, a ZIP file may contain an executable. Normally, the attachment must contain some executable element to be viewed as a potential threat. However, the system is capable of being toggled into a mode where it views all attachments as a potential threat. This is to cater for two possibilities such as:
A document, such as a .jpg picture, may contain illegal formatting that crashes the application used to view the attachment. This can cause either a denial of service attack, or an exploit which can cause a security breach or spread a virus.
The message body may contain instructions which, if followed, turn the attachment into a dangerous form, e.g. 'rename picture.jpg to picture.exe'.
After analysing each component, then if any one component has the possibility of containing a potential threat, the message is logged by the logger 22 in the database 23. Otherwise, the message is not logged.
The logger 22 is programmed so that the system logs components of each message so that similar messages can be detected. The following are logged:
Subject line and digest of subject line;
First few characters of text part of email, digest of first text part, and digest of first few characters;
Name of first attachment;
Digest of first attachment;
Number of recipients;
Whether recipients are in alphabetical order, or reverse alphabetical order; Time of logging;
Digest of sender;
Digest of first recipient;
Structural format indicators; Structural quirk indicators;
Unusual message headers;
Time email arrived.
The above list is not exhaustive, and the invention is not restricted to this particular combination of information items.
The database 23 logs details about messages, and allows querying of the details to find patterns of duplicate or similar emails.
In order to provide responsiveness, logging may be a one tier or several tier operation. For instance, messages may be logged locally in a database geographically near to the email servers, and analysed locally. This gives a quick response to local traffic patterns. However, the logs may also be copied back to a central database to perform global analysis. This will be slower to react, but will be able to react on global, rather than local patterns.
Old log entries are automatically deleted from the database 23 since they are no longer needed - the system is designed to provide an early warning of new viruses. The searcher 24 periodically queries the database searching for recent similar messages and generating a score by analysing the components. Depending on the score, the system may identify a 'definite' threat or a 'potential' threat. A definite threat causes a signature to be sent back to the stopper so that all future messages with that characteristic are stopped. A potential threat causes an alert to be sent to an operator who can then decide to treat as if it were a definite threat, to flag as a false alarm so no future occurrences are reported, or to wait and see.
The searcher can be configured with different parameters, so that it can be more sensitive if searching logs from a single email gateway, and less sensitive if processing a database of world- wide information. Each criterion can be associated a different score.
The time between searches can be adjusted.
The time span each search covers can be adjusted and multiple time spans accommodated.
Overall thresholds can be set. The stopper 25 takes signatures from the searcher 24. The signature identifies characteristics of emails which must be stopped. On receiving the signature, all future matching emails are treated as viruses, and stopped.
Obviously, the stopping action can take a number of forms, including - Disposing of the infected emails without sending them to their addressed recipients.
- Holding them in temporary storage and notifying the addressee by email that an infected message has been intercepted and is being held for a period for their retrieval, should they wish, otherwise it will be deleted.
- Disinfecting the email by removing the virus threat by any suitable means; for example if the virus is an executable attachment, it can be detached or disarmed before forwarding the email to its addressees. The email may be modified by the inclusion of a text message saying that the email has been disinfected. Where a virus is detected, an automated mail server 30 may notify other sites of the relevant characteristics of the infected emails, either to alert human operators or to supply embodiments of the invention at remote sites with the characteristics of the emails necessary for their stoppers 25 to stop them.
Typical algorithm
The following is one possible algorithm which can be implemented by the searcher 24 in an illustrated embodiment of the invention
Referring to the example email-assessment criteria set out above, it will be appreciated that an email under consideration has a number of attributes which can be represented as data values in a computer program, with the data type depending on the nature of the attribute. For example, the length of the message and number of attachments are integers, whereas the various text headers (e.g. To, SendTo, Subject) are character strings, as are digests such as the message digest. In the following, emails are considered to be equal according to a given criterion if the corresponding attributes are equal in the cases of integers and character strings. In the case of character strings, where appropriate, equality can be determined by a case-insensitive comparison; case-insensitive comparisons are appropriate for the textual fields of an email, but not necessarily for other character strings. (In the case of an attribute represented by a floating point value, the skilled man will be aware that comparisons should be done on the basis of whether the absolute value of the difference is greater than some small arbitrary value, sometimes referred to as "epsilon" in the technical literature, which is itself greater than the rounding error).
Below, the numbers in brackets are step numbers to identify the steps carried out. At regular intervals (100):
For each criterion A we are measuring (110) For each time interval B minutes we are measuring (200)
Get sample set S of emails over last B minutes where their value according to a selected criterion A is equal (210). Partition the sample set if it contains values which cannot be the same virus (for instance, if some emails in the set contain a HTML script, and some contain an EXE these cannot be the same virus, and should each be treated as a separate set S per step 210)
For each sample set S (300) Set X = count of mails in sample set (310)
Multiply X from step 310 by an importance factor C for criterion A (320). Each criterion has a respective importance factor which depends on the nature of the criterion, since some criteria, e.g. the name of a file attachment may be more significant than others so far as assessing the likelihood of a vims threat is concerned; similar comments apply to the other factors mentioned below)
Add to X from step 320 a second-importance factor D for each other criterion A2, where A2 is also equal over the sample set S (330)
Add to X from step 330 a third importance factor E for each other criterion A3, where A3 has a limited set of different values over the sample set S (340). "Limited range" means > 1 and < R. Each time interval B has a respective R.
Add to X from step 340 a spread factor (P times T) if the sample set contains emails entering a domain, and then T copies leaving the domain (where T > Q) (350). Each time interval B has a different P and Q)
If X from step 350 is greater than threshold V (each time interval B has a respective threshold V) then flag as virus. (360)
Else
If X from step 350 is greater than threshold O (each time interval B has a respective threshold O), where O is less than V, then flag as needing operator assistance (370). The operator can then assess whether a virus threat is present or not and instruct the software to proceed accordingly
Next sample set (380) Next interval (210) Next criterion (120) Note that the three "importance" factors C, D, E, the spread factor and thresholds are numeric values which may be set empirically and may be adjusted dynamically. Also, the algorithm may be carried out using one or more different values for the time interval B, e.g. 5 minutes, 30 minutes and 180 minutes. In English: we are looking for emails with similar characteristics arriving in a given time period. The more similar emails we find, the more suspicious we become. If the emails also have other characteristics in common, this makes us even more suspicious.
Some things may be more suspicious than others - for instance we may choose to allocate a higher score if we see emails with the same named attachment, than if we see emails with the same subject line.
If we see emails being sent to one domain, and then come flooding out, this is also suspicious.
Although, in the above, the invention has been described by reference to its application to Internet email, it is not restricted to such email; the invention is equally applicable to other private or public, local- or wide-area network or combinations of such networks with one another and with the Internet, as well as to email over WAP (Wireless Access Protocol) and SMS (Simple Messaging Service) for mobile telephones and similar devices.

Claims

1. A method of processing email to detect the spread of previously unknown viruses which comprises monitoring email traffic passing through one or more nodes of a network for patterns of email traffic which are indicative of, or suggestive of, the spread of an email-borne virus and, once such a pattern is detected, initiating automatic remedial action, alerting an operator, or both.
2. A method according to claim 1 which comprises decomposing each email into its constituent parts, analysing one or more of the decomposed constituent parts for content taken to be indicative of a potential virus and logging data of the decomposed email to a database.
3. A method according to claim 2, wherein data is logged only in respect of email which, on analysis, meets at least one criterion indicating that it is possible for the email to contain a virus.
4. A method according to claim 3, wherein data is logged in respect of email which, on analysis, meets any of a number of criteria indicating that it is possible for the email to contain a virus.
5. A method according to claim 2, 3 or 4 and including the step of continually or continuously executing an algorithm against entries in a database to identify patterns of email traffic taken to be indicative of a virus outbreak.
6. A method according to claim 5, wherein the database algorithm examines, principally or exclusively, only "recently" added database entries, i.e. entries which have been added less than a predetermined time ago.
7. A method according to any one of the preceding claims wherein the corrective action includes any or all of the following, in relation to each email which conforms to the detected pattern: a) at least temporarily stopping the passage of the emails b) notifying the sender c) notifying the intended recipient(s) d) disinfecting the email e) generating a signal to alert a human operator.
8. A method according to any one of claims 1 to 7 and including the step of forwarding emails which are taken to be infected, to their addressees.
9. A method according to any one of claims 1 to 8 and including sending a message identifying suspect emails to an automated email server.
10. A method according to any one of claims 1 to 9 and including the step of processing infected emails to disinfect them or to disarm a virus therein.
11. A method according to any one of claims 1 to 10 and including the step of inserting in emails not taken to be virus infected, a message indicating that the email has been processed
12. A system for processing email to detect the spread of previously unknown viruses which comprises monitoring email traffic passing through one or more nodes of a network for patterns of email traffic which are indicative of, or suggestive of, the spread of an email-borne virus and, once such a pattern is detected, initiating automatic remedial action, alerting an operator, or both.
13. A system according to claim 12 which comprises decomposing each email into its constituent parts, analysing one or more of the decomposed constituent parts for content taken to be indicative of a potential virus and logging data of the decomposed email to a database.
14. A system according to claim, 12 wherein data is logged only in respect of email which, on analysis, meet at least one criterion indicating that it is possible for the email to contain a virus.
15. A system according to claim, 14 wherein data is logged in respect of email which, on analysis, meets any of a number of criteria indicating that it is possible for the email to contain a virus.
16. A system according to claim 12, 13 or 14 and including the step of continually or continuously executing an algorithm against entries in the database to identify patterns of email traffic taken to be indicative of a virus outbreak.
17. A system according to claim, 16 wherein the database algorithm examines, principally or exclusively, only "recently" added database entries, i.e. entries which have been added less than a predetermined time ago.
18. A system according to any one of claims 12 to 17 wherein the corrective action includes any or all of the following, in relation to each email which conforms to the detected pattern: a) at least temporarily stopping the passage of the emails b) notifying the sender c) notifying the intended recipient(s) d) disinfecting the email e) generating a signal to alert a human operator.
19. A method according to any one of claims 12 to 18 and including means for forwarding emails which are taken to be infected, to their addressees.
20. A method according to any one of claims 12 to 19 and including sending a message identifying suspect emails to an automated email server.
21. A method according to any one of claims 12 to 20 and including means for processing infected emails to disinfect them or to disarm a virus therein.
22. A method according to any one of claims 12 to 21 and including means for inserting in emails not taken to be virus infected, a message indicating that the email has been processed.
PCT/GB2001/003036 2000-07-07 2001-07-06 Method of and system for, processing email WO2002005072A2 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US10/332,552 US7877807B2 (en) 2000-07-07 2001-07-06 Method of and system for, processing email
EP01949640A EP1299791B1 (en) 2000-07-07 2001-07-06 Method of and system for processing email
DE60128227T DE60128227T2 (en) 2000-07-07 2001-07-06 METHOD AND SYSTEM FOR E-MAIL PROCESSING
AU2001270763A AU2001270763A1 (en) 2000-07-07 2001-07-06 Method of and system for, processing email
DK01949640T DK1299791T3 (en) 2000-07-07 2001-07-06 Process and system for processing email
CY20071101022T CY1106782T1 (en) 2000-07-07 2007-08-01 METHOD AND SYSTEM FOR PROCESSING EMAIL

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB0016835.1 2000-07-07
GBGB0016835.1A GB0016835D0 (en) 2000-07-07 2000-07-07 Method of, and system for, processing email

Publications (2)

Publication Number Publication Date
WO2002005072A2 true WO2002005072A2 (en) 2002-01-17
WO2002005072A3 WO2002005072A3 (en) 2002-09-06

Family

ID=9895305

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2001/003036 WO2002005072A2 (en) 2000-07-07 2001-07-06 Method of and system for, processing email

Country Status (11)

Country Link
US (1) US7877807B2 (en)
EP (1) EP1299791B1 (en)
AT (1) ATE361489T1 (en)
AU (1) AU2001270763A1 (en)
CY (1) CY1106782T1 (en)
DE (1) DE60128227T2 (en)
DK (1) DK1299791T3 (en)
ES (1) ES2287140T3 (en)
GB (2) GB0016835D0 (en)
PT (1) PT1299791E (en)
WO (1) WO2002005072A2 (en)

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002084495A1 (en) 2001-04-13 2002-10-24 Nokia, Inc. System and method for providing exploit protection for networks
GB2384659A (en) * 2002-01-25 2003-07-30 F Secure Oyj Anti-virus protection at a network gateway
WO2003069449A2 (en) * 2002-02-13 2003-08-21 Levin Lawrence R Computer virus control
EP1385303A2 (en) * 2002-07-22 2004-01-28 Symantec Corporation Method and device for preventing malicious computer code from propagating
WO2004015954A1 (en) * 2002-08-07 2004-02-19 British Telecommunications Public Limited Company Server for sending electronics messages
EP1560112A1 (en) * 2004-01-30 2005-08-03 Microsoft Corporation Detection of files that do not contain executable code
WO2006038036A1 (en) * 2004-10-08 2006-04-13 I-Cd Publishing (Uk) Limited Processing electronic communications
EP1657662A2 (en) * 2004-10-29 2006-05-17 Microsoft Corporation Efficient white listing of user-modifiable files
US7089591B1 (en) 1999-07-30 2006-08-08 Symantec Corporation Generic detection and elimination of marco viruses
US7155742B1 (en) 2002-05-16 2006-12-26 Symantec Corporation Countering infections to communications modules
US7159149B2 (en) 2002-10-24 2007-01-02 Symantec Corporation Heuristic detection and termination of fast spreading network worm attacks
US7296293B2 (en) 2002-12-31 2007-11-13 Symantec Corporation Using a benevolent worm to assess and correct computer security vulnerabilities
US7370233B1 (en) 2004-05-21 2008-05-06 Symantec Corporation Verification of desired end-state using a virtual machine environment
US7418729B2 (en) 2002-07-19 2008-08-26 Symantec Corporation Heuristic detection of malicious computer code by page tracking
US7441042B1 (en) 2004-08-25 2008-10-21 Symanetc Corporation System and method for correlating network traffic and corresponding file input/output traffic
US7478431B1 (en) 2002-08-02 2009-01-13 Symantec Corporation Heuristic detection of computer viruses
US7631353B2 (en) 2002-12-17 2009-12-08 Symantec Corporation Blocking replication of e-mail worms
CN101212470B (en) * 2006-12-30 2011-05-04 中国科学院计算技术研究所 Distributed email system resistant to junk emails
US8104086B1 (en) 2005-03-03 2012-01-24 Symantec Corporation Heuristically detecting spyware/adware registry activity
US8271774B1 (en) 2003-08-11 2012-09-18 Symantec Corporation Circumstantial blocking of incoming network traffic containing code
US8763076B1 (en) 2006-06-30 2014-06-24 Symantec Corporation Endpoint management using trust rating data
US8863279B2 (en) 2010-03-08 2014-10-14 Raytheon Company System and method for malware detection

Families Citing this family (104)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6886099B1 (en) * 2000-09-12 2005-04-26 Networks Associates Technology, Inc. Computer virus detection
CN1316397C (en) * 2001-02-12 2007-05-16 Emc公司 System and method of indexing unique electronic mail messages and uses for same
US7673342B2 (en) * 2001-07-26 2010-03-02 Mcafee, Inc. Detecting e-mail propagated malware
US20030097409A1 (en) * 2001-10-05 2003-05-22 Hungchou Tsai Systems and methods for securing computers
JP3693244B2 (en) * 2001-10-31 2005-09-07 株式会社日立製作所 E-mail system, mail server and mail terminal
EP3401794A1 (en) * 2002-01-08 2018-11-14 Seven Networks, LLC Connection architecture for a mobile network
US7237008B1 (en) * 2002-05-10 2007-06-26 Mcafee, Inc. Detecting malware carried by an e-mail message
US20030226014A1 (en) * 2002-05-31 2003-12-04 Schmidt Rodney W. Trusted client utilizing security kernel under secure execution mode
GB2391419A (en) 2002-06-07 2004-02-04 Hewlett Packard Co Restricting the propagation of a virus within a network
GB2401280B (en) 2003-04-29 2006-02-08 Hewlett Packard Development Co Propagation of viruses through an information technology network
GB2394382A (en) 2002-10-19 2004-04-21 Hewlett Packard Co Monitoring the propagation of viruses through an Information Technology network
US7418732B2 (en) * 2002-06-26 2008-08-26 Microsoft Corporation Network switches for detection and prevention of virus attacks
DE10243243B4 (en) * 2002-09-17 2005-01-27 T-Mobile Deutschland Gmbh Method for the receiver-side automatic treatment of unwanted electronic mail in communication networks
US7917468B2 (en) * 2005-08-01 2011-03-29 Seven Networks, Inc. Linking of personal information management data
US8468126B2 (en) * 2005-08-01 2013-06-18 Seven Networks, Inc. Publishing data in an information community
US7299261B1 (en) * 2003-02-20 2007-11-20 Mailfrontier, Inc. A Wholly Owned Subsidiary Of Sonicwall, Inc. Message classification using a summary
US8266215B2 (en) 2003-02-20 2012-09-11 Sonicwall, Inc. Using distinguishing properties to classify messages
US7185015B2 (en) * 2003-03-14 2007-02-27 Websense, Inc. System and method of monitoring and controlling application files
US7529754B2 (en) 2003-03-14 2009-05-05 Websense, Inc. System and method of monitoring and controlling application files
GB2400934B (en) 2003-04-25 2005-12-14 Messagelabs Ltd A method of,and system for detecting mass mailing viruses
GB2401281B (en) 2003-04-29 2006-02-08 Hewlett Packard Development Co Propagation of viruses through an information technology network
US7796515B2 (en) 2003-04-29 2010-09-14 Hewlett-Packard Development Company, L.P. Propagation of viruses through an information technology network
CA2545916C (en) * 2003-11-12 2015-03-17 The Trustees Of Columbia University In The City Of New York Apparatus method and medium for detecting payload anomaly using n-gram distribution of normal data
US20050198168A1 (en) * 2003-12-04 2005-09-08 Justin Marston Messaging protocol discovery
US7971254B1 (en) * 2004-01-28 2011-06-28 Netgear, Inc. Method and system for low-latency detection of viruses transmitted over a network
US8220055B1 (en) * 2004-02-06 2012-07-10 Symantec Corporation Behavior blocking utilizing positive behavior system and method
US8214438B2 (en) * 2004-03-01 2012-07-03 Microsoft Corporation (More) advanced spam detection features
US8073911B2 (en) * 2004-05-12 2011-12-06 Bluespace Software Corporation Enforcing compliance policies in a messaging system
US7870200B2 (en) * 2004-05-29 2011-01-11 Ironport Systems, Inc. Monitoring the flow of messages received at a server
GB2418500A (en) * 2004-09-27 2006-03-29 Clearswift Ltd Detection, quarantine and modification of dangerous web pages
US8438633B1 (en) 2005-04-21 2013-05-07 Seven Networks, Inc. Flexible real-time inbox access
GB2427048A (en) 2005-06-09 2006-12-13 Avecho Group Ltd Detection of unwanted code or data in electronic mail
WO2006136660A1 (en) 2005-06-21 2006-12-28 Seven Networks International Oy Maintaining an ip connection in a mobile network
GB0512744D0 (en) * 2005-06-22 2005-07-27 Blackspider Technologies Method and system for filtering electronic messages
US8069166B2 (en) * 2005-08-01 2011-11-29 Seven Networks, Inc. Managing user-to-user contact with inferred presence information
WO2007022454A2 (en) 2005-08-18 2007-02-22 The Trustees Of Columbia University In The City Of New York Systems, methods, and media protecting a digital data processing device from attack
US8544097B2 (en) * 2005-10-14 2013-09-24 Sistema Universitario Ana G. Mendez, Inc. Attachment chain tracing scheme for email virus detection and control
EP1952240A2 (en) 2005-10-25 2008-08-06 The Trustees of Columbia University in the City of New York Methods, media and systems for detecting anomalous program executions
WO2007082308A2 (en) * 2006-01-13 2007-07-19 Bluespace Software Corp. Determining relevance of electronic content
US7769395B2 (en) * 2006-06-20 2010-08-03 Seven Networks, Inc. Location-based operations and messaging
WO2008055156A2 (en) 2006-10-30 2008-05-08 The Trustees Of Columbia University In The City Of New York Methods, media, and systems for detecting an anomalous sequence of function calls
GB0621656D0 (en) 2006-10-31 2006-12-06 Hewlett Packard Development Co Data file transformation
KR100859664B1 (en) * 2006-11-13 2008-09-23 삼성에스디에스 주식회사 Method for detecting a virus pattern of email
US9654495B2 (en) * 2006-12-01 2017-05-16 Websense, Llc System and method of analyzing web addresses
GB2444514A (en) 2006-12-04 2008-06-11 Glasswall Electronic file re-generation
US9729513B2 (en) 2007-11-08 2017-08-08 Glasswall (Ip) Limited Using multiple layers of policy management to manage risk
GB2458094A (en) * 2007-01-09 2009-09-09 Surfcontrol On Demand Ltd URL interception and categorization in firewalls
GB0709527D0 (en) 2007-05-18 2007-06-27 Surfcontrol Plc Electronic messaging system, message processing apparatus and message processing method
US8805425B2 (en) 2007-06-01 2014-08-12 Seven Networks, Inc. Integrated messaging
US8364181B2 (en) 2007-12-10 2013-01-29 Seven Networks, Inc. Electronic-mail filtering for mobile devices
US9002828B2 (en) * 2007-12-13 2015-04-07 Seven Networks, Inc. Predictive content delivery
US8862657B2 (en) 2008-01-25 2014-10-14 Seven Networks, Inc. Policy based content service
US20090193338A1 (en) 2008-01-28 2009-07-30 Trevor Fiatal Reducing network and battery consumption during content delivery and playback
US8787947B2 (en) * 2008-06-18 2014-07-22 Seven Networks, Inc. Application discovery on mobile devices
US8078158B2 (en) 2008-06-26 2011-12-13 Seven Networks, Inc. Provisioning applications for a mobile device
US8909759B2 (en) 2008-10-10 2014-12-09 Seven Networks, Inc. Bandwidth measurement
US9043433B2 (en) 2010-07-26 2015-05-26 Seven Networks, Inc. Mobile network traffic coordination across multiple applications
US8838783B2 (en) 2010-07-26 2014-09-16 Seven Networks, Inc. Distributed caching for resource and mobile network traffic management
US20120066759A1 (en) * 2010-09-10 2012-03-15 Cisco Technology, Inc. System and method for providing endpoint management for security threats in a network environment
WO2012060995A2 (en) 2010-11-01 2012-05-10 Michael Luna Distributed caching in a wireless network of content delivered for a mobile application over a long-held request
US8843153B2 (en) 2010-11-01 2014-09-23 Seven Networks, Inc. Mobile traffic categorization and policy for network use optimization while preserving user experience
US8484314B2 (en) 2010-11-01 2013-07-09 Seven Networks, Inc. Distributed caching in a wireless network of content delivered for a mobile application over a long-held request
GB2500327B (en) 2010-11-22 2019-11-06 Seven Networks Llc Optimization of resource polling intervals to satisfy mobile device requests
GB2495463B (en) 2010-11-22 2013-10-09 Seven Networks Inc Aligning data transfer to optimize connections established for transmission over a wireless network
GB2501416B (en) 2011-01-07 2018-03-21 Seven Networks Llc System and method for reduction of mobile network traffic used for domain name system (DNS) queries
WO2012145533A2 (en) 2011-04-19 2012-10-26 Seven Networks, Inc. Shared resource and virtual resource management in a networked environment
WO2012149434A2 (en) 2011-04-27 2012-11-01 Seven Networks, Inc. Detecting and preserving state for satisfying application requests in a distributed proxy and cache system
GB2504037B (en) 2011-04-27 2014-12-24 Seven Networks Inc Mobile device which offloads requests made by a mobile application to a remote entity for conservation of mobile device and network resources
US8584211B1 (en) 2011-05-18 2013-11-12 Bluespace Software Corporation Server-based architecture for securely providing multi-domain applications
US20120311710A1 (en) * 2011-06-03 2012-12-06 Voodoosoft Holdings, Llc Computer program, method, and system for preventing execution of viruses and malware
WO2013015994A1 (en) * 2011-07-27 2013-01-31 Seven Networks, Inc. Monitoring mobile application activities for malicious traffic on a mobile device
JP2014526751A (en) 2011-09-15 2014-10-06 ザ・トラスティーズ・オブ・コロンビア・ユニバーシティ・イン・ザ・シティ・オブ・ニューヨーク System, method, and non-transitory computer readable medium for detecting return oriented programming payload
US8868753B2 (en) 2011-12-06 2014-10-21 Seven Networks, Inc. System of redundantly clustered machines to provide failover mechanisms for mobile traffic management and network resource conservation
US8934414B2 (en) 2011-12-06 2015-01-13 Seven Networks, Inc. Cellular or WiFi mobile traffic optimization based on public or private network destination
US9009250B2 (en) 2011-12-07 2015-04-14 Seven Networks, Inc. Flexible and dynamic integration schemas of a traffic management system with various network operators for network traffic alleviation
WO2013086447A1 (en) 2011-12-07 2013-06-13 Seven Networks, Inc. Radio-awareness of mobile device for sending server-side control signals using a wireless network optimized transport protocol
EP2792188B1 (en) 2011-12-14 2019-03-20 Seven Networks, LLC Mobile network reporting and usage analytics system and method using aggregation of data in a distributed traffic optimization system
GB2499306B (en) 2012-01-05 2014-10-22 Seven Networks Inc Managing user interaction with an application on a mobile device
WO2013116856A1 (en) 2012-02-02 2013-08-08 Seven Networks, Inc. Dynamic categorization of applications for network access in a mobile network
US9326189B2 (en) 2012-02-03 2016-04-26 Seven Networks, Llc User as an end point for profiling and optimizing the delivery of content and data in a wireless network
US8812695B2 (en) 2012-04-09 2014-08-19 Seven Networks, Inc. Method and system for management of a virtual network connection without heartbeat messages
US10263899B2 (en) 2012-04-10 2019-04-16 Seven Networks, Llc Enhanced customer service for mobile carriers using real-time and historical mobile application and traffic or optimization data associated with mobile devices in a mobile network
WO2014011216A1 (en) 2012-07-13 2014-01-16 Seven Networks, Inc. Dynamic bandwidth adjustment for browsing or streaming activity in a wireless network based on prediction of user behavior when interacting with mobile applications
US9161258B2 (en) 2012-10-24 2015-10-13 Seven Networks, Llc Optimized and selective management of policy deployment to mobile clients in a congested network to prevent further aggravation of network congestion
US9241259B2 (en) 2012-11-30 2016-01-19 Websense, Inc. Method and apparatus for managing the transfer of sensitive information to mobile devices
US9307493B2 (en) 2012-12-20 2016-04-05 Seven Networks, Llc Systems and methods for application management of mobile device radio state promotion and demotion
US9241314B2 (en) 2013-01-23 2016-01-19 Seven Networks, Llc Mobile device with application or context aware fast dormancy
US8874761B2 (en) 2013-01-25 2014-10-28 Seven Networks, Inc. Signaling optimization in a wireless network for traffic utilizing proprietary and non-proprietary protocols
US8750123B1 (en) 2013-03-11 2014-06-10 Seven Networks, Inc. Mobile device equipped with mobile network congestion recognition to make intelligent decisions regarding connecting to an operator network
US9065765B2 (en) 2013-07-22 2015-06-23 Seven Networks, Inc. Proxy server associated with a mobile carrier for enhancing mobile traffic management in a mobile network
GB2518880A (en) 2013-10-04 2015-04-08 Glasswall Ip Ltd Anti-Malware mobile content data management apparatus and method
US9516049B2 (en) * 2013-11-13 2016-12-06 ProtectWise, Inc. Packet capture and network traffic replay
US10735453B2 (en) 2013-11-13 2020-08-04 Verizon Patent And Licensing Inc. Network traffic filtering and routing for threat analysis
US9654445B2 (en) 2013-11-13 2017-05-16 ProtectWise, Inc. Network traffic filtering and routing for threat analysis
US9330264B1 (en) 2014-11-26 2016-05-03 Glasswall (Ip) Limited Statistical analytic method for the determination of the risk posed by file based content
US20160164917A1 (en) 2014-12-03 2016-06-09 Phantom Cyber Corporation Action recommendations for computing assets based on enrichment information
US10057237B2 (en) * 2015-02-17 2018-08-21 Ca, Inc. Provide insensitive summary for an encrypted document
US20160287829A1 (en) * 2015-03-31 2016-10-06 Tom Whitehead Cushioned Sleep Apnea Mask
US10887261B2 (en) 2015-07-30 2021-01-05 Microsoft Technology Licensing, Llc Dynamic attachment delivery in emails for advanced malicious content filtering
US10868782B2 (en) 2018-07-12 2020-12-15 Bank Of America Corporation System for flagging data transmissions for retention of metadata and triggering appropriate transmission placement
US11151248B1 (en) * 2018-09-11 2021-10-19 NuRD LLC Increasing zero-day malware detection throughput on files attached to emails
US11677783B2 (en) * 2019-10-25 2023-06-13 Target Brands, Inc. Analysis of potentially malicious emails
EP4052156B1 (en) * 2019-11-03 2024-01-31 Microsoft Technology Licensing, LLC Campaign intelligence and visualization for combating cyberattacks
WO2021242687A1 (en) * 2020-05-28 2021-12-02 GreatHorn, Inc. Computer-implemented methods and systems for pre-analysis of emails for threat detection

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5414833A (en) * 1993-10-27 1995-05-09 International Business Machines Corporation Network security system and method using a parallel finite state machine adaptive active monitor and responder
US5832208A (en) * 1996-09-05 1998-11-03 Cheyenne Software International Sales Corp. Anti-virus agent for use with databases and mail servers
WO2000005650A1 (en) * 1998-07-21 2000-02-03 Raytheon Company Information security analysis system

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DK170490B1 (en) * 1992-04-28 1995-09-18 Multi Inform As Data Processing Plant
US5889943A (en) * 1995-09-26 1999-03-30 Trend Micro Incorporated Apparatus and method for electronic mail virus detection and elimination
US6453327B1 (en) * 1996-06-10 2002-09-17 Sun Microsystems, Inc. Method and apparatus for identifying and discarding junk electronic mail
US5796942A (en) * 1996-11-21 1998-08-18 Computer Associates International, Inc. Method and apparatus for automated network-wide surveillance and security breach intervention
US5935245A (en) * 1996-12-13 1999-08-10 3Com Corporation Method and apparatus for providing secure network communications
US5960170A (en) * 1997-03-18 1999-09-28 Trend Micro, Inc. Event triggered iterative virus detection
WO1999032985A1 (en) * 1997-12-22 1999-07-01 Accepted Marketing, Inc. E-mail filter and method thereof
DE69929206T2 (en) 1998-07-21 2006-08-24 Computer Associates Think, Inc. SYSTEM FOR ANALYSIS OF INFORMATION SECURITY
US6701440B1 (en) * 2000-01-06 2004-03-02 Networks Associates Technology, Inc. Method and system for protecting a computer using a remote e-mail scanning device
US7072942B1 (en) * 2000-02-04 2006-07-04 Microsoft Corporation Email filtering methods and systems
US6519703B1 (en) * 2000-04-14 2003-02-11 James B. Joyce Methods and apparatus for heuristic firewall
US6886099B1 (en) 2000-09-12 2005-04-26 Networks Associates Technology, Inc. Computer virus detection

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5414833A (en) * 1993-10-27 1995-05-09 International Business Machines Corporation Network security system and method using a parallel finite state machine adaptive active monitor and responder
US5832208A (en) * 1996-09-05 1998-11-03 Cheyenne Software International Sales Corp. Anti-virus agent for use with databases and mail servers
WO2000005650A1 (en) * 1998-07-21 2000-02-03 Raytheon Company Information security analysis system

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"Outbreak Manager" INTERNET, [Online] 19 October 2000 (2000-10-19), page 1 XP002203172 Retrieved from the Internet: <URL:http://web.archive.org/web/2000101907 1658/http://www.mcafeeb2b.com/products/oma nager/default-email-protection.asp> [retrieved on 2002-06-24] *
GARBER L: "MELISSA VIRUS CREATES A NEW TYPE OF THREAT" COMPUTER, IEEE COMPUTER SOCIETY, LONG BEACH., CA, US, US, vol. 32, no. 6, June 1999 (1999-06), pages 16-19, XP000829612 ISSN: 0018-9162 *
HOWLETT D: "SCREENING YOUR E-MAIL CONTENTS" PC USER, LONDON, GB, no. 266, 6 September 1995 (1995-09-06), page 58 XP000617461 *

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7089591B1 (en) 1999-07-30 2006-08-08 Symantec Corporation Generic detection and elimination of marco viruses
WO2002084495A1 (en) 2001-04-13 2002-10-24 Nokia, Inc. System and method for providing exploit protection for networks
EP1388068A1 (en) * 2001-04-13 2004-02-11 Nokia Inc. System and method for providing exploit protection for networks
EP1388068A4 (en) * 2001-04-13 2009-04-29 Nokia Inc System and method for providing exploit protection for networks
GB2384659A (en) * 2002-01-25 2003-07-30 F Secure Oyj Anti-virus protection at a network gateway
GB2384659B (en) * 2002-01-25 2004-01-14 F Secure Oyj Anti-virus protection at a network gateway
WO2003069449A2 (en) * 2002-02-13 2003-08-21 Levin Lawrence R Computer virus control
WO2003069449A3 (en) * 2002-02-13 2004-04-22 Lawrence R Levin Computer virus control
US7155742B1 (en) 2002-05-16 2006-12-26 Symantec Corporation Countering infections to communications modules
US7418729B2 (en) 2002-07-19 2008-08-26 Symantec Corporation Heuristic detection of malicious computer code by page tracking
EP1385303A2 (en) * 2002-07-22 2004-01-28 Symantec Corporation Method and device for preventing malicious computer code from propagating
EP1385303A3 (en) * 2002-07-22 2005-11-09 Symantec Corporation Method and device for preventing malicious computer code from propagating
US7380277B2 (en) 2002-07-22 2008-05-27 Symantec Corporation Preventing e-mail propagation of malicious computer code
US7478431B1 (en) 2002-08-02 2009-01-13 Symantec Corporation Heuristic detection of computer viruses
WO2004015954A1 (en) * 2002-08-07 2004-02-19 British Telecommunications Public Limited Company Server for sending electronics messages
US7159149B2 (en) 2002-10-24 2007-01-02 Symantec Corporation Heuristic detection and termination of fast spreading network worm attacks
US7631353B2 (en) 2002-12-17 2009-12-08 Symantec Corporation Blocking replication of e-mail worms
US7296293B2 (en) 2002-12-31 2007-11-13 Symantec Corporation Using a benevolent worm to assess and correct computer security vulnerabilities
US8271774B1 (en) 2003-08-11 2012-09-18 Symantec Corporation Circumstantial blocking of incoming network traffic containing code
JP2005216286A (en) * 2004-01-30 2005-08-11 Microsoft Corp Detection of cord-free file
US7721334B2 (en) 2004-01-30 2010-05-18 Microsoft Corporation Detection of code-free files
EP1560112A1 (en) * 2004-01-30 2005-08-03 Microsoft Corporation Detection of files that do not contain executable code
US7370233B1 (en) 2004-05-21 2008-05-06 Symantec Corporation Verification of desired end-state using a virtual machine environment
US7441042B1 (en) 2004-08-25 2008-10-21 Symanetc Corporation System and method for correlating network traffic and corresponding file input/output traffic
WO2006038036A1 (en) * 2004-10-08 2006-04-13 I-Cd Publishing (Uk) Limited Processing electronic communications
EP1657662A2 (en) * 2004-10-29 2006-05-17 Microsoft Corporation Efficient white listing of user-modifiable files
EP1657662A3 (en) * 2004-10-29 2008-03-26 Microsoft Corporation Efficient white listing of user-modifiable files
US8544086B2 (en) 2004-10-29 2013-09-24 Microsoft Corporation Tagging obtained content for white and black listing
US10043008B2 (en) 2004-10-29 2018-08-07 Microsoft Technology Licensing, Llc Efficient white listing of user-modifiable files
US8104086B1 (en) 2005-03-03 2012-01-24 Symantec Corporation Heuristically detecting spyware/adware registry activity
US8763076B1 (en) 2006-06-30 2014-06-24 Symantec Corporation Endpoint management using trust rating data
CN101212470B (en) * 2006-12-30 2011-05-04 中国科学院计算技术研究所 Distributed email system resistant to junk emails
US8863279B2 (en) 2010-03-08 2014-10-14 Raytheon Company System and method for malware detection

Also Published As

Publication number Publication date
DE60128227T2 (en) 2008-01-10
CY1106782T1 (en) 2012-05-23
ES2287140T3 (en) 2007-12-16
EP1299791B1 (en) 2007-05-02
EP1299791A2 (en) 2003-04-09
WO2002005072A3 (en) 2002-09-06
PT1299791E (en) 2007-08-16
GB2367714A (en) 2002-04-10
AU2001270763A1 (en) 2002-01-21
GB2367714C (en) 2006-10-30
US20040054498A1 (en) 2004-03-18
DE60128227D1 (en) 2007-06-14
GB0116578D0 (en) 2001-08-29
US7877807B2 (en) 2011-01-25
ATE361489T1 (en) 2007-05-15
GB2367714B (en) 2004-03-17
DK1299791T3 (en) 2007-09-10
GB0016835D0 (en) 2000-08-30

Similar Documents

Publication Publication Date Title
EP1299791B1 (en) Method of and system for processing email
AU2002237408B2 (en) A method of, and system for, processing email in particular to detect unsolicited bulk email
US9774569B2 (en) Detection of undesired computer files using digital certificates
US7712136B2 (en) Controlling a message quarantine
US7801960B2 (en) Monitoring electronic mail message digests
US10084801B2 (en) Time zero classification of messages
US7748038B2 (en) Method and apparatus for managing computer virus outbreaks
US20020004908A1 (en) Electronic mail message anti-virus system and method
US20150081825A1 (en) Method for Automatically Unsubscribing an Address from a Subscription
AU2002237408A1 (en) A method of, and system for, processing email in particular to detect unsolicited bulk email
US20040054742A1 (en) Method and system for detecting malicious activity and virus outbreak in email
US7257773B1 (en) Method and system for identifying unsolicited mail utilizing checksums
US20040128536A1 (en) Method and system for detecting presence of malicious code in the e-mail messages of an organization

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWE Wipo information: entry into national phase

Ref document number: 2001949640

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2001949640

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 10332552

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: JP

WWG Wipo information: grant in national office

Ref document number: 2001949640

Country of ref document: EP