US9934381B1

US9934381B1 - System and method for detecting malicious activity based on at least one environmental property

Info

Publication number: US9934381B1
Application number: US15/425,954
Authority: US
Inventors: Darien Kindlund; Julia Wolf; James Bennett
Original assignee: FireEye Inc
Current assignee: Magenta Security Holdings LLC; Magenta Security Intermediate Holdings LLC; Mandiant Inc
Priority date: 2013-03-13
Filing date: 2017-02-06
Publication date: 2018-04-03
Anticipated expiration: 2033-03-13
Also published as: US9565202B1; US10467414B1

Abstract

Techniques for detecting exfiltration content are described herein. According to one embodiment, a malicious content suspect is executed and a packet inspection of outbound network traffic is performed by a packet inspector running within the virtual machine. Occurring before the outbound network traffic leaving the virtual machine, the packet inspector determines whether a portion of outbound network traffic matches one or more portions of predetermined network traffic patterns or signatures. If so, a determination is made whether the outbound network traffic includes at least one environmental property of the virtual machine that is unique or almost unique to the virtual machine. If so, migration of the outbound network traffic outside of the virtual machine is precluded and an alert is transmitted. The alert includes the malicious content suspect that is attempting to perform an exfiltration of data.

Description

This is a Continuation application claiming the benefit of priority on U.S. patent application Ser. No. 13/801,573 filed Mar. 13, 2013, now U.S. Pat. No. 9,565,202 issued Feb. 7, 2017, which is incorporated by reference in its entirety.

FIELD OF THE INVENTION

Embodiments of the present invention relate generally to malicious content detection. More particularly, embodiments of the invention relate to detecting exfiltration content.

BACKGROUND

Malicious software, or malware for short, may include any program or file that is harmful by design to a computer. Malware includes computer viruses, worms, Trojan horses, adware, spyware, and any programming that gathers information about a computer or its user or otherwise operates without permission. The owners of the computers are often unaware that these programs have been added to their computers and are often similarly unaware of their function.

Malicious network content is a type of malware distributed over a network via websites, e.g., servers operating on a network according to a hypertext transfer protocol (HTTP) standard or other well-known standard. Malicious network content distributed in this manner may be actively downloaded and installed on a computer, without the approval or knowledge of its user, simply by the computer accessing the web site hosting the malicious network content (the “malicious web site”). Malicious network content may be embedded within objects associated with web pages hosted by the malicious web site. Malicious network content may also enter a computer on receipt or opening of email. For example, email may contain an attachment, such as a PDF document, with embedded malicious executable programs. Furthermore, malicious content may exist in files contained in a computer memory or storage device, having infected those files through any of a variety of attack vectors.

Various processes and devices have been employed to prevent the problems associated with malicious content. For example, computers often run antivirus scanning software that scans a particular computer for viruses and other forms of malware. The scanning typically involves automatic detection of a match between content stored on the computer (or attached media) and a library or database of signatures of known malware. The scanning may be initiated manually or based on a schedule specified by a user or system administrator associated with the particular computer. Unfortunately, by the time malware is detected by the scanning software, some damage on the computer or loss of privacy may have already occurred, and the malware may have propagated from the infected computer to other computers. Additionally, it may take days or weeks for new signatures to be manually created, the scanning signature library updated and received for use by the scanning software, and the new signatures employed in new scans.

Moreover, anti-virus scanning utilities may have limited effectiveness to protect against all exploits by polymorphic malware. Polymorphic malware has the capability to mutate to defeat the signature match process while keeping its original malicious capabilities intact. Signatures generated to identify one form of a polymorphic virus may not match against a mutated form. Thus polymorphic malware is often referred to as a family of virus rather than a single virus, and improved anti-virus techniques to identify such malware families is desirable.

Another type of malware detection solution employs virtual environments to replay content within a sandbox established by virtual machines (VMs). Such solutions monitor the behavior of content during execution to detect anomalies that may signal the presence of malware. One such system offered by FireEye, Inc., the assignee of the present patent application, employs a two-phase malware detection approach to detect malware contained in network traffic monitored in real-time. In a first or “static” phase, a heuristic is applied to network traffic to identify and filter packets that appear suspicious in that they exhibit characteristics associated with malware. In a second or “dynamic” phase, the suspicious packets (and typically only the suspicious packets) are replayed within one or more virtual machines. For example, if a user is trying to download a file over a network, the file is extracted from the network traffic and analyzed in the virtual machine. The results of the analysis aids in determining whether the file is malicious. The two-phase malware detection solution may detect numerous types of malware and, even malware missed by other commercially available approaches. Through verification, the two-phase malware detection solution may also achieve a significant reduction of false positives relative to such other commercially available approaches. Dealing with false positives in malware detection may needlessly slow or interfere with download of network content or receipt of email, for example. This two-phase approach has even proven successful against many types of polymorphic malware and other forms of advanced persistent threats.

Data loss/leak prevention solution is a system that is designed to detect potential data breach/data exfiltration transmissions and prevent them by monitoring, detecting & blocking sensitive data while in-use (endpoint actions), in-motion (network traffic), and at-rest (data storage). In data leakage incidents, sensitive data is disclosed to unauthorized personnel either by malicious intent or inadvertent mistake. Such sensitive data can come in the form of private or company information, intellectual property (IP), financial or patient information, credit-card data, and other information depending on the business and the industry. However, such a system is not capable of detecting a malware that performs data exfiltration before it causes damage.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the invention are illustrated by way of example and not limitation in the figures of the accompanying drawings in which like references indicate similar elements.

FIG. 1 is a block diagram illustrating a malicious content detection system according to one embodiment of the invention.

FIG. 2 is a block diagram illustrating a system for detecting exfiltration content according to one embodiment.

FIG. 3 is a flow diagram illustrating a method for detecting exfiltration content according to one embodiment of the invention.

FIG. 4 is a block diagram illustrating a system configuration for detecting exfiltration content according to another embodiment of the invention.

FIG. 5 is a block diagram of a computer network system deploying a malicious content detection system according to one embodiment of the invention.

FIG. 6 is a block diagram illustrating an example of a data processing system which may be used with one embodiment of the invention.

DETAILED DESCRIPTION

Various embodiments and aspects of the inventions will be described with reference to details discussed below, and the accompanying drawings will illustrate the various embodiments. The following description and drawings are illustrative of the invention and are not to be construed as limiting the invention. Numerous specific details are described to provide a thorough understanding of various embodiments of the present invention. However, in certain instances, well-known or conventional details are not described in order to provide a concise discussion of embodiments of the present inventions.

Reference in the specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in conjunction with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase “in one embodiment” in various places in the specification do not necessarily all refer to the same embodiment.

Techniques for detecting exfiltration content are described herein. According to some embodiments, a malicious content suspect is executed within a virtual machine (or other designated operating environments such as a sandboxed environment) that simulates or mimics a target operating environment that will likely cause the malicious content suspect to generate malicious indicators and activity. A malicious content suspect refers to any suspicious content that is likely malicious. A packet inspector is configured to monitor and inspect the outbound network traffic originated from an application used to render/display/run the malicious content suspect (if applicable) within the VM to determine whether the malicious content suspect is designed to perform content exfiltration or generic data theft. If so, the malicious content suspect may be declared as malicious.

The packet inspection may be performed by capturing the outbound network traffic upon detecting the malicious content suspect's callback (e.g., upon content render/load/execution, the operating system of the victim is compromised and the content instructs the operating system to transmit packets back the content/malware author, so that a clandestine channel is established, which allows the content/malware author to effectively take ownership of the victim system remotely for further nefarious purposes). The packet inspector searches and compares the content of the packets against predetermined network traffic patterns or signatures. In one embodiment, the packet inspector is configured to search the outbound network traffic emitted by the VM to a fake network that is isolated from connectivity to real assets external to the VM, in order to determine whether the outbound network traffic contains any machine or operating environment identifying information that identifies certain unique or almost unique characteristics of the virtual machine (e.g., a machine or computer identifier (ID), or user ID). If the outbound network traffic includes content that matches the predetermined network traffic patterns or signatures, an alert may be generated indicating that the malicious content suspect should be declared as malicious. Since the malicious content suspect is executed within an effectively isolated VM, the actual exfiltration content would not actually be transmitted to an external network. As a result, the malicious content suspect can be determined whether it is likely malicious without running a risk of causing damage to real enterprise assets or signaling to the malware author that such analysis was performed.

FIG. 1 is a block diagram illustrating a malicious content detection system according to one embodiment of the invention. Referring to FIG. 1, system 100 includes controller 101 to manage or control one or more virtual machines (VMs) 102 (also referred to as a sandboxed operating environment or simply a sandbox), where content associated with VMs 102 are stored in storage device 109 in a form of VM disk files 110.

Controller

101 may be implemented as part of a VM monitor or manager (VMM), also referred to as a hypervisor for managing or monitoring VMs, which may be hosted by a host operating system (OS). VM 102 may be hosted by a guest OS. The host OS and the guest OS may be the same type of operating systems or different types of operating systems (e.g., Windows™, Linux™, Unix™, Mac OS™, iOS™, etc.) or different versions thereof. A VM is a simulation of a machine (abstract or real) that is usually different from the target machine (where it is being simulated on). Virtual machines may be based on specifications of a hypothetical computer or emulate the computer architecture and functions of a real world computer. A virtual machine referred to herein can be any type of virtual machines, such as, for example, hardware emulation, full virtualization, para-virtualization, and operating system-level virtualization virtual machines.

According to one embodiment, when malicious content suspect 106 is received for a dynamic content analysis (as opposed to be a static content analysis described below), a scheduler 140 of controller 101 is configured to identify and select a VM, in this example VM 102, from a VM pool 145 that has been configured to closely simulate a target operating environment (e.g., particular version of an OS with particular versions of certain software installed therein) in which malicious content suspect 106 is to be analyzed. A malicious content suspect refers to any suspicious content that is likely malicious. The scheduler 140 then launches VM 102 in which monitoring module 105 is running within VM 102 and configured to monitor activities and behavior of malicious content suspect 106.

In addition, monitoring module 105 maintains a persistent communication channel with analysis module 103 of controller 101 to communicate certain events or activities of malicious content suspect 106 during the execution. In response to detecting certain predetermined events triggered by malicious content suspect 106, monitoring module 105 is configured to send a message via the communication channel to analysis module 103, where the message may be recorded as part of event log 108. The message may include information identifying an event triggered by malicious content suspect 106. Event log 108 records events that have been selectively monitored and detected by monitoring module 103, such as, for example, certain network activity events. Content of the event log 108 may be stored in a persistent storage as part of event log file(s) 112 of VM disk file 110 associated with VM 102. The recorded events may be analyzed by analysis module 103 based on a set of rules or policies (not shown) to determine whether malicious content suspect 106 is likely malicious (e.g., high probability of malicious) and/or should be declared as malicious.

In one embodiment, in response to some predetermined events (e.g., file creation, registry access, DLL loading, process execution, power management such as sleep) triggered by malicious content suspect 106, monitoring module 105 sends a message describing the event(s) via a communication channel to controller 101, which may be recorded as part of event log 108. Event log 108 may be further cached in a persistent storage as part of event log file(s) 112.

According to one embodiment, a packet inspector 125 is configured to monitor and inspect the outbound network traffic originated from the malicious content suspect 106 within the VM 102 to determine whether the malicious content suspect 106 performs specific content exfiltration or generic data theft. The packet inspection may be performed by capturing the outbound network traffic upon detecting the malicious content suspect's callback (e.g., transmitting packets back the original content/malware author to signal that the OS has been compromised and ready to be remotely controlled). The packet inspector 125 searches and compares the content of the packets against predetermined network traffic patterns or signatures as part of rules 126. In one embodiment, the packet inspector 125 is configured to search the outbound network traffic to determine whether the outbound network traffic contains any machine or operating environment identifying information that identifies certain unique or almost unique characteristics of the virtual machine 102 (e.g., a computer or machine identifier, or user identifier). If the outbound network traffic includes content that matches the predetermined network traffic patterns or signatures 126, an alert may be generated indicating that the malicious content suspect 106 may be declared as malicious.

FIG. 2 is a block diagram illustrating a system for detecting exfiltration content according to one embodiment. The system as shown in FIG. 2 may be implemented as part of malicious content detection system 100 of FIG. 1. Referring to FIG. 2, in this example, a packet capturer 202 is configured to monitor at least the outbound network traffic 220 initiated by malicious content suspect 106. Packet capturer 202 may be implemented as part of a network stack (e.g., TCP/IP stack) and/or within a firewall 250 of a guest operating system that hosts a VM in which malicious content suspect 106 is executed. The captured packets may be temporarily stored in buffer 204 and analyzed by packet inspector 125 based on a set of rules 126. Rules 126 represent a set of predefined system characteristics, network traffic patterns, and/or signatures, etc. If certain content of the outbound network traffic 220 matches at least some of the data in rules 126, packet inspector 125 may notify monitoring module 105 to send an alert 210 to controller 101. Alternatively, packet inspector 125 may send the alert 210 to controller 101 directly. Packet inspector 125 and/or rules 126 may also be implemented as part of network stack/firewall 250. Packet capturer 202 and packet inspector 125 may be integrated as a single unit. Packet capturer 202 and packet inspector 125 may be implemented in any one or more of the layers of a network stack, such as, an application layer, a transport control protocol (TCP) layer, an Internet protocol (IP) layer, and/or a media access control (MAC) layer, etc.

In one embodiment, upon detecting outbound malicious network activity (i.e., callback), packet inspector 125 identifies the computer name or NetBIOS name of the VM in which malicious content suspect 106 is running. NetBIOS (network basic input/output system) services related to the session layer of the Open Systems Interconnection (OSI) model allowing applications on separate computers to communicate over a local area network. The session layer of the OSI model controls the dialogues (connections) between computers. It establishes, manages, and terminates the connections between the local and remote application. It provides for full-duplex, half-duplex, or simplex operation, and establishes checkpointing, adjournment, termination, and restart procedures. The OSI model made this layer responsible for graceful close of sessions, which is a property of the Transmission Control Protocol, and also for session checkpointing and recovery, which is not usually used in the Internet Protocol Suite. The session layer is commonly implemented explicitly in application environments that use remote procedure calls.

The name used for malware detection can be used as a string, which can be encoded, and then used to scan subsequent suspicious content generated by the malicious content suspect 106. More specifically, the string can be encoded/compressed using standard reversible algorithms, for example, exclusive OR (XOR), BASE64, or ZLIB compression algorithm, any other commonly used encoding algorithms or methods. The encoded/compressed string can then be used to perform a search in the outbound network traffic 220, where a match indicates potential exfiltration of sensitive content from the malicious content suspect 106. This approach does not require knowledge of any password credentials previously stored on the VM.

However, this technique assumes computer names or NetBIOS names that are unique enough such that the encoded/compressed forms of this data do not match on generic network traffic, which may lead to false positives. In one embodiment, a switch mechanism can be used by a system user or system administrator to activate/enable or deactivate/disable this feature via at least an appropriate command line action or other user interface action.

According to one embodiment, packet inspector 125 and/or packet capturer 202 can perform real-time traffic analysis and packet logging on IP networks. They can perform protocol analysis, content searching, and content matching. They can also be used to detect probes or attacks, including, but not limited to, operating system fingerprinting attempts, common gateway interface, buffer overflows, server message block probes, and stealth port scans. The packet inspector 125 and/or packet capturer 202 read network packets (e.g., outbound traffic packets), log packets to a storage device, and monitor network traffic and analyze it against rules 126. The packet capturing and inspection can be performed automatically without user interaction or knowledge.

In this example, the virtual network interface 206 is configured to simulate a physical network interface, such as a network interface card, a network gateway device of a local area network (LAN), or a remote node such as a Web server, that the malicious content suspect 106 would normally access. The virtual network interface 206 may be a virtual network interface of the same VM or alternatively, the virtual network interface may be represented by another VM hosted by the same host operating system or VMM 101 of FIG. 1. Since the malicious content suspect 106 is contained or sandboxed within a VM, it cannot actually access an external network (e.g., Internet), the malware detection can be performed without the knowledge of the original author of the malicious content suspect 106. As a result, the malware author cannot collect the malware detection information or interfere with the malware detection process for the purpose of avoiding being detected in the future.

According to one embodiment, packet inspector 126 scans captured packets stored in buffer 204 to search for certain patterns or signatures predefined in rules 126 to determine whether the packets include certain identifying information that identifies a machine represented by the VM. The identifying information may include the unique or almost unique environmental properties of the VM, such as, for example, a computer name or NetBIOS name, hardware identifying information (e.g., hardware identifiers such as serial numbers for processor, motherboard, basic input/output system (BIOS), network interface, and/or storage device), application identifying information (e.g., software product IDs), and/or user identifying information (e.g., username or user ID, security ID). Note that the packet capturer 202 and packet inspector 125 may be activated or deactivated via a command. For example, an administrator can issue a command, for example, via a command line interface (CLI) or a user interface, to deactivate the packet capturing and packet inspection if the false positive rate is above a predetermined threshold.

In cases where legitimate, pre-installed applications within the VM emit similar unique or almost unique environmental information out on the network, the system will profile this “background traffic” when the VM has not yet processed any initial malicious content suspect and “train” the packet inspector 125 through specific exclusion rules within 126, so that this “background traffic” does not yield any subsequent false positive alerts 210.

FIG. 3 is a flow diagram illustrating a method for detecting exfiltration content according to one embodiment of the invention. The method as shown in FIG. 3 may be performed by system 100 of FIG. 1 or the system of FIG. 2, which may include processing logic in hardware, software, or a combination thereof. Referring to FIG. 3, at block 302, processing logic launches and executes malicious content suspect in a virtual machine that is configured to simulate a target operating environment associated with the malicious content suspect. At block 304, processing logic monitors and captures outbound network traffic that is initiated as a result of executing/rendering/loading from execution of the malicious content suspect to a virtual network interface (e.g., virtual network interface card or a virtual Web server). At block 306, processing logic dynamically performs a packet inspection on the captured outbound network traffic to determine whether the outbound network traffic satisfies a set of one or more rules (e.g., containing a predetermined environmental property of the VM). In one embodiment, the processing logic scans and analyzes the packets to search for certain system identifying information such as machine, hardware, software, and user identifying information that matches a set of predefined patterns or signatures. If a match is found, an alert is generated indicating that the malicious content suspect may be considered or declared as malicious.

According to some embodiments, the techniques described above can also be applied in real time within an actual production machine instead of a simulated operating environment such as a virtual machine. FIG. 4 is a block diagram illustrating a system configuration for detecting exfiltration content according to another embodiment of the invention. Referring to FIG. 4, in this example, packet capturer 202 and packet inspector 125 are implemented as part of firewall 404 or any of the network layers in a network stack (not shown). Firewall 404 may be part of an operating system of data processing system 402. Alternatively, firewall 404 may be implemented in a gateway device or router associated with a LAN in which data processing system 402 is a member.

A firewall can either be software-based or hardware-based and is used to help keep a network secure. Its primary objective is to control the incoming and outgoing network traffic by analyzing the data packets and determining whether it should be allowed through or not, based on a predetermined rule set. A network's firewall builds a bridge between the internal network or computer it protects, upon securing that the other network is secure and trusted, usually an external (inter)network, such as the Internet, that is not assumed to be secure and trusted. Many personal computer operating systems include software-based firewalls to protect against threats from the public Internet. Many routers that pass data between networks contain firewall components and, conversely, many firewalls can perform basic routing functions.

In one embodiment, packet capturer 202 and packet inspector 125 are configured to capture and analyze the outbound network traffic 430 initiated from an application such as application(s) 408. The outbound network traffic may be sent to a remote node such as remote Web server 410 over network 450. Network 450 may be a LAN, a wide area network (WAN), or a combination thereof.

According to one embodiment, packet inspector 125 dynamically scans packets captured by packet capturer 202 and stored in buffer 204 to search for certain patterns or signatures predefined in rules 126 to determine whether the packets include certain identifying information that identifies the real machine on the internal enterprise network which is running the application 408 that appears to be processing malicious content suspect. The identifying information may include the unique or almost unique environmental properties of the real machine on the internal enterprise network, such as, for example, a computer name or NetBIOS name, hardware identifying information (e.g., hardware identifiers such as serial numbers for processor, motherboard, basic input/output system (BIOS), network interface, and/or storage device), application identifying information (e.g., software product IDs), and/or user identifying information (e.g., username or user ID, security ID). Note that the packet capturer 202 and packet inspector 125 may also be activated/enabled or deactivated/disabled via a command. For example, an administrator can issue a command, for example, via a CLI or a user interface, to deactivate the packet capturing and packet inspection if the false positive rate is too high.

If certain content of the outbound network traffic 430 matches at least some of the data in rules 126, according to one embodiment, packet inspector 125 sends an alert 435 to administrator 420. In addition, since the outbound traffic may reach the intended destination 410, packet inspector 125 may further communicate with security system 406 to contain or shut down the suspect application 408 or machine 408 or alternatively, cause firewall 404 to block any further network traffic, inbound and/or outbound traffic, associated with the suspect application 408 or machine 408. Security system 406 may be part of a network intrusion detection system and/or network intrusion prevention system.

FIG. 5 is a block diagram of an illustrative computer network system having a malicious content detection system 850 in accordance with a further illustrative embodiment. The malicious content detection system 850 may represent any of the malicious content detection systems described above, such as, for example, detection system 100 of FIG. 1. The malicious content detection system 850 is illustrated with a server device 810 and a client device 830, each coupled for communication via a communication network 820. In various embodiments, there may be multiple server devices and multiple client devices sending and receiving data to/from each other, and the same device can serve as either a server or a client in separate communication sessions. Although FIG. 5 depicts data transmitted from the server device 810 to the client device 830, either device can transmit and receive data from the other.

Note that throughout this application, network content is utilized as an example of content for malicious content detection purposes; however, other types of content can also be applied. Network content may include any data transmitted over a network (i.e., network data). Network data may include text, software, images, audio, or other digital data. An example of network content includes web content, or any network data that may be transmitted using a Hypertext Transfer Protocol (HTTP), Hypertext Markup Language (HTML) protocol, or be transmitted in a manner suitable for display on a Web browser software application. Another example of network content includes email messages, which may be transmitted using an email protocol such as Simple Mail Transfer Protocol (SMTP), Post Office Protocol version 3 (POP3), or Internet Message Access Protocol (IMAP4). A further example of network content includes Instant Messages, which may be transmitted using an Instant Messaging protocol such as Session Initiation Protocol (SIP) or Extensible Messaging and Presence Protocol (XMPP). In addition, network content may include any network data that is transferred using other data transfer protocols, such as File Transfer Protocol (FTP).

The malicious network content detection system 850 may monitor exchanges of network content (e.g., Web content) in real-time rather than intercepting and holding the network content until such time as it can determine whether the network content includes malicious network content. The malicious network content detection system 850 may be configured to inspect exchanges of network content over the communication network 820, identify suspicious network content, and analyze the suspicious network content using a virtual machine to detect malicious network content. In this way, the malicious network content detection system 850 may be computationally efficient and scalable as data traffic volume and the number of computing devices communicating over the communication network 820 increase. Therefore, the malicious network content detection system 850 may not become a bottleneck in the computer network system.

The communication network 820 may include a public computer network such as the Internet, in which case a firewall 825 may be interposed between the communication network 820 and the client device 830. Alternatively, the communication network may be a private computer network such as a wireless telecommunication network, wide area network, or local area network, or a combination of networks. Though the communication network 820 may include any type of network and be used to communicate different types of data, communications of web data may be discussed below for purposes of example.

The malicious network content detection system 850 is shown as coupled with the network 820 by a network tap 840 (e.g., a data/packet capturing device). The network tap 840 may include a digital network tap configured to monitor network data and provide a copy of the network data to the malicious network content detection system 850. Network data may comprise signals and data that are transmitted over the communication network 820 including data flows from the server device 810 to the client device 830. In one example, the network tap 840 monitors and copies the network data without an appreciable decline in performance of the server device 810, the client device 830, or the communication network 820. The network tap 840 may copy any portion of the network data, for example, any number of data packets from the network data. In embodiments where the malicious content detection system 850 is implemented as an dedicated appliance or a dedicated computer system, the network tap 840 may include an assembly integrated into the appliance or computer system that includes network ports, network interface card and related logic (not shown) for connecting to the communication network 820 to non-disruptively “tap” traffic thereon and provide a copy of the traffic to the heuristic module 860. In other embodiments, the network tap 840 can be integrated into a firewall, router, switch or other network device (not shown) or can be a standalone component, such as an appropriate commercially available network tap. In virtual environments, a virtual tap (vTAP) can be used to copy traffic from virtual networks.

The network tap 840 may also capture metadata from the network data. The metadata may be associated with the server device 810 and/or the client device 830. For example, the metadata may identify the server device 810 and/or the client device 830. In some embodiments, the server device 810 transmits metadata which is captured by the tap 840. In other embodiments, a heuristic module 860 (described herein) may determine the server device 810 and the client device 830 by analyzing data packets within the network data in order to generate the metadata. The term, “content,” as used herein may be construed to include the intercepted network data and/or the metadata unless the context requires otherwise.

The malicious network content detection system 850 may include a heuristic module 860, a heuristics database 862, a scheduler 870, a virtual machine pool 880, an analysis engine 882 and a reporting module 884. In some embodiments, the network tap 840 may be contained within the malicious network content detection system 850.

The heuristic module 860 receives the copy of the network data from the network tap 840 and applies heuristics to the data to determine if the network data might contain suspicious network content. The heuristics applied by the heuristic module 860 may be based on data and/or rules stored in the heuristics database 862. The heuristic module 860 may examine the image of the captured content without executing or opening the captured content. For example, the heuristic module 860 may examine the metadata or attributes of the captured content and/or the code image (e.g., a binary image of an executable) to determine whether a certain portion of the captured content matches a predetermined pattern or signature that is associated with a particular type of malicious content. In one example, the heuristic module 860 flags network data as suspicious after applying a heuristic analysis. This detection process is also referred to as a static malicious content detection. The suspicious network data may then be provided to the scheduler 870. In some embodiments, the suspicious network data is provided directly to the scheduler 870 with or without buffering or organizing one or more data flows.

When a characteristic of the packet, such as a sequence of characters or keyword, is identified that meets the conditions of a heuristic, a suspicious characteristic of the network content is identified. The identified characteristic may be stored for reference and analysis. In some embodiments, the entire packet may be inspected (e.g., using deep packet inspection techniques) and multiple characteristics may be identified before proceeding to the next step. In some embodiments, the characteristic may be determined as a result of an analysis across multiple packets comprising the network content. A score related to a probability that the suspicious characteristic identified indicates malicious network content is determined.

The heuristic module 860 may also provide a priority level for the packet and/or the features present in the packet. The scheduler 870 may then load and configure a virtual machine from the virtual machine pool 880 in an order related to the priority level, and dispatch the virtual machine to the analysis engine 882 to process the suspicious network content.

The heuristic module 860 may provide the packet containing the suspicious network content to the scheduler 870, along with a list of the features present in the packet and the malicious probability scores associated with each of those features. Alternatively, the heuristic module 860 may provide a pointer to the packet containing the suspicious network content to the scheduler 870 such that the scheduler 870 may access the packet via a memory shared with the heuristic module 860. In another embodiment, the heuristic module 860 may provide identification information regarding the packet to the scheduler 870 such that the scheduler 870, or virtual machine may query the heuristic module 860 for data regarding the packet as needed.

The scheduler 870 may identify the client device 830 and retrieve a virtual machine associated with the client device 830. A virtual machine may itself be executable software that is configured to mimic the performance of a device (e.g., the client device 830). The virtual machine may be retrieved from the virtual machine pool 880. Furthermore, the scheduler 870 may identify, for example, a Web browser running on the client device 830, and retrieve a virtual machine associated with the web browser.

In some embodiments, the heuristic module 860 transmits the metadata identifying the client device 830 to the scheduler 870. In other embodiments, the scheduler 870 receives one or more data packets of the network data from the heuristic module 860 and analyzes the one or more data packets to identify the client device 830. In yet other embodiments, the metadata may be received from the network tap 840.

The scheduler 870 may retrieve and configure the virtual machine to mimic the pertinent performance characteristics of the client device 830. In one example, the scheduler 870 configures the characteristics of the virtual machine to mimic only those features of the client device 830 that are affected by the network data copied by the network tap 840. The scheduler 870 may determine the features of the client device 830 that are affected by the network data by receiving and analyzing the network data from the network tap 840. Such features of the client device 830 may include ports that are to receive the network data, select device drivers that are to respond to the network data, and any other devices coupled to or contained within the client device 830 that can respond to the network data. In other embodiments, the heuristic module 860 may determine the features of the client device 830 that are affected by the network data by receiving and analyzing the network data from the network tap 840. The heuristic module 860 may then transmit the features of the client device to the scheduler 870.

The virtual machine pool 880 may be configured to store one or more virtual machines. The virtual machine pool 880 may include software and/or a storage medium capable of storing software. In one example, the virtual machine pool 880 stores a single virtual machine that can be configured by the scheduler 870 to mimic the performance of any client device 830 on the communication network 820. The virtual machine pool 880 may store any number of distinct virtual machines that can be configured to simulate the performance of a wide variety of client devices 830.

The analysis engine 882 simulates the receipt and/or display of the network content from the server device 810 after the network content is received by the client device 110 to analyze the effects of the network content upon the client device 830. The analysis engine 882 may identify the effects of malware or malicious network content by analyzing the simulation of the effects of the network content upon the client device 830 that is carried out on the virtual machine. There may be multiple analysis engines 882 to simulate multiple streams of network content. The analysis engine 882 may be configured to monitor the virtual machine for indications that the suspicious network content is in fact malicious network content. Such indications may include unusual network transmissions, unusual changes in performance, and the like. This detection process is referred to as a dynamic malicious content detection.

The analysis engine 882 may flag the suspicious network content as malicious network content according to the observed behavior of the virtual machine. The reporting module 884 may issue alerts indicating the presence of malware, and using pointers and other reference information, identify the packets of the network content containing the malware. Additionally, the server device 810 may be added to a list of malicious network content providers, and future network transmissions originating from the server device 810 may be blocked from reaching their intended destinations, e.g., by firewall 825.

The computer network system may also include a further communication network 890, which couples the malicious content detection system (MCDS) 850 with one or more other MCDS, of which MCDS 892 and MCDS 894 are shown, and a management system 896, which may be implemented as a Web server having a Web interface. The communication network 890 may, in some embodiments, be coupled for communication with or part of network 820. The management system 896 is responsible for managing the

MCDS

850, 892, 894 and providing updates to their operation systems and software programs. Also, the management system 896 may cause malware signatures generated by any of the

MCDS

850, 892, 894 to be shared with one or more of the

other MCDS

850, 892, 894, for example, on a subscription basis. Moreover, the malicious content detection system as described in the foregoing embodiments may be incorporated into one or more of the

MCDS

850, 892, 894, or into all of them, depending on the deployment. Also, the management system 896 itself or another dedicated computer station may incorporate the malicious content detection system in deployments where such detection is to be conducted at a centralized resource.

Further information regarding an embodiment of a malicious content detection system can be had with reference to U.S. Pat. No. 8,171,553, the disclosure of which being incorporated herein by reference in its entirety.

As described above, the detection or analysis performed by the heuristic module 860 may be referred to as static detection or static analysis, which may generate a first score (e.g., a static detection score) according to a first scoring scheme or algorithm. The detection or analysis performed by the analysis engine 882 is referred to as dynamic detection or dynamic analysis, which may generate a second score (e.g., a dynamic detection score) according to a second scoring scheme or algorithm. The first and second scores may be combined, according to a predetermined algorithm, to derive a final score indicating the probability that a malicious content suspect is indeed malicious.

Furthermore, detection systems 850 and 892-894 may deployed in a variety of distribution ways. For example, detection system 850 may be deployed as a detection appliance at a client site to detect any suspicious content, for example, at a local area network (LAN) of the client. In addition, any of MCDS 892 and MCDS 894 may also be deployed as dedicated data analysis systems. Systems 850 and 892-894 may be configured and managed by a management system 896 over network 890, which may be a LAN, a wide area network (WAN) such as the Internet, or a combination of both. Management system 896 may be implemented as a Web server having a Web interface to allow an administrator of a client (e.g., corporation entity) to log in to manage detection systems 850 and 892-894. For example, an administrator may able to activate or deactivate certain functionalities of malicious content detection systems 850 and 892-894 or alternatively, to distribute software updates such as malicious content definition files (e.g., malicious signatures or patterns) or rules, etc. Furthermore, a user can submit via a Web interface suspicious content to be analyzed, for example, by dedicated data analysis systems 892-894. As described above, malicious content detection includes static detection and dynamic detection. Such static and dynamic detections can be distributed amongst different systems over a network. For example, static detection may be performed by detection system 850 at a client site, while dynamic detection of the same content can be offloaded to the cloud, for example, by any of detection systems 892-894. Other configurations may exist.

FIG. 6 is a block diagram illustrating an example of a data processing system which may be used with one embodiment of the invention. For example, the system as shown in FIG. 6 may represents any of data processing systems described above performing any of the processes or methods described above. the system as shown in FIG. 6 may represent a desktop, a tablet, a server, a mobile phone, a media player, a personal digital assistant (PDA), a personal communicator, a gaming device, a network router or hub, a wireless access point (AP) or repeater, a set-top box, or a combination thereof.

Referring to FIG. 6, in one embodiment, the system includes processor 901 and peripheral interface 902, also referred to herein as a chipset, to couple various components to processor 901 including memory 903 and devices 905-908 via a bus or an interconnect. Processor 901 may represent a single processor or multiple processors with a single processor core or multiple processor cores included therein. Processor 901 may represent one or more general-purpose processors such as a microprocessor, a central processing unit (CPU), or the like. More particularly, processor 901 may be a complex instruction set computing (CISC) microprocessor, reduced instruction set computing (RISC) microprocessor, very long instruction word (VLIW) microprocessor, or processor implementing other instruction sets, or processors implementing a combination of instruction sets. Processor 901 may also be one or more special-purpose processors such as an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), a network processor, a graphics processor, a network processor, a communications processor, a cryptographic processor, a co-processor, an embedded processor, or any other type of logic capable of processing instructions. Processor 901 is configured to execute instructions for performing the operations and steps discussed herein.

Peripheral interface

902 may include memory control hub (MCH) and input output control hub (ICH). Peripheral interface 902 may include a memory controller (not shown) that communicates with a memory 903. Peripheral interface 902 may also include a graphics interface that communicates with graphics subsystem 904, which may include a display controller and/or a display device. Peripheral interface 902 may communicate with graphics device 904 via an accelerated graphics port (AGP), a peripheral component interconnect (PCI) express bus, or other types of interconnects.

An MCH is sometimes referred to as a Northbridge and an ICH is sometimes referred to as a Southbridge. As used herein, the terms MCH, ICH, Northbridge and Southbridge are intended to be interpreted broadly to cover various chips who functions include passing interrupt signals toward a processor. In some embodiments, the MCH may be integrated with processor 901. In such a configuration, peripheral interface 902 operates as an interface chip performing some functions of the MCH and ICH. Furthermore, a graphics accelerator may be integrated within the MCH or processor 901.

Memory

903 may include one or more volatile storage (or memory) devices such as random access memory (RAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), static RAM (SRAM), or other types of storage devices. Memory 903 may store information including sequences of instructions that are executed by processor 901, or any other device. For example, executable code and/or data of a variety of operating systems, device drivers, firmware (e.g., input output basic system or BIOS), and/or applications can be loaded in memory 903 and executed by processor 901. An operating system can be any kind of operating systems, such as, for example, Windows® operating system from Microsoft®, Mac OS®/iOS® from Apple, Android® from Google®, Linux®, Unix®, or other real-time or embedded operating systems such as VxWorks.

Peripheral interface

902 may provide an interface to IO devices such as devices 905-908, including wireless transceiver(s) 905, input device(s) 906, audio IO device(s) 907, and other IO devices 908. Wireless transceiver 905 may be a WiFi transceiver, an infrared transceiver, a Bluetooth transceiver, a WiMax transceiver, a wireless cellular telephony transceiver, a satellite transceiver (e.g., a global positioning system (GPS) transceiver) or a combination thereof. Input device(s) 906 may include a mouse, a touch pad, a touch sensitive screen (which may be integrated with display device 904), a pointer device such as a stylus, and/or a keyboard (e.g., physical keyboard or a virtual keyboard displayed as part of a touch sensitive screen). For example, input device 906 may include a touch screen controller coupled to a touch screen. The touch screen and touch screen controller can, for example, detect contact and movement or break thereof using any of a plurality of touch sensitivity technologies, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen.

Audio IO

907 may include a speaker and/or a microphone to facilitate voice-enabled functions, such as voice recognition, voice replication, digital recording, and/or telephony functions. Other optional devices 908 may include a storage device (e.g., a hard drive, a flash memory device), universal serial bus (USB) port(s), parallel port(s), serial port(s), a printer, a network interface, a bus bridge (e.g., a PCI-PCI bridge), sensor(s) (e.g., a motion sensor, a light sensor, a proximity sensor, etc.), or a combination thereof. Optional devices 908 may further include an imaging processing subsystem (e.g., a camera), which may include an optical sensor, such as a charged coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) optical sensor, utilized to facilitate camera functions, such as recording photographs and video clips.

Note that while FIG. 6 illustrates various components of a data processing system, it is not intended to represent any particular architecture or manner of interconnecting the components; as such details are not germane to embodiments of the present invention. It will also be appreciated that network computers, handheld computers, mobile phones, and other data processing systems which have fewer components or perhaps more components may also be used with embodiments of the invention.

Some portions of the preceding detailed descriptions have been presented in terms of algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations are the ways used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of operations leading to a desired result. The operations are those requiring physical manipulations of physical quantities.

It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the above discussion, it is appreciated that throughout the description, discussions utilizing terms such as those set forth in the claims below, refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission or display devices.

The techniques shown in the figures can be implemented using code and data stored and executed on one or more electronic devices. Such electronic devices store and communicate (internally and/or with other electronic devices over a network) code and data using computer-readable media, such as non-transitory computer-readable storage media (e.g., magnetic disks; optical disks; random access memory; read only memory; flash memory devices; phase-change memory) and transitory computer-readable transmission media (e.g., electrical, optical, acoustical or other form of propagated signals—such as carrier waves, infrared signals, digital signals).

The processes or methods depicted in the preceding figures may be performed by processing logic that comprises hardware (e.g. circuitry, dedicated logic, etc.), firmware, software (e.g., embodied on a non-transitory computer readable medium), or a combination of both. Although the processes or methods are described above in terms of some sequential operations, it should be appreciated that some of the operations described may be performed in a different order. Moreover, some operations may be performed in parallel rather than sequentially.

In the foregoing specification, embodiments of the invention have been described with reference to specific exemplary embodiments thereof. It will be evident that various modifications may be made thereto without departing from the broader spirit and scope of the invention as set forth in the following claims. The specification and drawings are, accordingly, to be regarded in an illustrative sense rather than a restrictive sense.

Claims

What is claimed is:

1. A computer-implemented method for detecting exfiltration of data, comprising:

executing a malicious content suspect within a virtual machine;

performing a packet inspection on outbound network traffic by a packet inspector running within the virtual machine prior to the outbound network traffic leaving the virtual machine, the packet inspection to determine whether a portion of outbound network traffic matches one or more portions of predetermined network traffic patterns or signatures;

determining whether the outbound network traffic includes at least one environmental property of the virtual machine that is unique to or distinctive of the virtual machine after determining the portion of the outbound network traffic matches the one or more portions of predetermined network traffic patterns or signatures, the at least one environmental property is unique to or distinctive of the virtual machine in that the at least one environmental property pertains to the virtual machine so as to allow the match to indicate that the malicious content suspect is attempting to perform an exfiltration of data;

precluding migration of the outbound network traffic outside of the virtual machine upon determining that the outbound network traffic includes the at least one environmental property of the virtual machine that is unique to or distinctive of the virtual machine; and

transmitting an alert indicating that the malicious content suspect is attempting to perform the exfiltration of data upon determining that the outbound network traffic includes the at least one environmental property of the virtual machine.

2. The method of claim 1, wherein the determining whether the outbound network traffic includes the at least one environmental property of the virtual machine comprises matching the at least one environmental property to any of a set of patterns associated with the virtual machine selected to process the malicious content suspect.

3. The method of claim 1, wherein the at least one environmental property of the virtual machine comprises an identifier of an electronic device represented by the virtual machine.

4. The method of claim 1, wherein the at least one environmental property of the virtual machine comprises information that distinguishes hardware included in an electronic device represented by the virtual machine from other hardware.

5. The method of claim 1, wherein the alert being transmitted over a network.

6. The method of claim 1, wherein the malicious content suspect is extracted from the outbound network traffic by a packet capturer of a guest operating system that hosts the virtual machine.

7. The method of claim 6, wherein the packet capturer being implemented as part of a firewall of the guest operating system.

8. The method of claim 1, wherein a destination of the outbound network traffic is represented by a virtual network interface presented by the virtual machine, without allowing the outbound network traffic to reach an actual destination outside of a data processing system that hosts the virtual machine.

9. The method of claim 1, wherein the at least one environmental property includes at least one of (i) a computer name or NetBIOS name, (ii) a serial number of a hardware component, (iii) an identifier of a software application, or (iv) information identifying a user of an electronic device represented by the virtual machine.

10. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations for detecting exfiltration, comprising:

executing a malicious content suspect within a virtual machine;

prior to outbound network traffic initiated by the malicious content suspect leaving the virtual machine, performing a packet inspection within the virtual machine on the outbound network traffic by analyzing a portion of the outbound network traffic in comparison to one or more portions of predetermined network traffic patterns or signatures;

determining whether the outbound network traffic includes at least one environmental property of the virtual machine that is unique to or distinctive of the virtual machine after determining the portion of the outbound network traffic matches the one or more portions of predetermined network traffic patterns or signatures, the at least one environmental property is unique to or distinctive of the virtual machine in that the at least one environmental property pertains to the virtual machine so as to allow the match to indicate that the malicious content suspect is attempting to perform an exfiltration of data; and

responsive to determining the outbound network traffic includes the at least one environmental property of the virtual machine that is unique to or distinctive of the virtual machine, precluding migration of the outbound network traffic outside of the virtual machine, and transmitting an alert over a network, the alert indicating that the malicious content suspect is attempting to perform the exfiltration of data.

11. The non-transitory machine-readable medium of claim 10, wherein the determining whether the outbound network traffic includes the at least one environmental property of the virtual machine comprises matching the at least one environmental property to any of a set of patterns associated with the virtual machine selected to process the malicious content suspect.

12. The non-transitory machine-readable medium of claim 10, wherein the at least one environmental property of the virtual machine comprises an identifier of an electronic device represented by the virtual machine.

13. The non-transitory machine-readable medium of claim 10, wherein the performing of the packet inspection comprises performing a search of data that is part of the outbound network traffic based on a predetermined signature that was generated by encoding, using a predetermined encoding algorithm, a text string representing a unique identifier of an electronic device represented by the virtual machine.

14. The non-transitory machine-readable medium of claim 10, wherein the at least one environmental property of the virtual machine is unique when an encoded or compressed form of data of the at least one environmental property fails to match generic network traffic.

15. The non-transitory machine-readable medium of claim 10 being implemented as part of a firewall.

16. A data processing system, comprising:

a processor; and

a memory coupled to the processor for storing instructions, which when executed from the memory, cause the processor to

execute a malicious content suspect within a virtual machine,

prior to outbound network traffic initiated by the malicious content suspect leaving the virtual machine, perform a packet inspection, by a packet inspector executed by the processor and running within the virtual machine, on the outbound network traffic, the packet inspection to determine whether a portion of the outbound network traffic matches one or more portions of predetermined network traffic patterns or signatures,

determine whether the outbound network traffic includes at least one environmental property of the virtual machine that is unique to or distinctive of the virtual machine after determining that the portion of the outbound network traffic matches the one or more portions of predetermined network traffic patterns or signatures, and

preclude migration of the outbound network traffic outside of the virtual machine and transmitting an alert indicating that the malicious content suspect is attempting to perform an exfiltration of data upon determining that the outbound network traffic includes the at least one environmental property of the virtual machine that is unique to or distinctive of the virtual machine.

17. The system of claim 16, wherein the determining whether the outbound network traffic includes the at least one environmental property of the virtual machine comprises matching the at least one environmental property to any of a set of patterns associated with the virtual machine selected to process the malicious content suspect.

18. The system of claim 16, wherein the alert being transmitted to a controller, the controller is implemented as part of a virtual machine monitor (VMM).

19. The system of claim 18, wherein the controller includes a scheduler that selects a configuration of the virtual machine, the configuration includes a selection of at least a particular version of an operating system includes a selection of a particular version of a particular operating system and one or more of version of application software to operate with the particular version of the operating system.

20. The system of claim 16, wherein the at least one environmental property of the virtual machine comprises an identifier of an electronic device represented by the virtual machine.

21. The system of claim 16, wherein the performing of the packet inspection comprises performing a search of data that is part of the outbound network traffic based on a predetermined signature that was generated by encoding, using a predetermined encoding algorithm, a text string representing a unique identifier of an electronic device represented by the virtual machine comprising the at least one environmental property.

22. The system of claim 16, wherein the at least one environmental property of the virtual machine is unique or distinctive when an encoded or compressed form of data of the at least one environmental property fails to match generic network traffic.

23. The system of claim 16, wherein the at least one environmental property is unique to or distinctive of the virtual machine in that the at least one environmental property pertains to the virtual machine so as to allow the match to indicate that the malicious content suspect is attempting to perform an exfiltration of data.

24. The system of claim 23, wherein the at least one environmental property includes at least one of (i) a computer name or NetBIOS name, (ii) a serial number of a hardware component, (iii) an identifier of a software application, or (iv) information identifying a user of an electronic device represented by the virtual machine.