WO2017156560A1

WO2017156560A1 - Electronic security, investigation and surveillance system

Info

Publication number: WO2017156560A1
Application number: PCT/ZA2017/050014
Authority: WO
Inventors: Brian Riggs
Original assignee: Brian Riggs
Priority date: 2016-03-07
Filing date: 2017-03-07
Publication date: 2017-09-14
Also published as: ZA201805234B

Abstract

The invention provides an electronic security, investigation and surveillance system (10) and method involving the use of mobile electronic devices (12) such as smartphones. The system can maintain an up-to-date historical record of data and media sourced from across a broad spectrum of a mobile device's functionalities, for example its cameras, microphone, GPS system, etc. In the event a crime is committed or an emergency incident occurs in the vicinity of the mobile device, this historical record can be accessed and uploaded from the mobile device to a backend (14). The backend can also be used to assume control of the device. In common with the so-called "black box" systems found in aviation, the historical record is maintained for a limited and advancing period of time. That is, means are provided for erasing earliest data within the historical record on an advancing time basis, and/or with reference to a predetermined memory usage or storage capacity of the mobile device.

Description

Title of Invention:

ELECTRONIC SECURITY, INVESTIGATION AND SURVEILLANCE SYSTEM

Technical Field

[0001 ] THIS INVENTION relates to an electronic system and method for carrying out security, investigation and surveillance functions. The system is intended primarily for use in the investigation of crimes and other emergency incidents, and in the tracing of perpetrators.

Background Art

[0002] In certain parts of the world there is a high prevalence of crime. Evidence gathering and the tracking of suspects and victims is critical in the investigation of crimes such as murder, hi-jacking, assault, armed robbery, house-breaking and home invasions, burglary and theft, hostage taking, human trafficking, rape and other sexual offences, and also in missing persons' cases. Rapid response is critically important in such investigations.

[0003] An ongoing need exists for systems and methods which can enhance the speed and effectiveness of such investigations.

[0004] Electronic communication has become an important part of everyday life for many people on both personal and professional levels. Many people use some form of mobile electronic device, for example a mobile smartphone, as an integral part of their communication in daily life. However, mobile devices have to date only been able to provide limited assistance to authorities investigating crimes and tracing the perpetrators of such crimes.

[0005] Such protocols have typically been limited to locating a missing or stolen phone in current time (so called "real time"). Such techniques in the past have generally relied upon triangulation in real-time, using cellphone masts. [0006] Systems exist for remotely accessing mobile devices and controlling them in limited ways. For example, applications such as Android Device Manager are available but can only control a mobile device in real-time; no substantial data and media history is typically available to them.

[0007] Existing technologies such as Auto Answer and Ambient Listening and Recording also exist. Auto Answer allows a remote user to call a cell phone secretly and listen to its surroundings or observe internet activity. These activities are generally conducted in real-time and do not permit access to the history of the phone's surroundings.

[0008] Ambient Listening and Recording technology allows a recording to be made of voice and sounds in the vicinity of a mobile device. However, the listening and recording needs to be started by means of a direct and real-time instruction given by the remote user. The audio recording is stored in an MP4 file to allow it to be downloaded immediately or later from the mobile device. This system requires input from the remote user in order for it to start functioning. Recording periods are limited and in each case must be started afresh by the remote user. A further disadvantage is that the target device needs to have an internet connection so that it can receive instructions to start listening.

[0009] Systems are available to assist users to trace the movements and activities of their children by accessing their mobile devices. Once again, however, such systems do not provide a useful picture of ambient historical activities associated with the devices.

[0010] Anti-Theft systems allow remote use of mobile device functionality. One such product provides functionality so that, after an intruder makes three failed attempts to log in to a device, an Application on the device will take a photograph of the intruder and note the location of the device. It will then forward this to the remote user of the system. Once again, however, activation needs to be carried out in real-time; there is no history of the phone's surroundings which can be interrogated to give a comprehensive picture of the device's surroundings and users prior to activation by the remote user. [001 1 ] The current invention provides a system which exploits the prevalence of mobile electronic devices in society, as well as their functionality and increasing storage capacity, to maintain a continuously updated record of surveillance data for use by authorities investigating crimes and other emergencies, and to initiate and execute certain investigative and tracking protocols in response thereto. The system may, for example, provide a means of gathering evidence for purposes of tracing the perpetrators of crimes.

Definitions

[0012] As used herein, the following terms and acronyms have the following meanings:

App - A client software application, typically installable on an electronic device such as a mobile phone or the like. The App may be configured to run as a background service without any user interface.

GPS - Geographical Positioning System.

GUI - Graphical User Interface.

LBS - Location Based Services.

PIN - Personal Identification Number.

SMS - Short Message Service.

Phone - Telephone.

Unless otherwise indicated by the context, references to the performance of actions or functions by a mobile device, server, electronic device, software application (App), control centre or the like, are to be interpreted to imply that said actions or functions are mediated by way of the execution of corresponding software and/or the operation of corresponding hardware.

[0013] "Transmission", "transmit" and the like imply transmission via a communication system, typically a wireless and/or cellular communication system.

[0014] "Comprises" (or "comprising") specifies the presence of stated features, integers, steps or components but does not preclude the presence or addition of one or more other features, integers, steps or components or groups thereof.

[0015] Numeral References The claims appended to this description are to be considered as an integral part of the present disclosure. Reference numbers (directed to the drawings) shown in the claims serve to facilitate the correlation of integers of the claims with illustrated features of the preferred embodiment(s), but are not intended to restrict in any way the language of the claims to what is shown in the drawings, unless the contrary is clearly apparent from the context.

Summary of Invention

[0016] In part, this invention provides a system software application ("App") installable on a mobile electronic device such as a smartphone, for recording and maintaining an up-to-date historical record of data and media sourced from across a broad spectrum of the device's functionalities, and for facilitating remote control and management of the device by means of a backend. It enables the backend to remotely retrieve the historical record of data and media from the mobile device using a data communication network, thereby to facilitate capture of the device and the collection of intelligence for the purpose of apprehending and prosecuting criminal offenders and of managing emergency incidents. The principle of operation is similar to that of aviation "black boxes", although the present invention applies that principle in an entirely different field and by means of different and inventive technical steps.

Disclosure of Invention

[0017] According to a first aspect of the invention there is provided an electronic security, investigation and surveillance system comprising:

at least a first mobile user electronic device ("mobile device") on which a mobile system software application is installable, said mobile device having (i) a plurality of functionalities capable of generating data, and (ii) wireless communication means; and

at least a first control centre electronic device ("backend") on which a control centre system software application is installable, said backend being able to communicate with the mobile device via said communication means, thereby to access and control said mobile device and to receive electronic data reports therefrom; characterised in that said mobile system software application comprises code which is executable by the mobile device to record an historical record of at least a portion of said data generated by at least one of said functionalities of said mobile device over a limited period of time, said limited period advancing with time; and to transmit electronic data reports to said backend via said communication means, each such electronic data report comprising at least a portion of said advancing historical record.

[0018] The mobile system software application of said mobile device typically comprises means for erasing earliest data within said historical record on an advancing time basis, thereby to provide that the historical record of data remains limited to a predetermined (albeit advancing) period of time during which said mobile device is operable, and/or a predetermined memory usage or storage capacity of the mobile device.

[0019] The data recordable by the installable mobile system software application may comprise data generated by a plurality of data gathering means associated with the various functionalities of the mobile device; said data gathering means being selected from the group consisting of camera systems, microphone systems, cellular communication hardware systems, in-App messaging systems, telephonic and message storage systems, loggers, internal clocks, hardware identification means, and electronic location means (for example GPS and/or LBS).

[0020] The data of the historical record may be selected from the group consisting of photographs, video recordings, audio recordings, in-App messages, mobile text messages (for example SMS), dialled and received telephone numbers, operational logs and call logs, system time, hardware identification data, and location data (for example GPS and/or LBS co-ordinates), including breadcrumb trails reflecting periodic locations of said mobile device.

[0021 ] The mobile system software application preferably provides means for invoking a "False Off" condition of said mobile device, being a low energy state of operation wherein output of sensory data (and optionally also radio-frequency signal transmission) by the mobile device is suspended whilst at least the following capabilities and/or capacities of the mobile device remain activated: a capability and/or capacity for recording data generated by at least one of said functionalities of said mobile device; and

a capability and/or capacity for receiving communications and control instructions from said backend.

[0022] Pulsing means may be provided within said mobile device, controllable by said mobile system software application, for periodically transmitting pulses to the backend via said wireless communication means, said pulses being transmissible for the purpose of confirming an active ("on") state of the mobile device. The backend is typically then adapted to receive notification of said pulses or signals from said mobile device.

[0023] The mobile system software application may be configurable to record the data at spaced time intervals according to a predetermined time schedule. This is particularly relevant to those functionalities (e.g. GPS) which draw higher power compared to other functionalities. The user may be able to select a preferred time schedule from a pre-determined set of time parameters.

[0024] In preferred embodiments of the invention, the mobile system software application may be configurable to upload an electronic data report to the backend only when an instruction to do so is received from the backend, said report comprising at least a portion of said historical record.

[0025] However, in alternative embodiments of the invention, the mobile system software application may be configurable to intermittently or periodically upload electronic data reports to the backend, said reports each comprising at least a portion of said historical record. These uploads may start from the time that the system is installed on the mobile device, and continue intermittently for as long as the first mobile user electronic device is operating.

[0026] The control centre system software application and the mobile system software application are preferably configurable to cooperate with each other thereby to enable access to and remote control of the mobile device and/or its hardware, in order to perform actions selected from the group consisting of: Activate location services; Switch GPS on; Get location; View location history; Use camera; Take front photograph; Take rear photograph; Set taking of front or rear photograph on Screen Unlock; Set taking of front or rear photograph on Call; Set taking of front or rear photograph on Attempt to Power mobile device on or off; View photographs taken on Screen Unlock, Call, or Attempt to Power; Use video recorder; Take front video; Take rear video; Use sound recorder; Record audio; Record telephone calls; Call mobile device; Ring alarm; Vibrate; Activate flashlight; Activate Bluetooth; Send or receive notifications associated with applications on mobile device; Send or receive text messages from and to mobile device; Lock mobile device; Prevent mobile device from sleeping; Fetch telephone log; Fetch SIM details; Access file system of mobile device; View requested files; Delete data, files and/or media on mobile device; Send commands to mobile device; Save and upload data, files and/or media from mobile device to backend.

[0027] The installable control centre system software on the backend may further be configurable to process the electronic reports uploaded from the mobile device, to locate substantially the position or location of the first mobile user electronic device and to track substantially the movements of the mobile device over a period of time.

[0028] In various embodiments of the invention, the mobile device may comprise a mobile phone, a smartphone, a tablet or a notepad computing device, a laptop computing device, a wearable electronic computing device such as a smart watch, or the like.

[0029] Further according to the invention, the backend may comprise at least one storage, database and computing facility selected from the group consisting of: a cloud computing arrangement, computer server device, computer server and database network system, desktop computing device, and/or a mobile electronic device such as a laptop computing device, tablet, notepad computing device, or the like.

[0030] Typically the installable mobile system software application on the mobile device is able to establish a communication link, via the communication means or network, with the installable system software on the backend.

[0031 ] The communication network may include a plurality of computing devices forming part of a cloud computing arrangement. It typically also includes at least one electronic communication means such as, for example, a mobile or cellular phone communication network, GPRS, 3G, 4G, LTE, 5G, or DSL broadband Internet connection such as ADSL, Wi-Fi, a virtual private network (VPN), or the like.

[0032] The electronic reports which are storable on, and transmissible by, the first mobile user electronic device (and which are receivable by and storable on the backend) may be used to provide a history of information and data gathered by said mobile device, including a location history for the device. This history can be used by authorities to locate the first mobile user electronic device if it becomes involved in a crime or other emergency incident, and to provide details related to said crime or incident.

[0033] According to a further aspect of the invention there is provided an electronic security, investigation and surveillance system comprising:

at least a first mobile user electronic device ("mobile device") on which a mobile system software application is installable, said mobile device having a plurality of functionalities able to generate data, and said mobile system software application comprising code which is executable to record an historical record of said data generated by said functionalities of said mobile device over a limited period of time, said limited period advancing with time; and

means for transmitting to a remote location at least one electronic report comprising at least a portion of said historical record.

[0034] Details of individual integers of this system are mutatis mutandis as hereinbefore described.

[0035] According to a further aspect of the invention there is provided a mobile electronic device having

a plurality of functionalities able to generate data; and

at least one storage medium loaded with a system software application which is executable to record an historical record of said data over a limited period of time, said limited period advancing with time.

[0036] Details of individual integers of the mobile electronic device are mutatis mutandis as hereinbefore described. [0037] According to a further aspect of the invention there is provided a method of carrying out security, investigation and surveillance electronically, the method comprising:

installing a mobile system software application on a first mobile user electronic device ("mobile device");

installing a control centre system software application on a first control centre electronic device ("backend"), the backend being able to communicate with the mobile device via a communication means;

registering a user of said mobile device and obtaining permission from said user to access, record and store data generated by a plurality of functionalities of the mobile device;

accessing and recording data generated by said functionalities of the mobile device by means of the installable mobile system software application, and storing said recorded data on the mobile device as an historical record;

transmitting from the backend to the mobile device a request for transmittal of at least a portion of said historical record;

in response to said request, transmitting to the backend an electronic data report comprising at least a portion of said historical record, said transmission being performed by means of the installable mobile system software application on the mobile device; and

by means of the control centre system software application on the backend, receiving and storing said electronic report transmitted from the mobile device;

characterised in that the method includes a step of periodically transmitting pulses from the mobile device to the backend, for the purpose of confirming an active ("on") state of the mobile device.

[0038] The step of recording the data generated by the functionalities on the mobile device preferably comprises recording such data over a predetermined, limited, and advancing period of time, thereby to generate said historical record.

[0039] The method preferably includes erasing earliest data within said historical record on an advancing time basis, thereby to provide that the historical record of data remains limited to a predetermined (albeit advancing) period of time during which said mobile device is operable, and/or a predetermined memory usage or storage capacity of the mobile device.

[0040] The method typically includes a step of tracking locations and/or movements of the mobile device and accessing data generated by at least one of its functionalities, by interrogation of the historical record, said interrogation being carried out by the installable control centre system software application on the backend.

[0041 ] The data which is accessed and recorded may include:

data generated by a plurality of data gathering means associated with said plurality of functionalities of said mobile device; said data gathering means being selected from the group consisting of camera systems, microphone systems, cellular communication systems, in-App messaging systems, telephonic and message storage systems, loggers, internal clocks, hardware identification means, and electronic location means; and

data generated by software applications installable on said mobile device, said data being selected from the group consisting of: photographs, video recordings, audio recordings, in-App messages, mobile text messages, dialed and received telephone numbers, operational logs and call logs, system time, hardware identification data, and location data including breadcrumb trails reflecting periodic locations of said mobile device.

[0042] The step of recording of the data may be conducted at spaced time intervals according to a time schedule.

[0043] The method may further include a step of employing the backend to access and remotely control the mobile device and/or its hardware to perform at least one action selected from the group consisting of: Activate location services; Switch GPS on; Get location; View location history; Use camera; Take front photograph; Take rear photograph; Set taking of front or rear photograph on Screen Unlock; Set taking of front or rear photograph on Call; Set taking of front or rear photograph on Attempt to Power mobile device on or off; View photographs taken on Screen Unlock, Call or Attempt to Power; Use video recorder; Take front video; Take rear video; Use sound recorder; Record audio; Record telephone calls; Call mobile device; Ring alarm; Vibrate; Activate flashlight; Activate Bluetooth; Send or receive notifications associated with applications on mobile device; Send or receive text messages from and to mobile device; Lock mobile device; Prevent mobile device from sleeping; Fetch telephone log; Fetch SIM details; Access file system of mobile device; View requested files; Delete data, files and/or media on mobile device; Send commands to mobile device; Save and upload data, files and/or media from mobile device to backend.

A proprietary name proposed for the mobile system App of the invention is "MDDR", an acronym for Mobile Device Data Recorder.

Brief Description of Drawings

[0044] The invention will now be described in more detail by way of non-limiting example, with reference to the accompanying diagrammatic drawings and illustrations wherein:

Fig.1

[0045] [Fig.1 ] shows a schematic overview of an electronic security, investigation and surveillance system according to an embodiment of the invention.

Fig.2

[0046] [Fig.2] shows a sample screen from a separate application ("TrackBox") which may be used to prompt a user to install the MDDR App on their mobile device. The separate TrackBox application can also be used to obtain various permissions required for operation of the MDDR App. After installation, the MDDR App typically runs in the background as a hidden service without user interface.

Fig.3

[0047] [Fig.3] shows an example of a backend interface for the electronic security, investigation and surveillance system, illustrating a breadcrumb trail uploaded from an historical record compiled by an MDDR enabled mobile device.

Fig.4

[0048] [Fig.4] shows an example of a backend interface of the electronic security, investigation and surveillance system, the interface providing a series of slider bars for enabling remote control of various functionalities on the MDDR enabled mobile device. Fig.5

[0049] [Fig.5] shows an example of a backend interface of the electronic security, investigation and surveillance system, the interface providing means for remotely accessing the file system of the MDDR enabled mobile device.

Detailed Description of Embodiments

[0050] Referring to the drawings, an electronic security, investigation and surveillance system 10, according to an embodiment of the invention, is shown in Figure 1 .

[0051 ] The system 10 can be used to remotely track and control a mobile electronic device such as a smartphone, and to gather evidence provided by said device, for example in the event a crime is committed or an emergency incident occurs in the vicinity of the device. The functions of the system 10 and its method of use may thus include the provision of information to assist authorities when a crime has been committed or an emergency incident has occurred.

[0052] The system 10 includes at least a first mobile user electronic device 12 ("mobile device"), on which a mobile electronic system software application (the MDDR App) is installable.

[0053] The mobile device 12 may, for example, comprise a mobile phone, smartphone, tablet, notepad computing device, laptop computing device, wearable electronic device such as a smart watch, or the like.

[0054] The mobile system App of the present invention comprises software which may be installed and stored on the mobile device 12. The App comprises code which is executable to record data and facilitate remote device management. It enables data and media to be remotely retrieved from such a device over a communication network, such as a data network, to facilitate the gathering of intelligence and evidence to capture, apprehend and prosecute any offenders who may have been involved in a crime, and also to enable the device itself to be recovered.

[0055] The principle of operation of the system 10 is similar to that of the so-called "black box" systems found on aircraft. Aviation black box systems typically combine a Flight Data Recorder and Cockpit Voice Recorder, and are used to facilitate the investigation of aviation accidents and incidents after the fact. Aviation black boxes are able to record input parameters (e.g. aircraft control instructions) and output parameters (e.g. flight sensors). They constantly update and record data, voice and other parameters for a predetermined and continuously advancing amount of past time, creating a "spooling" or "rolling" historical recording. (Unlike in the case of the present invention, however, aviation black boxes which are currently in service do not provide for the transmission of recorded data back to remote control centres on a real-time basis or on demand.)

[0056] The system 10 further includes at least a first control centre electronic device ("backend") 14, on which a control centre system software application is installable. This control centre software application is able to communicate with the mobile device 12 by a communication means or network 16.

[0057] The term "control centre device" or backend is intended to be interpreted broadly herein. It is not intended to be limited only to localised physical hardware, such as servers, in a control centre. Thus, the control centre device 14 may comprise systems selected from a broad array of extant technologies, including cloud-based arrangements.

[0058] Thus, in a preferred embodiment of the invention the control centre "device" comprises a cloud-based network, interface and database arrangement, and the backend is operated by means of a web-based administration panel and interface.

[0059] Similarly, the communication network 16 may include a plurality of computing devices which may form part of a cloud computing arrangement. Such an arrangement may include remote computer servers, databases, and software networks. By way of example, in one such embodiment the backend processing may be carried out online via a secure MySQL/PHP server accessed and controlled by a Bootstrap/PHP Script framework residing within the cloud, i.e. in the communication network 16, rather than by means of software installed on any localised items of hardware such as servers or desktop computers. In such cloud- based embodiments, administrators will be able to perform the actions described herein from and through the cloud. [0060] It follows from this, that the depiction of the control centre "device" 14 in Figure 1 is schematic only and does not imply any limitation to localised physical hardware items or configurations at the backend. Physical hardware is not excluded from the scope of the invention, however, and may include computer servers and database network systems; desktop computing devices and PCs; as well as mobile electronic device such as laptop computing devices, tablets, notepad computing devices and the like.

[0061 ] Turning now to the MDDR App, this is typically configured so that it can establish a communication link, via the communication network 16, with the installable system software application on the control centre device or backend 14.

[0062] The communication network 16 of the invention may thus include at least one electronic communication means such as, for example, a mobile or cellular telephone communication network, GPRS, 3G, 4G, LTE, 5G, or DSL broadband Internet connection such as ADSL, Wi-Fi, a virtual private network (VPN), or the like. It will be appreciated by those skilled in the art, that the aforegoing list is illustrative not exhaustive, and that future wireless communication means and protocols, whether cellular or otherwise, are not excluded for use and application by and in the system of the present invention.

[0063] The functionality of the system 10 is facilitated by its two main components, namely (i) the MDDR App installed on the mobile device 12, and (ii) the control centre system software application installed on the control centre device or backend 14. The control centre device 14 sends and receives data and commands from or to the mobile device App. This may be carried out over the phone or data network using parameters defined by the device operating system (OS) which may, for example, be Android, iOS Apple, Blackberry, Windows, or the like.

[0064] A mechanism can be provided for making users aware of the MDDR App and for prompting them to install the App on their mobile devices.

[0065] A separate software application can be used to this end. One such proprietary application is the "TrackBox" application, which is made available by the organization SA Community Action Network (SA CAN). As shown in Figure 2, the TrackBox application can provide an interface for facilitating installation of the MDDR App.

[0066] In preparation for the installation of the MDDR App on the mobile device 12, the user 18 is required to set permissions. This step may be mediated by way of the separate application mentioned above, e.g. the TrackBox application. These permissions thereafter enable the system to activate and control various functionalities on the mobile device and to access and record data generated by the functionalities on the mobile device 12. This recording of the data is storable on the mobile device 12 as an historical record which may take the form of one or more electronic reports or packets of electronic data which can be uploaded to the control centre device or backend 14 as long as the mobile device 12 is switched on.

[0067] Thus, at the time of installation of the MDDR App, the user 18 authorises and gives permissions for a selection of the functionalities of the mobile device 12 to be accessed and continuously or intermittently recorded and stored by the App. This selection may include functions performed by the device's hardware such as, for example, its camera systems, microphone systems, cellular communication hardware systems, in-App messaging systems, telephonic and message storage systems, loggers, internal clocks, hardware identification means, and electronic location means (for example GPS and/or LBS).

[0068] Examples of specific permissions which the user 18 must typically select and accept so that they can be activated within the system mobile App, are the following: a. Permission to recorded data and media, for example: Location recordings;

Internal and atomic time recordings; Photographic recordings; Video recordings; Audio recordings; recordings of telephone number log; Recordings of SMS messages sent and received;

b. Permission to access hardware features and functionalities, for example: Global Positioning System (GPS) recorder; Location Based Services (LBS) recorder; Internal clock; Camera (front and rear); Sound recorder or microphone; Device interaction controls (for example when a user swipes to unlock a phone or taps to open a message);

c. Permission to delete data and media; and d. Permission to upload and share data, either automatically according to a schedule and/or in response to requests from the control centre backend (provided an Unlock Process has been successfully completed).

[0069] The data and media which are obtained and recorded as the historical record may thus include photographs, video recordings, audio recordings, in-App messages, mobile text messages (for example SMS), dialled and received telephone numbers, operational logs and call logs, system time, hardware identification data, and location data (for example GPS and/or LBS co-ordinates), including breadcrumb trails reflecting periodic locations of said mobile device.

[0070] The functionalities selected for activation and recording may also include software applications installed on the mobile device. Therefore, the data and media making up the historical record may further include data generated by such applications.

[0071 ] A "rolling history" of the surrounding vicinity of a smartphone, as well as its operation and location, can be maintained in this way. This can then be reviewed for evidence in the event that a crime or emergency takes place which involves the smartphone's user.

[0072] Once the system mobile App is installed on device 12, the system 10 also has access to the current details of the mobile device 12 such as, for example, the type of mobile or smartphone, the phone's IMEI number, the mobile or smartphone number, the name of the network provider and the phone's SIM card details.

[0073] Note: Not all the functionalities mentioned in this specification may be accessible and usable across all operating systems (OS). For example retrieving the IMEI number of a mobile device is becoming more difficult in newer versions of Android and iOS. It will be understood by one skilled in the art that the capabilities of systems according to the present invention will need to be limited and tailored on an OS-by-OS basis.

[0074] Data and media that are recorded by the functionalities which the user 18 has authorised are stored on the mobile device 12. [0075] Preferably the user of the mobile device is not permitted to change any settings on the App, that is, the settings are pre-configured and require no input from the user. This is to ensure efficacy, safety and reliability of the App and system.

[0076] In less preferred embodiments of the invention, however, certain restricted settings may be made adjustable by the user. For example, an embodiment is conceivable in which the App permits the user to adjust the interval at which breadcrumb trail locations are recorded (in order to save battery power). Such capacities for user adjustment may impact the safe use of the system, however, and are therefore discouraged.

[0077] Storing of the historical record is initiated when the system mobile App is installed on the mobile device, and continues for as long as the mobile device 12 is switched on and operating. Typically a limit is set for the period or memory usage and/or storage capacity of the stored historical record, so that the record covers a set time period extending back from the system time, or occupies a limited amount of memory on the device, with earliest parts of the record being deleted as said limit is reached. This takes place in an ongoing fashion so that the period covered by the historical record advances with time in the fashion of aviation "black box" systems. (It is from this concept of an advancing, limited recording, that the term "rolling history", as used in this specification, is derived.)

[0078] In certain embodiments of the invention, the stored historical record comprises a plurality of discrete electronic reports compiled periodically by interrogating the selected functionalities of the mobile device 12 at pre-set time intervals. In such cases, when said time or memory limits are reached, the earliest electronic reports are replaced by more recent electronic reports.

[0079] If the authorised user 18 of mobile device 12 finds himself or herself in an emergency or crime situation, the system mobile App installed on the mobile device 12 continues to gather and record information without any further action being required from the user 18. Unlike the case with certain prior art systems, it is not necessary for the authorised user 18 to press any button(s) to start recording the history, since the historical record is already in place and is being added to on an ongoing basis. The historical record is thus constantly and automatically being updated whilst the phone is on, and history extending back beyond a predetermined, limited period (or memory limit) is being deleted in an ongoing fashion. The limited period, may, for example, comprise the last hour during which the phone was operating.

[0080] The control centre device 14 can be used to instruct the mobile device 12 to upload this historical record to the control centre device 14 via communication network 16, by means of one or more electronic reports which the control centre device 14 is able to receive and store. The control centre device 14 is able to use this historical record to provide evidence to an operator or investigator 20, and/or to locate the position of the mobile device 12 or track its movements over a period of time.

[0081 ] Figure 3 illustrates an example of a backend GUI which can be used to track the location of an MDDR enabled mobile device, and or to view a previously stored breadcrumb trail stored in the historical record that was previously generated and maintained by the MDDR App.

[0082] It will be understood that this historical record and the location history can be used by authorities to locate the mobile device 12 involved in a crime or emergency incident, and to obtain related evidence and details.

[0083]

[0084] An important feature of the invention is its capability to access, initiate, control and terminate the various functionalities of the mobile device remotely from the backend. This feature would typically only be implemented in the event that the control centre receives notification from the App that an emergency or crime has taken place.

[0085] The backend may be used to remotely to access and control the user's mobile device functionalities. Figure 4 shows an example of a backend GUI used for this purpose.

[0086] The remotely controllable functionalities may be those listed earlier in this specification, for example, camera systems, microphone systems, cellular communication hardware systems, in-App messaging systems, telephonic and message storage systems, loggers, internal clocks, hardware identification means, and electronic location means (for example GPS and/or LBS). [0087] Requests for action can be sent from the backend to the mobile device as data packets or as in-App notifications. These may be used to initiate pre-defined actions on the mobile device.

[0088] For example, the backend may be used to send information to the App to instruct an individual user's smartphone to:

a. Retrieve data and media saved by the software on the device. Examples of such data and media include: Fetch phone log; Fetch SIM details; Access device file system (See Figure 5); View requested files; View screen unlock photographs; and/or:

b. Access device hardware features to generate data and media, e.g.: Switch GPS on; View device GPS history; Activate Bluetooth; Use camera; Use video recorder; Use sound recorder or microphone; Send commands to the device, for example App notifications; Delete data; Lock device.

[0089] A more comprehensive list of the actions which may be instructed by the backend can be found earlier in this specification.

[0090] Thus, the system mobile App installed on mobile device 12 and the control centre system software application installed on the control centre device 14 work together to enable data to be extracted from the mobile device 12 to the server and also to send commands from the server to the mobile device 12.

[0091 ] The system can be used to track the recent location of the mobile device 12 (from the historical record) and also to determine the real-time location of the mobile device 12 by switching on the GPS of the mobile device 12 and sharing this information with the backend server near-instantly.

[0092] The system mobile App can send photographs, video and audio from the mobile device 12 to the server. This can be from the media stored on the mobile device 12 programmatically as well as in response to specific actions performed on the mobile device 12. For example, the App may be configured so that as soon as the mobile device 12 is switched on it immediately takes a photograph and keeps doing so at periodic intervals. It may also be set so that when a user swipes to unlock the mobile device 12, a photograph from the front-facing (user-facing) camera on the device will be taken. In the instance of a stolen phone this could capture the image of an illicit user without the illicit user being aware thereof, and this image could then be uploaded to the server via the communication network 16.

[0093] The data received from device 12 by the server may then be interrogated and analysed by at least one operator or investigator 20 in the control centre, in order to decide upon an appropriate response. Thereafter the response may be co-ordinated and monitored until the final determination of the matter.

[0094] Various mechanisms can be used to alert the control centre that an emergency or crime is underway such as, for example, the pressing of a user interface button on the aforementioned TrackBox application, or an emergency phone call placed to the police by the victim or a third party, or by way of an alarm of other security response.

[0095] The type of data that is recorded by the MDDR App is of a very personal nature and for this reason it is critical to ensure that the data retrieved remains secure. Operators at the control centre will be obliged to go through a meticulous process to ensure that access to the data is given only to strictly authorised personnel. In the South African context, by way of example, such access could be given to an Agent of the Community Action Network (SA CAN) Violent Crimes & Technology Support (VCAT), and to a National Duty Officer of SA CAN.

[0096] A 6-step Unlock Process is proposed which must be followed step-by-step to achieve full unlock of the mobile device from the backend. Access is granted to the device for a fixed time-frame only before the full unlock process must be repeated. The process requires authorisation by the user of the mobile device or one of their nominated representatives. It is important to note that at no time will the data be available to a user's nominated representatives or to the general public.

[0097] The steps are as follows:

1 . An emergency call is initiated by a customer (user) or one of their nominated representatives to the SA CAN call centre.

2. The SA CAN call centre VCAT Agent retrieves a list of the victim's emergency contacts and calls each one until they reach one.

3. While on the line they ask if the contact is willing to authorise the unlocking of the MDDR App on the victim's phone for high level tracking and data retrieval. 4. If they agree the VCAT Agent initiates the sending of a One Time Pin (OTP) to the emergency contact and to the SA CAN National Duty Officer.

5. While on the phone, the VCAT Agent gets from the emergency contact the OTP which was sent to them, and enters it into the system. The Agent also gets and enters the other authorization OTP from National Duty Officer.

6. After entering both OTPs, a case is opened and the VCAT Agent can unlock the MDDR App on the phone and view live and historically recorded data.

[0098] Once the control centre has been alerted and the Unlock Process has been successfully completed, the backend can immediately be instructed to begin remotely interrogating and/or controlling the mobile device 12.

[0099] Photographs, bread crumb location trail information, and other data and media will continue to be uploaded to the server for the selected set period of time from the past, as well as in real-time, for as long as the device is on.

[0100] An important feature is that the App is configured to cause the mobile device 12 to "pulse" periodically in order to confirm the operable status of the mobile device 12. Even in the event of the mobile device 12 being switched off and only being switched on again at a much later date, for example after three months, the mobile device 12 will again begin pulsing (i.e. transmitting information periodically and automatically) as soon as it has been switched on again. These pulses may be detected by the control centre via the backend. By way of example, such pulsing can be preset to take place every 30 seconds, although it will be appreciated that other periods can also be suitable and fall equally within the scope of the invention.

[0101 ] The following is a hypothetical example of the use of the MDDR system. If a criminal attacks a victim, steals their mobile device 12, switches it off and then takes the device home, then whenever it is switched on again the device 12 will immediately begin to transmit information (pulses) to alert the backend server that it has now been switched on again. The control centre will thus be alerted to the fact that the mobile device 12 has been switched on, and can then remotely access and control the device. A history can then be accessed from the mobile device 12, going back for a period of time such as, for example, the last hour during which the device was on and operating before it was switched off (i.e. a history for the hour preceding the time at which it was switched off subsequent to the commission of the crime). [0102] In preferred embodiments of the invention, the App also provides means for invoking a "False Off" condition of the mobile device. This is a feature which, when a user or other person turns off a phone or other mobile device, puts the device into a low energy state rather than shutting it down completely, thereby creating an illusion that the mobile device has been switched off. The low energy state is similar to Airplane mode, aeroplane mode, flight mode, offline mode, or standalone mode. If users enable this feature or it is enabled from the backend, it can prevent criminals from turning a phone off entirely whilst creating a misperception in their minds that they have indeed turned it off. This feature may thus cause criminals to believe that they have switched a phone off when in fact it remains on. The False Off feature can rely upon a setting which is available on many smartphones, portable computers, and other electronic devices that, when activated, suspends radio-frequency signal transmission by the device, thereby disabling Bluetooth, GPS, telephony, and WiFi. Sensory outputs from the phone, such as screen, audio and haptic (vibrational) outputs can similarly be halted. False Off continues to allow actions to be recorded whilst permitting communications and instructions from the backend to be received and processed by the mobile device when requested.

[0103] As a further security measure the mobile device 12 may be remotely wiped or locked by the server to prevent illicit users from effectively using the device.

Advantageous Effects of Invention

[0104] .An important advantage of the present invention lies in the fact that the App records a "rolling history" of data and media on the phone. Pre-existing systems for remote control of mobile devices have typically facilitated remote control in real-time but do not provide access to a broad-spectrum of pre-recorded data and media.

[0105] An advantage for security which the mobile App provides is that, once installed and activated on the mobile device 12 by the user 18, it operates in a hidden manner and will continue to gather information and to record this information in the historical record without any further action being required from the owner of the mobile device 12. In this sense the App is not interactive. At any given time after the initial installation and activation, the App has already been recording a predetermined period of history in an ongoing, "rolling" or "spooling" manner. Provided the Unlock Process is followed and the mobile device 12 is switched on and in range, the data history recorded by the App can be accessed by the software of the backend server at any time by means of an instruction communicated from the server to the mobile device 12, whereby the device 12 is called upon to transmit its history or a portion of its history to the server.

[0106] A further advantage of the system 10 is that the App and the historical record are installed on the mobile device 12's internal memory, hard drive and/or SD card, so that the App remains active even if the SIM card for the device is removed.

[0107] Yet a further advantage of the system is that only minimal transmission of data is required from the mobile device 12 under normal operating conditions (history recordal conditions). During normal day-to-day operation, data transmission is only required for the periodic pulsing. Demand for significant data transmission only occurs if and when the mobile device 12 is instructed by the backend server to upload its historical record or real-time data and media in the event of a crime or emergency. Otherwise the historical record is simply stored until needed.

[0108] A further advantage lies in the fact that the system can leverage a wide spectrum of communication technologies, whereas some prior art systems for tracing mobile phones have often had to rely on cellphone masts only. The system of the present invention can harness additional routes and modes, such as, for example, LBS, WiFi and other types of internet access, Google accounts, etc.

[0109] The system provides an enhanced level of security for mobile device users and can assist authorities in surveillance and investigation activities following the commission of crimes or the occurrence of emergency incidents. The system is typically intended for high level investigation and life-saving intervention purposes. By accessing information from mobile device data recording, the collection of such information can assist and facilitate the investigation of, inter alia, murder; rape; armed house robbery; armed business robbery; hijacking; hostage location; missing persons; serious and violent crime; and cell phone recovery.

Claims

[Claim 1 ] An electronic security, investigation and surveillance system [10] comprising:

at least a first mobile user electronic device ("mobile device") [12] on which a mobile system software application is installable, said mobile device having (i) a plurality of functionalities capable of generating data, and (ii) wireless communication means [16]; and

at least a first control centre electronic device ("backend") [14] on which a control centre system software application is installable, said backend being able to communicate with the mobile device via said communication means, thereby to access and control said mobile device and to receive electronic data reports therefrom;

characterised in that said mobile system software application comprises code which is executable by the mobile device to record an historical record of at least a portion of said data generated by at least one of said functionalities of said mobile device over a limited period of time, said limited period advancing with time; and to transmit electronic data reports to said backend via said communication means, each such electronic data report comprising at least a portion of said advancing historical record.

[Claim 2] A system as claimed in Claim 1 , wherein the mobile system software application of said mobile device comprises means for erasing earliest data within said historical record on an advancing time basis, thereby to provide that the historical record of data remains limited to a predetermined period of time during which said mobile device is operable, and/or a predetermined memory usage of the mobile device.

[Claim 3] A system as claimed in Claim 1 or Claim 2, wherein the data recordable by the installable mobile system software application comprises data generated by a plurality of data gathering means associated with said plurality of functionalities of said mobile device; said data gathering means being selected from the group consisting of camera systems, microphone systems, cellular communication hardware systems, in-App messaging systems, telephonic and message storage systems, loggers, internal clocks, hardware identification means, and electronic location means.

[Claim 4] A system as claimed in any one of Claims 1 to 3 inclusive, wherein the data of the historical record is selected from the group consisting of photographs, video recordings, audio recordings, in-App messages, mobile text messages, dialed and received telephone numbers, operational logs and call logs, system time, hardware identification data, and location data including breadcrumb trails reflecting periodic locations of said mobile device.

[Claim 5] A system as claimed in any one of Claims 1 to 4 inclusive, wherein the mobile system software application provides means for invoking a "False Off" condition of said mobile device, being a low energy state of operation thereof wherein output of sensory data by the mobile device is suspended whilst the following capabilities of the mobile device remain activated:

a. a capability for recording data generated by at least one of said functionalities of said mobile device; and

b. a capability for receiving communications and control instructions from said backend.

[Claim 6] A system as claimed in any one of Claims 1 to 5 inclusive, which further includes pulsing means provided within said mobile device and controllable by said mobile system software application, for periodically transmitting pulses to the backend via said wireless communication means, said pulses being transmissible for the purpose of confirming an active ("on") state of said mobile device; and wherein the backend is able to receive notification of said pulses or signals from said mobile device.

[Claim 7] A system as claimed in any one of Claims 1 to 6 inclusive, wherein said mobile system software application installable on the mobile device is configurable to record the data generated by the functionalities at spaced time intervals according to a predetermined time schedule.

[Claim 8] A system as claimed in any one of Claims 1 to 7 inclusive, wherein said mobile system software application installable on the mobile device is configurable to upload an electronic data report to the backend when an instruction to do so is received from the backend, said report comprising at least a portion of said historical record.

[Claim 9] A system as claimed in any one of Claims 1 to 8 inclusive, wherein said mobile system software application installable on the mobile device is configurable to upload periodic electronic data reports to the backend, said reports comprising at least a portion of said historical record.

[Claim 10] A system as claimed in any one of Claims 1 to 9 inclusive, wherein said control centre system software application and said mobile system software application are configurable to cooperate with each other thereby to enable access to and remote control of the mobile device and/or its hardware, in order to perform actions selected from the group consisting of: Activate location services; Switch GPS on; Get location; View location history; Use camera; Take front photograph; Take rear photograph; Set taking of front or rear photograph on Screen Unlock; Set taking of front or rear photograph on Call; Set taking of front or rear photograph on Attempt to Power mobile device on or off; View photographs taken on Screen Unlock, Call, or Attempt to Power; Use video recorder; Take front video; Take rear video; Use sound recorder; Record audio; Record telephone calls; Call mobile device; Ring alarm; Vibrate; Activate flashlight; Activate Bluetooth; Send or receive notifications associated with applications on mobile device; Send or receive text messages from and to mobile device; Lock mobile device; Prevent mobile device from sleeping; Fetch telephone log; Fetch SIM details; Access file system of mobile device; View requested files; Delete data, files and/or media on mobile device; Send commands to mobile device; Save and upload data, files and/or media from mobile device to backend.

[Claim 1 1 ] According to a further aspect of the invention there is provided an electronic security, investigation and surveillance system [10] comprising:

at least a first mobile user electronic device ("mobile device") [12] on which a mobile system software application is installable, said mobile device having a plurality of functionalities able to generate data, and said mobile system software application comprising code which is executable to record an historical record of said data generated by said functionalities of said mobile device over a limited period of time, said limited period advancing with time; and

[Claim 12] A mobile electronic device having

a plurality of functionalities able to generate data; and

[Claim 13] A method of carrying out security, investigation and surveillance electronically, the method comprising:

installing a mobile system software application on a first mobile user electronic device ("mobile device") [12];

installing a control centre system software application on a first control centre electronic device ("backend") [14], the backend being able to communicate with the mobile device via a communication means [16];

registering a user [18] of said mobile device and obtaining permission from said user to access, record and store data generated by a plurality of functionalities of the mobile device;

accessing and recording data generated by said functionalities of the mobile device by means of the installable mobile system software application, and storing said recorded data on the mobile device as an historical record; transmitting from the backend to the mobile device a request for transmittal of at least a portion of said historical record;

in response to said request, transmitting to the backend an electronic data report comprising at least a portion of said historical record, said transmission being performed by means of the installable mobile system software application on the mobile device; and by means of the control centre system software application on the backend, receiving and storing said electronic report transmitted from the mobile device;

[Claim 14] A method as claimed in Claim 13, wherein the step of recording the data generated by the functionalities on the mobile device comprises recording such data over a predetermined, limited, and advancing period of time, thereby to generate said historical record.

[Claim 15] A method of carrying out security, investigation and surveillance electronically, as claimed in Claim 13 or Claim 14, which includes erasing earliest data within said historical record on an advancing time basis, thereby to provide that the historical record of data remains limited to a predetermined period of time during which said mobile device is operable, and/or a predetermined memory usage of the mobile device.

[Claim 16] A method of carrying out security, investigation and surveillance electronically, as claimed in any one of Claims 13 to 15 inclusive, which includes tracking locations and/or movements of the mobile device and accessing data generated by at least one of its functionalities, by interrogation of said historical record carried out by the installable control centre system software application on the backend.

[Claim 17] A method as claimed in any one of Claims 13 to 16 inclusive, wherein the data which is accessed and recorded includes:

a. data generated by a plurality of data gathering means associated with said plurality of functionalities of said mobile device; said data gathering means being selected from the group consisting of camera systems, microphone systems, cellular communication systems, in-App messaging systems, telephonic and message storage systems, loggers, internal clocks, hardware identification means, and electronic location means; and b. data generated by software applications installable on said mobile device, said data being selected from the group consisting of: photographs, video recordings, audio recordings, in-App messages, mobile text messages, dialed and received telephone numbers, operational logs and call logs, system time, hardware identification data, and location data including breadcrumb trails reflecting periodic locations of said mobile device.

[Claim 18] A method as claimed in any one of Claims 13 to 17 inclusive, in which the recording of the data is conducted at spaced time intervals according to a time schedule.

[Claim 19] A method as claimed in any one of Claims 13 to 18 inclusive, which further includes a step of accessing and remotely controlling the mobile device and/or its hardware to perform at least one action selected from the group consisting of: Activate location services; Switch GPS on; Get location; View location history; Use camera; Take front photograph; Take rear photograph; Set taking of front or rear photograph on Screen Unlock; Set taking of front or rear photograph on Call; Set taking of front or rear photograph on Attempt to Power mobile device on or off; View photographs taken on Screen Unlock, Call or Attempt to Power; Use video recorder; Take front video; Take rear video; Use sound recorder; Record audio; Record telephone calls; Call mobile device; Ring alarm; Vibrate; Activate flashlight; Activate Bluetooth; Send or receive notifications associated with applications on mobile device; Send or receive text messages from and to mobile device; Lock mobile device; Prevent mobile device from sleeping; Fetch telephone log; Fetch SIM details; Access file system of mobile device; View requested files; Delete data, files and/or media on mobile device; Send commands to mobile device; Save and upload data, files and/or media from mobile device to backend.

[Claim 20] An electronic security, investigation and surveillance system comprising any new and inventive integer or combination of integers, substantially as herein described.

[Claim 21 ] A system as specifically described herein with reference to, or as illustrated in, any one of the accompanying figures.

[Claim 22] A method of carrying out security, investigation and surveillance electronically, said method comprising any new and inventive integer or combination of integers, substantially as herein described.

[Claim 23] A method as specifically described herein with reference to, or as illustrated in, any one of the accompanying figures.