US20130311009A1 - Flight technical control management for an unmanned aerial vehicle - Google Patents
Flight technical control management for an unmanned aerial vehicle Download PDFInfo
- Publication number
- US20130311009A1 US20130311009A1 US13/932,623 US201313932623A US2013311009A1 US 20130311009 A1 US20130311009 A1 US 20130311009A1 US 201313932623 A US201313932623 A US 201313932623A US 2013311009 A1 US2013311009 A1 US 2013311009A1
- Authority
- US
- United States
- Prior art keywords
- processor
- aerial vehicle
- plan
- data
- mission plan
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims abstract description 43
- 238000012545 processing Methods 0.000 claims description 29
- 239000000446 fuel Substances 0.000 claims description 27
- 230000004044 response Effects 0.000 claims description 8
- 230000001133 acceleration Effects 0.000 claims description 5
- 230000005855 radiation Effects 0.000 claims description 2
- 239000000779 smoke Substances 0.000 claims description 2
- 239000000126 substance Substances 0.000 claims description 2
- 238000004891 communication Methods 0.000 abstract description 89
- 238000012549 training Methods 0.000 abstract description 43
- 230000003287 optical effect Effects 0.000 abstract description 30
- 230000037361 pathway Effects 0.000 description 37
- 230000036541 health Effects 0.000 description 27
- 208000033157 Hepatic cystic hamartoma Diseases 0.000 description 15
- 208000016457 liver mesenchymal hamartoma Diseases 0.000 description 15
- 238000007726 management method Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 13
- 230000008569 process Effects 0.000 description 13
- 238000012544 monitoring process Methods 0.000 description 12
- 230000006399 behavior Effects 0.000 description 10
- 238000013500 data storage Methods 0.000 description 9
- 238000012423 maintenance Methods 0.000 description 9
- 230000008859 change Effects 0.000 description 7
- 230000004913 activation Effects 0.000 description 5
- 238000011161 development Methods 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000012360 testing method Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 239000002828 fuel tank Substances 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000007704 transition Effects 0.000 description 3
- RZVHIXYEVGDQDX-UHFFFAOYSA-N 9,10-anthraquinone Chemical compound C1=CC=C2C(=O)C3=CC=CC=C3C(=O)C2=C1 RZVHIXYEVGDQDX-UHFFFAOYSA-N 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 238000002955 isolation Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 235000015842 Hesperis Nutrition 0.000 description 1
- 235000012633 Iberis amara Nutrition 0.000 description 1
- 238000012550 audit Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 239000000872 buffer Substances 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000008867 communication pathway Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 238000010304 firing Methods 0.000 description 1
- 235000013305 food Nutrition 0.000 description 1
- 229910052736 halogen Inorganic materials 0.000 description 1
- 150000002367 halogens Chemical class 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 238000013439 planning Methods 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000002459 sustained effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 238000012384 transportation and delivery Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/0011—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
- G05D1/0038—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64C—AEROPLANES; HELICOPTERS
- B64C19/00—Aircraft control not otherwise provided for
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/0055—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots with safety arrangements
- G05D1/0077—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots with safety arrangements using redundant signals or controls
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/0088—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/003—Flight plan management
- G08G5/0039—Modification of a flight plan
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/0047—Navigation or guidance aids for a single aircraft
- G08G5/006—Navigation or guidance aids for a single aircraft in accordance with predefined flight zones, e.g. to avoid prohibited zones
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/0047—Navigation or guidance aids for a single aircraft
- G08G5/0069—Navigation or guidance aids for a single aircraft specially adapted for an unmanned aircraft
Definitions
- This invention relates to the field of software architecture. More particularly, this invention relates to modular software architecture organized by layers and segments which can be applied to systems which contain multiple domains or functionality, such as unmanned aerial vehicles (UAVs).
- UAVs unmanned aerial vehicles
- UAVs The military, police, rescue, scientific, and commercial communities use unpiloted aircraft, such as UAVs.
- UAV unmanned device capable of controlled, sustained, and powered flight.
- a typical UAV consists of a propulsion device, such as an engine, a navigation system, one or more payload sensors, communication equipment, and possibly cargo.
- the sensors may provide information to a ground observer about the terrain the UAV overflies, such as video information about a lost hiker in a rescue application, information from laser and/or biological sensors about environmental conditions in a scientific or security application, or a combination of video, laser, biological and other sensors concerning battlefield conditions in a military application.
- the cargo may be munitions, food, medicine, and/or other goods depending on the mission of the UAV.
- the design of the UAV may change to integrate new and/or improved sensors, navigation systems, propulsion devices, and the like.
- UAV As the UAV is unmanned, computer software executing on one or more processors aboard the UAV partially or completely controls the UAV.
- the computer software may control the various functions performed by the UAV, perhaps with the aid of the ground observer.
- a first embodiment of the invention provides an aerial vehicle.
- the aerial vehicle includes a processing unit, data storage, and machine-language instructions.
- the machine-language instructions are stored in the data storage and are executable by the processing unit to perform functions.
- the functions include: (a) receiving a mission plan, which includes a flight plan, (b) validating the mission plan, (c) executing the mission plan by at least directing the aerial vehicle to travel along a flight plan of the mission plan, (d) determining a current location of the aerial vehicle is outside the flight plan, and (e) responsively executing a contingent flight plan.
- a second embodiment of the invention provides an aerial vehicle.
- the aerial vehicle includes a first redundant processing unit, a first data storage and first machine language instructions.
- the first redundant processing unit includes a first processor and a second processor.
- the first machine-language instructions are stored in the first data storage and executable by at least one processor of the first redundant processing unit to perform first functions.
- the first functions include: (a) receiving a mission plan that includes a flight plan and a contingency plan, (b) validating the mission plan, (c) executing the mission plan based on the flight plan, and (d) synchronizing the first processor and the second processor.
- a third embodiment of the invention provides a method for executing a mission plan.
- the mission plan is received at an aerial vehicle.
- the mission plan includes a flight plan, a sensor plan, a communication plan, a contingency flight plan, and a weapon plan.
- the mission plan is determined to be valid.
- a notification is sent indicating the mission plan is valid.
- the mission plan is loaded into one or more processors of the aerial vehicle. At least part of the mission plan is executed.
- FIG. 1 shows an example UAV, in accordance with embodiments of the invention
- FIG. 2 shows an example aerial vehicle control system, in accordance with embodiments of the invention
- FIG. 3 shows an example architecture for the example aerial vehicle control system, in accordance with embodiments of the invention
- FIG. 4 shows an example aerial vehicle control system with redundant components, in accordance with embodiments of the invention
- FIG. 4A shows an example block diagram of redundant FTCMs and VMCs, in accordance with embodiments of the invention
- FIG. 5 shows an example architecture for an aerial vehicle control system with redundant components, in accordance with embodiments of the invention
- FIG. 6 is a block diagram of an example computing device, in accordance with embodiments of the invention.
- FIG. 7 is a flowchart depicting an example method for executing a mission plan, in accordance with embodiments of the invention.
- the present invention includes methods and apparatus for controlling a UAV.
- the UAV may provide a networked situational awareness capability to a military unit, such as a platoon or a division.
- the UAV may secure areas and/or provide reconnaissance, surveillance, and target acquisition (RSTA).
- RSTA reconnaissance, surveillance, and target acquisition
- UAV control may reside both on board the aircraft and on the ground.
- UAV control may include a strategic or “command and mission execution” (CME) component and a tactical or “technical control manager” (TCM) component.
- CME command and mission execution
- TCM tactical or “technical control manager”
- the CME component provides high level control and may be shared between a ground CME (GCME) residing with ground control and an on-board or “flight” CME (FCME), residing on the UAV.
- GCME ground CME
- FCME on-board or “flight” CME
- the TCM component may include both ground and flight components or may just have a flight TCM (FTCM) component.
- FTCM flight TCM
- the FTCM may provide tactical control of the UAV while the FCME and GCME may provide strategic control.
- the GCME is the main controller for the air vehicle; it provides mission management (i.e., communication, sensor, and mission plan management) for the UAV via commands to the FCME and/or FTCM.
- the FTCM may process the commands directly or may pass the commands through to other vehicle components.
- the FTCM has the ability to support commands through critical and non-critical paths for message priority and security.
- the UAV may be equipped with sensors and cameras that provide real-time data to the ground control.
- the UAV may be equipped with weapons, such as rockets or bombs.
- Ground control may remotely launch the UAV's weapons in real time.
- the UAV may be configured to be carried by one or more platforms (e.g., vehicles) or persons (e.g., soldiers or police officers).
- the UAV may be carried by one or more dismounted persons in a protective transportation container that protects the system from natural and induced environments.
- the FTCM may provide a variety of services and interfaces within and external to the UAV, such as mission plan services, sensor management, and configuration utilities.
- the FTCM may enable loading of mission plans (e.g., flight plans, contingency flight plans, communication plans, rate commands, and/or sensor plans) from the ground control, and verify that a loaded mission plan is valid.
- a mission plan may include one or more flight plans, each with a list of one or more waypoints, timing requirements, sensor plans, and/or weapons plans.
- the waypoints and timing requirements may indicate where and when, respectively, the UAV should be to achieve a mission set forth by the mission plan.
- a sensor plan, communications plan, or a weapons plan may indicate how sensors, communication equipment, or weapons aboard the UAV, respectively, should be deployed during the mission.
- the FTCM may ensure compliance with the mission plan, by continuously verifying that the current location of the UAV is according to plan.
- the FTCM may issue commands to communicate with the ground control (e.g., the GCME) and/or other vehicles during the mission based on the communication plan.
- the FTCM may also monitor the performance and health of the UAV during the mission.
- the FTCM may provide information about the health of the UAV and/or components of the UAV to the GCME, perhaps as part of a health report.
- the FTCM may utilize navigational sensors to determine the current location, velocity and/or acceleration of the UAV.
- Vehicle management system (VMS) software and/or hardware may navigate the UAV.
- the VMS may manage navigation sensors and provide navigational data to the FTCM.
- VMS Vehicle management system
- the VMS and FTCM may share computer-hardware resources, such as one or more processors or memory, or may utilize separate computer-hardware resources.
- the FTCM and/or the VMS may have redundant processors; that is, the FTCM may execute software on one or more active or “primary” processors and have one or more “secondary” processors available to run FTCM software in case the primary processor(s) fail.
- redundant processors may be used as well.
- the FTCM may receive instructions to adhere to a new mission plan or to change portions of the current mission plan while in operation.
- the instructions and changes may be communicated from ground control via the GCME, to the FCME, and then to the FTCM.
- the FCME may provide instructions autonomously to the FTCM as well.
- the FTCM may issue commands to sensors and/or navigational systems (i.e., the VMS) to change sensor deployment and/or course in accordance with (now current) mission plan.
- Software developed for use aboard the UAV e.g., software components of the FTCM, the FCME, and the VMS
- Software developed for use by ground control may be designed according to a segmented and layered architecture that provides a framework for well-designed software that promotes loose coupling between “software entities”.
- Example software entities are software objects, modules, functions, subroutines, code, computer data, data objects, databases, and/or data structures.
- An example segmented and layered architecture for UAV development is disclosed in U.S. patent application Ser. No. 12/331,274 entitled “Modular Software Architecture for an Unmanned Aerial Vehicle” and filed on Dec. 9, 2008 (“the '274 Application”), which is incorporated by reference for all purposes.
- the division of different software and hardware components for strategic i.e., GCME/FCME), tactical (i.e., FTCM), and navigational control (i.e., VMS) provides several advantages.
- This division allows for concentration and specialization of resources within each area, as well as clear-cut responsibilities within each component.
- This division allows for well-defined interfaces between components, which allows for greater parallelism during software and hardware development.
- the well-defined interfaces provide isolation for data and control critical to the safety of the UAV.
- vehicle control, payload control, and communication control are separated, allowing for ready updating and fault isolation for each of the components and/or well-defined interfaces.
- software (or hardware) components may be replaced without affecting other components as long as the well-defined interfaces are enforced. The ability to replace components individually eases the process of updating components for maintenance, growth, and/or the addition of new technology.
- the herein-described invention may be applicable to other devices or vehicles as well, such as but not limited to unmanned ground vehicles (UGVs), ground vehicles, manned aerial vehicles, manned or unmanned naval vessels, and/or semi- or completely-automated machinery (e.g., some or all of the components in a factory).
- UUVs unmanned ground vehicles
- manned aerial vehicles manned or unmanned naval vessels
- semi- or completely-automated machinery e.g., some or all of the components in a factory.
- FIG. 1 shows an example UAV 100 , in accordance with embodiments of the invention.
- FIG. 1 shows the UAV 100 with an electrical system 110 , propulsion units 120 , 122 , and 124 , a flight management system 130 , a navigation system 140 , a data link system 150 with an antenna 152 , payload sensors 162 and 164 , a body 170 , and landing gear 172 .
- the electrical system 110 may include various electrical/electronic devices and equipment to provide and monitor the flow of electricity throughout the UAV 100 .
- One example set of devices are the lights 112 .
- Other example electrical/electronic devices and equipment include, but are not limited to, wires, cables, switches, lights, electrical devices (e.g. capacitors, inductors, diodes, transistors, etc.), light emitting diodes (LEDs), power devices (such as generators and/or batteries), electrical sensors, fuses, and/or circuit breakers.
- the electrical system 110 may also include a control panel as well for monitoring and controlling the electrical system 110 .
- the electrical system 110 may include other electrically-powered devices, such as (but not limited to) anti-collision lights and battery charging/monitoring circuitry.
- the propulsion units 120 , 122 , and 124 may provide power to move the UAV 100 .
- the propulsion units may include one or more engines, fans, pumps, rotors, belts, and/or propellers.
- One or more engine control units (ECUs) may control the propulsion units 120 , 122 , and 124 .
- ECUs engine control units
- an ECU may control fuel flow in an engine based on data received from various engine sensors, such as air and fuel sensors.
- the propulsion units 120 , 122 , and 124 may have one or more fuel tanks, one or more fuel pumps to provide the fuel from the fuel tank(s) to the propulsion units 120 , 122 , and 124 , and/or one or more fuel controllers.
- the propulsion units 120 , 122 , and 124 may also include one or more fuel sensors 126 to monitor fuel levels of the fuel tank(s).
- the flight management system 130 may provide flight planning, flight guidance, and flight controls functionality for the UAV 100 , akin to the control provided by a human pilot in a manned aircraft.
- the flight management system 130 may include flight control algorithms and/or servos (electro-mechanical devices) that manipulate various flight-control surfaces of the UAV 100 .
- servos electronic-mechanical devices
- one or more servos may control a rudder or aileron(s) of the UAV 100 .
- the flight management system may include a throttle control mechanism, instead or as well.
- the navigation system 140 may provide navigational data, including data about nearby aircraft, to the UAV 100 .
- the navigation system 140 may include location devices for the UAV 100 , such as, but not limited to, magnetometers, gyroscopes, lasers, Global Positioning System (GPS) receivers, altimeters, inertial navigation units, ground proximity sensors, and other navigation components.
- the location devices may include additional sensors to provide additional data about the environment for the UAV 100 , such as pressure sensors, thermometers, and/or other environment sensors.
- the data link system 150 may permit communication between the UAV 100 and other devices or vehicles.
- the data link system 150 may permit communication with other UAVs in use at the same time as the UAV 100 .
- the data link system 150 may permit communication with one or more ground control devices as well.
- the data link system 150 may use one or more wireless communication devices, such as an antenna 152 , for communication.
- the data link system 150 may use one or more wired communication devices, such as Ethernet cables, ports, and/or cards, perhaps while the UAV 100 is tethered to the ground.
- the data link system 150 may include one or more (ports for) removable and/or down-loadable storage devices.
- the removable and/or down-loadable storage devices may store data such as, but not limited to, telemetry and sensor data (e.g., video data, audio data, images, and/or collected data on sensor readings).
- the UAV 100 may be equipped with a payload including payload sensors 162 and 164 .
- the payload sensors 162 and 164 may include video sensors, such as cameras, laser designators, chemical sensors, biological sensors, smoke detectors, radiation detectors, electromagnetic wave detectors, and other payload sensors.
- the UAV 100 may be configured so that the payload sensors 162 and 164 may change between missions as well.
- the UAV 100 may have a body 170 and landing gear 172 .
- the shapes of the body 170 and/or landing gear 172 shown in FIG. 1 are examples only and may vary.
- the body 170 may have an aerodynamic shape, such as found in a body of a conventional manned aircraft.
- the landing gear 172 may or may not have controls, such as controls that allow the landing gear 172 to be retracted into the body 170 .
- FIG. 2 shows an example aerial vehicle control system 200 , in accordance with embodiments of the invention.
- the aerial vehicle control system 200 includes an aerial vehicle 210 (e.g., a UAV) and a ground control 270 .
- the aerial vehicle 210 includes a processor unit 220 with a port 240 , a vehicle management system (VMS) 250 , optical sensors 260 , a video unit 262 , and a UAV radio 264 .
- VMS vehicle management system
- the processor unit 220 may be configured to execute flight management software, such as but not limited to, a flight technical control manager (FTCM) 230 , a flight command and mission execution (CME) component 232 , a flight network software (FNS) component 234 , middleware software (MS/W) 236 , and a flight sensor manager (FSM) 238 .
- flight management software such as but not limited to, a flight technical control manager (FTCM) 230 , a flight command and mission execution (CME) component 232 , a flight network software (FNS) component 234 , middleware software (MS/W) 236 , and a flight sensor manager (FSM) 238 .
- FTCM flight technical control manager
- CME flight command and mission execution
- FNS flight network software
- MS/W middleware software
- FSM flight sensor manager
- the FSM 238 may provide the FTCM 230 with an interface to optical sensors 260 and/or video unit 262 .
- Data destined for the FTCM 230 through and to the optical sensors 260 and/or video unit 262 may be sent/received via the FSM 238 ; the data may include but is not limited to sensor control and status information.
- the FTCM 230 may receive critical vehicle control and status information from the VMS 250 via a native connection. Where possible, point-to-point communication provided by middleware software 236 may be used as a communication mechanism between the entities of aerial vehicle control system 200 .
- the FNS component 234 may provide an interface and/or support for network services, such as but not limited to, configuration/Reconfiguration of radios, status monitoring (perhaps in conjunction with middleware software 236 ), and network communication services, such as point-to-point connections, (priority-based) packet routing services (e.g., secure or critical path routing), quality-of-service (QoS) monitoring, and/or remote operation and/or supervision of the aerial vehicle.
- the FNS component 234 may enable establishment and maintenance of a number of pathways, such pathways described below with respect to FIG. 3 .
- Middleware software 236 generally may provide interfaces between application software and the operating system (e.g., as shown in FIGS. 3 and 5 ). With regard to FIG. 2 , the middleware software 236 may provide the FTCM 230 with interfaces for Communication Services (using a Network Software library), to perform checkpoints, obtain checkpoint status and general system services. Middleware software 236 may be able to prioritize one or more messages and thus set up communications pathways of differing priorities, such as described below with respect to FIG. 3 .
- the vehicle management system 250 may include a vehicle management controller (VMC) 252 , one or more navigation sensors 254 , training sensors 256 , and/or lights 258 .
- the navigation sensors 254 may include one or more sensors to provide data used in navigating the aerial vehicle 210 , but are not limited to, global positioning system (GPS) or other sensors equipped to receive and/or process navigation signals (perhaps received from one or more ground control devices, other UAVs, and/or satellites), dead-reckoning devices, (laser) rangefinders, inertial guidance sensors (e.g., gyroscopes), compasses, radar emitter and/or detectors, sound sensors, meteorological/environmental sensors (e.g., temperature and/or wind sensors), and/or image processing (e.g., feature and/or landmark detection) systems.
- GPS global positioning system
- inertial guidance sensors e.g., gyroscopes
- compasses radar emitter and/or detectors
- sound sensors e.
- the navigational sensors may provide data such as, but not limited to, a current location, velocity, and/or acceleration of the aerial vehicle 210 , location(s) of nearby vehicle(s), and/or atmospheric conditions.
- the training sensors 256 may include, but are not limited to, Multiple Integrated Laser Engagement System (MILES) sensor(s) and/or laser designator(s).
- the lights 258 may include one or more lights suitable for various purposes (i.e., anti-collision lights, ground illumination, illumination for video sensors) and may utilize any suitable lighting technology (e.g., incandescent bulbs, fluorescent lighting, light emitting diodes (LEDs), liquid crystal display (LCD), and halogen lighting).
- the optical sensors 260 may include sensors configured to observe various frequencies and types of light, such as but not limited to, visible light, infra-red, ultra-violet, X-rays, microwaves, laser light, and/or electromagnetic pulses.
- the optical sensors 260 may include one or more still cameras, video cameras, and/or specialized detectors/sensors (e.g., X-ray detector, EMP sensor, and/or laser detectors).
- the optical sensors 260 may also include one or more lasers, perhaps used in one or more laser range finders and/or for training purposes.
- One or more of the optical sensors 260 may be mounted in gimbal(s) that permit rotation along one or more degrees of freedom.
- the video unit 262 may be configured to receive video or other data from one or more sensors aboard the aerial vehicle 210 (e.g., optical sensors 260 ), process the video/other data, and then record and/or output the processed (or unprocessed) video/other data. Processing of video/other data may include, but is not limited to, use of compression, decompression, image processing, image enhancement, and/or location determination techniques.
- the video unit 262 may include one or more video storage devices (e.g., random access memory, flash memory, and disk storage) for storing compressed and/or uncompressed video and/or other data.
- the UAV radio 264 may be a radio transceiver configured to communicate with one or more other radios. In particular, the UAV radio 264 may be configured to communicate with one or more ground control radios, such as ground control radio 290 .
- the ground control 270 may include a controller 280 and the ground control radio 290 .
- the controller 280 may include software, such as, but not limited to, ground command and mission execution (GCME) software 282 , ground network software (GNS) 284 , and ground sensor management (GSM) software 286 .
- GCME ground command and mission execution
- GSM ground sensor management
- One or more computing devices, such as described below with respect to FIG. 6 , or other computing device(s)/CPUs may act as the controller 280 .
- the GCME 282 , GNS 284 , and GSM 286 may perform similar functions for the ground control 270 that the corresponding FCME 232 , FNS component 234 , and FSM 238 respectively perform for the aerial vehicle 210 .
- the FSM 238 may manage video stream data, perhaps by sending one or more video streams to the GSM 286 without interaction with the FTCM 230 .
- the ground control radio 290 may be a radio transceiver configured to communicate with one or more other radios, including the UAV radio 264 .
- the ground control 270 may use the ground control radio 290 to send commands and/or data to the aerial vehicle 210 .
- the ground control radio 290 may receive sensor and/or other data from the aerial vehicle 210 .
- the FTCM 230 may provide a number of controls and services for the aerial vehicle control system 200 .
- These controls and services may include, but are not limited to, integrated-platform mode (IPM) control, health/telemetry services, mission plan loading, maneuver constraint checks, contingency controls and execution monitoring, a training pass through, sensor controls and services (i.e., light controls, fuel consumption and monitoring via fuel sensors, support for sensor commands, and for sensor/vehicle field of view (FOV) tracking), platform commands and status information including vehicle handoff, and support for a render useless commands.
- IPM integrated-platform mode
- the FTCM 230 may provide pass-through functionality for the FCME 232 and/or GCME 282 ; that is, route commands from the FCME 232 and/or GCME 282 to the appropriate destinations and route data from the destinations to the FCME 232 and/or GCME 282 .
- Integrated-platform mode control may include changing modes as directed by the FCME 232 and/or GCME 282 , reporting mode information, verifying mode changes, and preventing invalid mode changes.
- the FTCM 230 may report current platform operating mode and current integrated-platform mode information to the GCME 282 .
- the FTCM 230 may prevent unintended integrated-platform mode transitions by validating any commands input to the aerial vehicle control system 200 , ensuring the commands are appropriate for the current integrated-platform mode, and disabling invalid integrated-platform mode transitions. For example, this prevents unintended activation of a maintenance command during operational flight.
- Example integrated-platform modes are: integrated-platform-safe mode, integrated-platform-maintenance mode, integrated-platform-training mode, and integrated-platform-operational mode.
- the integrated-platform-safe mode may accept a configuration command(s) as appropriate
- the integrated-platform-maintenance mode may accept configuration and maintenance command(s) as appropriate
- the integrated-platform-training mode may accept a subset of all operational commands as appropriate
- the integrated-platform- operational mode may accept all operational commands as appropriate.
- the FTCM 230 may monitor internal health, status and/or faults of the aerial vehicle control system 200 , including the FNS component 234 , middleware software 236 , FSM 238 and/or VMS 250 and report the internal health, status and/or faults to the FCME 232 and/or GCME 282 .
- the health report may include availability information, such as whether a component is active, inactive but available or out of service.
- the health report may include fault-related data such a fault count or rate information, debugging information, fault severity data.
- the health report may include availability information and/or fault-related data on a vehicle-wide or component-by-component basis.
- the health report may include logistical information about the vehicle, such as but not limited to fuel and weapon amounts, power levels, battery levels, and/or sensor-related logistical information. Differing health reports may include different amounts of data; for example, a “heartbeat” report may indicate the vehicle and/or major components are available, while a detailed health report may include detailed fault-related data and/or logistical information.
- the FTCM 230 may generate health reports for periodic communication (e.g., once a minute for a heartbeat report), upon request from the ground control, according to a mission plan/communication, and/or using other criteria.
- the FTCM 230 may support process monitoring and recovery techniques. Checkpoints provided by middleware software 236 may record information associated with a given process to ensure recall of states and status information of the given process if the given process fails. The FTCM 230 may user services provided by middleware software 236 to verify a heartbeat associated with other services, and report any problems to the FCME 232 and/or GCME 282 , perhaps as part of a health report. In addition, the FTCM 230 may send a heartbeat signal to the FCME 232 and/or GCME 282 to indicate the FTCM 230 is active.
- the FTCM 230 may send messages containing telemetry data that includes flight status, VMS status and pre-flight status.
- Sensors such as navigation sensors 254 and/or optical sensors 260 , may provide the telemetry data to the FTCM 230 .
- the telemetry-data messages may be part of a standard operational message set.
- the VMS 250 may provide the telemetry-data messages to the FTCM 230 .
- the telemetry-data messages may be in a standard format, such as the Joint Architecture for Unmanned Systems (JAUS) format.
- the telemetry-data messages also may not be in JAUS format, and thus may require translation to/from JAUS format.
- JAUS Joint Architecture for Unmanned Systems
- the FTCM 230 may manage the telemetry data and report it to the FCME 232 and/or GCME 282 .
- the FTCM 230 may capture engineering flight test data.
- An engineering ground station (not shown) may monitor the engineering flight test data.
- the engineering flight test data may include modes and states of the aerial vehicle 210 , mission plan monitoring data, and other necessary FTCM-related functionality data. Capture and monitoring of engineering flight test data may support debugging and system characterization during development and may be removed either during a development cycle or of the aerial vehicle 210 or upon final delivery of the aerial vehicle 210 .
- the FTCM 230 may enable the aerial vehicle 210 to be flown either manually (e.g., as instructed by the ground control 270 ) or autonomously. During either manual or autonomous flight, the FTCM 230 may support maneuver constraints of a flight plan. The FTCM 230 may constantly monitor the aerial vehicle 210 to ensure the aerial vehicle 210 remains within current airspace constraints. The FCME 232 and/or GCME 282 may provide critical path geometric flight boundary constraints as part of the flight plan to the FTCM 230 . The FTCM 230 may receive incremental updates to the mission plan (including the flight plan) during mission execution. The FTCM 230 may validate incoming constraints, determine which incoming constraints are acceptable or invalid and/or incorporate only acceptable constraints for the current mission. The FTCM 230 may notify the FCME 232 and/or GCME 282 about invalid constraints. If the aerial vehicle 210 breaches one or more flight plan constraints, the FTCM 230 may alert the FCME 232 and/or GCME 282 .
- the FTCM 230 may support loading of one or more mission plans from the FCME 232 and/or GCME 282 .
- Each mission plan may include, but is not limited to, one or more flight plans, contingency plans, communications plans, sensor plans, and/or weapons plans.
- the flight plans and/or contingency plans may comprise one or more waypoints and/or one or more maneuver constraints.
- Each waypoint may be a location or area specifying an intermediate or final destination for the aerial vehicle during the mission and may be specified using two-dimensional (e.g., latitude/longitude, map grid points, roadway intersections, etc.) or three-dimensional coordinates (e.g., each of the above two-dimensional coordinate examples with an elevation coordinate as well).
- Each maneuver constraint may specify one or more boundaries for the aerial vehicle during the mission plan, one or more minimum or maximum speed limits, and/or one or more sub-flight plans (e.g., constraints within confined airspace or restrictive terrain).
- the contingency plans may include, but are not limited to, alarm information, command information, and/or contingency flight plans.
- the communications plans may include, but are not limited to, information to be communicated, times and devices for communication, communication identification information (e.g., device addresses such as but not limited to fully-qualified domain names (FQDNs), medium-access control (MAC) or Internet Protocol (IP) addresses), communication frequencies, security information (e.g., encryption/decryption keys, lists of supported security protocols for security negotiation).
- FQDNs fully-qualified domain names
- MAC medium-access control
- IP Internet Protocol
- the FTCM 230 may first receive the mission plan(s) from the FCME 232 and/or GCME 282 . Upon reception of the mission plan(s), the FTCM 230 may provide the mission plan(s) to the VMS 250 and may ensure proper loading of the mission plan(s). After verifying the one or more mission plans have been properly loaded, the FTCM 230 may send a notification message specifying mission plan acceptance to the FCME 232 and/or GCME 282 . The FTCM 230 may copy the one or more mission plan(s) as well. The FTCM 230 may translate part or all of a given mission plan (including flight plan(s) and/or contingency flight plan(s)) to enable a control interface of the VMS 250 to execute the mission plan.
- a given mission plan including flight plan(s) and/or contingency flight plan(s)
- the FTCM 230 may perform contingency constraint checking in the context of implementing one or more contingency flight plans in the mission plan(s).
- the aerial vehicle 210 may invoke one or more contingency flight plans under specified conditions (discussed below).
- the FTCM 230 may interface with FCME 232 , GCME 282 , and/or the VMS 250 to implement the contingency capabilities.
- the FTCM 230 may command the VMS 250 to trigger a contingency behavior, such as land, hover, continue flight plan, and fly to a rally point.
- Contingency behaviors can be invoked in several ways: (1) the FCME 232 and/or GCME 282 may provide a contingency command to the FTCM 230 which in turn commands the VMS 250 to execute a contingency behavior, (2) the FTCM 232 may detect a condition (such as loss of communication with ground control 270 ) that requires a contingency behavior and commands the VMS 250 to execute a contingency behavior, (3) the FTCM 230 and the VMS 250 lose communications and the VMS 250 executes a contingency behavior, and (4) a flight condition requires a contingency behavior.
- a condition such as loss of communication with ground control 270
- Some of the flight conditions that may require a contingency behavior include: (a) airspace constraint corridor violations, (b) insufficient fuel thresholds, (c) receiving an excessive number of invalid commands from the FCME 232 and/or or GCME 282 (i.e., determining that the number of invalid commands received, perhaps during a period of time, exceeds a threshold, such as more than two invalid commands within one minute), (d) failure of safety critical processes, (e) loss of contingency management capability, (f) loss of communication with a controller (including manual control), and/or (g) invalid flight plan information received including missing contingency plans.
- the FTCM 230 may monitor execution of the mission plan by the aerial vehicle 210 and provide vehicle-flight status back to FCME 232 and/or GCME 282 .
- the FTCM may perform monitoring continuously, periodically, upon request, or under some other conditions.
- the FTCM 230 may provide vehicle-flight status during any flight phases and during either manual or autonomous flight.
- the FTCM 230 may monitor the current location of the aerial vehicle 210 relative to boundaries provided by the flight plan(s) in the mission plan(s). If the current location of the aerial vehicle 210 is within a threshold distance of any flight-plan boundary and/or crosses any flight-plan boundary, the FTCM 230 may execute a contingency behavior and/or send feedback to the ground control 270 via UAV radio 264 .
- the FTCM 230 may determine if the various sensors aboard the aerial vehicle 210 (e.g., optical sensors 260 and/or video unit 262 ) are operating in accordance with sensor plan(s) of the mission plan.
- the FTCM 230 may receive the sensor plan(s) as part or all of the mission plan(s) and send the sensor plan(s) to a sensor manager (not shown in FIG. 2 ) to control the sensors while the mission plan is executed.
- the FTCM 230 may send the flight plan(s) of the mission plan(s) to VMS 250 to control the location of the aerial vehicle 210 (i.e., fly the UAV) in accordance with the flight plan.
- the FTCM 230 may parcel out required functionality of the mission plan, coordinate on-board managers of the flight plan and/or sensor plan, verify the aerial vehicle 210 is executing the mission plan, and direct the execution of contingency behaviors as need.
- a flight plan component of the mission plan may instruct the UAV to fly to 43°51.3′ N/99°12.7′ W at 1645 Zulu time on the mission date via a waypoint at 43°51.293′ N/99°12.665′ W.
- a communication plan may instruct the UAV to provide a health report of the UAV to a ground control at address gc1.honeywell.com using a previously determined AES 128-bit key.
- a sensor plan of the mission plan may indicate that the UAV should activate an infrared sensor at 1646 Zulu.
- the mission plan may have contingency plan, mission plan and/or weapons plan components that instruct the UAV to fire Weapon #1 if the reading of the infrared sensor indicates a temperature of a heat source directly below the UAV exceeds a threshold amount.
- the FTCM 230 may provide support for shutdown commands for an engine of the aerial vehicle 210 and/or the entire aerial vehicle 210 , including providing safety interlocks to prevent unintended vehicle shutdown.
- the FTCM 230 may support a pass-through capability for training When the aerial vehicle 210 is in the integrated-platform-training mode, the FTCM 230 will interface between FCME 232 and/or GCME 282 and the VMS 250 .
- Training support may include the recording of training data in non-volatile memory, providing a pass-through for status information from the training sensor 256 to FCME 232 and/or GCME 282 , and the ability to change the integrated-platform mode to and from the integrated-platform-training mode, thereby enabling or disabling on-board training systems such as the training sensor 256 .
- the pass-through provided by the FTCM 230 may include forwarding training data to a training controller on the ground for processing.
- the training controller may be part of controller 280 and may determine hit/kill information based on the training data.
- the FTCM 230 may provide FCME 232 and/or GCME 282 with an interface to the optical sensor 260 and the video unit 262 via the FSM 238 .
- the FTCM 230 may pass-through sensor commands received from the FCME 232 and/or GCME 282 to the FSM 238 and may provide sensor command status from the FSM 238 to the
- FCME 232 and/or GCME 282 are FCME 232 and/or GCME 282 .
- the FTCM 230 may be equipped to send commands to the one or more lasers of the optical sensors 260 .
- the FTCM 230 may provide safety mechanisms for the one or more lasers, including but not limited to: (a) sending command(s) to the FSM 238 to turn off hazardous sensor features when transitioning to into the integrated-platform-training mode and (b) sending a command to turn off the laser under various potentially unsafe conditions occur, such as when a laser firing signal is lost, communication with the controller is lost, transfer of control occurs, and/or when a laser fire signal command expires.
- the FTCM 230 may maintain a field of view for one or more of the optical sensors 260 .
- the FTCM 230 may send commands to the FSM 238 to maneuver one or more of the optical sensors 260 mounted in gimbal(s) and to monitor sensor gimbal angles for the gimbal-mounted sensor(s).
- the FTCM 230 may determine that the aerial vehicle 210 requires rotation to prevent the gimbal-mounted sensor(s) from reaching hard gimbal limits.
- the FTCM 230 may maintain one or more thresholds of gimbal-angle limits.
- the FTCM 230 may send one or more commands to the VMS 250 to adjust vehicle position and/or azimuth.
- the FTCM 230 may also interface with the FSM 238 to provide sensor data (live or stored) to the controlling platform triggered by start and stop commands from the FCME 232 and/or GCME 282 .
- the FTCM 232 may also provide navigation data from the VMS 250 to the one or more optical sensors 260 .
- the FTCM 230 may monitor fuel sensors to determine fuel consumption.
- the FTCM may compare a fuel-consumption level against the requirements of the current mission and provide the appropriate status to the FCME 232 and/or GCME 282 .
- the FTCM 230 may provide computing platform services, such as data safety, message operations, and communication monitoring.
- the FTCM 230 may enforce data safety of the computing platform by applying cyclic-redundancy checks (CRCs) and/or boundary checking to all messages received (e.g., from the ground control 270 ) to ensure that safety critical data is not corrupted.
- CRCs cyclic-redundancy checks
- the FTCM 230 may ensure safety and validity of commands through interlock mechanisms, and only allow commands that are valid for the current integrated-platform mode.
- the interlock mechanisms may prevent unintended operations such as activation of a maintenance command during operational flight.
- the FTCM 230 may provide communication of vehicle commands between the FCME 232 and/or GCME 282 and the VMS 250 .
- An example list of commands includes: activation or resumption of a flight plan or contingency flight plan, tele-supervision command and control, launch commands, landing commands, pre-flight-checklist-condition verification, engine start commands following pre-flight-checklist-condition verification, rate and position “nudge” (minor adjustment) commands concerning up to four degrees of freedom, wave-off commands, waypoint vector commands, manual override commands, flight-route-modification commands, training commands (e.g., MILES commands), emergency commands, shutdown commands, render useless commands, and anti-collision light commands.
- many other types of commands may be communicated between the GCME 282 , FCME 232 , VMS 250 and/or FTCM 230 as well.
- the FTCM 230 may provide conversions to support messages to and from one or more standard formats, such as the JAUS standard.
- the FTCM 230 may support message sequencing. After receiving a message, the FTCM 230 will verify that subsequent messages are valid for the current mode and operations. The FTCM 230 may ensure proper reception and ordering of messages required to perform a given operation (such as flight plan loading). In the event that the FTCM 230 determines that one or more received command(s) is invalid, the FTCM 230 may reject the command(s), inform the sender, and/or continue current predicable and safe operation (e.g., maintain course and speed upon reception of an invalid activation of flight plan command).
- the FTCM 230 may monitor communication status of one or more data links between the aerial vehicle 210 and other entities, such as one or more ground controllers (e.g., ground control 270 ) and record any loss of communication. In particular, the FTCM 230 may report the condition where the aerial vehicle 210 is not receiving communication from a ground controller, but the ground controller may be receiving data from the aerial vehicle 210 .
- the FTCM 230 may support “controller handoffs”; that is, allowing a first ground controller at one level to resume control from a second ground controller at another level.
- the FTCM 230 may support one or more render useless commands sent from the FCME 232 and/or GCME 282 A.
- the FTCM 230 may send zeroize commands (i.e., commands to rewrite stored data and/or software with zeroes and/or random numbers) to the VMS 250 and to all on-board instances, processes, and tasks through middleware software 236 .
- the net effect of the render useless command may be to cause the UAV to be worthless if the UAV is captured or otherwise possessed by an enemy or unauthorized personnel.
- the FTCM 230 may include software and/or hardware developed in accordance with one or more development standards, such as but not limited to the DO-178B Software Considerations in Airborne Systems and Equipment Certification. Also, the FTCM 230 may be engineered to utilize a specified amount of computing resources, such as but not limited to processor time/utilization percentage, memory, input/output (I/O) resources, and/or system resources, such as buffers, pages, operating system tables/structures, semaphores or other mutual exclusion resources, and the like.
- computing resources such as but not limited to processor time/utilization percentage, memory, input/output (I/O) resources, and/or system resources, such as buffers, pages, operating system tables/structures, semaphores or other mutual exclusion resources, and the like.
- FIG. 3 shows an example communication architecture 300 for the example aerial vehicle control system 200 , in accordance with embodiments of the invention.
- the relatively-large polygon with dashed lines shown in FIG. 3 outlines components of the communication architecture 300 that are also components of the aerial vehicle 210 .
- the communication architecture 300 may include at least two priority levels for communications.
- FIG. 3 shows critical data or higher-priority communications communicated over critical-data pathways using dotted and dashed lines, and primary path or lower-priority communications communicated over primary-path pathways using solid lines.
- the communication architecture 300 uses critical-data pathways to transmit time-sensitive or mission-critical data between the vehicle and the ground control, including commands for the vehicle (including sensors aboard the vehicle) and some sensor data, and the communication architecture 300 uses primary-path pathways to communication information that is less time-sensitive.
- FIG. 3 shows FCME 232 and FTCM 230 as software components sharing a common hardware platform and software architecture.
- the hardware platform may be a pseudo-integrated computer system (PICS) with one or more central processing units (CPUs), shown in FIG. 3 as the “PICS-CPU” layer.
- FIG. 3 shows a plurality of software layers supporting the FTCM 230 and FCME 232 , including board support package (BSP), operating system (OS), and middleware layers of software. In other embodiments, more or fewer layers of software may be included in the software architecture, such as described in the '274 Application.
- FIG. 3 depicts the FSM 238 as a software component of FTCM 230 , and the FNS component 234 as a software component of the FCME 232 .
- the FTCM 230 and/or the FCME 232 may include more or fewer hardware and/or software components than shown in FIG. 3 .
- FIG. 3 shows the common hardware platform and software architecture equipped with video unit 262 .
- FIG. 3 shows the VMS 250 as a software component in a separate software architecture and executing on a separate hardware platform than used for the FTCM 230 and FCME 232 .
- Software for the VMS 250 may execute on the VMC 252 hardware platform.
- the VMS 250 may have a software architecture with two layers: a VMS OS layer and the VMS layer. In other embodiments, more or fewer layers of software may be included in the software architecture for the VMS 250 and/or may include more or fewer hardware and/or software components than shown in FIG. 3 .
- the VMS 250 may communicate with FTCM 230 and FCME 232 via one or more connections between the VMC 250 and the PICS-CPU, such as but not limited to, one or more wires, cables, computer busses, and/or computer-network connections (either wired or wireless).
- FIG. 3 shows a software architecture for the ground control processor 270 with the GCME 282 and GSM 286 as software components supported by the middleware software 288 layer, all executed by controller 280 .
- the ground control 270 and aerial vehicle 210 may utilize radios and/or ports to communicate.
- FIG. 3 shows the ground control with the ground control (GC) radio 290 communicating with the UAV radio 264 via a network 292 , such as a radio network.
- the ground control 270 may also, or instead, communicate with the aerial vehicle 210 using a wired or wireless connection to the port 240 of the aerial vehicle 210 .
- the port 240 may be an Ethernet port and thus the ground control 270 may communicate over an
- the ground control 270 may include a wireless device, such as but not limited to one or more Wi-Fi, Wi-MAX, wireless local area network (WLAN), or wireless wide area network (WWAN) devices, configured to communicate with one or more similarly equipped devices in the port 240 of the aerial vehicle 210 .
- a wireless device such as but not limited to one or more Wi-Fi, Wi-MAX, wireless local area network (WLAN), or wireless wide area network (WWAN) devices, configured to communicate with one or more similarly equipped devices in the port 240 of the aerial vehicle 210 .
- FIG. 3 shows communication of GCME Control/Status between the GCME 282 and the FTCM 230 via the FCME 232 along a primary-path pathway.
- the ground control 270 may interface with the aerial vehicle 210 via one or more data links between the ground control radio 290 and UAV radio 264 .
- the GCME 282 may provide a variety of commands via the data link(s) to the FTCM 230 , including but not limited to sensor commands, modes, airspace constraints, flight and contingency plans, position and rate commands, launch and land commands, anti-collision light commands, engine and power commands, fly-the-sensor maneuver commands, and emergency commands.
- the FTCM 230 may provide health and status information to the GCME 282 .
- the health information may include, but is not limited to, information about the FNS component 234 , FSM 238 , VMS 250 , and/or PICS.
- the status information may include, but is not limited to training status, telemetry data, fuel status and warning, flight status information, airspace constraint breech information, auto-tracking status, contingency plan activation, source data, and flight plan reject/accept status.
- FIG. 3 shows communication of radio configuration data along two primary-path pathways: one utilizing data link(s) established via ground control radio 290 , network 292 , and UAV radio 264 and another utilizing data link(s) established via port 240 . These two primary-pathways connect the FNS component 234 and the GCME 282 .
- the radio configuration data may control the network, communication configuration and/or the UAV radio 264 .
- FIG. 3 shows the GCME 282 communicating mission plans and/or software over the “Mission Plan & Software Load” primary-path pathway to the FTCM 230 via port 240 .
- the mission plans may include mission plans as described above with respect to FIG. 2 .
- the software may include software updates to fix software errors/bugs, partially or completely updated software components, and/or partially or completely updated software-architecture layers for the PICS-CPU and/or the VMC 252 . New software components and/or software-architecture layers may be installed aboard one or more processors aboard the aerial vehicle 210 in this fashion as well.
- FTCM 230 may provide data about mission plans and/or software via the Mission Plan & Software Load primary-path pathways as well, such as but not limited to mission-plan-loading status, software-loading status, mission-plan error reports (e.g., errors in formatting or completeness of a given mission plan), software error reports, and/or software-debugging data.
- mission-plan-loading status e.g., software-loading status
- mission-plan error reports e.g., errors in formatting or completeness of a given mission plan
- software error reports e.g., software error reports, and/or software-debugging data.
- FIG. 3 shows a “Sensor Control/Status” critical-data pathway between the FTCM 230 and the optical sensors 260 via FSM 238 and video unit 262 .
- the FTCM 230 may provide sensor commands, laser control and/or render useless commands to optical sensors 260 and/or video unit 262 via FSM 238 .
- the FSM 238 may provide video-sensor data (i.e., compressed video, uncompressed video, sensor health, sensor status, and/or sensor-auto-tracking status from the optical sensors 260 and/or video unit 262 ) to the FTCM 230 .
- the FTCM 230 may pass part or all of the video-sensor data to the GSM 286 and/or GCME 282 via one or more pathways, such as the “Video FSM to GSM/Video Stream” primary-path pathway and/or the “Critical Information” critical-data pathway shown in FIG. 3 .
- the FTCM 230 may implement one or more “Fly the Sensor” commands by monitoring the pointing angle and field of view of a camera of the optical sensors 260 and controlling the rotation of the vehicle, perhaps via command(s) issued to the VMS 250 , to maintain the desired field of view.
- FIG. 3 shows VMS 250 communicating “Vehicle Control/Status” with FTCM 230 over a critical-data pathway.
- the FTCM 230 may receive vehicle control and status information from the VMS 250 , such as, but not limited to, health and status of the VMC 252 , telemetry data, data about the position of the aerial vehicle 210 , flight plan execution status, flight plan load status, fuel level and consumption data, and training status.
- the FTCM 230 may provide the vehicle control and status information to the VMS 250 , such as but not limited to mission plan (flight plan, contingency plan, rate commands (as well as position commands translated into rate commands), launch and land commands, engine and power commands, fly-the-sensor commands, emergency commands, contingency commands, manual/remote operation commands and render useless commands.
- the FTCM 230 may pass some or all of the vehicle control and status information to the FCME 232 and/or GCME 282 via one or more pathways, such as the “Critical Information” pathway and/or the “GCME Control/Status” primary-path pathway shown in FIG. 3 .
- FIG. 4 shows an example aerial vehicle control system 400 with redundant components, in accordance with embodiments of the invention.
- the aerial vehicle control system 400 is a similar and enhanced system.
- each components of the aerial vehicle control system 400 with the same name as a component of the aerial vehicle control system 200 i.e., the FTCMs 430 a / 430 b, the FCME 432 , FNS component 434 , middleware software 436 , FSM 438 , VMS 450 , VMC 452 a / 452 b, navigation sensors 454 , training sensor 456 , lights 458 , optical sensors 460 , video unit 462 , AV Radio 464 , ground-control controller 480 , GCME 482 , GNS 484 , GSM 486 and ground-control radio 490 ) include the same functionality as the corresponding component of the aerial vehicle control system 200 (i.e., the FTCM 230 ,
- the aerial vehicle control system 400 includes an aerial vehicle 410 (e.g., a UAV) and a ground control 470 .
- the aerial vehicle 410 includes a redundant processor unit 420 , a vehicle management system (VMS) 450 , an aerial vehicle (AV) radio 464 , and one or more sensor interface(s) 466 .
- VMS vehicle management system
- AV aerial vehicle
- the redundant processor unit 420 may have two or more processors, each processor configured to execute flight management software, such as but not limited to, one flight technical control manager (FTCM) per processor.
- Each processor of the redundant processor unit 420 may be configured to execute other software components as well; that is, the software components shown in FIG. 4 inside of the rectangle surrounding the redundant processor unit 420 , such as but not limited to a flight command and mission execution (CME) component 432 , a flight network system (FNS) component 434 , a middleware software 436 , a flight sensor manager (FSM) component 438 , a training component 442 , an integrated computer system (ICS) component 444 , and a sustainment component 446 .
- CME flight command and mission execution
- FNS flight network system
- FSM flight sensor manager
- ICS integrated computer system
- sustainment component 446 There may be one or more copies of each of these software components executing on each processor of the redundant processor unit 440 , but only one copy is shown in FIG. 4 for simplicity.
- FIG. 4 shows FTCM 430 a and FTCM 430 b with a double-headed arrow indicating communication between the FTCMs 430 a and 430 b.
- the FTCM 430 a and FTCM 430 b may be configured with one FTCM acting as an active “primary FTCM” and the other acting as an idle “backup FTCM”.
- the text below accompanying FIG. 4A describes the use of primary and backup FTCMs in more detail.
- Each FTCM 430 a and 430 b may monitor health and status for each of the VMCs 450 a and 450 b.
- the primary FTCM may monitor the status of the redundant processor unit via the ICS 444 ; that is, the ICS 444 may provide at least information about the primary or backup status of each processor of the redundant processor unit 420 .
- the FTCMs 430 a and 430 b may send and/or receive appropriate signals and monitors identified by the Sustainment Model to and/or from sustainment 446 via FCME 432 (and middleware software 436 ).
- the FTCMs 430 a and 430 b may format and send health and status data about the VMS 450 (include the health/status of the VMCs 452 a and 452 b ) directly to sustainment 446 .
- the FTCMs 430 a and 430 b may manage optical sensors 460 and/or video unit 462 via the sensor interface(s) 466 ; for example, the FTCMs 430 a and 430 b may manage the auto-tracking status of a laser, perhaps via the FSM component 438 .
- the sensor interface(s) 466 may manage some or all of the optical sensors 460 and/or video unit 462 directly (that is, without intervention from the FTCMs 430 a and 430 b ).
- FIG. 4 shows the sensor interface(s) 466 may manage the training sensor 456 instead of the VMS 456 .
- the training component 442 may manage the training sensor 456 , perhaps under the guidance of the FTCMs 430 a and 430 b and/or the FCME 432 and/or GCME 482 .
- the FTCMs 430 a and 430 b include the functionality of the FTCM 230 described above. Some of the differences between the FTCMs 430 a and 430 b and the FTCM 230 (beyond those already mentioned above) are:
- the FTCMs 430 a and 430 b may manage live-fire training during the integrated-platform-training mode.
- Each VMC 452 a and 452 b may store one or more mission plans, perhaps including contingency flight plans. As such, the FTCMs 430 a and 430 b may send command(s) to the VMS 450 to activate a stored mission plan.
- the FTCMs 430 a and 430 b may perform services involving training in conjunction with training component 442 .
- the training component 442 may include a training controller.
- the training component 442 may be activated and/or deactivated via command(s) sent via the FCME 432 and/or GCME 482 .
- the mission plans executed by the aerial vehicle system 400 may be more complex than those executed by the aerial vehicle system 200 .
- the FTCMs 430 a and 430 b may have to support loading of and management of mission plans with more waypoints and flight patterns, along with supporting additional mission plans (including more contingency flight plans) beyond those supported by the FTCM 230 .
- FIG. 4 shows the FNS component 434 disconnected from the FTCMs 430 a and 430 b. As such, the FTCMs 430 a and 430 b do not have access to radio configuration data, processed by the FNS component 434 under the control of the FCME 232 and/or GCME 282 .
- the FTCMs 430 a and 430 b may account for redundant operations as described below with respect to FIG. 4A .
- the VMS 450 includes redundant VMCs 450 a and 450 b.
- the VMCs 450 a and 450 b may operate as primary and backup VMCs, such as described above with respect to the processors of the redundant processor unit 420 .
- Software for the VMS 450 may manage redundancy by communicating information between primary and backup software components such as described with respect to FTCMs 430 a and 430 b.
- FIG. 4A shows an example redundancy architecture 492 of redundant FTCMs 430 a and 430 b and VMCs 452 a and 452 b in accordance with embodiments of the invention.
- the design of the aerial vehicle system 400 may support a multi-process/multiprocessor implementation.
- the redundancy architecture 492 may indicate components as active or inactive, where active components may process data used in the operation of the aerial system 400 and the inactive components are idle.
- FIG. 4A shows FTCM 430 a as a primary FTCM and VMC 452 a as a primary VMC, as well as showing FTCM 430 b as a backup FTCM and VMC 452 b as a backup VMC.
- FIG. 4A shows active components FTCM 430 a, FCME 432 , middleware software 436 , FSM 438 , training component 442 , ICS 444 , sustainment 446 , and VMC 452 a outlined with solid lines.
- FIG. 4A also shows the inactive components FTCM 430 b and VMC 452 b outlined with dashed lines.
- the primary FTCM 430 a and the other active components 432 , 436 , 438 , 442 , 444 , and/or 446 may communicate status and other information to the backup FTCM 430 b.
- FIG. 4A shows communication paths from the active FTCM 430 a and the active VMC 452 a with solid lines and shows communication paths to the backup FTCM 430 b and the backup VMC 452 b as dashed lines.
- the backup FTCM 430 b may maintain/update internal data structures (e.g., integrated-platform-mode or mission-plan-related data structures) based on the information communicated from the primary FTCM.
- the maintenance of data structures by the backup FTCM based on data from the primary FTCM may enable the backup FTCM to take over (nearly) immediately from the primary FTCM in event of failure of the primary FTCM.
- Some examples of data communicated from the primary FTCM 430 a and/or the active components 432 , 436 , 438 , 442 , 444 , 446 are to the backup FTCM 430 b are: integrated-platform-mode information, status of the primary FTCM and the active components, commands from the FCME 432 and/or GCME 482 , networking and/or radio information, sensor data (e.g., the current location, velocity and/or acceleration of the aerial vehicle, laser-tracking status, video data), sensor configuration information, information about the lights 458 , training plan information, information about mission plan status, vehicle commands, the status of the VMCs 452 a and 452 b, and/or SUSTAINMENT information.
- sensor data e.g., the current location, velocity and/or acceleration of the aerial vehicle, laser-tracking status, video data
- sensor configuration information information about the lights 458
- training plan information information about mission plan status
- vehicle commands the status of the VMCs 452 a and 452
- synchronization data 494 may be sent to the backup FTCM 430 b as well.
- one or more messages may be sent to the backup FTCM 430 b at (nearly) regular intervals as a “heart beat” indicating the health and activity of the primary FTCM 430 a.
- Primary VMC 452 a and backup VMC 452 b communicate similar data, including synchronization data.
- Many other kinds of data may be sent to the backup FTCM 430 b and/or backup VMC 452 b as well.
- the backup FTCM 430 b may detect failure of the primary FTCM 430 a and responsively transition from backup to primary while the failed (and now backup) FTCM 430 a is evaluated and corrected.
- the designation as primary or backup FTCM may correspond to a processor of the redundant processor unit 420 being designated as primary (i.e., active) or backup (i.e., standby) by the ICS 444 .
- one reason for the failure of a primary FTCM is the corresponding failure of a primary processor of the redundant processor unit 420 .
- the redundant processor unit 420 may enable a backup processor to take over (nearly) immediately upon failure of the primary processor. In this case, the backup FTCM executing on the backup processor may then act as the primary FTCM once the backup processor becomes the primary processor.
- an FTCM may change from primary to standby operation (or vice versa) upon request of a user (e.g., ground control).
- FIG. 5 shows an example communication architecture 500 for the aerial vehicle control system with redundant components 400 , in accordance with embodiments of the invention.
- the relatively-large polygon with dashed lines shown in FIG. 5 outlines components of the communication architecture 500 that are also components of the aerial vehicle 410 .
- the communication architecture 500 may include at least two priority levels for communications.
- FIG. 5 shows critical data or higher-priority communications communicated over critical-data pathways using dotted and dashed lines and primary path or lower-priority communications communicated over primary-path pathways shown using solid lines.
- FIG. 5 shows active software components FNS 434 , training component 442 , sustainment component 446 , FCME 432 , FSM 438 and primary FTCM 430 a as software components sharing a common hardware platform and software architecture. More or fewer software components may share a common hardware platform.
- the hardware platform may be an integrated computer system (ICS) with one or more central processing units (CPUs), shown in FIG. 5 as the “ICS-CPU” layer.
- FIG. 5 shows a plurality of software layers supporting the active software components, including board support package, operating system, and middleware layers of software. In other embodiments, more or fewer layers of software may be included in the software architecture, such as described in the '274 Application.
- FIG. 5 shows the common hardware platform and software architecture equipped with optical sensors 460 as well.
- FIG. 5 shows the backup FTCM 430 b residing on a separate hardware platform operating the same software architecture (i.e., having ICS-CPU, BSP, OS, and middleware software layers) that supports the active software components.
- FIG. 5 shows the VMS 450 as a software component in a separate software architecture and executing on two separate hardware platforms from the hardware platforms supporting the active software components and the backup FTCM 430 b.
- Software for the VMS 450 may execute two hardware platforms: VMCs 452 a and 452 b.
- the VMS 450 may have a software architecture with two layers: a VMS OS layer and the VMS layer. In other embodiments, more or fewer layers of software may be included in the software architecture for the VMS 450 and/or may include more or fewer hardware and/or software components than shown in FIG. 5 .
- the hardware platforms shown in FIG. 5 may communicate with each other via one or more connections between the hardware platforms, such as described above with respect to FIG. 3 .
- FIG. 5 shows a software architecture for the ground control processor 470 with controller 480 executing the GCME 482 and GSM 486 software components supported by the middleware software layer 488 .
- the ground control 470 and aerial vehicle 410 may utilize radios and/or ports to communicate.
- FIG. 5 shows the ground control with the ground control (GC) radio 490 communicating with the UAV radio 464 via a network 492 .
- the communication between ground control 470 and the UAV radio 464 including use of the network 492 , may be as described above with respect to FIG. 3 .
- FIG. 5 shows communication of GCME Control/Status between the GCME 482 and the FCME 432 along a primary-path pathway.
- the FCME 432 communicates mission plan control and status information to the primary FTCM 430 a via a separate primary-path pathway.
- the ground control 470 may interface with the aerial vehicle 410 via one or more data links between the ground control radio 490 and UAV radio 464 .
- the GCME 482 may provide a variety of commands via the data link(s) to the FCME 432 and thence to Primary FTCM 430 a, including but not limited to sensor commands, modes, airspace constraints, flight and contingency plans, position and rate commands, launch and land commands, anti-collision light commands, engine and power commands, fly-the-sensor maneuver commands, and emergency commands.
- FIG. 5 shows communication of Radio Configuration data along a primary-path pathway utilizing data-links between GCME 482 and FNS 434 via UAV radio 464 .
- the radio configuration data may control the network, communication configuration and/or the UAV radio 464 .
- FIG. 5 shows a “Laser Control & Status” critical-data pathway between the Primary FTCM 430 a to the optical sensors 460 via the FSM 438 .
- the Primary FTCM 430 a may provide sensor commands, laser control and/or render useless commands to optical sensors 460 via FSM 438 .
- the FSM 438 may provide video-sensor data such as described above with respect to FIG. 3 to the Primary FTCM 430 a.
- the Primary FTCM 430 a and/or the FSM 438 may pass part or all of the video-sensor data to the GSM 286 and/or GCME 282 via one or more pathways, such as the “Sensor Control/Status” critical-data pathway and/or the “Critical Information” critical-data pathway shown in FIG. 5 .
- the FTCM 430 a and/or FSM 438 may implement “Fly the Sensor” commands such as described above with respect to FIG. 3 .
- FIG. 5 shows VMS 450 communicating “Vehicle Control/Status” with Primary FTCM 430 a over a critical-data pathway.
- the Vehicle Control/Status pathway including communicated vehicle control and status information, may be as described with respect to FIG. 3 , with the addition of data about the status of the redundant VMCs 452 a and 452 b.
- the Primary FTCM 430 a may pass some or all of the vehicle control and status information, along with other health and status information to the FCME 432 and/or GCME 482 via one or more pathways, such as the “Critical Information” critical-data pathway and/or the “GCME Control/Status” primary-path pathway shown in FIG. 5 .
- the other health and status information may include, but is not limited to, availability (i.e., active, inactive, out of service), fault/debugging data, and/or other information about the FNS component 434 , training component 442 , sustainment 446 , FCME 432 , FSM 438 , VMS 450 , VMCs 452 a and 452 b, Backup FTCM 430 b and/or the ICS-CPUs supporting the Primary FTCM 430 a and/or the Backup FTCM 430 b.
- the Primary FTCM 430 may provide the vehicle control and status information to VMS 450 via VMC 452 a and/or VMC 452 b.
- the Primary FTCM 430 a may communicate sustainment signals and monitors (described above with respect to FIG. 4 ) with the sustainment component 446 over the “Sustainment Data” primary-data pathway shown in FIG. 5 .
- the Backup FTCM 430 b may receive data, such as described above with respect to FIGS. 4 and 4A , from the Primary FTCM 430 a over a critical-path pathway, such as shown in FIG. 5 .
- the Backup VMC 452 b may receive data, such as described above with respect to FIGS. 4 and 4A , from the Primary VMC over a critical-path pathway, such as shown in FIG. 5 .
- FIG. 6 is a block diagram of an example computing device 600 , comprising a processing unit 610 , data storage 620 , a user interface 630 , a network-communication interface 640 , and a sensor interface 650 , in accordance with embodiments of the invention.
- a computing device 600 may be a desktop computer, laptop or notebook computer, personal data assistant (PDA), mobile phone, embedded processor, computer board (e.g., motherboard) or any similar device that is equipped with a processing unit capable of executing machine-language instructions that implement at least part of the herein-described method 700 described in more detail below with respect to FIG. 7 , and/or any or all of the herein-described software, including but not limited to FTCMs, VMSs, software components, video units, operating systems, BSPs, middleware software, and/or software layers.
- the processing unit 610 may include one or more central processing units, computer processors, mobile processors, digital signal processors (DSPs), microprocessors, computer chips, and similar processing units now known and later developed and may execute machine-language instructions and process data.
- DSPs digital signal processors
- microprocessors computer chips, and similar processing units now known and later developed and may execute machine-language instructions and process data.
- the data storage 620 may comprise one or more storage devices.
- the data storage 620 may include read-only memory (ROM), random access memory (RAM), removable-disk-drive memory, hard-disk memory, magnetic-tape memory, flash memory, and similar storage devices (i.e., tangible storage media for data and/or computer instructions executable by a processor) now known and later developed.
- the data storage 620 comprises at least enough storage capacity to contain machine-language instructions 622 and data structures 624 .
- the machine-language instructions 622 and the data structures 624 contained in the data storage 620 include instructions executable by the processing unit 610 and any storage required, respectively, to perform some or all of the herein-described functions described with respect any or all of the herein-described software, including but not limited to FTCMs, VMSs, software components, operating systems, BSPs, middleware software, video units, and/or software layers, and/or to perform some or all of the procedures described in method 700 .
- the user interface 630 may comprise an input unit 632 and/or an output unit 634 .
- the input unit 632 may receive user input from a user of the computing device 600 .
- the input unit 632 may comprise a steering device, keyboard, a keypad, a touch screen, a computer mouse, a track ball, a joystick, and/or other similar devices, now known or later developed, capable of receiving user input from a user of the computing device 600 .
- the output unit 634 may provide output to a user of the computing device 600 .
- the output unit 634 may comprise a visible output device for generating visual output(s), such as one or more cathode ray tubes (CRT), liquid crystal displays (LCD), light emitting diodes (LEDs), printers, lights, and/or other similar devices, now known or later developed, capable of displaying graphical, textual, and/or numerical information to a user of computing device 600 .
- CTR cathode ray tubes
- LCD liquid crystal displays
- LEDs light emitting diodes
- the output unit 634 may alternately or additionally comprise one or more aural output devices for generating audible output(s), such as a speaker, speaker jack, audio output port, audio output device, earphones, and/or other similar devices, now known or later developed, capable of conveying sound and/or audible information to a user of computing device 600 .
- aural output devices for generating audible output(s)
- Devices making up the input unit 632 and/or the output unit 634 may be detached and/or attached to the computing device as needed via one or more ports.
- one or more input devices e.g., a keyboard and/or mouse
- output devices e.g., a monitor
- the one or more ports may be part of the computing device 600 , such as ports for the input unit 632 , the output unit 634 , and/or the network-communication interface 640 described below.
- the network-communication interface 640 may send and receive data over a wired-communication interface and/or a wireless-communication interface.
- the data may be sent and received using digital and/or analog techniques, and may include textual, graphical, video, audio, binary data, and/or other types of data.
- the wired-communication interface if present, may comprise a wire, cable, fiber-optic link or similar physical connection, such as a USB, SCSI, Fire-Wire, and/or RS-232 connection, to a data network, such as a wide area network (WAN), a local area network (LAN), one or more public data networks, such as the Internet, one or more private data networks, or any combination of such networks.
- WAN wide area network
- LAN local area network
- public data networks such as the Internet
- private data networks such as any combination of such networks.
- the wireless-communication interface may utilize an air interface, such as a BluetoothTM, ZigBee, Wireless WAN (WWAN), Wi-Fi, and/or WiMAX interface to a data network, such as a WWAN, a Wireless LAN, one or more public data networks (e.g., the Internet), one or more private data networks, or any combination of public and private data networks.
- a data network such as a WWAN, a Wireless LAN, one or more public data networks (e.g., the Internet), one or more private data networks, or any combination of public and private data networks.
- the network-communication interface 640 may send and/or receive data over multiple communication frequencies, as well as being able to select a communication frequency out of the multiple communication frequency for utilization.
- the wireless-communication interface may also, or instead, include hardware and/or software to receive communications over a data-link via an antenna.
- the sensor interface 650 may permit communication with one or more sensors to permit the sensors to provide sensor data to the computing device 600 and/or to receive commands that permit sensor maintenance (e.g., setup commands, configuration parameter settings, and the like).
- the sensor interface 650 may include a wired-sensor interface and/or a wireless-sensor interface. Examples of the one or more sensors include, but are not limited to, the herein-described navigation sensors, optical sensors, lights, radios, and/or training sensors.
- the wired-sensor interface and the wireless-sensor interface may utilize the technologies described above with respect to the wired-communication interface of the network-communication interface 640 and the wireless-communication interface of the network-communication interface 640 , respectively.
- FIG. 7 is a flowchart depicting an example method 700 for executing a mission plan, in accordance with embodiments of the invention. It should be understood that each block in this flowchart and within other flowcharts presented herein may represent electronic hardware, such as, but not limited to, one or more components of the aerial vehicles and/or ground control described above with respect to FIGS. 1-5 and/or the computing device described above with respect to FIG. 6 , and/or computer software, such as, but not limited to, one or more software entities, modules, segments, layers, functions, routines, subroutines, data structures, objects, messages, or portions of computer program code, which includes one or more executable instructions for implementing specific logical functions or steps in the process.
- electronic hardware such as, but not limited to, one or more components of the aerial vehicles and/or ground control described above with respect to FIGS. 1-5 and/or the computing device described above with respect to FIG. 6
- computer software such as, but not limited to, one or more software entities, modules, segments, layers, functions, routine
- Method 700 begins at block 710 .
- a mission plan may be sent.
- a ground control may send the mission plan.
- the mission plan may include the components of mission plans described above, in particular with respect to FIGS. 2 and 4 .
- the mission plan may be received.
- the mission plan may be received by an aerial vehicle, such as aerial vehicle 210 described above with respect to FIGS. 2 and 3 or aerial vehicle 410 described above with respect to FIGS. 4 , 4 A, and 5 .
- An FTCM, FCME, VMS and/or other software component designated as an “MP Loader” executing on a designated processor e.g., a PICS-CPU, VMC, an active ICS-CPU
- the mission plan may be loaded via a radio aboard the aerial vehicle and/or via a port of the aerial vehicle, such as described above with respect to FIGS. 2 and 4 .
- the redundant processors may be synchronized and/or communicate information between primary and backup processors, such as described above with respect FIGS. 4 , 4 A, and 5 , and particularly with respect to the ICS-CPUs and VMCs. This synchronization and/or communication may occur continuously throughout operation of the aerial vehicle.
- the validity of the mission plan may be determined.
- the MP Loader may validate the mission plan, perhaps with the aid of other software and/or hardware components.
- the MP Loader may validate the mission plan on a mission-plan wide basis, a component-by-component basis, and/or on a data-checking basis.
- Validity checks on the mission-plan wide basis may ensure a given mission plan has all expected components, such as flight plans or sensor plans.
- Example validity checks on a component-by-component basis include: (a) determining a flight plan or contingent flight plan has an expected number of waypoints and (b) verifying a sensor plan or weapons plan only utilizes sensors or weapons, respectively, which are aboard the aerial vehicle.
- Validity checks on a data-checking basis may ensure correct transmission of the received mission plan using cyclic redundancy codes (CRCs) and/or encryption/decryption algorithms. Many other validity checks and bases for validity checking are possible as well.
- CRCs cyclic redundancy codes
- method 700 may proceed to block 732 . If the mission plan is determined to be valid, method 700 may proceed to block 734 .
- part or all of the mission plan may be retransmitted.
- the ground control and the MP Loader may coordinate the retransmission of the mission plan.
- Ground control may be notified which portions of the mission plan are requested to be retransmitted, as well as information about which validity check(s) failed at the aerial vehicle.
- ground control may retransmit part or all of the mission plan to the aerial vehicle.
- a partial retransmission may be attempted if validity checks determine only part of the mission plan is invalid; e.g., if ground control is informed that only a contingent flight plan is invalid.
- Another response may be to abort transmission of the mission plan if, for example, the mission plan needs to be reformulated (e.g., a missing mission-plan component needs to be written or the mission has changed) or if a number of retransmission attempts exceeds a threshold (e.g., the same portions of the mission plan have been resent five times).
- the mission plan needs to be reformulated (e.g., a missing mission-plan component needs to be written or the mission has changed) or if a number of retransmission attempts exceeds a threshold (e.g., the same portions of the mission plan have been resent five times).
- method 700 may proceed to block 710 . If the mission plan is not to be retransmitted, method 700 may end.
- a notification that the mission plan is valid may be sent.
- the MP Loader and/or another software component of the aerial vehicle may send the notification.
- the notification may include identifying information about the mission plan and/or the aerial vehicle (e.g., “Mission plan ALPHA-4 received and validated at UAV #33”).
- the notification may include timing and/or resource information as well.
- the mission plan may be loaded into one or more processors.
- the MP Loader may coordinate the loading of the mission plan onto the one or more processors, which may include one or more ICS-CPUs, PICS-CPUs, and/or VMCs as described above with respect to FIGS. 2 , 3 , 4 , 4 A, and 5 and/or a computing device as described above with respect to FIG. 6 .
- the MP Loader and/or other software component may translate the mission plan into one or more commands before transmission to the processor(s).
- the commands may be processor-independent (e.g., the same commands are used on all types of processors) or processor-dependent.
- the receiving processor(s) may verify, store, and/or execute the mission plan and/or commands.
- At block 750 at least part of the mission plan may be executed.
- Execution of the mission plan may include executing launch and/or lift-off commands, directing the aerial vehicle to travel along one or more flight plans of the mission plan, and/or executing one or more landing and/or shutdown commands.
- the VMS and/or VMCs described above with respect to FIGS. 2-5A may determine a current location of the aerial vehicle.
- the current location may be determined using one or more navigation sensors, such as described above with respect to FIGS. 1 , 2 , and 4 .
- the current location may be compared to the flight plan, and if the current location of the aerial vehicle is outside the flight plan, a contingent flight plan of the mission plan may be executed.
- the VMS and/or VMCs may determine a current velocity and/or current acceleration of the aerial vehicle as well.
- the aerial vehicle While traveling along the flight plan, the aerial vehicle may operate as directed by the ground control or operate autonomously.
- a “hand-off” operation or command may change operation from ground-control controlled to autonomous control or vice versa.
- Sensors aboard the aerial vehicle may operate during execution of the flight plan. For example, camera(s) aboard the aerial vehicle may generate video data. A video unit may compress and send the video data to ground control. Optical, training, and/or navigational sensors may be aboard the aerial vehicle and used as described above with respect to FIGS. 2 , 3 , 4 , and 5 . The sensors may be operated and controlled according to a sensor plan (which may be a component of the mission plan), as commanded by ground control and/or as directed by software aboard the aerial vehicle. Fuel sensor(s) may receive fuel data. The fuel data may determine a fuel level.
- Processors aboard the aerial vehicle and/or ground control may communicated sensor data (including but not limited to video data, data from optical, navigational, and/or training sensors, fuel data and/or the fuel level, and feedback from the sensors).
- Sensor control of the aerial vehicle e.g., fly-by-sensor operation, may be provided as well.
- Communication between software and/or hardware components of the aerial vehicle may be prioritized and/or organized along communication pathways, such as the primary-path and/or critical-data priorities and pathways, described above with respect to FIGS. 3 and 5 .
- Communication may take place according to a communication plan, such as described above with respect to FIG. 2 .
- Communication with the ground control may include health reports, such as described above with respect to FIG. 2 .
- the aerial vehicle may be equipped with one or more lights, which may be controlled as commanded by ground control and/or as directed by software aboard the aerial vehicle.
- the lights act as anti-collision lights by being turned on in response to detecting a nearby vehicle or object.
- the lights may be controlled by a sensor plan and/or the mission plan as well.
- the aerial vehicle may operate in an integrated-platform mode, such as the integrated-platform modes described above with respect to FIG. 2 .
- the aerial vehicle may receive one or more commands while executing the mission plan.
- the commands may be executed depending on whether the commands are appropriate for the integrated-platform mode.
- the aerial vehicle may receive a render useless command, perhaps from the ground control or as part of a contingency plan.
- the aerial vehicle may zeroize or otherwise scramble/self-destruct memory, hardware, and/or software of the aerial vehicle.
- a determination may be made as to whether the mission plan is complete. The determination may be made based on: (a) a specific indication in the mission plan that the mission plan is complete, (b) execution of a contingent plan indication completion, (c) execution of a completion command (e.g., render useless, shutdown or landing command), (d) an amount of time since receiving communication from the ground control (e.g., if no communication received from ground control within an hour), and/or (e) a state of the aerial vehicle (e.g., the aerial vehicle is powering off or is rendered useless). Other techniques for determining whether the mission plan is complete are possible as well.
- method 700 may proceed to block 750 . If the mission plan is complete, method 700 may end.
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Game Theory and Decision Science (AREA)
- Medical Informatics (AREA)
- Traffic Control Systems (AREA)
- Navigation (AREA)
Abstract
Two architectures for unmanned aerial vehicles (UAVs) and a method for executing a mission plan are provided. One architecture for a UAV includes a flight command and mission execution (FCME) component making strategic decisions, a flight technical control manager (FTCM) making tactical decisions and a vehicle management system (VMS) providing navigational support. The FCME and FTCM execute on one processor and the VMS executes on a separate processor. The second architecture includes redundant processors for executing the FCME and FTCM as well as redundant processors for executing the VMS. The UAV executes a mission plan, which may include flight plan(s), communication plan(s), weapons plan(s), sensor plan(s), and/or contingent flight plan(s). The UAV may control various optical sensors, training sensors, and lights as well.
Description
- The United States Government has acquired certain rights in this invention pursuant to Contract # W56HZV-05-C-0724, awarded by the US Army Tank—Automotive and Armaments Command.
- 1. Field of the Invention
- This invention relates to the field of software architecture. More particularly, this invention relates to modular software architecture organized by layers and segments which can be applied to systems which contain multiple domains or functionality, such as unmanned aerial vehicles (UAVs).
- 2. Background
- The military, police, rescue, scientific, and commercial communities use unpiloted aircraft, such as UAVs. One definition of a UAV is an unmanned device capable of controlled, sustained, and powered flight. As such, the designs of UAVs consist of aircraft of various sizes, capabilities, and weights. A typical UAV consists of a propulsion device, such as an engine, a navigation system, one or more payload sensors, communication equipment, and possibly cargo. The sensors may provide information to a ground observer about the terrain the UAV overflies, such as video information about a lost hiker in a rescue application, information from laser and/or biological sensors about environmental conditions in a scientific or security application, or a combination of video, laser, biological and other sensors concerning battlefield conditions in a military application. The cargo may be munitions, food, medicine, and/or other goods depending on the mission of the UAV. As technology improves, the design of the UAV may change to integrate new and/or improved sensors, navigation systems, propulsion devices, and the like.
- As the UAV is unmanned, computer software executing on one or more processors aboard the UAV partially or completely controls the UAV. The computer software may control the various functions performed by the UAV, perhaps with the aid of the ground observer.
- A first embodiment of the invention provides an aerial vehicle. The aerial vehicle includes a processing unit, data storage, and machine-language instructions. The machine-language instructions are stored in the data storage and are executable by the processing unit to perform functions. The functions include: (a) receiving a mission plan, which includes a flight plan, (b) validating the mission plan, (c) executing the mission plan by at least directing the aerial vehicle to travel along a flight plan of the mission plan, (d) determining a current location of the aerial vehicle is outside the flight plan, and (e) responsively executing a contingent flight plan.
- A second embodiment of the invention provides an aerial vehicle. The aerial vehicle includes a first redundant processing unit, a first data storage and first machine language instructions. The first redundant processing unit includes a first processor and a second processor. The first machine-language instructions are stored in the first data storage and executable by at least one processor of the first redundant processing unit to perform first functions. The first functions include: (a) receiving a mission plan that includes a flight plan and a contingency plan, (b) validating the mission plan, (c) executing the mission plan based on the flight plan, and (d) synchronizing the first processor and the second processor.
- A third embodiment of the invention provides a method for executing a mission plan. The mission plan is received at an aerial vehicle. The mission plan includes a flight plan, a sensor plan, a communication plan, a contingency flight plan, and a weapon plan. The mission plan is determined to be valid. In response, a notification is sent indicating the mission plan is valid. The mission plan is loaded into one or more processors of the aerial vehicle. At least part of the mission plan is executed.
- Various examples of embodiments are described herein with reference to the following drawings, wherein like numerals denote like entities, in which:
-
FIG. 1 shows an example UAV, in accordance with embodiments of the invention; -
FIG. 2 shows an example aerial vehicle control system, in accordance with embodiments of the invention; -
FIG. 3 shows an example architecture for the example aerial vehicle control system, in accordance with embodiments of the invention; -
FIG. 4 shows an example aerial vehicle control system with redundant components, in accordance with embodiments of the invention; -
FIG. 4A shows an example block diagram of redundant FTCMs and VMCs, in accordance with embodiments of the invention; -
FIG. 5 shows an example architecture for an aerial vehicle control system with redundant components, in accordance with embodiments of the invention; -
FIG. 6 is a block diagram of an example computing device, in accordance with embodiments of the invention; and -
FIG. 7 is a flowchart depicting an example method for executing a mission plan, in accordance with embodiments of the invention. - The present invention includes methods and apparatus for controlling a UAV. The UAV may provide a networked situational awareness capability to a military unit, such as a platoon or a division. The UAV may secure areas and/or provide reconnaissance, surveillance, and target acquisition (RSTA).
- UAV control may reside both on board the aircraft and on the ground. UAV control may include a strategic or “command and mission execution” (CME) component and a tactical or “technical control manager” (TCM) component. The CME component provides high level control and may be shared between a ground CME (GCME) residing with ground control and an on-board or “flight” CME (FCME), residing on the UAV. The TCM component may include both ground and flight components or may just have a flight TCM (FTCM) component.
- The FTCM may provide tactical control of the UAV while the FCME and GCME may provide strategic control. As such, the GCME is the main controller for the air vehicle; it provides mission management (i.e., communication, sensor, and mission plan management) for the UAV via commands to the FCME and/or FTCM. The FTCM may process the commands directly or may pass the commands through to other vehicle components. The FTCM has the ability to support commands through critical and non-critical paths for message priority and security.
- The UAV may be equipped with sensors and cameras that provide real-time data to the ground control. In addition, the UAV may be equipped with weapons, such as rockets or bombs. Ground control may remotely launch the UAV's weapons in real time. The UAV may be configured to be carried by one or more platforms (e.g., vehicles) or persons (e.g., soldiers or police officers). The UAV may be carried by one or more dismounted persons in a protective transportation container that protects the system from natural and induced environments.
- The FTCM may provide a variety of services and interfaces within and external to the UAV, such as mission plan services, sensor management, and configuration utilities. The FTCM may enable loading of mission plans (e.g., flight plans, contingency flight plans, communication plans, rate commands, and/or sensor plans) from the ground control, and verify that a loaded mission plan is valid. For example, a mission plan may include one or more flight plans, each with a list of one or more waypoints, timing requirements, sensor plans, and/or weapons plans. The waypoints and timing requirements may indicate where and when, respectively, the UAV should be to achieve a mission set forth by the mission plan. A sensor plan, communications plan, or a weapons plan may indicate how sensors, communication equipment, or weapons aboard the UAV, respectively, should be deployed during the mission.
- While on a mission, the FTCM may ensure compliance with the mission plan, by continuously verifying that the current location of the UAV is according to plan. The FTCM may issue commands to communicate with the ground control (e.g., the GCME) and/or other vehicles during the mission based on the communication plan. The FTCM may also monitor the performance and health of the UAV during the mission. As part of the communication plan or otherwise, the FTCM may provide information about the health of the UAV and/or components of the UAV to the GCME, perhaps as part of a health report. The FTCM may utilize navigational sensors to determine the current location, velocity and/or acceleration of the UAV. Vehicle management system (VMS) software and/or hardware may navigate the UAV. The VMS may manage navigation sensors and provide navigational data to the FTCM.
- The VMS and FTCM may share computer-hardware resources, such as one or more processors or memory, or may utilize separate computer-hardware resources. In some embodiments, the FTCM and/or the VMS may have redundant processors; that is, the FTCM may execute software on one or more active or “primary” processors and have one or more “secondary” processors available to run FTCM software in case the primary processor(s) fail. A similar primary/secondary designation and operation of redundant VMS processors may be used as well.
- The FTCM may receive instructions to adhere to a new mission plan or to change portions of the current mission plan while in operation. The instructions and changes may be communicated from ground control via the GCME, to the FCME, and then to the FTCM. The FCME may provide instructions autonomously to the FTCM as well. Upon receiving the instructions/changes from the FCME/GCME, the FTCM may issue commands to sensors and/or navigational systems (i.e., the VMS) to change sensor deployment and/or course in accordance with (now current) mission plan.
- Software developed for use aboard the UAV (e.g., software components of the FTCM, the FCME, and the VMS) and/or for use by ground control may be designed according to a segmented and layered architecture that provides a framework for well-designed software that promotes loose coupling between “software entities”. Example software entities are software objects, modules, functions, subroutines, code, computer data, data objects, databases, and/or data structures. An example segmented and layered architecture for UAV development is disclosed in U.S. patent application Ser. No. 12/331,274 entitled “Modular Software Architecture for an Unmanned Aerial Vehicle” and filed on Dec. 9, 2008 (“the '274 Application”), which is incorporated by reference for all purposes.
- The division of different software and hardware components for strategic (i.e., GCME/FCME), tactical (i.e., FTCM), and navigational control (i.e., VMS) provides several advantages. This division allows for concentration and specialization of resources within each area, as well as clear-cut responsibilities within each component. This division allows for well-defined interfaces between components, which allows for greater parallelism during software and hardware development. The well-defined interfaces provide isolation for data and control critical to the safety of the UAV. By use of well-defined interfaces and various components of the mission plan (e.g., flight plans, weapons/sensor plans, and communications plans), vehicle control, payload control, and communication control are separated, allowing for ready updating and fault isolation for each of the components and/or well-defined interfaces. Also, software (or hardware) components may be replaced without affecting other components as long as the well-defined interfaces are enforced. The ability to replace components individually eases the process of updating components for maintenance, growth, and/or the addition of new technology.
- The herein-described invention may be applicable to other devices or vehicles as well, such as but not limited to unmanned ground vehicles (UGVs), ground vehicles, manned aerial vehicles, manned or unmanned naval vessels, and/or semi- or completely-automated machinery (e.g., some or all of the components in a factory).
- An Example UAV
- Turning to the figures,
FIG. 1 shows anexample UAV 100, in accordance with embodiments of the invention.FIG. 1 shows theUAV 100 with anelectrical system 110,propulsion units flight management system 130, anavigation system 140, adata link system 150 with anantenna 152,payload sensors body 170, andlanding gear 172. - The
electrical system 110 may include various electrical/electronic devices and equipment to provide and monitor the flow of electricity throughout theUAV 100. One example set of devices are thelights 112. Other example electrical/electronic devices and equipment include, but are not limited to, wires, cables, switches, lights, electrical devices (e.g. capacitors, inductors, diodes, transistors, etc.), light emitting diodes (LEDs), power devices (such as generators and/or batteries), electrical sensors, fuses, and/or circuit breakers. Theelectrical system 110 may also include a control panel as well for monitoring and controlling theelectrical system 110. Theelectrical system 110 may include other electrically-powered devices, such as (but not limited to) anti-collision lights and battery charging/monitoring circuitry. - The
propulsion units UAV 100. The propulsion units may include one or more engines, fans, pumps, rotors, belts, and/or propellers. One or more engine control units (ECUs) may control thepropulsion units propulsion units propulsion units propulsion units more fuel sensors 126 to monitor fuel levels of the fuel tank(s). - The
flight management system 130 may provide flight planning, flight guidance, and flight controls functionality for theUAV 100, akin to the control provided by a human pilot in a manned aircraft. Theflight management system 130 may include flight control algorithms and/or servos (electro-mechanical devices) that manipulate various flight-control surfaces of theUAV 100. For example, one or more servos may control a rudder or aileron(s) of theUAV 100. The flight management system may include a throttle control mechanism, instead or as well. - The
navigation system 140 may provide navigational data, including data about nearby aircraft, to theUAV 100. Thenavigation system 140 may include location devices for theUAV 100, such as, but not limited to, magnetometers, gyroscopes, lasers, Global Positioning System (GPS) receivers, altimeters, inertial navigation units, ground proximity sensors, and other navigation components. The location devices may include additional sensors to provide additional data about the environment for theUAV 100, such as pressure sensors, thermometers, and/or other environment sensors. - The
data link system 150 may permit communication between theUAV 100 and other devices or vehicles. For example, thedata link system 150 may permit communication with other UAVs in use at the same time as theUAV 100. Thedata link system 150 may permit communication with one or more ground control devices as well. Thedata link system 150 may use one or more wireless communication devices, such as anantenna 152, for communication. In an alternative not shown inFIG. 1 , thedata link system 150 may use one or more wired communication devices, such as Ethernet cables, ports, and/or cards, perhaps while theUAV 100 is tethered to the ground. Thedata link system 150 may include one or more (ports for) removable and/or down-loadable storage devices. The removable and/or down-loadable storage devices may store data such as, but not limited to, telemetry and sensor data (e.g., video data, audio data, images, and/or collected data on sensor readings). - The
UAV 100 may be equipped with a payload includingpayload sensors payload sensors UAV 100 may be configured so that thepayload sensors UAV 100 may have abody 170 andlanding gear 172. - The shapes of the
body 170 and/orlanding gear 172 shown inFIG. 1 are examples only and may vary. For example, thebody 170 may have an aerodynamic shape, such as found in a body of a conventional manned aircraft. Thelanding gear 172 may or may not have controls, such as controls that allow thelanding gear 172 to be retracted into thebody 170. - An Example Aerial Vehicle Control System
-
FIG. 2 shows an example aerialvehicle control system 200, in accordance with embodiments of the invention. The aerialvehicle control system 200 includes an aerial vehicle 210 (e.g., a UAV) and aground control 270. Theaerial vehicle 210 includes aprocessor unit 220 with aport 240, a vehicle management system (VMS) 250,optical sensors 260, avideo unit 262, and aUAV radio 264. Theprocessor unit 220 may be configured to execute flight management software, such as but not limited to, a flight technical control manager (FTCM) 230, a flight command and mission execution (CME)component 232, a flight network software (FNS)component 234, middleware software (MS/W) 236, and a flight sensor manager (FSM) 238. - The
FSM 238 may provide theFTCM 230 with an interface tooptical sensors 260 and/orvideo unit 262. Data destined for theFTCM 230 through and to theoptical sensors 260 and/orvideo unit 262 may be sent/received via theFSM 238; the data may include but is not limited to sensor control and status information. - The
FTCM 230 may receive critical vehicle control and status information from theVMS 250 via a native connection. Where possible, point-to-point communication provided bymiddleware software 236 may be used as a communication mechanism between the entities of aerialvehicle control system 200. - The
FNS component 234 may provide an interface and/or support for network services, such as but not limited to, configuration/Reconfiguration of radios, status monitoring (perhaps in conjunction with middleware software 236), and network communication services, such as point-to-point connections, (priority-based) packet routing services (e.g., secure or critical path routing), quality-of-service (QoS) monitoring, and/or remote operation and/or supervision of the aerial vehicle. TheFNS component 234 may enable establishment and maintenance of a number of pathways, such pathways described below with respect toFIG. 3 . -
Middleware software 236 generally may provide interfaces between application software and the operating system (e.g., as shown inFIGS. 3 and 5 ). With regard toFIG. 2 , themiddleware software 236 may provide theFTCM 230 with interfaces for Communication Services (using a Network Software library), to perform checkpoints, obtain checkpoint status and general system services.Middleware software 236 may be able to prioritize one or more messages and thus set up communications pathways of differing priorities, such as described below with respect toFIG. 3 . - The
vehicle management system 250 may include a vehicle management controller (VMC) 252, one ormore navigation sensors 254,training sensors 256, and/or lights 258. Thenavigation sensors 254 may include one or more sensors to provide data used in navigating theaerial vehicle 210, but are not limited to, global positioning system (GPS) or other sensors equipped to receive and/or process navigation signals (perhaps received from one or more ground control devices, other UAVs, and/or satellites), dead-reckoning devices, (laser) rangefinders, inertial guidance sensors (e.g., gyroscopes), compasses, radar emitter and/or detectors, sound sensors, meteorological/environmental sensors (e.g., temperature and/or wind sensors), and/or image processing (e.g., feature and/or landmark detection) systems. The navigational sensors may provide data such as, but not limited to, a current location, velocity, and/or acceleration of theaerial vehicle 210, location(s) of nearby vehicle(s), and/or atmospheric conditions. Thetraining sensors 256 may include, but are not limited to, Multiple Integrated Laser Engagement System (MILES) sensor(s) and/or laser designator(s). Thelights 258 may include one or more lights suitable for various purposes (i.e., anti-collision lights, ground illumination, illumination for video sensors) and may utilize any suitable lighting technology (e.g., incandescent bulbs, fluorescent lighting, light emitting diodes (LEDs), liquid crystal display (LCD), and halogen lighting). - The
optical sensors 260 may include sensors configured to observe various frequencies and types of light, such as but not limited to, visible light, infra-red, ultra-violet, X-rays, microwaves, laser light, and/or electromagnetic pulses. Theoptical sensors 260 may include one or more still cameras, video cameras, and/or specialized detectors/sensors (e.g., X-ray detector, EMP sensor, and/or laser detectors). Theoptical sensors 260 may also include one or more lasers, perhaps used in one or more laser range finders and/or for training purposes. One or more of theoptical sensors 260 may be mounted in gimbal(s) that permit rotation along one or more degrees of freedom. - The
video unit 262 may be configured to receive video or other data from one or more sensors aboard the aerial vehicle 210 (e.g., optical sensors 260), process the video/other data, and then record and/or output the processed (or unprocessed) video/other data. Processing of video/other data may include, but is not limited to, use of compression, decompression, image processing, image enhancement, and/or location determination techniques. Thevideo unit 262 may include one or more video storage devices (e.g., random access memory, flash memory, and disk storage) for storing compressed and/or uncompressed video and/or other data. TheUAV radio 264 may be a radio transceiver configured to communicate with one or more other radios. In particular, theUAV radio 264 may be configured to communicate with one or more ground control radios, such asground control radio 290. - The
ground control 270 may include acontroller 280 and theground control radio 290. Thecontroller 280 may include software, such as, but not limited to, ground command and mission execution (GCME)software 282, ground network software (GNS) 284, and ground sensor management (GSM)software 286. One or more computing devices, such as described below with respect toFIG. 6 , or other computing device(s)/CPUs may act as thecontroller 280. - The
GCME 282,GNS 284, andGSM 286 may perform similar functions for theground control 270 that thecorresponding FCME 232,FNS component 234, andFSM 238 respectively perform for theaerial vehicle 210. Note that theFSM 238 may manage video stream data, perhaps by sending one or more video streams to theGSM 286 without interaction with theFTCM 230. - The
ground control radio 290 may be a radio transceiver configured to communicate with one or more other radios, including theUAV radio 264. Theground control 270 may use theground control radio 290 to send commands and/or data to theaerial vehicle 210. In addition, theground control radio 290 may receive sensor and/or other data from theaerial vehicle 210. - Example Functionality of the Flight Technical Control Manager
- As shown in
FIG. 2 , theFTCM 230 may provide a number of controls and services for the aerialvehicle control system 200. These controls and services may include, but are not limited to, integrated-platform mode (IPM) control, health/telemetry services, mission plan loading, maneuver constraint checks, contingency controls and execution monitoring, a training pass through, sensor controls and services (i.e., light controls, fuel consumption and monitoring via fuel sensors, support for sensor commands, and for sensor/vehicle field of view (FOV) tracking), platform commands and status information including vehicle handoff, and support for a render useless commands. In addition, theFTCM 230 may provide pass-through functionality for theFCME 232 and/orGCME 282; that is, route commands from theFCME 232 and/orGCME 282 to the appropriate destinations and route data from the destinations to theFCME 232 and/orGCME 282. - Integrated-platform mode control may include changing modes as directed by the
FCME 232 and/orGCME 282, reporting mode information, verifying mode changes, and preventing invalid mode changes. TheFTCM 230 may report current platform operating mode and current integrated-platform mode information to theGCME 282. TheFTCM 230 may prevent unintended integrated-platform mode transitions by validating any commands input to the aerialvehicle control system 200, ensuring the commands are appropriate for the current integrated-platform mode, and disabling invalid integrated-platform mode transitions. For example, this prevents unintended activation of a maintenance command during operational flight. Example integrated-platform modes are: integrated-platform-safe mode, integrated-platform-maintenance mode, integrated-platform-training mode, and integrated-platform-operational mode. Other integrated-platform modes are possible as well. The integrated-platform-safe mode may accept a configuration command(s) as appropriate, the integrated-platform-maintenance mode may accept configuration and maintenance command(s) as appropriate, the integrated-platform-training mode may accept a subset of all operational commands as appropriate, and the integrated-platform- operational mode may accept all operational commands as appropriate. - For health services, the
FTCM 230 may monitor internal health, status and/or faults of the aerialvehicle control system 200, including theFNS component 234,middleware software 236,FSM 238 and/orVMS 250 and report the internal health, status and/or faults to theFCME 232 and/orGCME 282. The health report may include availability information, such as whether a component is active, inactive but available or out of service. The health report may include fault-related data such a fault count or rate information, debugging information, fault severity data. The health report may include availability information and/or fault-related data on a vehicle-wide or component-by-component basis. The health report may include logistical information about the vehicle, such as but not limited to fuel and weapon amounts, power levels, battery levels, and/or sensor-related logistical information. Differing health reports may include different amounts of data; for example, a “heartbeat” report may indicate the vehicle and/or major components are available, while a detailed health report may include detailed fault-related data and/or logistical information. TheFTCM 230 may generate health reports for periodic communication (e.g., once a minute for a heartbeat report), upon request from the ground control, according to a mission plan/communication, and/or using other criteria. - The
FTCM 230 may support process monitoring and recovery techniques. Checkpoints provided bymiddleware software 236 may record information associated with a given process to ensure recall of states and status information of the given process if the given process fails. TheFTCM 230 may user services provided bymiddleware software 236 to verify a heartbeat associated with other services, and report any problems to theFCME 232 and/orGCME 282, perhaps as part of a health report. In addition, theFTCM 230 may send a heartbeat signal to theFCME 232 and/orGCME 282 to indicate theFTCM 230 is active. - For telemetry services, the
FTCM 230 may send messages containing telemetry data that includes flight status, VMS status and pre-flight status. Sensors, such asnavigation sensors 254 and/oroptical sensors 260, may provide the telemetry data to theFTCM 230. The telemetry-data messages may be part of a standard operational message set. TheVMS 250 may provide the telemetry-data messages to theFTCM 230. The telemetry-data messages may be in a standard format, such as the Joint Architecture for Unmanned Systems (JAUS) format. The telemetry-data messages also may not be in JAUS format, and thus may require translation to/from JAUS format. - The
FTCM 230 may manage the telemetry data and report it to theFCME 232 and/orGCME 282. In addition to telemetry data, theFTCM 230 may capture engineering flight test data. An engineering ground station (not shown) may monitor the engineering flight test data. The engineering flight test data may include modes and states of theaerial vehicle 210, mission plan monitoring data, and other necessary FTCM-related functionality data. Capture and monitoring of engineering flight test data may support debugging and system characterization during development and may be removed either during a development cycle or of theaerial vehicle 210 or upon final delivery of theaerial vehicle 210. - The
FTCM 230 may enable theaerial vehicle 210 to be flown either manually (e.g., as instructed by the ground control 270) or autonomously. During either manual or autonomous flight, theFTCM 230 may support maneuver constraints of a flight plan. TheFTCM 230 may constantly monitor theaerial vehicle 210 to ensure theaerial vehicle 210 remains within current airspace constraints. TheFCME 232 and/orGCME 282 may provide critical path geometric flight boundary constraints as part of the flight plan to theFTCM 230. TheFTCM 230 may receive incremental updates to the mission plan (including the flight plan) during mission execution. TheFTCM 230 may validate incoming constraints, determine which incoming constraints are acceptable or invalid and/or incorporate only acceptable constraints for the current mission. TheFTCM 230 may notify theFCME 232 and/orGCME 282 about invalid constraints. If theaerial vehicle 210 breaches one or more flight plan constraints, theFTCM 230 may alert theFCME 232 and/orGCME 282. - The
FTCM 230 may support loading of one or more mission plans from theFCME 232 and/orGCME 282. Each mission plan may include, but is not limited to, one or more flight plans, contingency plans, communications plans, sensor plans, and/or weapons plans. The flight plans and/or contingency plans may comprise one or more waypoints and/or one or more maneuver constraints. Each waypoint may be a location or area specifying an intermediate or final destination for the aerial vehicle during the mission and may be specified using two-dimensional (e.g., latitude/longitude, map grid points, roadway intersections, etc.) or three-dimensional coordinates (e.g., each of the above two-dimensional coordinate examples with an elevation coordinate as well). Each maneuver constraint may specify one or more boundaries for the aerial vehicle during the mission plan, one or more minimum or maximum speed limits, and/or one or more sub-flight plans (e.g., constraints within confined airspace or restrictive terrain). The contingency plans may include, but are not limited to, alarm information, command information, and/or contingency flight plans. The communications plans may include, but are not limited to, information to be communicated, times and devices for communication, communication identification information (e.g., device addresses such as but not limited to fully-qualified domain names (FQDNs), medium-access control (MAC) or Internet Protocol (IP) addresses), communication frequencies, security information (e.g., encryption/decryption keys, lists of supported security protocols for security negotiation). Many other components to a mission plan are possible as well. - The
FTCM 230 may first receive the mission plan(s) from theFCME 232 and/orGCME 282. Upon reception of the mission plan(s), theFTCM 230 may provide the mission plan(s) to theVMS 250 and may ensure proper loading of the mission plan(s). After verifying the one or more mission plans have been properly loaded, theFTCM 230 may send a notification message specifying mission plan acceptance to theFCME 232 and/orGCME 282. TheFTCM 230 may copy the one or more mission plan(s) as well. TheFTCM 230 may translate part or all of a given mission plan (including flight plan(s) and/or contingency flight plan(s)) to enable a control interface of theVMS 250 to execute the mission plan. - The
FTCM 230 may perform contingency constraint checking in the context of implementing one or more contingency flight plans in the mission plan(s). Theaerial vehicle 210 may invoke one or more contingency flight plans under specified conditions (discussed below). TheFTCM 230 may interface withFCME 232,GCME 282, and/or theVMS 250 to implement the contingency capabilities. In this context, theFTCM 230 may command theVMS 250 to trigger a contingency behavior, such as land, hover, continue flight plan, and fly to a rally point. - Contingency behaviors can be invoked in several ways: (1) the
FCME 232 and/orGCME 282 may provide a contingency command to theFTCM 230 which in turn commands theVMS 250 to execute a contingency behavior, (2) theFTCM 232 may detect a condition (such as loss of communication with ground control 270) that requires a contingency behavior and commands theVMS 250 to execute a contingency behavior, (3) theFTCM 230 and theVMS 250 lose communications and theVMS 250 executes a contingency behavior, and (4) a flight condition requires a contingency behavior. Some of the flight conditions that may require a contingency behavior include: (a) airspace constraint corridor violations, (b) insufficient fuel thresholds, (c) receiving an excessive number of invalid commands from theFCME 232 and/or or GCME 282 (i.e., determining that the number of invalid commands received, perhaps during a period of time, exceeds a threshold, such as more than two invalid commands within one minute), (d) failure of safety critical processes, (e) loss of contingency management capability, (f) loss of communication with a controller (including manual control), and/or (g) invalid flight plan information received including missing contingency plans. - The
FTCM 230 may monitor execution of the mission plan by theaerial vehicle 210 and provide vehicle-flight status back to FCME 232 and/orGCME 282. The FTCM may perform monitoring continuously, periodically, upon request, or under some other conditions. TheFTCM 230 may provide vehicle-flight status during any flight phases and during either manual or autonomous flight. - The
FTCM 230 may monitor the current location of theaerial vehicle 210 relative to boundaries provided by the flight plan(s) in the mission plan(s). If the current location of theaerial vehicle 210 is within a threshold distance of any flight-plan boundary and/or crosses any flight-plan boundary, theFTCM 230 may execute a contingency behavior and/or send feedback to theground control 270 viaUAV radio 264. - The
FTCM 230 may determine if the various sensors aboard the aerial vehicle 210 (e.g.,optical sensors 260 and/or video unit 262) are operating in accordance with sensor plan(s) of the mission plan. TheFTCM 230 may receive the sensor plan(s) as part or all of the mission plan(s) and send the sensor plan(s) to a sensor manager (not shown inFIG. 2 ) to control the sensors while the mission plan is executed. TheFTCM 230 may send the flight plan(s) of the mission plan(s) toVMS 250 to control the location of the aerial vehicle 210 (i.e., fly the UAV) in accordance with the flight plan. TheFTCM 230 may parcel out required functionality of the mission plan, coordinate on-board managers of the flight plan and/or sensor plan, verify theaerial vehicle 210 is executing the mission plan, and direct the execution of contingency behaviors as need. - For example, a flight plan component of the mission plan may instruct the UAV to fly to 43°51.3′ N/99°12.7′ W at 1645 Zulu time on the mission date via a waypoint at 43°51.293′ N/99°12.665′ W. At 1645 Zulu, a communication plan may instruct the UAV to provide a health report of the UAV to a ground control at address gc1.honeywell.com using a previously determined AES 128-bit key. Then, a sensor plan of the mission plan may indicate that the UAV should activate an infrared sensor at 1646 Zulu. The mission plan may have contingency plan, mission plan and/or weapons plan components that instruct the UAV to fire Weapon #1 if the reading of the infrared sensor indicates a temperature of a heat source directly below the UAV exceeds a threshold amount.
- The
FTCM 230 may provide support for shutdown commands for an engine of theaerial vehicle 210 and/or the entireaerial vehicle 210, including providing safety interlocks to prevent unintended vehicle shutdown. - The
FTCM 230 may support a pass-through capability for training When theaerial vehicle 210 is in the integrated-platform-training mode, theFTCM 230 will interface betweenFCME 232 and/orGCME 282 and theVMS 250. Training support may include the recording of training data in non-volatile memory, providing a pass-through for status information from thetraining sensor 256 to FCME 232 and/orGCME 282, and the ability to change the integrated-platform mode to and from the integrated-platform-training mode, thereby enabling or disabling on-board training systems such as thetraining sensor 256. The pass-through provided by theFTCM 230 may include forwarding training data to a training controller on the ground for processing. The training controller may be part ofcontroller 280 and may determine hit/kill information based on the training data. - As part of the sensor controls and services, the
FTCM 230 may provideFCME 232 and/orGCME 282 with an interface to theoptical sensor 260 and thevideo unit 262 via theFSM 238. TheFTCM 230 may pass-through sensor commands received from theFCME 232 and/orGCME 282 to theFSM 238 and may provide sensor command status from theFSM 238 to the -
FCME 232 and/orGCME 282. - Specifically, the
FTCM 230 may be equipped to send commands to the one or more lasers of theoptical sensors 260. TheFTCM 230 may provide safety mechanisms for the one or more lasers, including but not limited to: (a) sending command(s) to theFSM 238 to turn off hazardous sensor features when transitioning to into the integrated-platform-training mode and (b) sending a command to turn off the laser under various potentially unsafe conditions occur, such as when a laser firing signal is lost, communication with the controller is lost, transfer of control occurs, and/or when a laser fire signal command expires. - The
FTCM 230 may maintain a field of view for one or more of theoptical sensors 260. TheFTCM 230 may send commands to theFSM 238 to maneuver one or more of theoptical sensors 260 mounted in gimbal(s) and to monitor sensor gimbal angles for the gimbal-mounted sensor(s). TheFTCM 230 may determine that theaerial vehicle 210 requires rotation to prevent the gimbal-mounted sensor(s) from reaching hard gimbal limits. TheFTCM 230 may maintain one or more thresholds of gimbal-angle limits. Upon determining a given sensor's gimbal angle exceeded a corresponding gimbal-angle-limit threshold for the given sensor's gimbal, theFTCM 230 may send one or more commands to theVMS 250 to adjust vehicle position and/or azimuth. TheFTCM 230 may also interface with theFSM 238 to provide sensor data (live or stored) to the controlling platform triggered by start and stop commands from theFCME 232 and/orGCME 282. TheFTCM 232 may also provide navigation data from theVMS 250 to the one or moreoptical sensors 260. - The
FTCM 230 may monitor fuel sensors to determine fuel consumption. The FTCM may compare a fuel-consumption level against the requirements of the current mission and provide the appropriate status to theFCME 232 and/orGCME 282. - The
FTCM 230 may provide computing platform services, such as data safety, message operations, and communication monitoring. TheFTCM 230 may enforce data safety of the computing platform by applying cyclic-redundancy checks (CRCs) and/or boundary checking to all messages received (e.g., from the ground control 270) to ensure that safety critical data is not corrupted. TheFTCM 230 may ensure safety and validity of commands through interlock mechanisms, and only allow commands that are valid for the current integrated-platform mode. The interlock mechanisms may prevent unintended operations such as activation of a maintenance command during operational flight. - The
FTCM 230 may provide communication of vehicle commands between theFCME 232 and/orGCME 282 and theVMS 250. An example list of commands includes: activation or resumption of a flight plan or contingency flight plan, tele-supervision command and control, launch commands, landing commands, pre-flight-checklist-condition verification, engine start commands following pre-flight-checklist-condition verification, rate and position “nudge” (minor adjustment) commands concerning up to four degrees of freedom, wave-off commands, waypoint vector commands, manual override commands, flight-route-modification commands, training commands (e.g., MILES commands), emergency commands, shutdown commands, render useless commands, and anti-collision light commands. In addition to the example list of commands and other commands discussed herein, many other types of commands may be communicated between theGCME 282,FCME 232,VMS 250 and/orFTCM 230 as well. - The
FTCM 230 may provide conversions to support messages to and from one or more standard formats, such as the JAUS standard. TheFTCM 230 may support message sequencing. After receiving a message, theFTCM 230 will verify that subsequent messages are valid for the current mode and operations. TheFTCM 230 may ensure proper reception and ordering of messages required to perform a given operation (such as flight plan loading). In the event that theFTCM 230 determines that one or more received command(s) is invalid, theFTCM 230 may reject the command(s), inform the sender, and/or continue current predicable and safe operation (e.g., maintain course and speed upon reception of an invalid activation of flight plan command). - The
FTCM 230 may monitor communication status of one or more data links between theaerial vehicle 210 and other entities, such as one or more ground controllers (e.g., ground control 270) and record any loss of communication. In particular, theFTCM 230 may report the condition where theaerial vehicle 210 is not receiving communication from a ground controller, but the ground controller may be receiving data from theaerial vehicle 210. TheFTCM 230 may support “controller handoffs”; that is, allowing a first ground controller at one level to resume control from a second ground controller at another level. - The
FTCM 230 may support one or more render useless commands sent from theFCME 232 and/or GCME 282A. In response to the render useless command, theFTCM 230 may send zeroize commands (i.e., commands to rewrite stored data and/or software with zeroes and/or random numbers) to theVMS 250 and to all on-board instances, processes, and tasks throughmiddleware software 236. The net effect of the render useless command may be to cause the UAV to be worthless if the UAV is captured or otherwise possessed by an enemy or unauthorized personnel. - The
FTCM 230 may include software and/or hardware developed in accordance with one or more development standards, such as but not limited to the DO-178B Software Considerations in Airborne Systems and Equipment Certification. Also, theFTCM 230 may be engineered to utilize a specified amount of computing resources, such as but not limited to processor time/utilization percentage, memory, input/output (I/O) resources, and/or system resources, such as buffers, pages, operating system tables/structures, semaphores or other mutual exclusion resources, and the like. - Example Message Architecture for an Aerial Vehicle Control System
-
FIG. 3 shows anexample communication architecture 300 for the example aerialvehicle control system 200, in accordance with embodiments of the invention. The relatively-large polygon with dashed lines shown inFIG. 3 outlines components of thecommunication architecture 300 that are also components of theaerial vehicle 210. - The
communication architecture 300 may include at least two priority levels for communications.FIG. 3 shows critical data or higher-priority communications communicated over critical-data pathways using dotted and dashed lines, and primary path or lower-priority communications communicated over primary-path pathways using solid lines. Generally speaking, thecommunication architecture 300 uses critical-data pathways to transmit time-sensitive or mission-critical data between the vehicle and the ground control, including commands for the vehicle (including sensors aboard the vehicle) and some sensor data, and thecommunication architecture 300 uses primary-path pathways to communication information that is less time-sensitive. -
FIG. 3 showsFCME 232 andFTCM 230 as software components sharing a common hardware platform and software architecture. The hardware platform may be a pseudo-integrated computer system (PICS) with one or more central processing units (CPUs), shown inFIG. 3 as the “PICS-CPU” layer.FIG. 3 shows a plurality of software layers supporting theFTCM 230 andFCME 232, including board support package (BSP), operating system (OS), and middleware layers of software. In other embodiments, more or fewer layers of software may be included in the software architecture, such as described in the '274 Application.FIG. 3 depicts theFSM 238 as a software component ofFTCM 230, and theFNS component 234 as a software component of theFCME 232. In other embodiments, theFTCM 230 and/or theFCME 232 may include more or fewer hardware and/or software components than shown inFIG. 3 .FIG. 3 shows the common hardware platform and software architecture equipped withvideo unit 262. -
FIG. 3 shows theVMS 250 as a software component in a separate software architecture and executing on a separate hardware platform than used for theFTCM 230 andFCME 232. Software for theVMS 250 may execute on theVMC 252 hardware platform. TheVMS 250 may have a software architecture with two layers: a VMS OS layer and the VMS layer. In other embodiments, more or fewer layers of software may be included in the software architecture for theVMS 250 and/or may include more or fewer hardware and/or software components than shown inFIG. 3 . TheVMS 250 may communicate withFTCM 230 andFCME 232 via one or more connections between theVMC 250 and the PICS-CPU, such as but not limited to, one or more wires, cables, computer busses, and/or computer-network connections (either wired or wireless). -
FIG. 3 shows a software architecture for theground control processor 270 with theGCME 282 andGSM 286 as software components supported by themiddleware software 288 layer, all executed bycontroller 280. Theground control 270 andaerial vehicle 210 may utilize radios and/or ports to communicate.FIG. 3 shows the ground control with the ground control (GC)radio 290 communicating with theUAV radio 264 via anetwork 292, such as a radio network. Theground control 270 may also, or instead, communicate with theaerial vehicle 210 using a wired or wireless connection to theport 240 of theaerial vehicle 210. For example, theport 240 may be an Ethernet port and thus theground control 270 may communicate over an - Ethernet connection with the aerial vehicle. As another example, the
ground control 270 may include a wireless device, such as but not limited to one or more Wi-Fi, Wi-MAX, wireless local area network (WLAN), or wireless wide area network (WWAN) devices, configured to communicate with one or more similarly equipped devices in theport 240 of theaerial vehicle 210. -
FIG. 3 shows communication of GCME Control/Status between theGCME 282 and theFTCM 230 via theFCME 232 along a primary-path pathway. Theground control 270 may interface with theaerial vehicle 210 via one or more data links between theground control radio 290 andUAV radio 264. TheGCME 282 may provide a variety of commands via the data link(s) to theFTCM 230, including but not limited to sensor commands, modes, airspace constraints, flight and contingency plans, position and rate commands, launch and land commands, anti-collision light commands, engine and power commands, fly-the-sensor maneuver commands, and emergency commands. TheFTCM 230 may provide health and status information to theGCME 282. The health information may include, but is not limited to, information about theFNS component 234,FSM 238,VMS 250, and/or PICS. The status information may include, but is not limited to training status, telemetry data, fuel status and warning, flight status information, airspace constraint breech information, auto-tracking status, contingency plan activation, source data, and flight plan reject/accept status. -
FIG. 3 shows communication of radio configuration data along two primary-path pathways: one utilizing data link(s) established viaground control radio 290,network 292, andUAV radio 264 and another utilizing data link(s) established viaport 240. These two primary-pathways connect theFNS component 234 and theGCME 282. The radio configuration data may control the network, communication configuration and/or theUAV radio 264. -
FIG. 3 shows theGCME 282 communicating mission plans and/or software over the “Mission Plan & Software Load” primary-path pathway to theFTCM 230 viaport 240. The mission plans may include mission plans as described above with respect toFIG. 2 . The software may include software updates to fix software errors/bugs, partially or completely updated software components, and/or partially or completely updated software-architecture layers for the PICS-CPU and/or theVMC 252. New software components and/or software-architecture layers may be installed aboard one or more processors aboard theaerial vehicle 210 in this fashion as well.FTCM 230 may provide data about mission plans and/or software via the Mission Plan & Software Load primary-path pathways as well, such as but not limited to mission-plan-loading status, software-loading status, mission-plan error reports (e.g., errors in formatting or completeness of a given mission plan), software error reports, and/or software-debugging data. -
FIG. 3 shows a “Sensor Control/Status” critical-data pathway between theFTCM 230 and theoptical sensors 260 viaFSM 238 andvideo unit 262. TheFTCM 230 may provide sensor commands, laser control and/or render useless commands tooptical sensors 260 and/orvideo unit 262 viaFSM 238. TheFSM 238 may provide video-sensor data (i.e., compressed video, uncompressed video, sensor health, sensor status, and/or sensor-auto-tracking status from theoptical sensors 260 and/or video unit 262) to theFTCM 230. TheFTCM 230 may pass part or all of the video-sensor data to theGSM 286 and/orGCME 282 via one or more pathways, such as the “Video FSM to GSM/Video Stream” primary-path pathway and/or the “Critical Information” critical-data pathway shown inFIG. 3 . - For example, the
FTCM 230 may implement one or more “Fly the Sensor” commands by monitoring the pointing angle and field of view of a camera of theoptical sensors 260 and controlling the rotation of the vehicle, perhaps via command(s) issued to theVMS 250, to maintain the desired field of view. -
FIG. 3 showsVMS 250 communicating “Vehicle Control/Status” withFTCM 230 over a critical-data pathway. TheFTCM 230 may receive vehicle control and status information from theVMS 250, such as, but not limited to, health and status of theVMC 252, telemetry data, data about the position of theaerial vehicle 210, flight plan execution status, flight plan load status, fuel level and consumption data, and training status. In addition, theFTCM 230 may provide the vehicle control and status information to theVMS 250, such as but not limited to mission plan (flight plan, contingency plan, rate commands (as well as position commands translated into rate commands), launch and land commands, engine and power commands, fly-the-sensor commands, emergency commands, contingency commands, manual/remote operation commands and render useless commands. TheFTCM 230 may pass some or all of the vehicle control and status information to theFCME 232 and/orGCME 282 via one or more pathways, such as the “Critical Information” pathway and/or the “GCME Control/Status” primary-path pathway shown inFIG. 3 . - A Second Example Aerial Vehicle Control System
-
FIG. 4 shows an example aerialvehicle control system 400 with redundant components, in accordance with embodiments of the invention. Compared to the aerialvehicle control system 200 described above with respect toFIG. 2 , the aerialvehicle control system 400 is a similar and enhanced system. As described herein, each components of the aerialvehicle control system 400 with the same name as a component of the aerial vehicle control system 200 (i.e., theFTCMs 430 a/430 b, theFCME 432,FNS component 434,middleware software 436,FSM 438,VMS 450,VMC 452 a/452 b,navigation sensors 454,training sensor 456,lights 458,optical sensors 460,video unit 462,AV Radio 464, ground-control controller 480,GCME 482,GNS 484,GSM 486 and ground-control radio 490) include the same functionality as the corresponding component of the aerial vehicle control system 200 (i.e., theFTCM 230, theFCME 232,FNS component 234,middleware software 236,FSM 238,VMS 250,VMC 252,navigation sensors 254,training sensor 256,lights 258,optical sensors 260,video unit 262,AV Radio 264, ground-control controller 280,GCME 282,GNS 284,GSM 286 and ground-control radio 290, respectively) unless specifically stated otherwise below. - As shown in
FIG. 4 , the aerialvehicle control system 400 includes an aerial vehicle 410 (e.g., a UAV) and aground control 470. Theaerial vehicle 410 includes aredundant processor unit 420, a vehicle management system (VMS) 450, an aerial vehicle (AV)radio 464, and one or more sensor interface(s) 466. - The
redundant processor unit 420 may have two or more processors, each processor configured to execute flight management software, such as but not limited to, one flight technical control manager (FTCM) per processor. Each processor of theredundant processor unit 420 may be configured to execute other software components as well; that is, the software components shown inFIG. 4 inside of the rectangle surrounding theredundant processor unit 420, such as but not limited to a flight command and mission execution (CME)component 432, a flight network system (FNS)component 434, amiddleware software 436, a flight sensor manager (FSM)component 438, atraining component 442, an integrated computer system (ICS)component 444, and asustainment component 446. There may be one or more copies of each of these software components executing on each processor of the redundant processor unit 440, but only one copy is shown inFIG. 4 for simplicity. -
FIG. 4 shows FTCM 430 a andFTCM 430 b with a double-headed arrow indicating communication between theFTCMs FTCM 430 a andFTCM 430 b may be configured with one FTCM acting as an active “primary FTCM” and the other acting as an idle “backup FTCM”. The text below accompanyingFIG. 4A describes the use of primary and backup FTCMs in more detail. - Each FTCM 430 a and 430 b may monitor health and status for each of the VMCs 450 a and 450 b. The primary FTCM may monitor the status of the redundant processor unit via the
ICS 444; that is, theICS 444 may provide at least information about the primary or backup status of each processor of theredundant processor unit 420. TheFTCMs sustainment 446 via FCME 432 (and middleware software 436). TheFTCMs VMCs sustainment 446. - The
FTCMs optical sensors 460 and/orvideo unit 462 via the sensor interface(s) 466; for example, theFTCMs FSM component 438. The sensor interface(s) 466 may manage some or all of theoptical sensors 460 and/orvideo unit 462 directly (that is, without intervention from theFTCMs -
FIG. 4 shows the sensor interface(s) 466 may manage thetraining sensor 456 instead of theVMS 456. Thetraining component 442 may manage thetraining sensor 456, perhaps under the guidance of theFTCMs FCME 432 and/orGCME 482. - As indicated above, the
FTCMs FTCM 230 described above. Some of the differences between theFTCMs - 1. In addition to the integrated-platform modes described above with respect to
FIG. 2 , theFTCMs - 2. Each
VMC FTCMs VMS 450 to activate a stored mission plan. - 3. The
FTCMs training component 442. Thetraining component 442 may include a training controller. Thetraining component 442 may be activated and/or deactivated via command(s) sent via theFCME 432 and/orGCME 482. - 4. The mission plans executed by the
aerial vehicle system 400 may be more complex than those executed by theaerial vehicle system 200. Thus, theFTCMs FTCM 230. - 5.
FIG. 4 shows theFNS component 434 disconnected from theFTCMs FTCMs FNS component 434 under the control of theFCME 232 and/orGCME 282. - 6. The
FTCMs FIG. 4A . - 7. Additional differences are described with respect to
FIGS. 4A and 5 below. - As shown in
FIG. 4 , theVMS 450 includes redundant VMCs 450 a and 450 b. The VMCs 450 a and 450 b may operate as primary and backup VMCs, such as described above with respect to the processors of theredundant processor unit 420. Software for theVMS 450 may manage redundancy by communicating information between primary and backup software components such as described with respect to FTCMs 430 a and 430 b. - An Example Redundant Vehicle Control System
-
FIG. 4A shows anexample redundancy architecture 492 ofredundant FTCMs VMCs FIG. 4A and described above with respect toFIG. 4 , the design of theaerial vehicle system 400 may support a multi-process/multiprocessor implementation. - The
redundancy architecture 492 may indicate components as active or inactive, where active components may process data used in the operation of theaerial system 400 and the inactive components are idle.FIG. 4A shows FTCM 430 a as a primary FTCM andVMC 452 a as a primary VMC, as well as showingFTCM 430 b as a backup FTCM andVMC 452 b as a backup VMC.FIG. 4A shows active components FTCM 430 a,FCME 432,middleware software 436,FSM 438,training component 442,ICS 444,sustainment 446, andVMC 452 a outlined with solid lines.FIG. 4A also shows the inactive components FTCM 430 b andVMC 452 b outlined with dashed lines. - To account for redundant operation of the FTCMs, the
primary FTCM 430 a and the otheractive components backup FTCM 430 b.FIG. 4A shows communication paths from theactive FTCM 430 a and theactive VMC 452 a with solid lines and shows communication paths to thebackup FTCM 430 b and thebackup VMC 452 b as dashed lines. Thebackup FTCM 430 b may maintain/update internal data structures (e.g., integrated-platform-mode or mission-plan-related data structures) based on the information communicated from the primary FTCM. The maintenance of data structures by the backup FTCM based on data from the primary FTCM may enable the backup FTCM to take over (nearly) immediately from the primary FTCM in event of failure of the primary FTCM. - Some examples of data communicated from the
primary FTCM 430 a and/or theactive components backup FTCM 430 b are: integrated-platform-mode information, status of the primary FTCM and the active components, commands from theFCME 432 and/orGCME 482, networking and/or radio information, sensor data (e.g., the current location, velocity and/or acceleration of the aerial vehicle, laser-tracking status, video data), sensor configuration information, information about thelights 458, training plan information, information about mission plan status, vehicle commands, the status of theVMCs synchronization data 494 may be sent to thebackup FTCM 430 b as well. For example, one or more messages may be sent to thebackup FTCM 430 b at (nearly) regular intervals as a “heart beat” indicating the health and activity of theprimary FTCM 430 a.Primary VMC 452 a andbackup VMC 452 b communicate similar data, including synchronization data. Many other kinds of data may be sent to thebackup FTCM 430 b and/orbackup VMC 452 b as well. - In operation, the
backup FTCM 430 b may detect failure of theprimary FTCM 430 a and responsively transition from backup to primary while the failed (and now backup) FTCM 430 a is evaluated and corrected. The designation as primary or backup FTCM may correspond to a processor of theredundant processor unit 420 being designated as primary (i.e., active) or backup (i.e., standby) by theICS 444. Thus, one reason for the failure of a primary FTCM is the corresponding failure of a primary processor of theredundant processor unit 420. Theredundant processor unit 420 may enable a backup processor to take over (nearly) immediately upon failure of the primary processor. In this case, the backup FTCM executing on the backup processor may then act as the primary FTCM once the backup processor becomes the primary processor. - Many other reasons for failure of an FTCM are possible as well, including but not limited to software errors in the FTCM, failure to send and/or receive
synchronization data 494 in an appropriate format and/or within a threshold time interval (i.e., “heart beat” failure), detection of an excessive number failing internal checks or audits, unavailability of resources such as memory or processor time. In addition, an FTCM may change from primary to standby operation (or vice versa) upon request of a user (e.g., ground control). - A Second Example Message Architecture for an Aerial Vehicle Control System
-
FIG. 5 shows anexample communication architecture 500 for the aerial vehicle control system withredundant components 400, in accordance with embodiments of the invention. The relatively-large polygon with dashed lines shown inFIG. 5 outlines components of thecommunication architecture 500 that are also components of theaerial vehicle 410. Thecommunication architecture 500 may include at least two priority levels for communications.FIG. 5 shows critical data or higher-priority communications communicated over critical-data pathways using dotted and dashed lines and primary path or lower-priority communications communicated over primary-path pathways shown using solid lines. -
FIG. 5 shows activesoftware components FNS 434,training component 442,sustainment component 446,FCME 432,FSM 438 and primary FTCM 430 a as software components sharing a common hardware platform and software architecture. More or fewer software components may share a common hardware platform. The hardware platform may be an integrated computer system (ICS) with one or more central processing units (CPUs), shown inFIG. 5 as the “ICS-CPU” layer.FIG. 5 shows a plurality of software layers supporting the active software components, including board support package, operating system, and middleware layers of software. In other embodiments, more or fewer layers of software may be included in the software architecture, such as described in the '274 Application.FIG. 5 shows the common hardware platform and software architecture equipped withoptical sensors 460 as well. -
FIG. 5 shows thebackup FTCM 430 b residing on a separate hardware platform operating the same software architecture (i.e., having ICS-CPU, BSP, OS, and middleware software layers) that supports the active software components. -
FIG. 5 shows theVMS 450 as a software component in a separate software architecture and executing on two separate hardware platforms from the hardware platforms supporting the active software components and thebackup FTCM 430 b. Software for theVMS 450 may execute two hardware platforms:VMCs VMS 450 may have a software architecture with two layers: a VMS OS layer and the VMS layer. In other embodiments, more or fewer layers of software may be included in the software architecture for theVMS 450 and/or may include more or fewer hardware and/or software components than shown inFIG. 5 . The hardware platforms shown inFIG. 5 may communicate with each other via one or more connections between the hardware platforms, such as described above with respect toFIG. 3 . -
FIG. 5 shows a software architecture for theground control processor 470 withcontroller 480 executing theGCME 482 andGSM 486 software components supported by themiddleware software layer 488. Theground control 470 andaerial vehicle 410 may utilize radios and/or ports to communicate.FIG. 5 shows the ground control with the ground control (GC)radio 490 communicating with theUAV radio 464 via anetwork 492. The communication betweenground control 470 and theUAV radio 464, including use of thenetwork 492, may be as described above with respect toFIG. 3 . -
FIG. 5 shows communication of GCME Control/Status between theGCME 482 and theFCME 432 along a primary-path pathway. TheFCME 432 communicates mission plan control and status information to theprimary FTCM 430 a via a separate primary-path pathway. Theground control 470 may interface with theaerial vehicle 410 via one or more data links between theground control radio 490 andUAV radio 464. TheGCME 482 may provide a variety of commands via the data link(s) to theFCME 432 and thence toPrimary FTCM 430 a, including but not limited to sensor commands, modes, airspace constraints, flight and contingency plans, position and rate commands, launch and land commands, anti-collision light commands, engine and power commands, fly-the-sensor maneuver commands, and emergency commands. -
FIG. 5 shows communication of Radio Configuration data along a primary-path pathway utilizing data-links betweenGCME 482 andFNS 434 viaUAV radio 464. The radio configuration data may control the network, communication configuration and/or theUAV radio 464. -
FIG. 5 shows a “Laser Control & Status” critical-data pathway between thePrimary FTCM 430 a to theoptical sensors 460 via theFSM 438. ThePrimary FTCM 430 a may provide sensor commands, laser control and/or render useless commands tooptical sensors 460 viaFSM 438. TheFSM 438 may provide video-sensor data such as described above with respect toFIG. 3 to thePrimary FTCM 430 a. ThePrimary FTCM 430 a and/or theFSM 438 may pass part or all of the video-sensor data to theGSM 286 and/orGCME 282 via one or more pathways, such as the “Sensor Control/Status” critical-data pathway and/or the “Critical Information” critical-data pathway shown inFIG. 5 . TheFTCM 430 a and/orFSM 438 may implement “Fly the Sensor” commands such as described above with respect toFIG. 3 . -
FIG. 5 showsVMS 450 communicating “Vehicle Control/Status” withPrimary FTCM 430 a over a critical-data pathway. The Vehicle Control/Status pathway, including communicated vehicle control and status information, may be as described with respect toFIG. 3 , with the addition of data about the status of theredundant VMCs Primary FTCM 430 a may pass some or all of the vehicle control and status information, along with other health and status information to theFCME 432 and/orGCME 482 via one or more pathways, such as the “Critical Information” critical-data pathway and/or the “GCME Control/Status” primary-path pathway shown inFIG. 5 . The other health and status information may include, but is not limited to, availability (i.e., active, inactive, out of service), fault/debugging data, and/or other information about theFNS component 434,training component 442,sustainment 446,FCME 432,FSM 438,VMS 450,VMCs Backup FTCM 430 b and/or the ICS-CPUs supporting thePrimary FTCM 430 a and/or theBackup FTCM 430 b. The Primary FTCM 430 may provide the vehicle control and status information toVMS 450 viaVMC 452 a and/orVMC 452 b. - The
Primary FTCM 430 a may communicate sustainment signals and monitors (described above with respect toFIG. 4 ) with thesustainment component 446 over the “Sustainment Data” primary-data pathway shown inFIG. 5 . - The
Backup FTCM 430 b may receive data, such as described above with respect toFIGS. 4 and 4A , from thePrimary FTCM 430 a over a critical-path pathway, such as shown inFIG. 5 . Similarly, theBackup VMC 452 b may receive data, such as described above with respect toFIGS. 4 and 4A , from the Primary VMC over a critical-path pathway, such as shown inFIG. 5 . - An Example Computing Device
-
FIG. 6 is a block diagram of anexample computing device 600, comprising aprocessing unit 610,data storage 620, a user interface 630, a network-communication interface 640, and asensor interface 650, in accordance with embodiments of the invention. Acomputing device 600 may be a desktop computer, laptop or notebook computer, personal data assistant (PDA), mobile phone, embedded processor, computer board (e.g., motherboard) or any similar device that is equipped with a processing unit capable of executing machine-language instructions that implement at least part of the herein-describedmethod 700 described in more detail below with respect toFIG. 7 , and/or any or all of the herein-described software, including but not limited to FTCMs, VMSs, software components, video units, operating systems, BSPs, middleware software, and/or software layers. - The
processing unit 610 may include one or more central processing units, computer processors, mobile processors, digital signal processors (DSPs), microprocessors, computer chips, and similar processing units now known and later developed and may execute machine-language instructions and process data. - The
data storage 620 may comprise one or more storage devices. Thedata storage 620 may include read-only memory (ROM), random access memory (RAM), removable-disk-drive memory, hard-disk memory, magnetic-tape memory, flash memory, and similar storage devices (i.e., tangible storage media for data and/or computer instructions executable by a processor) now known and later developed. Thedata storage 620 comprises at least enough storage capacity to contain machine-language instructions 622 anddata structures 624. - The machine-
language instructions 622 and thedata structures 624 contained in thedata storage 620 include instructions executable by theprocessing unit 610 and any storage required, respectively, to perform some or all of the herein-described functions described with respect any or all of the herein-described software, including but not limited to FTCMs, VMSs, software components, operating systems, BSPs, middleware software, video units, and/or software layers, and/or to perform some or all of the procedures described inmethod 700. - The user interface 630 may comprise an input unit 632 and/or an
output unit 634. The input unit 632 may receive user input from a user of thecomputing device 600. The input unit 632 may comprise a steering device, keyboard, a keypad, a touch screen, a computer mouse, a track ball, a joystick, and/or other similar devices, now known or later developed, capable of receiving user input from a user of thecomputing device 600. - The
output unit 634 may provide output to a user of thecomputing device 600. Theoutput unit 634 may comprise a visible output device for generating visual output(s), such as one or more cathode ray tubes (CRT), liquid crystal displays (LCD), light emitting diodes (LEDs), printers, lights, and/or other similar devices, now known or later developed, capable of displaying graphical, textual, and/or numerical information to a user ofcomputing device 600. Theoutput unit 634 may alternately or additionally comprise one or more aural output devices for generating audible output(s), such as a speaker, speaker jack, audio output port, audio output device, earphones, and/or other similar devices, now known or later developed, capable of conveying sound and/or audible information to a user ofcomputing device 600. - Devices making up the input unit 632 and/or the
output unit 634 may be detached and/or attached to the computing device as needed via one or more ports. For example, one or more input devices (e.g., a keyboard and/or mouse) and/or output devices (e.g., a monitor) may be attached via port(s) to the computing device to maintain an aerial vehicle, but detached before the aerial vehicle attempts to take flight. The one or more ports may be part of thecomputing device 600, such as ports for the input unit 632, theoutput unit 634, and/or the network-communication interface 640 described below. - The network-
communication interface 640 may send and receive data over a wired-communication interface and/or a wireless-communication interface. The data may be sent and received using digital and/or analog techniques, and may include textual, graphical, video, audio, binary data, and/or other types of data. The wired-communication interface, if present, may comprise a wire, cable, fiber-optic link or similar physical connection, such as a USB, SCSI, Fire-Wire, and/or RS-232 connection, to a data network, such as a wide area network (WAN), a local area network (LAN), one or more public data networks, such as the Internet, one or more private data networks, or any combination of such networks. The wireless-communication interface, if present, may utilize an air interface, such as a Bluetooth™, ZigBee, Wireless WAN (WWAN), Wi-Fi, and/or WiMAX interface to a data network, such as a WWAN, a Wireless LAN, one or more public data networks (e.g., the Internet), one or more private data networks, or any combination of public and private data networks. In some embodiments, the network-communication interface 640 may send and/or receive data over multiple communication frequencies, as well as being able to select a communication frequency out of the multiple communication frequency for utilization. The wireless-communication interface may also, or instead, include hardware and/or software to receive communications over a data-link via an antenna. - The
sensor interface 650 may permit communication with one or more sensors to permit the sensors to provide sensor data to thecomputing device 600 and/or to receive commands that permit sensor maintenance (e.g., setup commands, configuration parameter settings, and the like). Thesensor interface 650 may include a wired-sensor interface and/or a wireless-sensor interface. Examples of the one or more sensors include, but are not limited to, the herein-described navigation sensors, optical sensors, lights, radios, and/or training sensors. The wired-sensor interface and the wireless-sensor interface may utilize the technologies described above with respect to the wired-communication interface of the network-communication interface 640 and the wireless-communication interface of the network-communication interface 640, respectively. - An Example Method for Executing a Mission Plan
-
FIG. 7 is a flowchart depicting anexample method 700 for executing a mission plan, in accordance with embodiments of the invention. It should be understood that each block in this flowchart and within other flowcharts presented herein may represent electronic hardware, such as, but not limited to, one or more components of the aerial vehicles and/or ground control described above with respect toFIGS. 1-5 and/or the computing device described above with respect toFIG. 6 , and/or computer software, such as, but not limited to, one or more software entities, modules, segments, layers, functions, routines, subroutines, data structures, objects, messages, or portions of computer program code, which includes one or more executable instructions for implementing specific logical functions or steps in the process. - Alternate implementations are included within the scope of the example embodiments in which functions described herein as blocks of the method may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the described embodiments.
-
Method 700 begins atblock 710. Atblock 710, a mission plan may be sent. A ground control may send the mission plan. The mission plan may include the components of mission plans described above, in particular with respect toFIGS. 2 and 4 . - At
block 720, the mission plan may be received. The mission plan may be received by an aerial vehicle, such asaerial vehicle 210 described above with respect toFIGS. 2 and 3 oraerial vehicle 410 described above with respect toFIGS. 4 , 4A, and 5. An FTCM, FCME, VMS and/or other software component designated as an “MP Loader” executing on a designated processor (e.g., a PICS-CPU, VMC, an active ICS-CPU) may receive the mission plan. The mission plan may be loaded via a radio aboard the aerial vehicle and/or via a port of the aerial vehicle, such as described above with respect toFIGS. 2 and 4 . - If the aerial vehicle is equipped with redundant processors, the redundant processors may be synchronized and/or communicate information between primary and backup processors, such as described above with respect
FIGS. 4 , 4A, and 5, and particularly with respect to the ICS-CPUs and VMCs. This synchronization and/or communication may occur continuously throughout operation of the aerial vehicle. - At
block 730, the validity of the mission plan may be determined. The MP Loader may validate the mission plan, perhaps with the aid of other software and/or hardware components. - The MP Loader may validate the mission plan on a mission-plan wide basis, a component-by-component basis, and/or on a data-checking basis. Validity checks on the mission-plan wide basis may ensure a given mission plan has all expected components, such as flight plans or sensor plans. Example validity checks on a component-by-component basis include: (a) determining a flight plan or contingent flight plan has an expected number of waypoints and (b) verifying a sensor plan or weapons plan only utilizes sensors or weapons, respectively, which are aboard the aerial vehicle. Validity checks on a data-checking basis may ensure correct transmission of the received mission plan using cyclic redundancy codes (CRCs) and/or encryption/decryption algorithms. Many other validity checks and bases for validity checking are possible as well.
- If the mission plan is determined to be invalid,
method 700 may proceed to block 732. If the mission plan is determined to be valid,method 700 may proceed to block 734. - At
block 732, part or all of the mission plan may be retransmitted. The ground control and the MP Loader may coordinate the retransmission of the mission plan. Ground control may be notified which portions of the mission plan are requested to be retransmitted, as well as information about which validity check(s) failed at the aerial vehicle. In response, ground control may retransmit part or all of the mission plan to the aerial vehicle. A partial retransmission may be attempted if validity checks determine only part of the mission plan is invalid; e.g., if ground control is informed that only a contingent flight plan is invalid. - Another response may be to abort transmission of the mission plan if, for example, the mission plan needs to be reformulated (e.g., a missing mission-plan component needs to be written or the mission has changed) or if a number of retransmission attempts exceeds a threshold (e.g., the same portions of the mission plan have been resent five times).
- If part or all the mission plan is to be retransmitted,
method 700 may proceed to block 710. If the mission plan is not to be retransmitted,method 700 may end. - At
block 734, a notification that the mission plan is valid may be sent. The MP Loader and/or another software component of the aerial vehicle may send the notification. The notification may include identifying information about the mission plan and/or the aerial vehicle (e.g., “Mission plan ALPHA-4 received and validated at UAV #33”). The notification may include timing and/or resource information as well. - At
block 740, the mission plan may be loaded into one or more processors. The MP Loader may coordinate the loading of the mission plan onto the one or more processors, which may include one or more ICS-CPUs, PICS-CPUs, and/or VMCs as described above with respect toFIGS. 2 , 3, 4, 4A, and 5 and/or a computing device as described above with respect toFIG. 6 . The MP Loader and/or other software component may translate the mission plan into one or more commands before transmission to the processor(s). The commands may be processor-independent (e.g., the same commands are used on all types of processors) or processor-dependent. Once received, the receiving processor(s) may verify, store, and/or execute the mission plan and/or commands. - At
block 750, at least part of the mission plan may be executed. Execution of the mission plan may include executing launch and/or lift-off commands, directing the aerial vehicle to travel along one or more flight plans of the mission plan, and/or executing one or more landing and/or shutdown commands. - The VMS and/or VMCs described above with respect to
FIGS. 2-5A may determine a current location of the aerial vehicle. The current location may be determined using one or more navigation sensors, such as described above with respect toFIGS. 1 , 2, and 4. The current location may be compared to the flight plan, and if the current location of the aerial vehicle is outside the flight plan, a contingent flight plan of the mission plan may be executed. The VMS and/or VMCs may determine a current velocity and/or current acceleration of the aerial vehicle as well. - While traveling along the flight plan, the aerial vehicle may operate as directed by the ground control or operate autonomously. A “hand-off” operation or command may change operation from ground-control controlled to autonomous control or vice versa.
- Sensors aboard the aerial vehicle may operate during execution of the flight plan. For example, camera(s) aboard the aerial vehicle may generate video data. A video unit may compress and send the video data to ground control. Optical, training, and/or navigational sensors may be aboard the aerial vehicle and used as described above with respect to
FIGS. 2 , 3, 4, and 5. The sensors may be operated and controlled according to a sensor plan (which may be a component of the mission plan), as commanded by ground control and/or as directed by software aboard the aerial vehicle. Fuel sensor(s) may receive fuel data. The fuel data may determine a fuel level. Processors aboard the aerial vehicle and/or ground control may communicated sensor data (including but not limited to video data, data from optical, navigational, and/or training sensors, fuel data and/or the fuel level, and feedback from the sensors). Sensor control of the aerial vehicle, e.g., fly-by-sensor operation, may be provided as well. - Communication between software and/or hardware components of the aerial vehicle may be prioritized and/or organized along communication pathways, such as the primary-path and/or critical-data priorities and pathways, described above with respect to
FIGS. 3 and 5 . Communication may take place according to a communication plan, such as described above with respect toFIG. 2 . Communication with the ground control may include health reports, such as described above with respect toFIG. 2 . - The aerial vehicle may be equipped with one or more lights, which may be controlled as commanded by ground control and/or as directed by software aboard the aerial vehicle. The lights act as anti-collision lights by being turned on in response to detecting a nearby vehicle or object. The lights may be controlled by a sensor plan and/or the mission plan as well.
- The aerial vehicle may operate in an integrated-platform mode, such as the integrated-platform modes described above with respect to
FIG. 2 . The aerial vehicle may receive one or more commands while executing the mission plan. The commands may be executed depending on whether the commands are appropriate for the integrated-platform mode. - The aerial vehicle may receive a render useless command, perhaps from the ground control or as part of a contingency plan. In response, the aerial vehicle may zeroize or otherwise scramble/self-destruct memory, hardware, and/or software of the aerial vehicle.
- At
block 760, a determination may be made as to whether the mission plan is complete. The determination may be made based on: (a) a specific indication in the mission plan that the mission plan is complete, (b) execution of a contingent plan indication completion, (c) execution of a completion command (e.g., render useless, shutdown or landing command), (d) an amount of time since receiving communication from the ground control (e.g., if no communication received from ground control within an hour), and/or (e) a state of the aerial vehicle (e.g., the aerial vehicle is powering off or is rendered useless). Other techniques for determining whether the mission plan is complete are possible as well. - If the mission plan is not complete,
method 700 may proceed to block 750. If the mission plan is complete,method 700 may end. - Exemplary embodiments of the present invention have been described above. Those skilled in the art will understand, however, that changes and modifications may be made to the embodiments described without departing from the true scope and spirit of the present invention, which is defined by the claims. It should be understood, however, that this and other arrangements described in detail herein are provided for purposes of example only and that the invention encompasses all modifications and enhancements within the scope and spirit of the following claims. As such, those skilled in the art will appreciate that other arrangements and other elements (e.g. machines, interfaces, functions, orders, and groupings of functions, etc.) can be used instead, and some elements may be omitted altogether.
- Further, many of the elements described herein are functional entities that may be implemented as discrete or distributed components or in conjunction with other components, in any suitable combination and location, and as any suitable combination of hardware, firmware, and/or software.
Claims (21)
1-20. (canceled)
21. An aerial vehicle comprising:
a vehicle management system configured to navigate the aerial vehicle; and
a redundant processing unit comprising a first processor and a second processor, wherein at least one of the first processor or the second processor is configured to:
receive a mission plan comprising a flight plan and a contingency plan,
validate the mission plan by at least determining the mission plan includes the flight plan,
after determining the mission plan is valid, execute the mission plan by at least providing the mission plan to the vehicle management system, wherein the vehicle management system is configured to direct the aerial vehicle to travel along the flight plan, and
synchronize the first processor and the second processor.
22. The aerial vehicle of claim 21 , wherein the first processor is configured to synchronize the first processor and the second processor by at least communicating data to the second processor.
23. The aerial vehicle of claim 22 , wherein the first processor is configured to synchronize the first processor and the second processor by at least communicating data to the second processor at regular intervals.
24. The aerial vehicle of claim 22 , wherein the data comprises at least one of mission execution commands or information about a status of the mission plan.
25. The aerial vehicle of claim 22 , further comprising a sensor, wherein the data comprises at least one of sensor data or data indicative of a configuration of the sensor.
26. The aerial vehicle of claim 25 , wherein the sensor data comprises at least one of data indicating a current location of the aerial vehicle, a velocity of the aerial vehicle, an acceleration of the aerial vehicle, or video data.
27. The aerial vehicle of claim 25 , wherein the sensor comprises at least one of a video sensor, a laser designator, a chemical sensor, a biological sensor, a smoke detector, a radiation detector, or an electromagnetic wave detector.
28. The aerial vehicle of claim 21 , wherein the first processor is configured to receive the mission plan, validate the mission plan, execute the mission plan, and synchronize the first processor and the second processor, and wherein the second processor is configured to detect failure of the first processor and, in response, receive the mission plan, validate the mission plan, and execute the mission plan.
29. The aerial vehicle of claim 28 , wherein the second processor is configured to detect failure of the first processor by at least failing to receive synchronization data from the first processor in an appropriate format or within a threshold time interval.
30. The aerial vehicle of claim 28 , wherein the second processor is configured to detect failure of the first processor by at least detecting a software error in the first processor or unavailability of resources of the first processor.
31. The aerial vehicle of claim 21 , where the redundant processing unit comprises a first redundant processing unit, the aerial vehicle further comprising:
at least one navigational sensor; and
a second redundant processing unit coupled with the first redundant processing unit, wherein the second redundant processing unit comprises a third processor and a fourth processor, wherein at least one of the third processor or the fourth processor is configured to receive navigational data from the at least one navigational sensor, determine a current location of the aerial vehicle based on the navigational data, and communicate the current location of the aerial vehicle to at least one of the first or second processors of the first processing unit.
32. The aerial vehicle of claim 31 , further comprising a fuel sensor, and wherein the second processing unit is configured to receive fuel data from the fuel sensor, determine a fuel level based on the fuel data, and communicate the fuel level to at least one of the first or second processors of the first processing unit, and wherein the first processing unit is configured to communicate the flight path to at least one of the third or fourth processors of the second processing unit.
33. The aerial vehicle of claim 21 , wherein the flight plan comprises one or more waypoints for a particular mission and the contingent flight plan includes a plan to at least one of land the aerial vehicle, hover the aerial vehicle, continue the flight plan, or fly the aerial vehicle to a rally point.
34. A method comprising:
receiving a mission plan at an aerial vehicle, wherein the mission plan comprises a flight plan and a contingency plan;
determining, by at least one of a first processor or a second processor of a redundant processing unit of the aerial vehicle, that the mission plan is valid, wherein determining the mission plan is valid comprises determining the mission plan includes the flight plan;
after determining the mission plan is valid, executing the mission plan by at least providing the mission plan to a vehicle management system of the aerial vehicle, the vehicle management system being configured to navigate the aerial vehicle, wherein the vehicle management system is configured to direct the aerial vehicle to travel along the flight plan; and
with at least one of the first processor or the second processor, synchronizing the first processor and the second processor.
35. The method of claim 34 , further comprising;
determining that the mission plan is not valid; and
responsively requesting retransmission of at least part of the mission plan.
36. The method of claim 34 , wherein synchronizing the first processor and the second processor comprises communicating data from the first processor to the second processor.
37. The method of claim 36 , where communicating data from the first processor to the second processor comprises communicating data from the first processor to the second processor at regular intervals.
38. The method of claim 36 , wherein the data comprises at least one of mission execution commands or information about a status of the mission plan, sensor data, or data indicative of a configuration of the sensor.
39. The method of claim 34 , wherein receiving the mission plan comprises receiving the mission plan by the first processor, wherein determining that the mission plan is valid comprises determining, by the first processor, that the mission plan is valid, and wherein executing the mission plan comprises executing the mission plan by the first processor, the method further comprising detecting, by the second processor, failure of the first processor, and, in response:
receiving, by the second processor, the mission plan;
validating, by the second processor, the mission plan; and
executing, by the processor, the mission plan.
40. The method of claim 39 , wherein detecting, by the second processor, failure of the first processor comprises at least one of failing to receive synchronization data from the first processor in an appropriate format or within a threshold time interval, or detecting a software error in the first processor or unavailability of resources of the first processor.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/932,623 US8600602B1 (en) | 2009-07-06 | 2013-07-01 | Flight technical control management for an unmanned aerial vehicle |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/497,788 US8515609B2 (en) | 2009-07-06 | 2009-07-06 | Flight technical control management for an unmanned aerial vehicle |
US13/932,623 US8600602B1 (en) | 2009-07-06 | 2013-07-01 | Flight technical control management for an unmanned aerial vehicle |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/497,788 Division US8515609B2 (en) | 2009-07-06 | 2009-07-06 | Flight technical control management for an unmanned aerial vehicle |
Publications (2)
Publication Number | Publication Date |
---|---|
US20130311009A1 true US20130311009A1 (en) | 2013-11-21 |
US8600602B1 US8600602B1 (en) | 2013-12-03 |
Family
ID=43535465
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/497,788 Expired - Fee Related US8515609B2 (en) | 2009-07-06 | 2009-07-06 | Flight technical control management for an unmanned aerial vehicle |
US13/932,623 Expired - Fee Related US8600602B1 (en) | 2009-07-06 | 2013-07-01 | Flight technical control management for an unmanned aerial vehicle |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/497,788 Expired - Fee Related US8515609B2 (en) | 2009-07-06 | 2009-07-06 | Flight technical control management for an unmanned aerial vehicle |
Country Status (1)
Country | Link |
---|---|
US (2) | US8515609B2 (en) |
Cited By (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103823362A (en) * | 2014-02-17 | 2014-05-28 | 南京航空航天大学 | Arbitration mechanism-based similar dual-redundancy flight control computer and redundancy control method |
US9070101B2 (en) | 2007-01-12 | 2015-06-30 | Fatdoor, Inc. | Peer-to-peer neighborhood delivery multi-copter and method |
CN105116907A (en) * | 2015-07-20 | 2015-12-02 | 清华大学 | Method for designing data transmission and control system of miniature unmanned aerial vehicle |
WO2016003635A1 (en) * | 2014-06-30 | 2016-01-07 | Google Inc. | Systems and methods for updating software in a hazard detection system |
WO2016100286A1 (en) * | 2014-12-15 | 2016-06-23 | Sikorsky Aircraft Corporation | Method and system for teaming manned and unmanned aerial vehicles |
CN105866780A (en) * | 2016-04-12 | 2016-08-17 | 张萍 | Unmanned aerial vehicle for searching and rescuing based on ultrasonic detection |
WO2016179637A1 (en) * | 2015-05-12 | 2016-11-17 | Precision Autonomy Pty Ltd | Systems and methods of unmanned vehicle control and monitoring |
US20170086048A1 (en) * | 2015-09-23 | 2017-03-23 | Hyundai Motor Company | Apparatus and Method for Sending SOS in Vehicle Engaged with Uninhabited Aerial Vehicle |
WO2017147142A1 (en) * | 2016-02-22 | 2017-08-31 | Unmanned Innovation Inc. | Unmanned aerial vehicle visual line of sight control |
US9908638B1 (en) * | 2016-05-27 | 2018-03-06 | Kitty Hawk Corporation | Impact velocity reduction by mass ejection |
US9915945B2 (en) | 2016-08-04 | 2018-03-13 | International Business Machines Corporation | Lost person rescue drone |
WO2017172809A3 (en) * | 2016-03-31 | 2018-07-26 | Unmanned Innovation, Inc. | Unmanned aerial vehicle modular command priority determination and filtering system |
US10112721B2 (en) * | 2015-10-14 | 2018-10-30 | Flirtey Holdings, Inc. | Parachute deployment system for an unmanned aerial vehicle |
US10147329B2 (en) | 2015-03-31 | 2018-12-04 | SZ DJI Technology Co., Ltd. | Open platform for flight restricted region |
WO2019067285A1 (en) * | 2017-09-27 | 2019-04-04 | Nio Usa, Inc. | Dual-network for fault tolerance |
US20190163178A1 (en) * | 2017-11-29 | 2019-05-30 | Nio Usa, Inc. | Method and apparatus for simultaneous processing and logging of automotive vision system with controls and fault monitoring |
US10507914B2 (en) | 2013-03-15 | 2019-12-17 | Flir Detection, Inc. | Spooler for unmanned aerial vehicle system |
US10573319B2 (en) | 2013-11-12 | 2020-02-25 | Apple Inc. | Always-on audio control for mobile device |
US10618655B2 (en) | 2015-10-14 | 2020-04-14 | Flirtey Holdings, Inc. | Package delivery mechanism in an unmanned aerial vehicle |
US10671067B2 (en) | 2018-01-15 | 2020-06-02 | Qualcomm Incorporated | Managing limited safe mode operations of a robotic vehicle |
US10762795B2 (en) | 2016-02-08 | 2020-09-01 | Skydio, Inc. | Unmanned aerial vehicle privacy controls |
US20210004004A1 (en) * | 2019-07-05 | 2021-01-07 | Liebherr Mining Equipment Newport News Co. | Method for autonomously controlling a vehicle |
US11242143B2 (en) | 2016-06-13 | 2022-02-08 | Skydio, Inc. | Unmanned aerial vehicle beyond visual line of sight control |
US20220266988A1 (en) * | 2021-02-19 | 2022-08-25 | Beta Air, Llc | Methods and systems for fall back flight control configured for use in electric aircraft |
US11462116B2 (en) | 2014-04-17 | 2022-10-04 | SZ DJI Technology Co., Ltd. | Polygon shaped vehicle restriction zones |
US11749122B1 (en) * | 2019-12-12 | 2023-09-05 | Amazon Technologies, Inc. | Multi-device redundant flight controller |
US11840333B2 (en) | 2017-06-02 | 2023-12-12 | Flirtey Holdings, Inc. | Package delivery mechanism |
US12087171B2 (en) | 2020-07-15 | 2024-09-10 | Rockwell Collins, Inc. | Assurance module |
US12117320B2 (en) | 2014-05-29 | 2024-10-15 | Apple Inc. | System on a chip with always-on component with powered-down configurations to process audio samples |
Families Citing this family (345)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9459622B2 (en) | 2007-01-12 | 2016-10-04 | Legalforce, Inc. | Driverless vehicle commerce network and community |
US9064288B2 (en) | 2006-03-17 | 2015-06-23 | Fatdoor, Inc. | Government structures and neighborhood leads in a geo-spatial environment |
US9373149B2 (en) | 2006-03-17 | 2016-06-21 | Fatdoor, Inc. | Autonomous neighborhood vehicle commerce network and community |
US9002754B2 (en) | 2006-03-17 | 2015-04-07 | Fatdoor, Inc. | Campaign in a geo-spatial environment |
US8965409B2 (en) | 2006-03-17 | 2015-02-24 | Fatdoor, Inc. | User-generated community publication in an online neighborhood social network |
US9037516B2 (en) | 2006-03-17 | 2015-05-19 | Fatdoor, Inc. | Direct mailing in a geo-spatial environment |
US9071367B2 (en) | 2006-03-17 | 2015-06-30 | Fatdoor, Inc. | Emergency including crime broadcast in a neighborhood social network |
IL183024A0 (en) * | 2007-05-06 | 2008-03-20 | Gita Technologies Ltd | Safe self-destruction of data |
WO2009151863A2 (en) * | 2008-06-10 | 2009-12-17 | Myers Wolin, Llc | A network gateway for time-critical and mission-critical networks |
CN107655362A (en) | 2009-02-02 | 2018-02-02 | 威罗门飞行公司 | Multimode unmanned aerial vehicle |
US9728006B2 (en) * | 2009-07-20 | 2017-08-08 | Real Time Companies, LLC | Computer-aided system for 360° heads up display of safety/mission critical data |
US9456185B2 (en) | 2009-08-26 | 2016-09-27 | Geotech Environmental Equipment, Inc. | Helicopter |
CN106081109B (en) | 2009-09-09 | 2020-09-08 | 威罗门飞行公司 | System for a transmitter for a remotely operated unmanned aerial vehicle |
KR101914305B1 (en) | 2009-09-09 | 2018-11-01 | 에어로바이론먼트, 인크. | Elevon control system |
US9163909B2 (en) * | 2009-12-11 | 2015-10-20 | The Boeing Company | Unmanned multi-purpose ground vehicle with different levels of control |
US8590828B2 (en) * | 2010-02-24 | 2013-11-26 | Robert Marcus | Rotocraft |
TWI465872B (en) * | 2010-04-26 | 2014-12-21 | Hon Hai Prec Ind Co Ltd | Unmanned aerial vehicle and method for collecting data using the unmanned aerial vehicle |
US9064222B2 (en) * | 2010-05-14 | 2015-06-23 | The Boeing Company | Real time mission planning |
WO2012002976A1 (en) * | 2010-07-01 | 2012-01-05 | Mearthane Products Corporation | High performance resilient skate wheel with compression modulus gradient |
US9981740B2 (en) * | 2010-08-06 | 2018-05-29 | Northrup Grumman Systems Corporation | Layered architecture for customer payload systems |
US8774982B2 (en) | 2010-08-26 | 2014-07-08 | Leptron Industrial Robotic Helicopters, Inc. | Helicopter with multi-rotors and wireless capability |
TW201235949A (en) * | 2011-02-24 | 2012-09-01 | Hon Hai Prec Ind Co Ltd | Unmanned aerial vehicle and method for adjusting control command of the unmanned aerial vehicle |
US9766337B2 (en) * | 2011-02-28 | 2017-09-19 | The Boeing Company | Alternative communications for an air vehicle |
US8644512B2 (en) * | 2011-03-17 | 2014-02-04 | Massachusetts Institute Of Technology | Mission planning interface for accessing vehicle resources |
GB201105520D0 (en) | 2011-03-31 | 2011-08-17 | Bae Systems Plc | Unmanned air vehicle communications |
US20130021475A1 (en) * | 2011-07-21 | 2013-01-24 | Canant Ross L | Systems and methods for sensor control |
ITTO20110681A1 (en) * | 2011-07-27 | 2013-01-28 | Csp Innovazione Nelle Ict Scarl | METHOD TO ALLOW MISSIONS OF AIR VEHICLES WITHOUT PILOT, IN PARTICULAR IN NON-SEGREGATED AIR SPACES |
TW201307155A (en) * | 2011-08-01 | 2013-02-16 | Hon Hai Prec Ind Co Ltd | System and method for simulating a control flight test of an unmanned aerial vehicle |
US8897931B2 (en) * | 2011-08-02 | 2014-11-25 | The Boeing Company | Flight interpreter for captive carry unmanned aircraft systems demonstration |
WO2013103403A2 (en) * | 2011-09-30 | 2013-07-11 | Aurora Flight Sciences Corporation | Hardware-based weight and range limitation system, apparatus and method |
WO2013062577A1 (en) * | 2011-10-28 | 2013-05-02 | Hewlett-Packard Development Company, L.P. | Management of a computer |
EP2780869B1 (en) * | 2011-11-15 | 2019-03-13 | Insitu, Inc. | System and associated method of controlling range and payload for unmanned aerial vehicles |
US9315178B1 (en) | 2012-04-13 | 2016-04-19 | Google Inc. | Model checking for autonomous vehicles |
AU2013204965B2 (en) | 2012-11-12 | 2016-07-28 | C2 Systems Limited | A system, method, computer program and data signal for the registration, monitoring and control of machines and devices |
US8798922B2 (en) * | 2012-11-16 | 2014-08-05 | The Boeing Company | Determination of flight path for unmanned aircraft in event of in-flight contingency |
US9113347B2 (en) | 2012-12-05 | 2015-08-18 | At&T Intellectual Property I, Lp | Backhaul link for distributed antenna system |
US10009065B2 (en) | 2012-12-05 | 2018-06-26 | At&T Intellectual Property I, L.P. | Backhaul link for distributed antenna system |
US9776716B2 (en) | 2012-12-19 | 2017-10-03 | Elwah LLC | Unoccupied flying vehicle (UFV) inter-vehicle communication for hazard handling |
US9540102B2 (en) | 2012-12-19 | 2017-01-10 | Elwha Llc | Base station multi-vehicle coordination |
US9527587B2 (en) | 2012-12-19 | 2016-12-27 | Elwha Llc | Unoccupied flying vehicle (UFV) coordination |
US9747809B2 (en) | 2012-12-19 | 2017-08-29 | Elwha Llc | Automated hazard handling routine activation |
US9527586B2 (en) | 2012-12-19 | 2016-12-27 | Elwha Llc | Inter-vehicle flight attribute communication for an unoccupied flying vehicle (UFV) |
US10518877B2 (en) | 2012-12-19 | 2019-12-31 | Elwha Llc | Inter-vehicle communication for hazard handling for an unoccupied flying vehicle (UFV) |
US9235218B2 (en) | 2012-12-19 | 2016-01-12 | Elwha Llc | Collision targeting for an unoccupied flying vehicle (UFV) |
US9669926B2 (en) | 2012-12-19 | 2017-06-06 | Elwha Llc | Unoccupied flying vehicle (UFV) location confirmance |
US10279906B2 (en) | 2012-12-19 | 2019-05-07 | Elwha Llc | Automated hazard handling routine engagement |
US9567074B2 (en) | 2012-12-19 | 2017-02-14 | Elwha Llc | Base station control for an unoccupied flying vehicle (UFV) |
US9405296B2 (en) | 2012-12-19 | 2016-08-02 | Elwah LLC | Collision targeting for hazard handling |
US9810789B2 (en) | 2012-12-19 | 2017-11-07 | Elwha Llc | Unoccupied flying vehicle (UFV) location assurance |
AT515454A3 (en) * | 2013-03-14 | 2018-07-15 | Fts Computertechnik Gmbh | Method for handling errors in a central control unit and control unit |
US9525524B2 (en) | 2013-05-31 | 2016-12-20 | At&T Intellectual Property I, L.P. | Remote distributed antenna system |
US9999038B2 (en) | 2013-05-31 | 2018-06-12 | At&T Intellectual Property I, L.P. | Remote distributed antenna system |
US20150025927A1 (en) * | 2013-07-16 | 2015-01-22 | Raytheon Company | Mission component evaluation and response architecture |
US9676472B2 (en) * | 2013-08-30 | 2017-06-13 | Insitu, Inc. | Systems and methods for configurable user interfaces |
WO2015108586A2 (en) * | 2013-10-21 | 2015-07-23 | Kespry, Inc. | System and methods for execution of recovery actions on an unmanned aerial vehicle |
WO2016172251A1 (en) * | 2015-04-22 | 2016-10-27 | Kespry, Inc. | Systems and methods for execution of recovery actions on an unmanned aerial vehicle |
US8897697B1 (en) | 2013-11-06 | 2014-11-25 | At&T Intellectual Property I, Lp | Millimeter-wave surface-wave communications |
US9209902B2 (en) | 2013-12-10 | 2015-12-08 | At&T Intellectual Property I, L.P. | Quasi-optical coupler |
US9915950B2 (en) * | 2013-12-31 | 2018-03-13 | Polysync Technologies, Inc. | Autonomous vehicle interface system |
US9439367B2 (en) | 2014-02-07 | 2016-09-13 | Arthi Abhyanker | Network enabled gardening with a remotely controllable positioning extension |
WO2015140517A1 (en) * | 2014-03-17 | 2015-09-24 | Bae Systems Plc | Producing data describing target measurements |
EP2924529A1 (en) * | 2014-03-26 | 2015-09-30 | Airbus Defence and Space GmbH | System for a vehicle with redundant computers |
US9457901B2 (en) | 2014-04-22 | 2016-10-04 | Fatdoor, Inc. | Quadcopter with a printable payload extension system and method |
US9004396B1 (en) | 2014-04-24 | 2015-04-14 | Fatdoor, Inc. | Skyteboard quadcopter and method |
US9022324B1 (en) | 2014-05-05 | 2015-05-05 | Fatdoor, Inc. | Coordination of aerial vehicles through a central server |
US9311760B2 (en) | 2014-05-12 | 2016-04-12 | Unmanned Innovation, Inc. | Unmanned aerial vehicle authorization and geofence envelope determination |
US9273981B1 (en) | 2014-05-12 | 2016-03-01 | Unmanned Innovation, Inc. | Distributed unmanned aerial vehicle architecture |
US9499264B2 (en) | 2014-05-30 | 2016-11-22 | Sikorsky Aircraft Corporation | Unmanned vehicle operating modes |
US9971985B2 (en) | 2014-06-20 | 2018-05-15 | Raj Abhyanker | Train based community |
US9441981B2 (en) | 2014-06-20 | 2016-09-13 | Fatdoor, Inc. | Variable bus stops across a bus route in a regional transportation network |
US9953287B1 (en) | 2014-07-01 | 2018-04-24 | Amazon Technologies, Inc. | Utilizing automated aerial vehicles for transporting priority pick items |
US9451020B2 (en) | 2014-07-18 | 2016-09-20 | Legalforce, Inc. | Distributed communication of independent autonomous vehicles to provide redundancy and performance |
US20160016664A1 (en) * | 2014-07-19 | 2016-01-21 | Umm Al-Qura University | Unmanned aerial delivery device |
JP6784434B2 (en) | 2014-07-30 | 2020-11-11 | エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd | Methods, UAV control programs, unmanned aerial vehicles, and control systems |
US9692101B2 (en) | 2014-08-26 | 2017-06-27 | At&T Intellectual Property I, L.P. | Guided wave couplers for coupling electromagnetic waves between a waveguide surface and a surface of a wire |
US9768833B2 (en) | 2014-09-15 | 2017-09-19 | At&T Intellectual Property I, L.P. | Method and apparatus for sensing a condition in a transmission medium of electromagnetic waves |
US10063280B2 (en) | 2014-09-17 | 2018-08-28 | At&T Intellectual Property I, L.P. | Monitoring and mitigating conditions in a communication network |
US9754496B2 (en) | 2014-09-30 | 2017-09-05 | Elwha Llc | System and method for management of airspace for unmanned aircraft |
US9615269B2 (en) | 2014-10-02 | 2017-04-04 | At&T Intellectual Property I, L.P. | Method and apparatus that provides fault tolerance in a communication network |
US9685992B2 (en) | 2014-10-03 | 2017-06-20 | At&T Intellectual Property I, L.P. | Circuit panel network and methods thereof |
US9503189B2 (en) | 2014-10-10 | 2016-11-22 | At&T Intellectual Property I, L.P. | Method and apparatus for arranging communication sessions in a communication system |
US9762289B2 (en) | 2014-10-14 | 2017-09-12 | At&T Intellectual Property I, L.P. | Method and apparatus for transmitting or receiving signals in a transportation system |
US9973299B2 (en) | 2014-10-14 | 2018-05-15 | At&T Intellectual Property I, L.P. | Method and apparatus for adjusting a mode of communication in a communication network |
US9780834B2 (en) | 2014-10-21 | 2017-10-03 | At&T Intellectual Property I, L.P. | Method and apparatus for transmitting electromagnetic waves |
US9520945B2 (en) | 2014-10-21 | 2016-12-13 | At&T Intellectual Property I, L.P. | Apparatus for providing communication services and methods thereof |
US9627768B2 (en) | 2014-10-21 | 2017-04-18 | At&T Intellectual Property I, L.P. | Guided-wave transmission device with non-fundamental mode propagation and methods for use therewith |
US9653770B2 (en) | 2014-10-21 | 2017-05-16 | At&T Intellectual Property I, L.P. | Guided wave coupler, coupling module and methods for use therewith |
US9312919B1 (en) | 2014-10-21 | 2016-04-12 | At&T Intellectual Property I, Lp | Transmission device with impairment compensation and methods for use therewith |
US9769020B2 (en) | 2014-10-21 | 2017-09-19 | At&T Intellectual Property I, L.P. | Method and apparatus for responding to events affecting communications in a communication network |
US9577306B2 (en) | 2014-10-21 | 2017-02-21 | At&T Intellectual Property I, L.P. | Guided-wave transmission device and methods for use therewith |
US10669042B2 (en) | 2014-10-23 | 2020-06-02 | Wet | Unmanned aerial vehicle with lighting and cooling therefor |
US10243784B2 (en) | 2014-11-20 | 2019-03-26 | At&T Intellectual Property I, L.P. | System for generating topology information and methods thereof |
US10009067B2 (en) | 2014-12-04 | 2018-06-26 | At&T Intellectual Property I, L.P. | Method and apparatus for configuring a communication interface |
US9742462B2 (en) | 2014-12-04 | 2017-08-22 | At&T Intellectual Property I, L.P. | Transmission medium and communication interfaces and methods for use therewith |
US9544006B2 (en) | 2014-11-20 | 2017-01-10 | At&T Intellectual Property I, L.P. | Transmission device with mode division multiplexing and methods for use therewith |
US9461706B1 (en) | 2015-07-31 | 2016-10-04 | At&T Intellectual Property I, Lp | Method and apparatus for exchanging communication signals |
US10340573B2 (en) | 2016-10-26 | 2019-07-02 | At&T Intellectual Property I, L.P. | Launcher with cylindrical coupling device and methods for use therewith |
US9997819B2 (en) | 2015-06-09 | 2018-06-12 | At&T Intellectual Property I, L.P. | Transmission medium and method for facilitating propagation of electromagnetic waves via a core |
US9800327B2 (en) | 2014-11-20 | 2017-10-24 | At&T Intellectual Property I, L.P. | Apparatus for controlling operations of a communication device and methods thereof |
US9680670B2 (en) | 2014-11-20 | 2017-06-13 | At&T Intellectual Property I, L.P. | Transmission device with channel equalization and control and methods for use therewith |
US9954287B2 (en) | 2014-11-20 | 2018-04-24 | At&T Intellectual Property I, L.P. | Apparatus for converting wireless signals and electromagnetic waves and methods thereof |
US9654173B2 (en) | 2014-11-20 | 2017-05-16 | At&T Intellectual Property I, L.P. | Apparatus for powering a communication device and methods thereof |
US9656805B1 (en) | 2014-12-12 | 2017-05-23 | Amazon Technologies, Inc. | Mobile base utilizing transportation units for receiving items |
US9928474B1 (en) | 2014-12-12 | 2018-03-27 | Amazon Technologies, Inc. | Mobile base utilizing transportation units for delivering items |
WO2016100796A1 (en) * | 2014-12-19 | 2016-06-23 | Aerovironment, Inc. | Supervisory safety system for controlling and limiting unmanned aerial system (uas) operations |
US10366616B2 (en) * | 2015-01-09 | 2019-07-30 | Botlink, Llc | System and method of collision avoidance in unmanned aerial vehicles |
US10144036B2 (en) | 2015-01-30 | 2018-12-04 | At&T Intellectual Property I, L.P. | Method and apparatus for mitigating interference affecting a propagation of electromagnetic waves guided by a transmission medium |
US9454157B1 (en) | 2015-02-07 | 2016-09-27 | Usman Hafeez | System and method for controlling flight operations of an unmanned aerial vehicle |
US9454907B2 (en) | 2015-02-07 | 2016-09-27 | Usman Hafeez | System and method for placement of sensors through use of unmanned aerial vehicles |
WO2016131005A1 (en) | 2015-02-13 | 2016-08-18 | Unmanned Innovation, Inc. | Unmanned aerial vehicle sensor activation and correlation |
US20160307447A1 (en) * | 2015-02-13 | 2016-10-20 | Unmanned Innovation, Inc. | Unmanned aerial vehicle remote flight planning system |
US9471059B1 (en) | 2015-02-17 | 2016-10-18 | Amazon Technologies, Inc. | Unmanned aerial vehicle assistant |
US9876570B2 (en) | 2015-02-20 | 2018-01-23 | At&T Intellectual Property I, Lp | Guided-wave transmission device with non-fundamental mode propagation and methods for use therewith |
US9540121B2 (en) | 2015-02-25 | 2017-01-10 | Cisco Technology, Inc. | Pre-flight self test for unmanned aerial vehicles (UAVs) |
US9809305B2 (en) * | 2015-03-02 | 2017-11-07 | Amazon Technologies, Inc. | Landing of unmanned aerial vehicles on transportation vehicles for transport |
US9749013B2 (en) | 2015-03-17 | 2017-08-29 | At&T Intellectual Property I, L.P. | Method and apparatus for reducing attenuation of electromagnetic waves guided by a transmission medium |
US9714088B2 (en) * | 2015-03-27 | 2017-07-25 | Amazon Technologies, Inc. | Unmanned vehicle rollback |
US9663226B2 (en) | 2015-03-27 | 2017-05-30 | Amazon Technologies, Inc. | Influencing acceptance of messages in unmanned vehicles |
US9930027B2 (en) | 2015-03-27 | 2018-03-27 | Amazon Technologies, Inc. | Authenticated messages between unmanned vehicles |
US9912655B2 (en) | 2015-03-27 | 2018-03-06 | Amazon Technologies, Inc. | Unmanned vehicle message exchange |
CN107408352B (en) | 2015-03-31 | 2021-07-09 | 深圳市大疆创新科技有限公司 | System and method for geo-fencing device communication |
EP3254404A4 (en) | 2015-03-31 | 2018-12-05 | SZ DJI Technology Co., Ltd. | Authentication systems and methods for generating flight regulations |
KR101651890B1 (en) * | 2015-04-01 | 2016-09-09 | 고려대학교 산학협력단 | Apparatus for providing delay tolerant networking service based on drone fleet |
US10224981B2 (en) | 2015-04-24 | 2019-03-05 | At&T Intellectual Property I, Lp | Passive electrical coupling device and methods for use therewith |
US9705561B2 (en) | 2015-04-24 | 2017-07-11 | At&T Intellectual Property I, L.P. | Directional coupling device and methods for use therewith |
US9793954B2 (en) | 2015-04-28 | 2017-10-17 | At&T Intellectual Property I, L.P. | Magnetic coupling device and methods for use therewith |
US9948354B2 (en) | 2015-04-28 | 2018-04-17 | At&T Intellectual Property I, L.P. | Magnetic coupling device with reflective plate and methods for use therewith |
US9490869B1 (en) | 2015-05-14 | 2016-11-08 | At&T Intellectual Property I, L.P. | Transmission medium having multiple cores and methods for use therewith |
US9748626B2 (en) | 2015-05-14 | 2017-08-29 | At&T Intellectual Property I, L.P. | Plurality of cables having different cross-sectional shapes which are bundled together to form a transmission medium |
US9871282B2 (en) | 2015-05-14 | 2018-01-16 | At&T Intellectual Property I, L.P. | At least one transmission medium having a dielectric surface that is covered at least in part by a second dielectric |
US10650940B2 (en) | 2015-05-15 | 2020-05-12 | At&T Intellectual Property I, L.P. | Transmission medium having a conductive material and methods for use therewith |
CN104932286A (en) * | 2015-05-18 | 2015-09-23 | 国家电网公司 | Nacelle three-dimensional dynamic model and control method |
US9917341B2 (en) | 2015-05-27 | 2018-03-13 | At&T Intellectual Property I, L.P. | Apparatus and method for launching electromagnetic waves and for modifying radial dimensions of the propagating electromagnetic waves |
US10059459B2 (en) | 2015-05-28 | 2018-08-28 | Kespry Inc. | Unmanned aerial vehicle recovery system |
US9874874B2 (en) * | 2015-05-29 | 2018-01-23 | Northrop Grumman Systems Corporation | Dynamic compliance monitoring of unmanned vehicles |
US10103801B2 (en) | 2015-06-03 | 2018-10-16 | At&T Intellectual Property I, L.P. | Host node device and methods for use therewith |
US9912381B2 (en) | 2015-06-03 | 2018-03-06 | At&T Intellectual Property I, Lp | Network termination and methods for use therewith |
US9866309B2 (en) | 2015-06-03 | 2018-01-09 | At&T Intellectual Property I, Lp | Host node device and methods for use therewith |
US10812174B2 (en) | 2015-06-03 | 2020-10-20 | At&T Intellectual Property I, L.P. | Client node device and methods for use therewith |
US9913139B2 (en) | 2015-06-09 | 2018-03-06 | At&T Intellectual Property I, L.P. | Signal fingerprinting for authentication of communicating devices |
US9608692B2 (en) | 2015-06-11 | 2017-03-28 | At&T Intellectual Property I, L.P. | Repeater and methods for use therewith |
US10142086B2 (en) | 2015-06-11 | 2018-11-27 | At&T Intellectual Property I, L.P. | Repeater and methods for use therewith |
US9820146B2 (en) | 2015-06-12 | 2017-11-14 | At&T Intellectual Property I, L.P. | Method and apparatus for authentication and identity management of communicating devices |
US9667317B2 (en) | 2015-06-15 | 2017-05-30 | At&T Intellectual Property I, L.P. | Method and apparatus for providing security using network traffic adjustments |
US9953540B2 (en) * | 2015-06-16 | 2018-04-24 | Here Global B.V. | Air space maps |
US9865911B2 (en) | 2015-06-25 | 2018-01-09 | At&T Intellectual Property I, L.P. | Waveguide system for slot radiating first electromagnetic waves that are combined into a non-fundamental wave mode second electromagnetic wave on a transmission medium |
US9640850B2 (en) | 2015-06-25 | 2017-05-02 | At&T Intellectual Property I, L.P. | Methods and apparatus for inducing a non-fundamental wave mode on a transmission medium |
US9509415B1 (en) | 2015-06-25 | 2016-11-29 | At&T Intellectual Property I, L.P. | Methods and apparatus for inducing a fundamental wave mode on a transmission medium |
WO2016210432A1 (en) * | 2015-06-26 | 2016-12-29 | Apollo Robotic Systems Incorporated | Robotic apparatus, systems, and related methods |
RU2595064C1 (en) * | 2015-06-30 | 2016-08-20 | Акционерное общество "Корпорация "Тактическое ракетное вооружение" | Method of recording telemetric information of unmanned aircraft and device therefor |
WO2017007456A1 (en) * | 2015-07-07 | 2017-01-12 | Halliburton Energy Services, Inc. | Semi-autonomous monitoring system |
US9628116B2 (en) | 2015-07-14 | 2017-04-18 | At&T Intellectual Property I, L.P. | Apparatus and methods for transmitting wireless signals |
US9722318B2 (en) | 2015-07-14 | 2017-08-01 | At&T Intellectual Property I, L.P. | Method and apparatus for coupling an antenna to a device |
US10341142B2 (en) | 2015-07-14 | 2019-07-02 | At&T Intellectual Property I, L.P. | Apparatus and methods for generating non-interfering electromagnetic waves on an uninsulated conductor |
US9836957B2 (en) | 2015-07-14 | 2017-12-05 | At&T Intellectual Property I, L.P. | Method and apparatus for communicating with premises equipment |
US10320586B2 (en) | 2015-07-14 | 2019-06-11 | At&T Intellectual Property I, L.P. | Apparatus and methods for generating non-interfering electromagnetic waves on an insulated transmission medium |
US10033108B2 (en) | 2015-07-14 | 2018-07-24 | At&T Intellectual Property I, L.P. | Apparatus and methods for generating an electromagnetic wave having a wave mode that mitigates interference |
US10044409B2 (en) | 2015-07-14 | 2018-08-07 | At&T Intellectual Property I, L.P. | Transmission medium and methods for use therewith |
US9882257B2 (en) | 2015-07-14 | 2018-01-30 | At&T Intellectual Property I, L.P. | Method and apparatus for launching a wave mode that mitigates interference |
US9847566B2 (en) | 2015-07-14 | 2017-12-19 | At&T Intellectual Property I, L.P. | Method and apparatus for adjusting a field of a signal to mitigate interference |
US9853342B2 (en) | 2015-07-14 | 2017-12-26 | At&T Intellectual Property I, L.P. | Dielectric transmission medium connector and methods for use therewith |
US10033107B2 (en) | 2015-07-14 | 2018-07-24 | At&T Intellectual Property I, L.P. | Method and apparatus for coupling an antenna to a device |
US10170840B2 (en) | 2015-07-14 | 2019-01-01 | At&T Intellectual Property I, L.P. | Apparatus and methods for sending or receiving electromagnetic signals |
US10148016B2 (en) | 2015-07-14 | 2018-12-04 | At&T Intellectual Property I, L.P. | Apparatus and methods for communicating utilizing an antenna array |
US10205655B2 (en) | 2015-07-14 | 2019-02-12 | At&T Intellectual Property I, L.P. | Apparatus and methods for communicating utilizing an antenna array and multiple communication paths |
US9608740B2 (en) | 2015-07-15 | 2017-03-28 | At&T Intellectual Property I, L.P. | Method and apparatus for launching a wave mode that mitigates interference |
US10090606B2 (en) | 2015-07-15 | 2018-10-02 | At&T Intellectual Property I, L.P. | Antenna system with dielectric array and methods for use therewith |
US9793951B2 (en) | 2015-07-15 | 2017-10-17 | At&T Intellectual Property I, L.P. | Method and apparatus for launching a wave mode that mitigates interference |
US9922282B2 (en) | 2015-07-21 | 2018-03-20 | Limitless Computing, Inc. | Automated readiness evaluation system (ARES) for use with an unmanned aircraft system (UAS) |
US9948333B2 (en) | 2015-07-23 | 2018-04-17 | At&T Intellectual Property I, L.P. | Method and apparatus for wireless communications to mitigate interference |
US10784670B2 (en) | 2015-07-23 | 2020-09-22 | At&T Intellectual Property I, L.P. | Antenna support for aligning an antenna |
US9912027B2 (en) | 2015-07-23 | 2018-03-06 | At&T Intellectual Property I, L.P. | Method and apparatus for exchanging communication signals |
US9871283B2 (en) | 2015-07-23 | 2018-01-16 | At&T Intellectual Property I, Lp | Transmission medium having a dielectric core comprised of plural members connected by a ball and socket configuration |
US9749053B2 (en) | 2015-07-23 | 2017-08-29 | At&T Intellectual Property I, L.P. | Node device, repeater and methods for use therewith |
US9967173B2 (en) | 2015-07-31 | 2018-05-08 | At&T Intellectual Property I, L.P. | Method and apparatus for authentication and identity management of communicating devices |
US10020587B2 (en) | 2015-07-31 | 2018-07-10 | At&T Intellectual Property I, L.P. | Radial antenna and methods for use therewith |
US9735833B2 (en) | 2015-07-31 | 2017-08-15 | At&T Intellectual Property I, L.P. | Method and apparatus for communications management in a neighborhood network |
EP3139542A1 (en) * | 2015-09-07 | 2017-03-08 | BAE Systems PLC | Management of wireless communication links from a moving platform |
US9904535B2 (en) | 2015-09-14 | 2018-02-27 | At&T Intellectual Property I, L.P. | Method and apparatus for distributing software |
JP2017058829A (en) * | 2015-09-15 | 2017-03-23 | 株式会社オプティム | Uninhabited airborne vehicle control system and uninhabited airborne vehicle control method |
CN108351620A (en) * | 2015-09-16 | 2018-07-31 | 深圳市大疆创新科技有限公司 | Method and apparatus for operating mobile platform |
US10009901B2 (en) | 2015-09-16 | 2018-06-26 | At&T Intellectual Property I, L.P. | Method, apparatus, and computer-readable storage medium for managing utilization of wireless resources between base stations |
US10009063B2 (en) | 2015-09-16 | 2018-06-26 | At&T Intellectual Property I, L.P. | Method and apparatus for use with a radio distributed antenna system having an out-of-band reference signal |
US10079661B2 (en) | 2015-09-16 | 2018-09-18 | At&T Intellectual Property I, L.P. | Method and apparatus for use with a radio distributed antenna system having a clock reference |
US10136434B2 (en) | 2015-09-16 | 2018-11-20 | At&T Intellectual Property I, L.P. | Method and apparatus for use with a radio distributed antenna system having an ultra-wideband control channel |
US9769128B2 (en) | 2015-09-28 | 2017-09-19 | At&T Intellectual Property I, L.P. | Method and apparatus for encryption of communications over a network |
US9729197B2 (en) | 2015-10-01 | 2017-08-08 | At&T Intellectual Property I, L.P. | Method and apparatus for communicating network management traffic over a network |
US9876264B2 (en) | 2015-10-02 | 2018-01-23 | At&T Intellectual Property I, Lp | Communication system, guided wave switch and methods for use therewith |
US9882277B2 (en) | 2015-10-02 | 2018-01-30 | At&T Intellectual Property I, Lp | Communication device and antenna assembly with actuated gimbal mount |
US10665942B2 (en) | 2015-10-16 | 2020-05-26 | At&T Intellectual Property I, L.P. | Method and apparatus for adjusting wireless communications |
US10355367B2 (en) | 2015-10-16 | 2019-07-16 | At&T Intellectual Property I, L.P. | Antenna structure for exchanging wireless signals |
CN105280026A (en) * | 2015-11-05 | 2016-01-27 | 深圳市十方联智科技有限公司 | Method for setting no-fly zone for unmanned aerial vehicle |
US11230391B2 (en) | 2015-11-16 | 2022-01-25 | Altaeros Energies, Inc. | Systems and methods for attitude control of tethered aerostats |
US10319243B2 (en) | 2015-11-30 | 2019-06-11 | At&T Intellectual Property I, L.P. | Computer aided dispatch of drones |
TWI593602B (en) * | 2015-12-03 | 2017-08-01 | 新唐科技股份有限公司 | Verification system and method for electronic governor of unmanned aerial vehicle |
US10745126B2 (en) | 2015-12-28 | 2020-08-18 | Wet | Unmanned aerial system with transportable screen |
US11059601B2 (en) | 2015-12-28 | 2021-07-13 | Dezso Molnar | Water and lighting displays including unmanned aerial system |
WO2017117291A1 (en) | 2015-12-28 | 2017-07-06 | Dezso Molnar | Tethered unmanned aerial system |
WO2017114501A1 (en) * | 2015-12-31 | 2017-07-06 | Wellen Sham | Uav network |
WO2017147731A1 (en) * | 2016-02-29 | 2017-09-08 | SZ DJI Technology Co., Ltd. | Uav hardware architecture |
US9592912B1 (en) | 2016-03-08 | 2017-03-14 | Unmanned Innovation, Inc. | Ground control point assignment and determination system |
CN105807788A (en) * | 2016-03-09 | 2016-07-27 | 广州极飞电子科技有限公司 | Unmanned aerial vehicle monitoring method, system, unmanned aerial vehicle and ground station |
US10001776B2 (en) * | 2016-03-21 | 2018-06-19 | The Boeing Company | Unmanned aerial vehicle flight control system |
US10553122B1 (en) | 2016-03-22 | 2020-02-04 | Amazon Technologies, Inc. | Unmanned aerial vehicle data collection for routing |
US10179583B2 (en) * | 2016-03-29 | 2019-01-15 | Ford Global Technologies, Llc | Vehicle subsystem coordination and control |
CN105788394A (en) * | 2016-04-16 | 2016-07-20 | 吉林医药学院 | Maintenance detection simulated training system for unmanned plane |
US20200183380A1 (en) * | 2016-06-10 | 2020-06-11 | Gopro, Inc. | Systems and methods for communicating with an unmanned aerial vehicle |
US10365651B2 (en) | 2016-06-20 | 2019-07-30 | Nutanix, Inc. | Control system for autonomous locomotion devices |
US10249200B1 (en) * | 2016-07-22 | 2019-04-02 | Amazon Technologies, Inc. | Deployable delivery guidance |
US10216188B2 (en) | 2016-07-25 | 2019-02-26 | Amazon Technologies, Inc. | Autonomous ground vehicles based at delivery locations |
US9912419B1 (en) | 2016-08-24 | 2018-03-06 | At&T Intellectual Property I, L.P. | Method and apparatus for managing a fault in a distributed antenna system |
US9860075B1 (en) | 2016-08-26 | 2018-01-02 | At&T Intellectual Property I, L.P. | Method and communication node for broadband distribution |
US10204521B2 (en) | 2016-08-31 | 2019-02-12 | At&T Intellectual Property I, L.P. | Method and system on dynamic control of UAVs using software defined networks |
US10291311B2 (en) | 2016-09-09 | 2019-05-14 | At&T Intellectual Property I, L.P. | Method and apparatus for mitigating a fault in a distributed antenna system |
US10139837B2 (en) * | 2016-09-13 | 2018-11-27 | Hangzhou Zero Zero Technology Co., Ltd. | Unmanned aerial vehicle system and method with environmental sensing |
US11032819B2 (en) | 2016-09-15 | 2021-06-08 | At&T Intellectual Property I, L.P. | Method and apparatus for use with a radio distributed antenna system having a control channel reference signal |
US10248120B1 (en) | 2016-09-16 | 2019-04-02 | Amazon Technologies, Inc. | Navigable path networks for autonomous vehicles |
US20180090013A1 (en) * | 2016-09-23 | 2018-03-29 | Sharp Laboratories Of America, Inc. | Unmanned aircraft and operation thereof |
US10245993B1 (en) | 2016-09-29 | 2019-04-02 | Amazon Technologies, Inc. | Modular autonomous ground vehicles |
US20180088045A1 (en) * | 2016-09-29 | 2018-03-29 | Honeywell International Inc. | Apparatus and method for laser particle sensor eye safety |
US10303171B1 (en) | 2016-09-29 | 2019-05-28 | Amazon Technologies, Inc. | Autonomous ground vehicles providing ordered items in pickup areas |
US10222798B1 (en) | 2016-09-29 | 2019-03-05 | Amazon Technologies, Inc. | Autonomous ground vehicles congregating in meeting areas |
US10775504B2 (en) | 2016-09-29 | 2020-09-15 | Honeywell International Inc. | Laser air data sensor mounting and operation for eye safety |
US10241516B1 (en) | 2016-09-29 | 2019-03-26 | Amazon Technologies, Inc. | Autonomous ground vehicles deployed from facilities |
US10135147B2 (en) | 2016-10-18 | 2018-11-20 | At&T Intellectual Property I, L.P. | Apparatus and methods for launching guided waves via an antenna |
US10340600B2 (en) | 2016-10-18 | 2019-07-02 | At&T Intellectual Property I, L.P. | Apparatus and methods for launching guided waves via plural waveguide systems |
US10135146B2 (en) | 2016-10-18 | 2018-11-20 | At&T Intellectual Property I, L.P. | Apparatus and methods for launching guided waves via circuits |
EP3529144B1 (en) * | 2016-10-18 | 2021-12-08 | Altaeros Energies, Inc. | Systems and methods for automated, lighter-than-air airborne platform |
US9876605B1 (en) | 2016-10-21 | 2018-01-23 | At&T Intellectual Property I, L.P. | Launcher and coupling system to support desired guided wave mode |
US10811767B2 (en) | 2016-10-21 | 2020-10-20 | At&T Intellectual Property I, L.P. | System and dielectric antenna with convex dielectric radome |
US9991580B2 (en) | 2016-10-21 | 2018-06-05 | At&T Intellectual Property I, L.P. | Launcher and coupling system for guided wave mode cancellation |
US10374316B2 (en) | 2016-10-21 | 2019-08-06 | At&T Intellectual Property I, L.P. | System and dielectric antenna with non-uniform dielectric |
US10312567B2 (en) | 2016-10-26 | 2019-06-04 | At&T Intellectual Property I, L.P. | Launcher with planar strip antenna and methods for use therewith |
US10233021B1 (en) | 2016-11-02 | 2019-03-19 | Amazon Technologies, Inc. | Autonomous vehicles for delivery and safety |
US10498044B2 (en) | 2016-11-03 | 2019-12-03 | At&T Intellectual Property I, L.P. | Apparatus for configuring a surface of an antenna |
US10291334B2 (en) | 2016-11-03 | 2019-05-14 | At&T Intellectual Property I, L.P. | System for detecting a fault in a communication system |
US10224634B2 (en) | 2016-11-03 | 2019-03-05 | At&T Intellectual Property I, L.P. | Methods and apparatus for adjusting an operational characteristic of an antenna |
US10225025B2 (en) | 2016-11-03 | 2019-03-05 | At&T Intellectual Property I, L.P. | Method and apparatus for detecting a fault in a communication system |
US10514690B1 (en) | 2016-11-15 | 2019-12-24 | Amazon Technologies, Inc. | Cooperative autonomous aerial and ground vehicles for item delivery |
US10535928B2 (en) | 2016-11-23 | 2020-01-14 | At&T Intellectual Property I, L.P. | Antenna system and methods for use therewith |
US10178445B2 (en) | 2016-11-23 | 2019-01-08 | At&T Intellectual Property I, L.P. | Methods, devices, and systems for load balancing between a plurality of waveguides |
US10340603B2 (en) | 2016-11-23 | 2019-07-02 | At&T Intellectual Property I, L.P. | Antenna system having shielded structural configurations for assembly |
US10340601B2 (en) | 2016-11-23 | 2019-07-02 | At&T Intellectual Property I, L.P. | Multi-antenna system and methods for use therewith |
US10090594B2 (en) | 2016-11-23 | 2018-10-02 | At&T Intellectual Property I, L.P. | Antenna system having structural configurations for assembly |
US10305190B2 (en) | 2016-12-01 | 2019-05-28 | At&T Intellectual Property I, L.P. | Reflecting dielectric antenna system and methods for use therewith |
US10361489B2 (en) | 2016-12-01 | 2019-07-23 | At&T Intellectual Property I, L.P. | Dielectric dish antenna system and methods for use therewith |
US11263579B1 (en) | 2016-12-05 | 2022-03-01 | Amazon Technologies, Inc. | Autonomous vehicle networks |
US10020844B2 (en) | 2016-12-06 | 2018-07-10 | T&T Intellectual Property I, L.P. | Method and apparatus for broadcast communication via guided waves |
US10135145B2 (en) | 2016-12-06 | 2018-11-20 | At&T Intellectual Property I, L.P. | Apparatus and methods for generating an electromagnetic wave along a transmission medium |
US10326494B2 (en) | 2016-12-06 | 2019-06-18 | At&T Intellectual Property I, L.P. | Apparatus for measurement de-embedding and methods for use therewith |
US9927517B1 (en) | 2016-12-06 | 2018-03-27 | At&T Intellectual Property I, L.P. | Apparatus and methods for sensing rainfall |
US10819035B2 (en) | 2016-12-06 | 2020-10-27 | At&T Intellectual Property I, L.P. | Launcher with helical antenna and methods for use therewith |
US10439675B2 (en) | 2016-12-06 | 2019-10-08 | At&T Intellectual Property I, L.P. | Method and apparatus for repeating guided wave communication signals |
US10637149B2 (en) | 2016-12-06 | 2020-04-28 | At&T Intellectual Property I, L.P. | Injection molded dielectric antenna and methods for use therewith |
US10755542B2 (en) | 2016-12-06 | 2020-08-25 | At&T Intellectual Property I, L.P. | Method and apparatus for surveillance via guided wave communication |
US10382976B2 (en) | 2016-12-06 | 2019-08-13 | At&T Intellectual Property I, L.P. | Method and apparatus for managing wireless communications based on communication paths and network device positions |
US10694379B2 (en) | 2016-12-06 | 2020-06-23 | At&T Intellectual Property I, L.P. | Waveguide system with device-based authentication and methods for use therewith |
US10727599B2 (en) | 2016-12-06 | 2020-07-28 | At&T Intellectual Property I, L.P. | Launcher with slot antenna and methods for use therewith |
US10139820B2 (en) | 2016-12-07 | 2018-11-27 | At&T Intellectual Property I, L.P. | Method and apparatus for deploying equipment of a communication system |
US9893795B1 (en) | 2016-12-07 | 2018-02-13 | At&T Intellectual Property I, Lp | Method and repeater for broadband distribution |
US10359749B2 (en) | 2016-12-07 | 2019-07-23 | At&T Intellectual Property I, L.P. | Method and apparatus for utilities management via guided wave communication |
US10446936B2 (en) | 2016-12-07 | 2019-10-15 | At&T Intellectual Property I, L.P. | Multi-feed dielectric antenna system and methods for use therewith |
US10547348B2 (en) | 2016-12-07 | 2020-01-28 | At&T Intellectual Property I, L.P. | Method and apparatus for switching transmission mediums in a communication system |
US10027397B2 (en) | 2016-12-07 | 2018-07-17 | At&T Intellectual Property I, L.P. | Distributed antenna system and methods for use therewith |
US10389029B2 (en) | 2016-12-07 | 2019-08-20 | At&T Intellectual Property I, L.P. | Multi-feed dielectric antenna system with core selection and methods for use therewith |
US10168695B2 (en) | 2016-12-07 | 2019-01-01 | At&T Intellectual Property I, L.P. | Method and apparatus for controlling an unmanned aircraft |
US10243270B2 (en) | 2016-12-07 | 2019-03-26 | At&T Intellectual Property I, L.P. | Beam adaptive multi-feed dielectric antenna system and methods for use therewith |
US10103422B2 (en) | 2016-12-08 | 2018-10-16 | At&T Intellectual Property I, L.P. | Method and apparatus for mounting network devices |
US10530505B2 (en) | 2016-12-08 | 2020-01-07 | At&T Intellectual Property I, L.P. | Apparatus and methods for launching electromagnetic waves along a transmission medium |
US10777873B2 (en) | 2016-12-08 | 2020-09-15 | At&T Intellectual Property I, L.P. | Method and apparatus for mounting network devices |
US10601494B2 (en) | 2016-12-08 | 2020-03-24 | At&T Intellectual Property I, L.P. | Dual-band communication device and method for use therewith |
US9911020B1 (en) | 2016-12-08 | 2018-03-06 | At&T Intellectual Property I, L.P. | Method and apparatus for tracking via a radio frequency identification device |
US10389037B2 (en) | 2016-12-08 | 2019-08-20 | At&T Intellectual Property I, L.P. | Apparatus and methods for selecting sections of an antenna array and use therewith |
US9998870B1 (en) | 2016-12-08 | 2018-06-12 | At&T Intellectual Property I, L.P. | Method and apparatus for proximity sensing |
US10916969B2 (en) | 2016-12-08 | 2021-02-09 | At&T Intellectual Property I, L.P. | Method and apparatus for providing power using an inductive coupling |
US10069535B2 (en) | 2016-12-08 | 2018-09-04 | At&T Intellectual Property I, L.P. | Apparatus and methods for launching electromagnetic waves having a certain electric field structure |
US10326689B2 (en) | 2016-12-08 | 2019-06-18 | At&T Intellectual Property I, L.P. | Method and system for providing alternative communication paths |
US10938108B2 (en) | 2016-12-08 | 2021-03-02 | At&T Intellectual Property I, L.P. | Frequency selective multi-feed dielectric antenna system and methods for use therewith |
US10411356B2 (en) | 2016-12-08 | 2019-09-10 | At&T Intellectual Property I, L.P. | Apparatus and methods for selectively targeting communication devices with an antenna array |
US10340983B2 (en) | 2016-12-09 | 2019-07-02 | At&T Intellectual Property I, L.P. | Method and apparatus for surveying remote sites via guided wave communications |
US10264586B2 (en) | 2016-12-09 | 2019-04-16 | At&T Mobility Ii Llc | Cloud-based packet controller and methods for use therewith |
US9838896B1 (en) | 2016-12-09 | 2017-12-05 | At&T Intellectual Property I, L.P. | Method and apparatus for assessing network coverage |
US10310499B1 (en) | 2016-12-23 | 2019-06-04 | Amazon Technologies, Inc. | Distributed production of items from locally sourced materials using autonomous vehicles |
DE102016015689A1 (en) * | 2016-12-23 | 2018-06-28 | Mbda Deutschland Gmbh | Flight path determination device and flight path determination method |
US10308430B1 (en) | 2016-12-23 | 2019-06-04 | Amazon Technologies, Inc. | Distribution and retrieval of inventory and materials using autonomous vehicles |
FR3061344B1 (en) | 2016-12-23 | 2021-01-01 | Thales Sa | AIRCRAFT PILOT ASSISTANCE SYSTEM |
US10310500B1 (en) | 2016-12-23 | 2019-06-04 | Amazon Technologies, Inc. | Automated access to secure facilities using autonomous vehicles |
US20180189704A1 (en) * | 2017-01-04 | 2018-07-05 | Honeywell International Inc. | Methods and Apparatus for Providing Fuel Tankering Data Onboard and Aircraft |
US9849044B1 (en) | 2017-01-30 | 2017-12-26 | SkyRyse, Inc. | Vehicle system and method for providing services |
US10531994B2 (en) | 2017-01-30 | 2020-01-14 | SkyRyse, Inc. | Safety system for aerial vehicles and method of operation |
US9973940B1 (en) | 2017-02-27 | 2018-05-15 | At&T Intellectual Property I, L.P. | Apparatus and methods for dynamic impedance matching of a guided wave launcher |
ES2978374T3 (en) * | 2017-03-06 | 2024-09-11 | Spiral Inc | Flying object control system, control device and marker of the same |
US10429196B2 (en) * | 2017-03-08 | 2019-10-01 | Invensense, Inc. | Method and apparatus for cart navigation |
US10298293B2 (en) | 2017-03-13 | 2019-05-21 | At&T Intellectual Property I, L.P. | Apparatus of communication utilizing wireless network devices |
US10573106B1 (en) | 2017-03-22 | 2020-02-25 | Amazon Technologies, Inc. | Personal intermediary access device |
US10147249B1 (en) | 2017-03-22 | 2018-12-04 | Amazon Technologies, Inc. | Personal intermediary communication device |
US10520948B2 (en) | 2017-05-12 | 2019-12-31 | Autonomy Squared Llc | Robot delivery method |
CN106998270B (en) * | 2017-05-16 | 2019-12-31 | 北京京东尚科信息技术有限公司 | Unmanned aerial vehicle communication system and communication system of unmanned aerial vehicle server |
CN107276661B (en) * | 2017-07-25 | 2020-12-29 | 陕西师范大学 | Search and rescue method and system based on unmanned aerial vehicle group |
US10535272B2 (en) | 2017-07-27 | 2020-01-14 | SkyRyse, Inc. | System and method for situational awareness, vehicle control, and/or contingency planning |
US10382225B2 (en) * | 2017-07-27 | 2019-08-13 | Wing Aviation Llc | Asymmetric CAN-based communication for aerial vehicles |
US11222299B1 (en) | 2017-08-31 | 2022-01-11 | Amazon Technologies, Inc. | Indoor deliveries by autonomous vehicles |
KR102340446B1 (en) * | 2017-09-08 | 2021-12-21 | 삼성전자주식회사 | Storage device and data training method thereof |
KR102288799B1 (en) * | 2017-09-27 | 2021-08-11 | 현대모비스 주식회사 | Apparatus for controlling group driving and method thereof |
US10894601B2 (en) | 2017-12-20 | 2021-01-19 | Wing Aviation Llc | Methods and systems for self-deployment of operational infrastructure by an unmanned aerial vehicle (UAV) |
JP7034721B2 (en) * | 2018-01-10 | 2022-03-14 | アルパイン株式会社 | Control device and control method for unmanned transport aircraft |
US10942509B2 (en) | 2018-01-19 | 2021-03-09 | Ge Aviation Systems Llc | Heterogeneous processing in unmanned vehicles |
US11032905B2 (en) * | 2018-01-19 | 2021-06-08 | Ge Aviation Systems Llc | Unmanned vehicle control systems |
US11029985B2 (en) | 2018-01-19 | 2021-06-08 | Ge Aviation Systems Llc | Processor virtualization in unmanned vehicles |
US10578717B2 (en) | 2018-01-31 | 2020-03-03 | Honeywell International Inc. | Dimmable glass for eye safety for LiDAR technology |
CN108594645B (en) * | 2018-03-08 | 2021-02-19 | 中国人民解放军国防科技大学 | Planning method and system for single-station multi-unmanned aerial vehicle distribution and flight route |
CN108548538B (en) * | 2018-03-08 | 2020-04-14 | 中国人民解放军国防科技大学 | Method and system for multi-station multi-unmanned aerial vehicle task allocation and flight path planning |
WO2019204931A1 (en) * | 2018-04-25 | 2019-10-31 | Flir Unmanned Aerial Systems Ulc | Systems and methods for communicating with payload on an unmanned vehicle |
US10564940B2 (en) | 2018-05-03 | 2020-02-18 | International Business Machines Corporation | Systems and methods for programming drones |
WO2020028353A1 (en) | 2018-07-30 | 2020-02-06 | Seekops Inc. | Ultra-lightweight, handheld gas leak detection device |
US11062614B2 (en) | 2018-09-12 | 2021-07-13 | Alliance Solutions Group, Inc. | Systems and methods for collecting and analyzing hazardous materials information using an unmanned aerial vehicle |
US10275589B1 (en) * | 2018-11-06 | 2019-04-30 | Capital One Services, Llc | Identity verification using autonomous vehicles |
US11687400B2 (en) * | 2018-12-12 | 2023-06-27 | Insitu Inc., A Subsidiary Of The Boeing Company | Method and system for controlling auxiliary systems of unmanned system |
US11392130B1 (en) | 2018-12-12 | 2022-07-19 | Amazon Technologies, Inc. | Selecting delivery modes and delivery areas using autonomous ground vehicles |
US11550320B2 (en) * | 2019-03-18 | 2023-01-10 | Pony Ai Inc. | Vehicle redundant processing resource usage |
US10877488B1 (en) * | 2019-06-06 | 2020-12-29 | Honey Well International Inc. | Unmanned aerial vehicle (UAV) intelligent emergency voice report system and method |
EP4010246A4 (en) | 2019-08-05 | 2023-09-13 | SeekOps Inc. | Rapidly deployable uas system for autonomous inspection operations using a combined payload |
US11474530B1 (en) | 2019-08-15 | 2022-10-18 | Amazon Technologies, Inc. | Semantic navigation of autonomous ground vehicles |
WO2021046304A1 (en) | 2019-09-04 | 2021-03-11 | Shake N Bake Llc | Uav surveying system and methods |
WO2021061810A1 (en) | 2019-09-26 | 2021-04-01 | Amazon Technologies, Inc. | Autonomous home security devices |
US10796562B1 (en) | 2019-09-26 | 2020-10-06 | Amazon Technologies, Inc. | Autonomous home security devices |
CN110493792B (en) * | 2019-09-29 | 2021-02-26 | 北京航空航天大学 | Unmanned aerial vehicle swarm system construction method and system |
US20240028051A1 (en) * | 2019-10-04 | 2024-01-25 | Seekops Inc. | Closed surface flight pattern generation for unmanned aerial vehicle (uav) flux plane assessment of large facilities |
CN113168776B (en) * | 2019-10-09 | 2023-04-18 | 乐天集团股份有限公司 | Processing system, unmanned aerial vehicle and flight path determination method |
US11394782B2 (en) * | 2019-11-17 | 2022-07-19 | Daniel Donahue | Flight management systems and methods |
US11423789B2 (en) | 2019-12-05 | 2022-08-23 | Rockwell Collins, Inc. | System and method for preventing inadvertent loss of command and control link to an unmanned aerial system |
US11345473B1 (en) | 2019-12-05 | 2022-05-31 | Rockwell Collins, Inc. | System and method for preventing inadvertent loss of surveillance coverage for an unmanned aerial system (UAS) |
US11705009B2 (en) | 2019-12-05 | 2023-07-18 | Rockwell Collins, Inc. | System and method for optimizing mission fulfillment by unmanned aircraft systems (UAS) via dynamic atmospheric modeling |
CN111241552B (en) * | 2020-01-20 | 2023-06-09 | 上海大学 | Autonomous unmanned system safety auxiliary system |
US12055485B2 (en) | 2020-02-05 | 2024-08-06 | Seekops Inc. | Multispecies measurement platform using absorption spectroscopy for measurement of co-emitted trace gases |
WO2021195709A1 (en) * | 2020-03-31 | 2021-10-07 | Stealth Technologies Pty Ltd | Autonomous vehicle/robot control |
CN111884340B (en) * | 2020-07-31 | 2022-03-01 | 北京中科宇航技术有限公司 | Carrier rocket remote emergency power-off control device based on optical transceiver |
KR102209503B1 (en) * | 2020-08-24 | 2021-02-01 | 코아글림 주식회사 | Wireless communication system of Intelligent UAV |
US11972691B2 (en) * | 2020-10-27 | 2024-04-30 | The Boeing Company | Autonomous aerial vehicle flight management |
CN113401333B (en) * | 2021-08-18 | 2021-11-09 | 中国商用飞机有限责任公司 | High-lift system of airplane and slat operation instruction determination method for high-lift system |
US20230081498A1 (en) * | 2021-09-14 | 2023-03-16 | Beta Air, Llc | Systems and methods for monitoring electrical flow in an electric aircraft |
CN113955087B (en) * | 2021-12-21 | 2022-06-07 | 山东欧龙电子科技有限公司 | Manned vehicle intelligence flight control system |
KR102623939B1 (en) * | 2021-12-24 | 2024-01-11 | 주식회사 현대케피코 | Drone |
CN115027500B (en) * | 2022-06-30 | 2024-05-14 | 智道网联科技(北京)有限公司 | Decision planning method and device for unmanned vehicle, electronic equipment and storage medium |
KR102705494B1 (en) * | 2022-08-25 | 2024-09-11 | 엘아이지넥스원 주식회사 | Unmanned aerial vehicle and method for operating it |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5550736A (en) * | 1993-04-27 | 1996-08-27 | Honeywell Inc. | Fail-operational fault tolerant flight critical computer architecture and monitoring method |
US6056237A (en) | 1997-06-25 | 2000-05-02 | Woodland; Richard L. K. | Sonotube compatible unmanned aerial vehicle and system |
DE19849857C2 (en) | 1998-10-29 | 2003-08-21 | Eads Deutschland Gmbh | Remote control method for an unmanned aircraft |
JP2000205925A (en) * | 1999-01-07 | 2000-07-28 | Nissan Motor Co Ltd | Vehicular fuel consumption indicator |
DE60113552T3 (en) | 2000-05-17 | 2009-07-30 | The Boeing Co., Chicago | INTUITIVE VEHICLE AND MACHINE CONTROL |
US7343232B2 (en) * | 2003-06-20 | 2008-03-11 | Geneva Aerospace | Vehicle control system including related methods and components |
WO2005073085A1 (en) | 2004-01-29 | 2005-08-11 | Iostar Corporation | In orbit space transportation & recovery system |
US7768988B2 (en) | 2005-02-22 | 2010-08-03 | Intel Corporation | Method and apparatus to perform network medium reservation in a wireless network |
US7962252B2 (en) | 2005-06-20 | 2011-06-14 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Self-contained avionics sensing and flight control system for small unmanned aerial vehicle |
US7451023B2 (en) | 2005-07-25 | 2008-11-11 | Lockheed Martin Corporation | Collaborative system for a team of unmanned vehicles |
US7415331B2 (en) | 2005-07-25 | 2008-08-19 | Lockheed Martin Corporation | System for controlling unmanned vehicles |
CA2837477C (en) | 2005-10-14 | 2016-06-21 | Aethon, Inc. | Robotic ordering and delivery apparatuses, systems and methods |
US8326469B2 (en) | 2006-07-14 | 2012-12-04 | Irobot Corporation | Autonomous behaviors for a remote vehicle |
WO2008085536A2 (en) | 2006-05-23 | 2008-07-17 | Avid, Llc | Dual-use modular propulsion surveillance vehicle with detachable unmanned airborne vehicles |
FR2901619B1 (en) * | 2006-05-24 | 2008-11-14 | Airbus France Sas | COMPUTERIZED FLIGHT MANUAL AND DYNAMIC CONTROL METHOD FOR SUCH A FLIGHT MANUAL |
GB2450665B (en) | 2006-05-31 | 2011-03-09 | Shell Int Research | Oil and/or gas production system |
US7581702B2 (en) * | 2006-06-09 | 2009-09-01 | Insitu, Inc. | Wirelessly controlling unmanned aircraft and accessing associated surveillance data |
EP1901153A1 (en) | 2006-09-12 | 2008-03-19 | OFFIS e.V. | Control system for unmanned 4-rotor-helicopter |
US8380424B2 (en) * | 2007-09-28 | 2013-02-19 | The Boeing Company | Vehicle-based automatic traffic conflict and collision avoidance |
US8082102B2 (en) * | 2008-01-14 | 2011-12-20 | The Boeing Company | Computing flight plans for UAVs while routing around obstacles having spatial and temporal dimensions |
-
2009
- 2009-07-06 US US12/497,788 patent/US8515609B2/en not_active Expired - Fee Related
-
2013
- 2013-07-01 US US13/932,623 patent/US8600602B1/en not_active Expired - Fee Related
Cited By (64)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9070101B2 (en) | 2007-01-12 | 2015-06-30 | Fatdoor, Inc. | Peer-to-peer neighborhood delivery multi-copter and method |
US11180249B2 (en) | 2013-03-15 | 2021-11-23 | Flir Detection, Inc. | Spooler for unmanned aerial vehicle system |
US10507914B2 (en) | 2013-03-15 | 2019-12-17 | Flir Detection, Inc. | Spooler for unmanned aerial vehicle system |
US11661187B2 (en) | 2013-03-15 | 2023-05-30 | Teledyne Flir Detection, Inc. | Spooler for unmanned aerial vehicle system |
US11862173B2 (en) | 2013-11-12 | 2024-01-02 | Apple Inc. | Always-on audio control for mobile device |
US11049503B2 (en) | 2013-11-12 | 2021-06-29 | Apple Inc. | Always-on audio control for mobile device |
US10573319B2 (en) | 2013-11-12 | 2020-02-25 | Apple Inc. | Always-on audio control for mobile device |
CN103823362A (en) * | 2014-02-17 | 2014-05-28 | 南京航空航天大学 | Arbitration mechanism-based similar dual-redundancy flight control computer and redundancy control method |
US11462116B2 (en) | 2014-04-17 | 2022-10-04 | SZ DJI Technology Co., Ltd. | Polygon shaped vehicle restriction zones |
US11482119B2 (en) | 2014-04-17 | 2022-10-25 | SZ DJI Technology Co., Ltd. | Polygon shaped flight-restriction zones |
US11810465B2 (en) | 2014-04-17 | 2023-11-07 | SZ DJI Technology Co., Ltd. | Flight control for flight-restricted regions |
US12117320B2 (en) | 2014-05-29 | 2024-10-15 | Apple Inc. | System on a chip with always-on component with powered-down configurations to process audio samples |
US9513898B2 (en) | 2014-06-30 | 2016-12-06 | Google Inc. | Systems and methods for updating software in a hazard detection system |
US10331430B2 (en) * | 2014-06-30 | 2019-06-25 | Google Llc | Systems and methods for updating software in a hazard detection system |
US11175900B2 (en) | 2014-06-30 | 2021-11-16 | Google Llc | Systems and methods for updating software in a hazard detection system |
US11726768B2 (en) * | 2014-06-30 | 2023-08-15 | Google Llc | Systems and methods for updating software in a hazard detection system |
WO2016003635A1 (en) * | 2014-06-30 | 2016-01-07 | Google Inc. | Systems and methods for updating software in a hazard detection system |
US20170075679A1 (en) * | 2014-06-30 | 2017-03-16 | Google Inc. | Systems and methods for updating software in a hazard detection system |
US20220075614A1 (en) * | 2014-06-30 | 2022-03-10 | Google Llc | Systems and methods for updating software in a hazard detection system |
US10665112B2 (en) | 2014-12-15 | 2020-05-26 | Sikorsky Aircraft Corporation | Method and system for teaming manned and unmanned aerial vehicles |
WO2016100286A1 (en) * | 2014-12-15 | 2016-06-23 | Sikorsky Aircraft Corporation | Method and system for teaming manned and unmanned aerial vehicles |
US10147329B2 (en) | 2015-03-31 | 2018-12-04 | SZ DJI Technology Co., Ltd. | Open platform for flight restricted region |
US10733895B2 (en) | 2015-03-31 | 2020-08-04 | SZ DJI Technology Co., Ltd. | Open platform for flight restricted region |
US12125394B2 (en) | 2015-03-31 | 2024-10-22 | SZ DJI Technology Co., Ltd. | Open platform for flight restricted region |
US11482121B2 (en) | 2015-03-31 | 2022-10-25 | SZ DJI Technology Co., Ltd. | Open platform for vehicle restricted region |
US11488487B2 (en) | 2015-03-31 | 2022-11-01 | SZ DJI Technology Co., Ltd. | Open platform for flight restricted region |
WO2016179637A1 (en) * | 2015-05-12 | 2016-11-17 | Precision Autonomy Pty Ltd | Systems and methods of unmanned vehicle control and monitoring |
US20180157255A1 (en) * | 2015-05-12 | 2018-06-07 | Precision Autonomy Pty Ltd | Systems and methods of unmanned vehicle control and monitoring |
CN105116907A (en) * | 2015-07-20 | 2015-12-02 | 清华大学 | Method for designing data transmission and control system of miniature unmanned aerial vehicle |
US9723468B2 (en) * | 2015-09-23 | 2017-08-01 | Hyundai Motor Company | Apparatus and method for sending SOS in vehicle engaged with uninhabited aerial vehicle |
US20170086048A1 (en) * | 2015-09-23 | 2017-03-23 | Hyundai Motor Company | Apparatus and Method for Sending SOS in Vehicle Engaged with Uninhabited Aerial Vehicle |
US10112721B2 (en) * | 2015-10-14 | 2018-10-30 | Flirtey Holdings, Inc. | Parachute deployment system for an unmanned aerial vehicle |
US10703494B2 (en) | 2015-10-14 | 2020-07-07 | Flirtey Holdings, Inc. | Parachute control system for an unmanned aerial vehicle |
US10618655B2 (en) | 2015-10-14 | 2020-04-14 | Flirtey Holdings, Inc. | Package delivery mechanism in an unmanned aerial vehicle |
US11338923B2 (en) | 2015-10-14 | 2022-05-24 | Flirtey Holdings, Inc. | Parachute control system for an unmanned aerial vehicle |
US11854413B2 (en) | 2016-02-08 | 2023-12-26 | Skydio, Inc | Unmanned aerial vehicle visual line of sight control |
US11189180B2 (en) | 2016-02-08 | 2021-11-30 | Skydio, Inc. | Unmanned aerial vehicle visual line of sight control |
US10762795B2 (en) | 2016-02-08 | 2020-09-01 | Skydio, Inc. | Unmanned aerial vehicle privacy controls |
US11361665B2 (en) | 2016-02-08 | 2022-06-14 | Skydio, Inc. | Unmanned aerial vehicle privacy controls |
WO2017147142A1 (en) * | 2016-02-22 | 2017-08-31 | Unmanned Innovation Inc. | Unmanned aerial vehicle visual line of sight control |
US11874656B2 (en) | 2016-03-31 | 2024-01-16 | Skydio, Inc. | Unmanned aerial vehicle modular command priority determination and filtering system |
WO2017172809A3 (en) * | 2016-03-31 | 2018-07-26 | Unmanned Innovation, Inc. | Unmanned aerial vehicle modular command priority determination and filtering system |
CN105866780A (en) * | 2016-04-12 | 2016-08-17 | 张萍 | Unmanned aerial vehicle for searching and rescuing based on ultrasonic detection |
US10322817B2 (en) | 2016-05-27 | 2019-06-18 | Kitty Hawk Corporation | Impact velocity reduction by mass ejection |
US9908638B1 (en) * | 2016-05-27 | 2018-03-06 | Kitty Hawk Corporation | Impact velocity reduction by mass ejection |
US11242143B2 (en) | 2016-06-13 | 2022-02-08 | Skydio, Inc. | Unmanned aerial vehicle beyond visual line of sight control |
US11897607B2 (en) | 2016-06-13 | 2024-02-13 | Skydio, Inc. | Unmanned aerial vehicle beyond visual line of sight control |
US9915945B2 (en) | 2016-08-04 | 2018-03-13 | International Business Machines Corporation | Lost person rescue drone |
US10216181B2 (en) | 2016-08-04 | 2019-02-26 | International Business Machines Corporation | Implementation of a rescue drone |
US11840333B2 (en) | 2017-06-02 | 2023-12-12 | Flirtey Holdings, Inc. | Package delivery mechanism |
US10608941B2 (en) | 2017-09-27 | 2020-03-31 | Nio Usa, Inc. | Dual-network for fault tolerance |
WO2019067285A1 (en) * | 2017-09-27 | 2019-04-04 | Nio Usa, Inc. | Dual-network for fault tolerance |
US10845803B2 (en) * | 2017-11-29 | 2020-11-24 | Nio Usa, Inc. | Method and apparatus for simultaneous processing and logging of automotive vision system with controls and fault monitoring |
US20190163178A1 (en) * | 2017-11-29 | 2019-05-30 | Nio Usa, Inc. | Method and apparatus for simultaneous processing and logging of automotive vision system with controls and fault monitoring |
WO2019108494A1 (en) * | 2017-11-29 | 2019-06-06 | Nio Usa, Inc. | Method and apparatus for simultaneous processing and logging of automotive vision system with controls and fault monitoring |
US10671067B2 (en) | 2018-01-15 | 2020-06-02 | Qualcomm Incorporated | Managing limited safe mode operations of a robotic vehicle |
US11703859B2 (en) * | 2019-07-05 | 2023-07-18 | Liebherr Mining Equipment Newport News Co. | Method for autonomously controlling a vehicle |
US20210004004A1 (en) * | 2019-07-05 | 2021-01-07 | Liebherr Mining Equipment Newport News Co. | Method for autonomously controlling a vehicle |
US11749122B1 (en) * | 2019-12-12 | 2023-09-05 | Amazon Technologies, Inc. | Multi-device redundant flight controller |
US12087171B2 (en) | 2020-07-15 | 2024-09-10 | Rockwell Collins, Inc. | Assurance module |
US20220363369A1 (en) * | 2021-02-19 | 2022-11-17 | Beta Air, Llc | Methods and systems for fall back flight control configured for use in aircraft |
US11999467B2 (en) * | 2021-02-19 | 2024-06-04 | BETA Technologies, Inc. | Methods and systems for fall back flight control configured for use in aircraft |
US20220266988A1 (en) * | 2021-02-19 | 2022-08-25 | Beta Air, Llc | Methods and systems for fall back flight control configured for use in electric aircraft |
US11724797B2 (en) * | 2021-02-19 | 2023-08-15 | Beta Air, Llc | Methods and systems for fall back flight control configured for use in electric aircraft |
Also Published As
Publication number | Publication date |
---|---|
US8600602B1 (en) | 2013-12-03 |
US8515609B2 (en) | 2013-08-20 |
US20110035149A1 (en) | 2011-02-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8600602B1 (en) | Flight technical control management for an unmanned aerial vehicle | |
US10599138B2 (en) | Autonomous package delivery system | |
US9958875B2 (en) | Autonomous cargo delivery system | |
EP3557358B1 (en) | Adaptive autonomy system architecture | |
US9910432B1 (en) | System and method for human operator intervention in autonomous vehicle operations | |
US8594932B2 (en) | Management system for unmanned aerial vehicles | |
US11614734B2 (en) | Local drone identification verification | |
Dill et al. | SAFEGUARD: An assured safety net technology for UAS | |
JP5345495B2 (en) | Modular software architecture for unmanned aerial vehicles | |
US8265818B2 (en) | Open architecture command system | |
US20160284221A1 (en) | Route planning for unmanned aerial vehicles | |
US20190235489A1 (en) | System and method for autonomous remote drone control | |
US20120143482A1 (en) | Electronically file and fly unmanned aerial vehicle | |
US12079343B2 (en) | Tamper-resistant geo-fence system for drones | |
US11881116B2 (en) | Aerial vehicle navigation system | |
Nonami | Present state and future prospect of autonomous control technology for industrial drones | |
JP6713156B2 (en) | Flight management server and flight management system for unmanned air vehicles | |
KR20170139326A (en) | Autonomous flight system and method of unmanned aerial vehicle | |
KR101788721B1 (en) | Method and System for Automatic Operation of Unmanned Aerial Vehicle based on Wireless Communication Network | |
Athavale et al. | Chip-level considerations to enable dependability for eVTOL and Urban Air Mobility systems | |
US20220406205A1 (en) | Management of the spatial congestion around the path of a vehicle | |
Areias et al. | A control and communications platform for procedural mission planning with multiple aerial drones | |
Figueira et al. | C4ISR systems applied to amazonian constraints | |
US20220137618A1 (en) | Intelligent multi-level safe autonomous flight ecosystem | |
Özer | Avionics and Communication Architecture Design for Intelligent Automated Fixed-Wing Armed Aircraft |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
REMI | Maintenance fee reminder mailed | ||
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.) |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20171203 |