US20160142562A9

US20160142562A9 - Wireless adapter and method for communication with digital camera

Info

Publication number: US20160142562A9
Application number: US14/217,463
Authority: US
Inventors: David James Pawlowski
Original assignee: Individual
Current assignee: Camranger LLC
Priority date: 2013-03-15
Filing date: 2014-03-17
Publication date: 2016-05-19
Anticipated expiration: 2034-03-17
Also published as: US9712688B2; US20150264202A1

Abstract

The present invention provides a camera accessory that connects to a camera. The camera accessory includes a wireless antenna and can communicate on a wireless local area network with a separate wireless enabled device. The camera accessory controls and interacts with a camera through Picture Transfer Protocol. According to some embodiments the separate wireless enabled device is a smart phone, tablet or computer.

Description

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application No. 61/802,283, filed Mar. 15, 2013.

BACKGROUND

This invention relates generally to digital cameras and, more precisely, to wireless adapters to enable control of and feedback from digital cameras from remote wirelessly enabled devices.
Digital cameras, including digital single lens reflex (DSLR) cameras and digital video cameras, are pervasive in the field of photography and videography. Digital cameras provide a large number of features including near immediate feedback and viewing, and a large number of settings and adjustments that can be made. However, it is not always convenient, efficient, or practical to physically control the camera. The camera may be located out of reach such as on a pole, jib, boom, or in a building's rafters and would be impractical to be physically co-located. Or the camera may be positioned low to ground and looking through the viewfinder or manipulating the controls could be difficult. Remote control can also advantageous when the photographer would like to be in the photograph or when being co-located with the camera could be dangerous such as near animals or in inclement weather. A means of remotely controlling a digital camera can provide great assistance to a photographer. Similarly, it may be advantageous for a photographer to transmit data, images, or video back to other interested parties in a separate location, which could also allow immediate editing or further transfer or images or video. Remotely transmitting images and video can also allow remote and/or backup storage.
Existing solutions for remote control of digital cameras have drawbacks. Simplistic solutions exist, but are more limited in their application to controls such as triggering an image or automatically transferring images, and do not encompass more complete control due to limitations in each approach. Lastly, more feature complete solutions exist but are either hardware built into the camera or dedicated solely for the use of a single or very small number of camera models.

SUMMARY

Embodiments of the present invention relate to a wireless adapter and system capable of controlling a digital camera from one or more remote wirelessly enabled devices. In one embodiment, the wireless adapter is contained within a housing and is detachably connected to the camera creating an electrical interface between the camera and adapter. The wireless adapter contains a transceiver to wirelessly communicate with remote wireless enabled device(s). These remote devices can thusly control the digital camera wirelessly through the wireless adapter as well as receive feedback and data from said camera.
The remote device aids in composing the photograph, as many remote devices have screens much larger than the screen on the back of the camera it is often easier to compose the photo. The associated software on the remote device can be configured to show grid lines, aspect ratios, focus peaking, shadows and highlights, focus points, detailed focus, histogram, etc.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1: Overview of camera connected with wireless adapter and wireless transmitting data to and from a remote device.

FIG. 2: Logical block diagram of the wireless adaptor.

FIG. 3: A different embodiment with multiple cameras wireless connected to multiple devices.

FIG. 4: A detailed drawing of the camera with wireless adapter and associated application on the remote device.

FIG. 5: Process flow of simplistic communications method.

FIG. 6: Process flow of more complex communications method.

DETAILED DESCRIPTION

Referring now to FIGS. 1 through 6, the invention of a wireless adapter and camera control system will now be described. It is noted that the invention may be embodied in many different forms and should not be limited solely to the embodiment listed herein.
FIG. 1 illustrates an overview of the wireless adapter system. The wireless adapter 2 is detachably connected 3 to a digital camera 4 and creates an electrical interface enabling the wireless adapter to be capable of controlling and receiving feedback from said camera. The wireless adapter is capable of creating and/or joining a wireless network 5. This wireless network may then be used by a remote wirelessly enabled device 6 to communicate with said wireless adapter.
The wireless network 5 may be a wide area wireless network (WWAN) such as a WiMAX, GSM, or CDMA network or a wireless local area network (WLAN) such as WiFi. The wireless adapter may optionally create a WLAN network, such as through the creation of an ad-hoc WiFi network. This wireless network may be joined by remote device 6. Optionally, additional wirelessly enabled devices may join the network, such as a computer, printer, print server, wireless bridge, or additional wirelessly enabled devices. The wireless network may optionally bridge to other wireless or wired network to expand range, capability and connectivity.
The remote device 6 may be any item satisfying the requirements of being able to be connect to a wireless network and communicate with the wireless adapter. Optionally, some additional capability could be possible such being capable of displaying graphic and/or textual information such as pictures, live video feed, and camera data and settings. The remote device interface may also be capable of permitting the user to interact in ways such as making configuration changes to the camera, initiating camera focusing, initiating the camera to take a picture, or starting or stopping video recording. Additional capabilities could include the ability to save or print incoming data. These are just a subset of the possible capabilities and controls and are listed here to describe the remote device interface. The remote device may for example be a smartphone, tablet, computer, wireless enabled hard drive, or other embodiment meeting the listed requirements and associated applications and programs. The wireless device should contain software to enable it to be able comply with the requirements of it's ability to send, receive, display, and/or issue commands. It is advantageous to have a custom application or program on the wirelessly enabled remote device to communicate with the wireless adapter.
The wireless adapter 2 and camera 4 are detachably connected with connector 3. In this embodiment that connector is comprised of a cable inserted into appropriate connection points on the wireless adapter and camera respectively. The cable may consist of any appropriate connection type or protocol, including Firewire, USB, Cat5, etc, or any combination thereof. The connector provides an electrical interface between the wireless adapter and camera enabling communication between said wireless adapter and camera over some appropriate protocol. A common protocol could, for example, be the Picture Transfer Protocol (PTP) over a USB connection. However, any number of appropriate protocols and connection types may be used. A USB connection with the Picture Transfer Protocol is advantageous for the following reasons: digital cameras commonly have USB connectors regardless of camera brand or model; digital cameras commonly implement the Picture Transfer Protocol; USB is a common embedded system interface making it a possibly preferred choice for the wireless adapter's interface; consumers are familiar with the use and operation of USB and USB connectors. A shutter release connector could also be used by itself or in conjunction with other attachment connectors and protocols. The wireless adaptor is a universal system that can be configured for use with any camera containing the appropriate physical connection port and protocol interface.
FIG. 2 illustrates an embodiment of the wireless adapter 10 as a block diagram to illustrate core components. It is understood that this block diagram is a simplification of the system and only one of many possible arrangements. A power control module 11 consists of electronics and software necessary to interface with a power interface 12 and battery 13. The wireless adaptor may be powered by the power interface 12 providing DC or AC power or by means of the battery 13. The power control module in conjunction with the power interface can also recharge the battery. The wireless interface 14, most commonly an antenna and appropriate control circuitry and logic, enables a wireless communication link between the wireless adaptor and a wireless enabled remote device 15. The wireless communication link may be between one or more wireless enabled devices. The communication control module 16 interfaces with the wireless interface and provides appropriate command and control such as monitoring, maintaining, and creating wireless connections, initiating or receiving wireless transmissions, and providing access to the wireless interface for the control logic module 17. The camera interface 18 provides a physical link 19 from the wireless adapter 10 to the camera 20. As discussed this link can be through any number of physical interfaces and protocols: USB, FireWire, Cat5, or other common interface and protocol. The control logic module can serve as both a simple pass through for transferring signals and data between the communication control module and camera interface as well as a more advanced controller capable of initiating its own command, control, and feedback through the camera interface. In most instances the wireless adapter having its own battery is advantageous as the adaptor provides it's own power rather than using the camera's battery. It is preferable for the battery to be rechargeable and replaceable. However, having a non-replaceable battery is also an option. It is also possible to configure the wireless adaptor to power itself using the power from the camera, as this aids in decreasing the size of the adapter.
FIG. 3 illustrates an embodiment with multiple remote devices and cameras. A smartphone 31, tablet 32, and computer 33 are all wireless communicating 34 with the wireless adapter 30. Other devices could also be connected such as a printer, wireless hard drive, PDA. The wireless adapter 30 is detachably connected to multiple cameras 35, 36, as well as a external hard drive storage device 37 through a hub 38 or some other suitable mechanism. In this embodiment, the wireless adapter can be configured to enable communication between any remote wireless device and detachably connected camera. Some of the resulting capabilities include, but are not limited to: a remote device controlling any single camera; a remote wireless device controlling any number of cameras including multiple in unison if so configured; feedback, data or images transmitted to a particular remote wireless device; and feedback, data or images transmitted to any number of remote wireless devices. The external storage device 37 could also be used to permit the transfer of images and video from the cameras 35, 36 either automatically or based on input from the remote wirelessly enabled devices 31, 32, 33.
FIG. 4 demonstrates a possible configuration and usage. An operator with a remote wireless device 42 wirelessly connects to the wireless adapter 41 that is detachably connected to a camera 40. The remote wireless device may be comprised of a display 43 and some means of interaction, such as touch screen buttons 44, or separate physical buttons. Other configurations are also possible, such as only a display for presenting information and images or only controls for commanding the wireless adapter and no visual feedback mechanism. In the configuration in FIG. 4 an image 45 is displayed on the screen. This image could be a still image that was captured, a video stream, or live view stream of the camera's current field of view. A control section 46 provides status as well as control over camera parameters such as Shutter Speed, Aperture, ISO, etc. This is of course a subset of the possible camera settings and parameters that could be monitored and manipulated. Additional controls may also be present, such as the ability to trigger an image to be captured 47; start or stop streaming a live view of the cameras field of view 48; start or stop recording a video 49; and change focusing modes such as between automatic and manual focus.
The physically and logical structure described thus far enables many possible methods of configuration and communication. FIG. 5 illustrates the control flow of a simple communication method. The wirelessly enabled device 60 transmits a message 63 to the wireless adapter 61. The wireless adapter transmits the message exactly as received 64 to the camera 62. Any responses received 65 from the camera 62 by the wireless adapter 61 are then transmitted back 66 to the wirelessly enabled remote device 60. In this configuration the wireless adapter acts as a direct link between the wireless device and camera.
In addition to the simplistic direct-link method described previously, the wireless adapter may be configured to perform more complex communication tasks. For example, in FIG. 6, the wirelessly enabled remote device 70 issues a command 73 to the wireless adapter 71 with in intent for it to be sent three times with a one second delay between each command. This intent could, for example, be communicated through additional headers fields added to the command. The wireless adapter can respond to the wirelessly enabled remote device that the sequence command was successfully received and initiated 74. The wireless adapter then begins the sequence by relaying the message 75 to the camera and receiving a response 76. This response may optionally be relayed to the wirelessly enabled remote device. After a one second delay 77 as specified by the initial command 73, this process of sending a command 78, 81, receiving a response 79, 82 and delaying 80 is repeated the appropriate number of times. After completing the sequence, the wireless adapter can inform the wirelessly enabled device that the sequence has terminated.
The wireless adapter may be configured in various physical forms as well as various attachment methods. The adapter may be a separate stand-alone device; integrated into or onto an existing item such as a tripod, tripod mount, camera flash unit, L-bracket, or other similar item; or may be physically detachably secured to the camera through means such as a male or female threaded adapter or screw, clip, strap, hot-shoe plate adapter, or any similar type means or any combination thereof. It should be noted that these forms and attachment methods are a subset of possible options and one skilled in the art would not be limited to these listed. Any items to aid in attachment may be detachably or fixedly secured and/or integrated with the wireless adapter. It should be noted that the wireless adapter is external to the camera.
The wireless adapter may be configured internal or external with additional items. The wireless adapter may, for example, be configured internal or external with a motorized control unit capable of various functions such as physically moving the camera in any direction or adjusting the angle of rotation about any given axis, thereby enabling pan, tilt, and rotation controls. A motorized control unit could also be used to physically move the camera's lens, such as to change the lens' zoom distance, or could be used to make physical adjustments to buttons, dials, or other controls located for example on the camera or lens. These items listed are a subset of the possible items that the wireless adapter may be configured with as well as a subset of the possible controls such configurations may offer.
The wireless adapter described allows a number of possible methods of use. One configuration could be a user directly interacting with a remote wirelessly enabled device, such as an iPad™, that is wirelessly communicating with the wireless adapter fixedly connected to a camera. In one possible method of use, the user could interact with buttons on the on the associated application on the iPad™ to command the wireless adapter to stream a live view video stream to then be displayed to the user on the iPad's™ screen. The exact method for turning on a live view stream varies by camera and manufacturer. The state-full knowledge could reside with either the iPad or the wireless adapter, but the process is essentially the same. The camera model and manufacturer must be determined through appropriate queries. Then depending on the model the appropriate commands must be taken, for example some models require only a specific camera parameter to be set before live view feed images can be retrieved, while other models require a camera parameter to be set as well as a specific command issued. In addition to simply the benefit of the video feed for feedback and composition, additional capabilities could be offered to the user. The user could touch on certain areas or objects within the live view feed, which would then automatically instruct the wireless adapter to command the camera to focus on the selected area. The user will then be able to see this focus adjustment take place in real time. Similarly to the process of turning on the live view feed, the touch focusing process must take specific actions based on the current camera model. In general terms the process involves commanding the camera to set the location of interest to the selected area and then perform a focus operation. However, the exact parameters and values used need to be determined based on prior information correlated with the current camera model. In addition to the touch focus method described here, the user could initiate an automatic focus adjusting and capture procedure known as focus stacking. Focus stacking is the process of acquiring images at multiple focal planes enabling the images to be later combined to achieve an enhanced depth of field. The user can configure this process through a number of methods. In one method the user can specify two focal planes on the iPad™ using the live view feed for feedback and then instruct the wireless adapter to capture a focus stack between those planes. Similarly the user could specify an initial focal plane on the iPad™ as well as specifying how many image captures to take and how large of a focus step to take between each capture. In either scenario the wireless adapter's task is to query the camera for its model and then using that information select the appropriate focus adjustment and capture commands. Using these specifically selected commands the wireless adapter can step through the process of applying focus adjustments and capturing images. It should be noted that the wireless adapter could perform this process autonomous from the iPad™ or be directly commanded by the iPad™ through the entire process. To more easily enable the user to determine focal planes, techniques such as focus peaking could be used. The iPad™ could use a contrast detection algorithm to determine and then outline areas within focus.
Building upon the previous configuration of a user directly interacting with an iPad™, the user can configure the wireless adapter to automate commands to the camera. For example the user can specify a series of image captures on the iPad™, such as indicating a initial start time or delay, and then either how many images to capture over a specific interval or how many images to capture and with how long of a delay between each image. In either case, this information can be transmitted to the wireless adapter, which can calculate how many shots to take, and with how long a delay between each shot. After waiting for any specified initial delay, the wireless adapter can command to camera to capture an image. The wireless adapter can then enter a cycle of waiting the specified intermediate delay between each subsequent image capture. The exact image capture commands sent by the wireless adapter can be determined by querying for the currently connected camera and selecting the appropriate commands based on the camera model. It should be noted that as described, the iPad™ no longer needs to remain in communication with the wireless adapter after the initial configuration of the wireless adapter, and the wireless adapter can continue its capture sequence autonomous from the iPad™. The iPad™ could, however, remain connected and directly command the wireless adapter for each capture if so desired.
Similarly to the previous method of capturing a sequence of images, the user could also configure on the iPad™ set or variable exposure adjustments to be made during the image capture sequence. In addition to an image capture, a camera property could be adjusted either between each capture or at specific intervals. The process to change a property involves determining the camera model and correlating the appropriate property command and value to set said property to. Similarly to the more simplistic image capture process, this image capture and property adjustment process could be performed on the wireless adapter autonomously from the iPad™ or driven directly by commands from the iPad™.
The camera with the wireless adaptor is also appropriate for photo booths. The remote device is used to trigger and/or view the photos while the wireless adaptor transmits and receives data and can optionally print the photos.
It is also noted that the wireless adapter may have a GPS receiver to tag images captured with location information or alternatively the wirelessly enabled remote device may provide location information to add information.

Claims

1. An apparatus comprising a camera accessory that connects to a camera using an electrical interface, said camera accessory comprises a wireless antenna, power control module, communication control module, and control logic module, with said camera accessory able to be communicate on a wireless local area network with a separate wireless enabled device as well as control and interact with a camera through Picture Transfer Protocol (PTP), wherein control of said camera as well as feedback and data from said camera is comprised of Picture Transfer Protocol messages.

2. The apparatus of claim 1 wherein said electrical interface comprises USB.

3. The apparatus of claim 1 wherein said camera accessory is either attached or housed with one or more of pan, tilt and rotation motors to allow motion of said camera.

4. The apparatus of claim 1 further comprises a shutter release port to connect to a corresponding shutter release port of said camera to allow more precise triggering of said camera.

5. The apparatus of claim 1 further comprises said camera accessory being powered by a replaceable battery.

6. The apparatus of claim 1 further comprises using said camera accessory to communicate on a wireless local area network with a wireless enabled device on said wireless local area network, said wireless enabled device being a smart phone, tablet or computer.

7. The apparatus of claim 6, wherein said wireless enabled device has a specific program configured to be executed for use with said camera accessory.

8. The apparatus of claim 7, wherein said specific program includes a library for each camera that said camera accessory is compatible with wherein said library uses Picture Transfer Protocol messages for each camera.

9. The apparatus of claim 7, wherein said wireless enabled device is capable of monitoring and adjusting parameters and settings on said camera by use of said specific program, said settings and parameters include but are not limited to shutter speed, aperture, ISO, and focus point and/or focal plane, this information is obtained from said camera using Picture Transfer Protocol messages.

10. The apparatus of claim 8, wherein said specific program includes commands for focus stacking, comprising the automated process of capturing multiple images with varying focal planes achieved by commanding the camera to trigger image captures with one or more commands to adjust the camera's focal plane between each capture, where in a user of said wireless enabled device does not change the focal plane, said specific program automatically changes the focal plane.

11. The apparatus of claim 8, wherein said specific program includes commands for creating exposure bracketed sequences, comprising an automated sequence of commands comprising commands to trigger image captures on said camera with commands to adjust said camera's exposure through changing shutter speed, aperture, or ISO between each capture, a user of said wireless enabled device does not change shutter speed, aperture or ISO between the shots as said specific program automatically changes these values.

12. The apparatus of claim 8, wherein said specific program includes commands for Time Lapse, wherein said camera accessory is configured to perform an automated sequence of image capture commands according to a configured interval predetermined by a user on said wireless enabled device.

13. The apparatus of claim 8, wherein triggering of images from said camera is inputted from a user into said specific program and said inputs are stored on said camera accessory and said wireless enabled device does not remain connected on said wireless local area network while the commands are being delivered to said camera.

14. The apparatus of claim 7 above, wherein said camera accessory communicates with multiple of said wireless enabled devices on a wireless local area network thus transferring images and/or live view from said camera to multiple of said wireless enabled devices.

15. The apparatus of claim 1 above, wherein multiple of said camera accessory are communicating with one or more wireless enabled devices on a wireless local area network.

16. The apparatus of claim 7, wherein said wireless enabled device is capable of triggering image captures on said camera by use of said specific program and a user is further capable of viewing and/or saving said image onto said wireless enabled device.

17. The apparatus of claim 7, wherein by use of said specific program on said wireless enabled device a user of said wireless enabled device is capable of starting and stopping video recording by use said specific program of said camera and monitoring said recording through a live feed displayed on said wireless enabled device said user optionally can change focus during said video recording.

18. The apparatus of claim 17, by use of said specific program on said wireless enabled device a user of said wireless enabled device is capable of viewing a live feed from said camera on said wireless enabled device and making focus adjustments through the commands of Picture Transfer Protocol messages according to information provided within said live view.

19. A kit comprising a camera accessory of claim 1, electrically connected to a camera through the USB protocol, and wireless connected to a wireless enabled device on a wireless local area network.

20. A method of communicating with a camera using the apparatus of claim 1 to remotely control a camera or remotely view images or live feed.