JP2003198928A - Camera and remote control terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera and a remote control terminal device, which utilize a camera shake correcting function to change a picture by remote control. <P>SOLUTION: The camera is provided with a camera shake correction means for correcting a camera shake, a communication means for communicating information with a destination, and a control means which uses the camera shake correcting means to change a picture to be photographed on the basis of information received by the communication means and uses the communication means to transmit information related to the changed picture to the destination. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a camera and a remote control terminal device which can change a screen by remote control using a camera shake correction function.

[0002]

2. Description of the Related Art Conventionally, computers have mainly been used as devices connected to the Internet, but various devices have become connectable due to the development of communication devices and web browsers. For example, there are terminals dedicated to the Internet mainly for connecting to the Internet, electronic devices such as mobile phones, game machines, and video cameras with a built-in camera, which are provided with an Internet connection function.

A user uses an Internet service provider (Internet service provider) to install these terminals and devices.
vider, abbreviated as "ISP" below. It is possible to browse various home pages (Home Page, hereinafter abbreviated as “HP”) by connecting to the Internet via a web browser. HP
Some of the pages include landscape photos and live broadcasts of landscapes.
By entering (Uniform Resource Locater), you can enjoy the scenery of scenic spots, famous places and historic sites both in Japan and abroad.

[0004]

By the way, in such a live broadcast of scenery, contents (contents,
Contents of service) A screen is provided according to the intention of the provider. Therefore, if the user can operate the camera on the content providing side from the terminal or device to change the camera angle, the user can enjoy the image more.

Therefore, in the present invention, by utilizing a certain function originally for correcting camera shake, the camera angle can be remotely controlled without providing the camera with a special mechanism for changing the camera angle. An object of the present invention is to provide a camera and a remote control device that can be changed and can perform high-resolution shooting and panoramic shooting.

[0006]

In a camera according to the present invention, a camera shake correction means for correcting camera shake, a communication means for communicating information with a communication partner, and a change of a screen to be photographed are received by the communication means. And a control means for transmitting the information related to the changed screen to the communication partner by using the communication means based on the information.

With such a configuration, the camera according to the present invention is instructed to operate wirelessly with a communication partner directly or via a network, and changes the screen based on the content of the instruction using the camera shake correction function. Can be done by Therefore, the camera can be operated remotely and no special mechanism for changing the screen is required.

In the remote control terminal device according to the present invention, the communication means for communicating information with the camera having the camera shake correction function, the display means for displaying the communicating information, and the screen taken by the camera are used as the hand And a control unit that causes the communication unit to communicate change information for making a change using the shake correction function.

With such a configuration, the remote operation terminal device according to the present invention can instruct the camera to change the screen by remote operation, and furthermore, change the screen by using the camera shake correction function of the camera. can do.

[0010]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. In each figure, the same components are designated by the same reference numerals and the description thereof will be omitted.

FIG. 1 is a diagram showing the configuration of the remote control system of this embodiment.

In FIG. 1, the camera
A plurality of imaging devices 11 that change the angle to photograph a subject and provide the photographed images to the HP as contents.
A plurality of remote control terminal devices 12 that issue an instruction to change the camera angle of the imaging device 11 are connected via a communication line 15. Here, the remote control terminal device 12 includes a terminal device connected by wire, a terminal device connected wirelessly via the base station 13, and the like. Communication line 15 is LA
Examples include N (Local-Area Network) and general public lines.

First, the structure of the image pickup device 11 will be described.

FIG. 2 is a view showing the arrangement of an image pickup apparatus having a camera shake correction function.

In FIG. 2, the image pickup device 11 includes an image pickup unit 2
1, signal processing unit 22, display unit 23, storage device 24, communication unit 25, drive unit 27, control unit 28, and operation input unit 29.
It is configured with. When the imaging device 11 and the communication line 15 are connected by wireless communication,
A transmission / reception antenna 26 is provided. The imaging device 11 is, for example, a camera-integrated video camera, an electronic still camera, or the like.

The image pickup section 21 uses an optical system composed of a plurality of lenses to pick up light from a subject by means of an image pickup device (eg CCD).
(Solid-state image sensor such as a charge-coupled device) is an optical part of a camera that obtains electric signals related to an image by photoelectric conversion.

The signal processing unit 22 converts the electric signal from the image pickup unit 21 into an image signal and outputs it to the storage device 24.

The storage device 24 is a storage circuit for storing a program executed by the control unit 28, data to be temporarily saved during the execution of the program, an image signal, and the like.
ROM (Read Only Memory) and RAM (Random Access)
Memory) is a semiconductor memory.

The display unit 23 is, for example, a display device such as a cathode ray tube display (CRT), a liquid crystal display (LCD) or an organic EL display, and is connected to the storage device 24 to execute the execution program under the control of the control unit 28. Each screen in execution, the image read from the storage device 24, the operation content input from the operation input unit 29, and the like are displayed.

The communication unit 25 includes the image pickup device 11 and the communication line 1.
5 is an interface that adjusts the communication protocol with 5.
For example, IPX / SPX (Internetwork Packet Exchan
ge / Sequenced Packet eXchange) and TCP / IP (Tra
Signals are converted according to a protocol that complies with Internet communication standards such as nsmission Control Protocol / Internet Protocol. When connecting to the communication line 15 by wireless communication, the communication unit 25 uses the DECT (Digital
The signal is further converted according to a protocol conforming to a wireless communication standard such as Enhanced Cordless Telecommunications, Bluetooth, or IEEE 802.11b, and the signal is connected via the transmitting / receiving antenna 26.

The drive unit 27 adjusts the aperture area of the iris to adjust the exposure according to the instruction of the control unit 28, and controls the lens position to adjust the focus according to the instruction of the control unit 28.

The control unit 28 is a microprocessor or the like, is connected to the signal processing unit 22, the display unit 23, the storage unit 24, the communication unit 25, the drive unit 27 and the operation input unit 29, and is stored in the storage unit 24. Each of these parts is controlled according to each control program.

The operation input unit 29 is, for example, a keyboard,
An input device such as a mouse or a touch panel, which is a control unit 2
8 is connected. The user (user) operates the operation input unit 29.
By inputting commands and data from, the subject is photographed and the photographed image is uploaded to the Internet.

The image pickup device 11 also has a so-called camera shake correction function. Various methods have been disclosed for camera shake correction, but they are roughly classified into a mechanical method that mechanically corrects camera shake and an electronic method that electronically corrects camera shake.

In the mechanical system, basically, detection means for detecting the amount of camera shake from a sensor such as an acceleration sensor or the image signal itself, a lens for camera shake correction provided in the optical system, and this camera shake correction are provided. The moving means moves the lens in a plane perpendicular to the optical axis according to the detected camera shake amount. In this case, a camera shake correction lens is provided in the imaging unit 21, and the drive unit 27 and the control unit 28 perform camera shake correction.

On the other hand, in the electronic system, a detection means for detecting the amount of camera shake, a means for cutting out a part of the image stored in the image memory, and a control means for controlling the cutting position according to the detected amount of camera shake. Consists of. In this case, the imaging unit 2
The image sensor of No. 1, the signal processing unit 22, the storage device 24, and the control unit 28 perform camera shake correction.

The present invention can be applied to both the mechanical system and the electronic system.

Next, the configuration of the remote control terminal device will be described.

FIG. 3 is a diagram showing the configuration of the remote control terminal device.

In FIG. 3, the remote control terminal device 12 is
The display unit 33, the storage device 34, the communication unit 35, the control unit 38, and the operation input unit 39 are provided. The remote control terminal device 12 is, for example, a personal computer, a notebook personal computer, a mobile phone with a display unit, or the like.

The display unit 33 is, for example, a display device such as a cathode ray tube display (CRT), a liquid crystal display (LCD) or an organic EL display, and is connected to the storage device 34 to execute the execution program under the control of the control unit 38. Each screen in execution, an image read from the storage device 34, an operation input from the operation input unit 39, and the like are displayed.

The storage device 34 is a storage circuit for storing a program executed by the control unit 38, data to be temporarily stored during the execution of the program, an image signal received via the communication unit 35, and a ROM, for example. And a semiconductor memory such as a RAM.

The communication section 35 is an interface for adjusting the communication protocol between the remote control terminal device 12 and the communication line 15. The communication unit 35 is, for example, IPX / SPX or TC.
Signals are converted according to a protocol that complies with Internet communication standards such as P / IP. Remote control terminal device 12
Gives an instruction to the imaging device 11 to be operated via the communication unit 35 and the communication line 15, and receives an image from the imaging device 11 to be operated. When connecting to the communication line 15 by wireless communication, the communication unit 35 uses the PDC (Pers
onal Digital Cellular) and GSM (Global System for
Mobile Communications) and CDMA (Code Division)
The signal is further converted according to a protocol conforming to Multiple Access) and connected via the transmitting / receiving antenna 26.

The control unit 38 is a microprocessor or the like, is connected to the display unit 33, the storage device 34, the communication unit 35 and the operation input unit 39, and controls each of these units according to each control program stored in the storage device 34. .

The operation input section 39 is, for example, a keyboard,
It is an input device such as a mouse or a touch panel, and the control unit 3
8 is connected. The user (user) operates the operation input unit 39.
By inputting a command and data from, the operation target imaging device 11 is operated so as to obtain a desired camera angle.

Next, the operation of changing the range of the image pick-up device 11 by changing the camera angle of the image pick-up device 11 from the remote control terminal device 12 via the communication line 15 will be described.

FIG. 4 is a diagram showing a procedure of communication processing.

First, the user who uses the remote operation connects to the network through the operation input unit 39 of the remote operation terminal device 12.

In FIG. 4, the remote control terminal device 12 is
In order to establish a connection with the operation target imaging device 11, the operation target imaging device 11 is searched. In the case of directly operating the image pickup device 11 directly without going through the network, this exploration is performed by the remote control terminal device 1 like Bluetooth.
2 and the imaging device 11 to be operated may be mutually performed. When the URL of the HP provided by the operation target imaging device 11 is known, the URL is input from the web browser to establish the connection between the remote operation terminal device 12 and the operation target imaging device 11. May be.

The image-pickup device 11 which is the searched operation target responds to the remote-control terminal device 12 which has searched. In the figure, the remote operation terminal 12 that has received the response performs authentication work, and obtains information for identifying the device from the imaging device 11 that is the operation target, so that the remote operation terminal device 12 becomes the operation target of the communication partner. Recognize the imaging device 11. The imaging device 11 to be operated also obtains the information specifying the remote operation terminal device 12, so that the imaging device 11 to be operated recognizes the remote operation terminal device 12 of the communication partner. After confirming the communication partner with each other, the imaging device 11 and the remote operation terminal device 12 to be operated send a preparation OK indicating that remote operation is possible to the communication partner, and notify the communication partner that the preparation for the remote operation is completed. Let us know.

Then, the image pickup device 11 to be operated transmits the screen displayed on the display section 23 as an image signal to the remote operation terminal device 12 of the communication partner at a constant interval, and the image signal is normally returned each time. If received, the remote operation terminal device transmits a reception OK to the imaging device 11 to be operated, and transmits that the reception was successful.

Further, when the remote operation terminal device 12 is remotely operated, the image pickup device 12 to be operated receives a command sent from the remote operation terminal device 12. When the command is normally received each time, the imaging device 1 to be operated
1 sends a reception OK to the remote control terminal device 12 and transmits that the reception was successful.

When the communication fails in each of these communications, the contents of the failed communication are retransmitted, then the reaction from the communication partner is waited, and whether or not the communication is normally received is determined by whether or not the reception OK is received. Make a decision. This determination is performed a predetermined number of times (for example, 5 times or 10 times), and if the communication still fails, the communication between the devices is terminated. When the communication is successful, the communication content after the communication failure is started and the original communication is restored.

When the connection is established between the remote operation terminal device 12 and the image pickup device 11 to be operated in this way, the mode selection screen shown in FIG. 5 is displayed on the display unit 33 of the remote operation terminal device 12. .

FIG. 5 is a diagram showing a mode selection screen in the remote control terminal device.

The contents that can be operated remotely are screen change, panoramic photography and high resolution, and each operation can be performed by designating an operation mode. In the present embodiment, as shown in FIG. 5, each operation mode has a hierarchical structure, and the hierarchy for selecting the resolution changing mode and the screen changing mode, and the panoramic shooting selected after selecting the resolution changing mode. It is composed of a hierarchy for selecting a mode and a high resolution mode.

The resolution changing mode is a mode used when changing from a standard resolution to a different resolution,
The resolution can be selected from panoramic shooting and high resolution. The panoramic shooting mode is used when panoramic shooting is performed, and the high resolution mode is used when shooting is performed at a higher resolution than the resolution set as standard. The screen change mode is a mode used when changing the camera angle of the imaging device 11.

Each mode is selected by moving the cursor with the control key 53 provided in the operation input section 39. The mode designated by the cursor is highlighted. The mode is determined by pressing a decision button 54 provided on the operation input unit 39.

In this embodiment, each mode is displayed in a hierarchical structure, but each mode may be displayed in the same column.

When a mode is selected from such a mode selection screen, the selected mode is the remote control terminal device 1
2 to the imaging device 11 to be operated via the communication line 15.

The image pickup device 11 to be operated, which has been received, operates as follows depending on the contents received.

First, the case of the screen change mode will be described.

FIG. 6 is a diagram showing the relationship between the screen change and the cutout position of the memory.

FIG. 7 is a diagram showing the display unit of the remote control terminal device when the screen is changed.

When the screen change mode is selected, the control key 53 provided in the operation input section 39 of the remote control terminal device 12 becomes an input means for instructing the change direction of the screen, and the decision button 54 performs photographing. It becomes an input means.

When the user wants to move the image captured by the imaging device 11 to be operated in the upward direction, the user depresses the up arrow control key 53-1 shown in FIG.

When the up arrow control key 53-1 is pressed, the remote control terminal device 12 generates an upward movement command for moving the camera angle upward, and operates this command via the communication line 15. Target imaging device 11
Send to.

The image pickup device 11 to be operated, which has received the upward movement command, uses the image stabilization used when the image pickup device 11 is shaken downward to move the image captured by the image pickup device 11 upward. Move in the direction.

More specifically, for example, in the case of a camera shake correction device that corrects camera shake by changing the clipping position of the image stored in the memory according to the camera shake amount, it is shown in FIG. To change the cutout position.

That is, in FIG. 6, the entire image pickup range picked up by the image pickup device of the image pickup unit 21 is stored in the storage device 24 (dotted line rectangle 42 in FIG. 6), and usually a part thereof (solid line in FIG. 6). The rectangle 41) is displayed on the display unit 23 as a screen shot.

When the upward movement command is received, as shown in FIG.
Rectangle 4 that is cut out by shifting upward as shown in 3-1
The image signal of the 3-1 part is transmitted from the imaging device 11 to be operated to the remote operation terminal device 12 via the communication line 15,
This is displayed on the display unit 33.

Similarly, the left arrow control key 53-2
When is pressed, the remote control terminal device 12 generates a leftward movement command for moving the camera angle to the left, and transmits this command to the operation target imaging device 11 via the communication line 15. The imaging device 11 to be operated, which has received the leftward movement command, moves the image captured by the imaging device 11 to the left by using the image stabilization used when the imaging device 11 blurs to the right. Let

Similarly, the down arrow control key 5
When 3-3 is pressed, the remote control terminal device 12
A downward movement command for moving the angle downward is generated, and this command is transmitted to the operation-target imaging device 11 via the communication line 15. The imaging device 11 to be operated, which has received the downward movement command, uses the image stabilization used when the imaging device 11 is shaken in the upward direction,
The image captured by the imaging device 11 is moved downward.

Similarly, the right arrow control key 5
When 3-4 is pressed, the remote control terminal device 12
A right move command for moving the angle to the right is generated, and this command is transmitted to the operation-target imaging device 11 via the communication line 15. The imaging device 11 to be operated, which has received this rightward movement command, uses the camera shake correction that is used when the imaging device 11 blurs to the right,
The image captured by the imaging device 11 is moved leftward.

On the other hand, when it is desired to move the camera angle diagonally downward to the left, the down arrow control key 53-2 and the down control key 53-3 may be used together.
By operating in this way, as shown in FIG. 6, the cutout position of the storage device 24 is slanted to the lower left as shown by a broken-line rectangle 43-2, and the cutout image signal of the rectangle 43-2 is displayed. The image is transmitted from the operation target imaging device 11 to the remote control terminal device 12 via the communication line 15, and the display unit 3
It is displayed in 3. For example, the range of the screen displayed by the imaging device 11 to be operated can be changed from the screen shown in FIG. 7A to the screen shown in FIG. 7B.

The amount of movement in the case of moving in a predetermined direction may be made proportional to the number of times the arrow control key 53 is pressed, for example.

The user presses the enter button 54 when the desired composition is obtained.

When the enter button 54 is pressed, the remote control terminal device 12 transmits a shutter command for releasing the shutter to the image pickup device 11 to be operated. Upon receiving this command, the imaging device 11 to be operated releases the shutter,
At the cutout position in that case, the image signal is transmitted from the storage device 34 to the remote control terminal device 12 via the communication unit 25 and the communication line 15.

The command of the remote control terminal device 12 and the operation executed by the image pickup apparatus 11 by this command are summarized and the relationship between the command and the operation of the image pickup apparatus is shown in FIG. The commands are not limited to those shown in FIG.
It may include a command that causes the imaging device 11 to perform another operation.

As described above, in this embodiment, the communication line 15
The image pickup device 11 and the remote operation terminal device 12 are connected by, and a desired command can be transmitted from the remote operation terminal device 12 to the image pickup device 11 to take an image with a desired camera angle. By using the camera shake correction function, the camera angle of the image pickup device 11 can be changed without moving the image pickup device 11 itself.

Since the camera angle can be changed while watching the image displayed by the image pickup device 11,
You can get the exact composition you want and never miss a photo opportunity.

Next, the case of the panoramic photography mode will be described.

FIG. 9 is a diagram showing a relationship between panoramic photography and camera shake correction and an example of an image.

When the panoramic photography mode is selected, the control key 53 provided in the operation input section 39 of the remote control terminal device 12 serves as an input means for instructing the screen changing direction, and the enter button 54 performs photography. It becomes an input means. Here, the camera angle can be changed only in the vertical direction because the camera shake correction function in the horizontal direction is used for performing panoramic shooting as described later.

When the user wants to move the image captured by the image pickup device 11 to be operated in the upward direction, the user presses the control key 53-1 of the up arrow shown in FIG. , Press the down arrow control key 53-3 shown in FIG.

Similarly to the above, when these control keys 53-1 and 53-3 are pressed, the remote control terminal device 12
Generates a command corresponding to the pressed control key 53-1 or 53-3, and transmits this command to the operation-target imaging device 11 via the communication line 15. The imaging device 11 that is the operation target that has received the command moves the image captured by the imaging device 11 in the upward direction or the downward direction by using the camera shake correction according to the command.

More specifically, in FIG. 9A, the entire image pickup range imaged by the image pickup device of the image pickup section 21 is stored in the storage device 24 (dotted line rectangle 42 in FIG. 9A), and when a command is received, FIG. As shown in FIG. 7, the cutout position of the storage device 24 is shifted as shown by a solid line rectangle 51, and the image signal of the cutout rectangle 51 portion is transmitted from the image pickup device 11 to be operated via the communication line 15 to the remote control terminal device 1.
2 and is displayed on the display unit 33.

The user presses the enter button 54 when the desired composition is obtained.

When the enter button 54 is pressed, the remote control terminal device 12 transmits a shutter command for releasing the shutter to the image pickup device 11 to be operated. Upon receiving this command, the imaging device 11 to be operated releases the shutter,
An image 52-L to be captured by camera shake correction when the image pickup apparatus 11 shakes to the right and an image 52-R to be captured by camera shake correction when the camera shakes to the left are cut out from the storage device 34. An image signal of a panoramic image is obtained by synthesizing the images. The image signal of this panoramic image is transmitted to the remote control terminal device 12 via the communication unit 25 and the communication line 15.

As described above, when the image pickup apparatus 11 takes a picture using the camera shake correction function, for example, a panoramic image 52 as shown in FIG. 9B can be obtained.

Finally, the case of the high resolution mode will be described.

FIG. 10 is a diagram showing an example of the relationship between high-resolution shooting and camera shake correction and an image.

When the high resolution photographing mode is selected, the enter button 54 becomes an input means for photographing.

In FIG. 10A, the user presses the enter button 5
When 4 is pressed, the remote control terminal device 12 transmits a shutter command to release the shutter to the image capture device 11 to be operated. The imaging device 11 that is the operation target that has received this command
Releases the shutter, cuts out each image 56-UL, 56-UR, 56-DL, 56-DR that should be captured by camera shake correction from the storage device 34, and synthesizes each image to obtain a high-resolution image. Get the signal. The image signal of this high resolution image is transmitted to the remote control terminal device 12 via the communication section 25 and the communication line 15.

As described above, when the image pickup apparatus 11 takes a picture by utilizing the camera shake correction function, for example, a high resolution image 56 as shown in FIG. 10B can be obtained.

[0086]

As described above, according to the present invention, since the screen is changed by using the camera shake correction function, it is not necessary to specially provide a mechanism for changing the screen. Therefore, the screen can be easily changed. The size of the camera does not increase and the power consumption does not increase.

Further, since the remote control can be performed, the composition can be decided while looking at the photographed image. Therefore, the image can be obtained with the composition intended by the user or at the photo opportunity.

[Brief description of drawings]

FIG. 1 is a diagram showing a configuration of a remote control system of the present embodiment.

FIG. 2 is a diagram showing a configuration of an image pickup apparatus with a camera shake correction function.

FIG. 3 is a diagram showing a configuration of a remote control terminal device.

FIG. 4 is a diagram showing a procedure of communication processing.

FIG. 5 is a diagram showing a mode selection screen in the remote control terminal device.

FIG. 6 is a diagram showing a relationship between a screen change and a memory cutout position.

FIG. 7 is a diagram showing a display unit of a remote control terminal device in changing a screen.

FIG. 8 is a diagram showing a relationship between a command and an operation of the image pickup apparatus.

FIG. 9 is a diagram showing a relationship between panoramic photography and camera shake correction and an example of an image.

FIG. 10 is a diagram illustrating an example of an image and a relationship between high-resolution shooting and camera shake correction.

[Explanation of symbols] 11 Imaging device 12 Remote control terminal 15 communication lines 21 Imaging unit 22 Signal processing unit 23, 33 Display 24, 34 storage device 25,35 Communication unit 28, 38 control unit 53 Control key 54 decision button

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04Q 9/00 301 H04Q 9/00 301E F term (reference) 5C022 AA01 AB62 AB65 AC31 AC69 5C054 AA02 CA04 CF05 CG02 DA07 EA01 EA03 EA05 ED07 FD02 FF02 GB11 HA19 5C064 AC04 AC07 AC12 AD07 AD08 5K048 AA04 BA10 DC01 DC03 EB02 EB15 FB05 HA02 5K101 KK11 NN06 NN18

Claims (5)

[Claims] 1. A camera shake correction means for correcting camera shake, a communication means for communicating information with a communication partner, and the camera shake correction means based on information received by the communication means for changing a screen to be photographed. And a control unit for transmitting information regarding the changed screen to the communication partner using the communication unit. 2. The camera according to claim 1, wherein the change of the screen is a change of a camera angle. 3. The camera according to claim 1, wherein the change of the screen is a change to panoramic photography. 4. The camera according to claim 1, wherein the change of the screen is a change to high resolution. 5. A communication means for communicating information with a camera having a camera shake correction function, a display means for displaying the information to be communicated, and a screen for shooting by the camera, which is changed by using the camera shake correction function. A remote control terminal device, comprising: a control unit that communicates change information using the communication unit.