CN105721752A - Digital Camera And Camera Shooting Method - Google Patents
Digital Camera And Camera Shooting Method Download PDFInfo
- Publication number
- CN105721752A CN105721752A CN201610186833.0A CN201610186833A CN105721752A CN 105721752 A CN105721752 A CN 105721752A CN 201610186833 A CN201610186833 A CN 201610186833A CN 105721752 A CN105721752 A CN 105721752A
- Authority
- CN
- China
- Prior art keywords
- image
- dynamic image
- mentioned
- face
- dynamic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Signal Processing For Recording (AREA)
- Studio Devices (AREA)
- Studio Circuits (AREA)
- Image Processing (AREA)
Abstract
The invention provides a digital camera and a camera shooting method, with the device and the method, a dynamic image which arouses the interest of the appreciators thereof can be obtained. Therefore, when the operating mode of a digital camera (100) during reproducing the dynamic image recorded in a recording part (105) of the digital camera (100) in a display part (202) of a TV (200) is a communication mode, the camera part (101) of the digital camera (100) is started to obtain the facial image of the appreciator of the dynamic image, the obtained facial image is synthesized with the dynamic image in reproduction and then displayed on the display part (202).
Description
The application is original bill application number is the divisional application of application for a patent for invention (applying date: on 07 02nd, 2010, priority date: on 07 03rd, 2009, denomination of invention: camera head and moving image reproduction method) of No.201010222803.3.
Technical field
The present invention relates to and there is use external equipment to reproduce the camera head of the function of dynamic image and such moving image reproduction method.
Background technology
In recent years, digital camera and portable telephone etc. have the portable equipment of various camera function and have been able to carry out dynamic image photography.But, accurate seizure does not carry out the motion of the subject of regulation motion to shoot dynamic image, and this is more difficult for domestic consumer.Therefore, for domestic consumer, the dynamic image of dullness can only be shot.On the other hand, the TV programme etc. expert personage made, it is possible to photograph while frequently switching composition by multiple video cameras.Therefore, it can shoot not dull dynamic image.But, domestic consumer takes this method for imaging to be extremely difficult.
Even the dynamic image of dullness during photography, if through suitable editing operating, also can become it will be appreciated that dynamic image.In recent years it has been proposed that the various technology (referring for example to No. 2822187 publications of Japanese Patent No.) that the dynamic image reproduced in TV image can be carried out dynamic image editor.
In the existing dynamic image editing techniques such as No. 2822187 publications of Japanese Patent No., not doing any consideration as the appreciator of the dynamic image obtained after appreciating editor, the dynamic image obtained after editor is not necessarily dynamic image interested for appreciator.Therefore, the appreciator of dynamic image probably feels bored.
Summary of the invention
It is an object of the invention to provide a kind of camera head obtaining the appreciator appreciating dynamic image dynamic image easily interested and image capture method.
In order to achieve the above object, the camera head of the 1st mode of the present invention, it is characterised in that this camera head has: image pickup part, it obtains dynamic image；Record portion, it records the dynamic image obtained by above-mentioned image pickup part；Face detection portion, it detects face from the dynamic image that above-mentioned image pickup part obtains；And combining unit, to making the work of above-mentioned image pickup part and the dynamic image that obtains synthesizes on its dynamic image in being recorded in above-mentioned record portion, the dynamic image that above-mentioned combining unit determines to make the work of above-mentioned image pickup part according to sound variation or the expression shape change of face that detected by above-mentioned face detection portion and obtains is synthesized to the opportunity in the dynamic image being recorded in above-mentioned record portion.
In order to achieve the above object, the image capture method of the 2nd mode of the present invention, it is characterised in that this image capture method includes: obtained dynamic image by image pickup part；Record portion will be recorded in by the dynamic image of above-mentioned acquirement；From the above-mentioned dynamic image obtained, face is detected by face detection portion；The dynamic image obtained making above-mentioned image pickup part work on dynamic image in being recorded in above-mentioned record portion synthesizes, in above-mentioned building-up process, determine to make the work of above-mentioned image pickup part according to sound variation or the expression shape change of face that detected by above-mentioned face detection portion and the dynamic image that obtains is synthesized to the opportunity in the dynamic image being recorded in above-mentioned record portion.
Accompanying drawing explanation
Fig. 1 is the figure of the structure of the dynamic image playback system of the digital camera of the example illustrating and having the camera head as an embodiment of the invention.
Fig. 2 is the figure illustrating situation when dynamic image playback system uses.
Fig. 3 is the 1st figure of the flow chart of the main work illustrating digital camera.
Fig. 4 A indicates that the display example of the thumbnail image of dynamic image.
Fig. 4 B is the display example of the picture reproducing destination for selecting dynamic image.
Fig. 4 C is example during dynamic image reproduction.
Fig. 4 D indicates that display example in the communication mode.
Fig. 5 is the 2nd figure of the flow chart of the main work illustrating digital camera.
Fig. 6 A is the figure of the synthesis example illustrating face image.
Fig. 6 B is the figure of the synthesising position modification illustrating face image.
Fig. 7 illustrates the flow chart that location change processes.
Fig. 8 is the 3rd figure of the flow chart of the main work illustrating digital camera.
Fig. 9 A is the figure of the 1st display example illustrating remote controller operation display image.
Fig. 9 B is the figure of the 2nd display example illustrating remote controller operation display image.
Figure 10 illustrates the outside flow chart reproducing end process.
Figure 11 is the figure of the display example illustrating confirmation screen.
Detailed description of the invention
Hereinafter, with reference to the accompanying drawings of embodiments of the present invention.
Fig. 1 is the figure of the structure illustrating the dynamic image playback system with digital camera (it is as an example of the camera head of an embodiment of the invention).As it is shown in figure 1, this dynamic image playback system is configured to make digital camera 100 and radiotelevisor (hereinafter referred to as TV) 200 connect in the way of free communication via communication cable.
The digital camera 100 of present embodiment has: image pickup part 101, face detection portion 102, display part 103, sound collection portion 104, record portion 105, clock portion 106, control portion 107, operating portion 108, and communication interface part 109.Additionally, digital camera 100 in present embodiment at least has following mode of operation: for carrying out the dynamic image photograph mode of dynamic image photography, for carrying out the dynamic image reproduction mode of dynamic image reproduction, and for carrying out the communication pattern of data communication with TV200.
Image pickup part 101 has the camera lens for not shown shot object image is assembled and the imaging apparatus etc. that the shot object image assembled by camera lens converts to the signal of telecommunication.Subject is imaged by this image pickup part 101, obtains the still image of subject.Additionally, by the shooting being consecutively carried out image pickup part 101, moreover it is possible to obtain dynamic image.
The face of the subject in the image that face detection portion 102 detects the shooting by image pickup part 101 and obtains.The information of the face detected by face detection portion 102 such as can be used for making the control of the focus constituting the camera lens of image pickup part 101 alignment face location and the control making the exposure of face in image suitable.It addition, what the characteristic quantity (shape of eye and nose and position relationship etc.) of face that the face detection in face detection portion 102 for example is by detection image carried out.Further, countenance (particularly smiling face) can also detect in the face detection portion 102 in present embodiment.
Display part 103 shows the still image or dynamic image that are obtained by image pickup part 101.This display part 103 is the liquid crystal display being such as disposed in digital camera 100 back side.
Sound collection portion 104 obtains the sound around the digital camera 100 when dynamic image is photographed, and converts acquired acoustical signal to the signal of telecommunication.
Record portion 105 records the still image or dynamic image that are obtained by image pickup part 101.This record portion 105 is the semiconductor memory card that such as can carry out disassembled and assembled freely on digital camera 100.The date and time carrying out still image photography or dynamic image photography in image pickup part 101 is carried out timing by clock portion 106.It is recorded in association with in record portion 105 with the still image acquired by image pickup part 101 or dynamic image by the photography date and time of these 106 timing of clock portion.
Control portion 107 carries out the control (including the job control etc. in the control of the camera work of image pickup part 101, the display control of work of display part 103, sound collection portion 104) of each module within digital camera 100.Additionally, control portion 107 also carries out the image procossing for the image obtained by image pickup part 101, various data such as acoustic processing for the sound obtained by sound collection portion 104 process.Here, the control portion 107 in present embodiment also has the function as combining unit.That is, control portion 107 also carries out such process: synthesized by the image of the dynamic image recorded in record portion 105 with the appreciator appreciating this dynamic image, and the sound of the person of will appreciate that associates with record dynamic image in record portion 105.And, control portion 107 also has the function as cutting portion, image pickup part 101 face image (face image) in the image obtained is carried out cutting and extracted.
Operating portion 108 is the operating portion of the various operations for carrying out digital camera 100 for user.Identifying the operation of operating portion 108, control portion 107 performs the process corresponding with the operation of operating portion 108.It addition, as operating portion 108, for instance include: for setting the operating portion of the mode of operation of digital camera 100, for the operating portion of the photography execution/end of designation number photographing unit 100, for carrying out the operating portion etc. of various selection work.
Communication interface part 109 is the interface for carrying out data communication between digital camera 100 and TV200.In the present embodiment, by HDMI (HighDefinitionMultimediaInterface, HDMI) (registered trade mark) as communication interface part 109.But, as long as communication interface part 109 is suitable to the interface that dynamic image transmits, just it is not particularly limited.Further, Fig. 1 has illustrated wireline interface, but the wave point corresponding with infrared communication or radio wave communication etc. can also have been used.
TV200 as an example of the external equipment of present embodiment has: broadcast reception portion 201, display part 202, network communication unit 203, information overlap portion 204, control portion 205, remote controller signal acceptance division 206, and communication interface part 207.
Broadcast reception portion 201 comprises for the antenna etc. from receiving television broadcastings such as not shown television stations.Display part 202 shows the dynamic image based on the television broadcasting received via broadcast reception portion 201.Additionally, the display part 202 in present embodiment can also show transmits, from digital camera 100, the dynamic image of coming as numerical data.
Network communication unit 203 is for for the TV200 interface communicated via the Internet and not shown server etc..Information superposition portion 204 makes the various data obtained from not shown server etc. via network communication unit 203 superpose with the dynamic image being shown in display part 202.
Control portion 205 carries out comprising the control of each module within the control of the display work of display part 202 and the job control etc. in information superposition portion 204, TV200.Remote controller signal acceptance division 206 receives the remote controller signal of the remote controller 400 from TV200.Identifying the remote controller signal received by remote controller signal acceptance division 206, control portion 205 performs the process corresponding with the operation of remote controller 400.
Communication interface part 207 is for for the interface carrying out data communication between TV200 and digital camera 100.This communication interface part 207 is also such as HDMI.
Fig. 2 is the figure illustrating the situation when dynamic image playback system of present embodiment uses.As in figure 2 it is shown, digital camera 100 is connected with TV200 via communication cable 300.In such a state, appreciator 500 may be viewed by the dynamic image 202a that is shown in the display part 202 of TV200.Further, appreciator 500 is operated by remote controller 400, can TV200 remotely be operated.
Here, in the present embodiment, during the reproduction of the dynamic image 202a transmitted via communication cable 300 from digital camera 100, obtained the face image of appreciator 500 by the image pickup part 101 of digital camera 100, the face image 202b of the person of will appreciate that 500 synthesizes with the dynamic image transmitted from digital camera 100 and is shown in the display part 202 of TV200.By carrying out such display, for instance as in figure 2 it is shown, two appreciators 500 can confirm reaction each other when appreciating dynamic image 202a on display part 202, thus can make the appreciation lively atmosphere of dynamic image 202a.Such that make the dynamic image of non-pre-edit actual reproduction, can this dynamic image be given is not the enjoyment only watching this dynamic image yet.It is to say, in the present embodiment, the display part 202 of TV200 shows and has and the image just as watching the identical effect of edited image.
Hereinafter, the operational detail of the dynamic image playback system shown in Fig. 2 is described with reference to Fig. 3～Figure 11.It addition, the TV200 in present embodiment only works as follows: show from the dynamic image that digital camera 100 sends；And when operating remote controller 400, would indicate that the operation signal of the operation content of remote controller 400 is sent to digital camera 100 as external signal.Therefore, in the following description the work of digital camera 100 side is illustrated.Additionally, the digital camera 100 in present embodiment also can carry out photography and the reproduction of still image, but in the following description, dynamic image photography and dynamic image are reproduced involved work and illustrates.
In figure 3, first the control portion 107 of digital camera 100 judges whether the mode of operation of digital camera 100 is dynamic image photograph mode (step S101).In the judgement of step S101, when the mode of operation of digital camera 100 is dynamic image photograph mode, control portion 107 makes image pickup part 101 continuous operation be taken into (step S102) to what carry out image, is shown on display part 103 in real time (step S103) by the dynamic image obtained by the continuous operation of image pickup part 101.While viewing is shown in the dynamic image on this display part 103, cameraman can determine opportunity and the composition etc. of photography beginning.After showing dynamic image on display part 103, control portion 107 determines whether that cameraman is operated by operating portion 108 and has carried out the photography of dynamic image and started instruction (step S104).In the judgement of step S104, when the photography not carrying out dynamic image starts to indicate, control portion 107 again carries out the mode of operation of step S101 and judges.And, in the judgement of step S104, when the photography carrying out dynamic image starts to indicate, control portion 107 starts the dynamic image obtained via image pickup part 101 and the SoundRec that obtains via sound collection portion 104 to record portion 105 interior (step S105).Here, as the recording mode of dynamic image, in the present embodiment, for instance use MotionJPEG mode.The reason using MotionJPEG is because editing dynamic graphics picture (being specially face image described later synthesis) in units of frame and is easier to.Certainly, as long as allow the standard of the predetermined condition such as restriction on synthesis opportunity, it is possible to use the interframe compression H.264 waited to process.Furthermore, it is assumed that via the dynamic image record of image pickup part 101 be carry out via the SoundRec in sound collection portion 104 simultaneously so that synchronized with each other.
After the photography of dynamic image starts, control portion 107 determines whether that cameraman is operated by operating portion 108 and has carried out the photography termination instruction (step S106) of dynamic image.In the judgement of step S106, when not carrying out the photography termination instruction of dynamic image, processing and return to step S105, control portion 107 continues the record of dynamic image.Further, in the judgement of step S106, when having carried out the photography termination instruction of dynamic image, control portion 107 terminates the record of dynamic image.Now, the dynamic image recorded in record portion 105 is associated with the photography date and time recorded by clock portion 106 and is recorded by control portion 107.After the record end of dynamic image, control portion 107 carries out the later process of step S101.
Further, in the judgement of step S101, when the mode of operation of digital camera 100 is not dynamic image photograph mode, control portion 107 judges whether the mode of operation of digital camera 100 is dynamic image reproduction mode (step S107).In the judgement of step S107, when the mode of operation of digital camera 100 is dynamic image reproduction mode, control portion 107 would indicate that the thumbnail image of record dynamic image (being also associated with sound) in record portion 105 is shown on display part 103 (step S108) as shown in Figure 4 A.Further, it is assumed that the image displayed as thumbnail image is the representative image of each dynamic image.This representative image is such as the image of the first frame in dynamic image or the image with the frame indexed described later.
After display thumbnail image, control portion 107 determines whether that appreciator is operated by operating portion 108 and has carried out the selection (step S109) of dynamic image.In the judgement of step S109, when not carrying out the selection of dynamic image, control portion 107 continues display thumbnail image.Further, in the judgement of step S109, when the selection carrying out dynamic image, the picture reproducing destination selecting dynamic image shown in Fig. 4 B is shown on display part 103 by control portion 107.In the example of Fig. 4 B, " 1. reproducing " represents that the reproduction destination of dynamic image is the display part 103 of digital camera 100, and " 2.TV " represents that the reproduction destination of dynamic image is the display part 202 of TV200.After the picture of display Fig. 4 B, control portion 107 determines whether to be shown in by dynamic image on display part 103, and namely whether the reproduction destination of dynamic image is display part 103 (step S110).In the judgement of step S110, when the reproduction destination of dynamic image is display part 103, control portion 107 reads current dynamic image selected by appreciator from record portion 105, as shown in Figure 4 C, begin at and display part 103 reproduces read-out dynamic image (step S111).Now, as shown in Figure 4 C, it is possible to display represents the message reproducing dynamic image.
After the reproduction of dynamic image starts, control portion 107 determines whether that user is operated by operating portion 108 and has carried out the switching (step S112) of the dynamic image to reproduce on display part 103.In the judgement of step S112, when the switching carrying out dynamic image, control portion 107 terminates the reproduction of dynamic image, carries out the switching (step S113) of the dynamic image to reproduce afterwards.This switching is performed such, for instance, whenever operating operating portion 108, the dynamic image that will reproduce switches to photography date and time to compare (or late) dynamic image that the dynamic image being currently reproduced by is Zao.After dynamic image switches, the control portion 107 dynamic image to selecting by switching carries out the later process of step S109.
Further, in the judgement of step S112, when not carrying out the switching of dynamic image, control portion 107 determines whether that user is operated by operating portion 108 and indicates the reproduction of dynamic image and terminate (step S114).In the judgement of step S114, when not indicating dynamic image to terminate, control portion 107 carries out the later process of step S109.On the other hand, in the judgement of step S114, when the end operation carrying out dynamic image, control portion 107 carries out the later process of step S101.
Further, in the judgement of step S107, when the mode of operation of digital camera 100 is not dynamic image reproduction mode, control portion 107 performs the process of the flow chart shown in Fig. 5.The process of this Fig. 5 is the process corresponding with communication pattern.Concrete condition will be described later, but in the communication mode, reproduces dynamic image on the display part 202 of TV200.Then, the digital camera 100 operation according to the remote controller 400 undertaken by appreciator, it is operated according to from the TV200 external signal inputted.
In the communication mode, control portion 107 determines whether to receive external signal (step S201) via communication interface part 109 from TV200.In the judgement of step S201, when not inputting external signal from TV200, process the step S101 being back to Fig. 3.Further, in the judgement of step S201, when have input external signal from TV200, the external signal inputted is identified (step S202) by control portion 107.Then, control portion 107 judges whether external signal indicates that the signal (step S203) of the synthetic order of face image.In the judgement of step S203, when external signal is not representing the signal of synthetic order of face image, control portion 107, when current image pickup part 101 works, stops the work (step S204) of image pickup part 101.Concrete condition will be described later, but in the communication mode, the period that image pickup part 101 is transfused at the synthetic order representing face image is operated.After stopped the work of image pickup part 101, control portion 107 judges whether external signal indicates that the signal (step S205) of the reproduction order of dynamic image.In the judgement of step S205, when external signal indicates that the signal of reproduction order of dynamic image, the image of the frame that should send subsequently is sent to TV200 (step S206) by control portion 107.On the other hand, in the judgement of step S206, when external signal is not representing the signal of reproduction order of dynamic image, control portion 107 is such as carrying out outside reproduction end process (step S207) after the scheduled time.Reproduce end process about this outside will be described later.After process in step S206 or step S207 terminates, control portion 107 carries out the process later for step S101 of Fig. 3.
And, in the judgement of step S203, when external signal indicates that the signal of synthetic order, control portion 107 temporarily ceases the reproduction of the dynamic image reproduced, start image pickup part 101 afterwards, in units of frame, obtain the image (step S208) of appreciator.Then, control portion 107 utilizes face detection portion 102 to detect the face in the image of the appreciator via image pickup part 101 acquisition, the face image that cutting detects, is synthesized to the face image of institute's cutting outside the display box of the dynamic image reproduced on the display part 202 of TV200.Then, face image is such as temporarily recorded in record portion 105 by control portion 107, in order to can not will appreciate that the face image of person later as required and carries out synthesizing and preserve (step S209) with the dynamic image being currently reproduced by.So, by only cutting face image, the recording capacity in record portion 105 can be saved.Additionally, by synthesis scope is defined to narrower scope, unnecessary background etc. does not also show, the expression of appreciator can be easily seen.At this point it is possible to make sound collection portion 104 start, it is taken into sound simultaneously, sound variation can be monitored as required, it is also possible to as described later, determine the opportunity being synthesized in the dynamic image reproduced by face according to sound variation.It is of course also possible to specify either one in face image and sound.
After face image is carried out compound display process and temporary transient record by reproduced picture outer (or the periphery of the dynamic image reproduced), control portion 107 carries out location change process (step S210).Illustrate that this location change processes with reference to Fig. 6 A, Fig. 6 B, Fig. 7.It is such process that location change processes, and as shown in Figure 6 A and 6 B, at the face image 202b of the pre-position synthesis appreciator reproducing the dynamic image 202a being shown on the display part 202 of TV200, or changes the position of synthesized face image 202b.At this point it is possible to change the size of face.
In the figure 7, whether the tupe that control portion 107 judges in location change process is automatically change pattern (step S301).
In the judgement of step S301, when tupe is automatically to change pattern, the control portion 107 face image according to the appreciator recorded in the step S209 of Fig. 5 to record portion 105, face detection portion 102 is utilized to detect the countenance of appreciator, it is determined that whether the countenance detected is changed to such as smiling face (step S302).This judgement for example is by judging that whether the countenance detected is consistent with the feature representing smiling face and carries out.In the judgement of step S302, when the countenance of appreciator is changed to smiling face, portion's without contrast (background portion in the such as image shown in Fig. 6 B) in being subsequently sent to the image of frame of TV200 of the control portion 107, the face image (step S303) in synthesis shooting.In order to determine face image compound display opportunity in the dynamic image that this is reproducing, beyond the change except with expression, it is also possible to utilize laugh or the change of Conversation Voice size.Lain in this is because expression during lively atmosphere is for everybody.When face image is synthesized in the dynamic image reproduced, control portion 107 using the opportunity carrying out face image synthesis, face image now, represent the information of position of frame as synthesis historical record in record portion 105.Now, as mentioned above, it is also possible to the record sound such as laugh or Conversation Voice.Thus, it will be seen which kind of reaction appreciator has carried out subsequently.So, face image is suitably synthesized in the dynamic image reproduced, thus the display enriched can be changed.Even easily sinking into the dynamic image captured by amateur of dullness, the face image sometimes also having become to have appreciator enters into the dynamic image of this effect in picture, can obtain the dynamic image changed.Here, only smiling face has entered in the dynamic image reproduced, but, if seeming when boring face enters, for the idea making the image of dullness change, it is also possible to utilize this expression.
In addition, if remaining that face image enters into the state of the dynamic image reproduced, enjoyment will be lost, thus when the size of expression or sound is recovered, or when there being the operation using remote controller 400, make the face image come into keep out of the way beyond the picture reproduced or periphery.In digital camera 100, in order to realize such playback system, although the dynamic image reproduced is synthesized with face image and is shown on TV200 (using HDMI to send), but in this case, as composite signal (history), relieve synthesis.
Further, it is positioned at that the display box of the dynamic image reproduced is outer or when periphery at face image, it is desirable to as far as possible explicitly unobtrusively and little, thus the display size of face image can also be changed according to the picture dimension of the display part 202 of TV200.If the TV200 of big picture, even if not using wide picture scope, also can confirm that out the face of projection.
Additionally, it is also contemplated that the appreciator of dynamic image is many people, in this case, it is not necessary to proprietary expression is all changed to smiling face.When this there is multiple face as the appreciator's image obtained via image pickup part 101, for instance only the face image that expression shape change is smiling face is synthesized.It is of course also possible to proprietary face image is synthesized.Such switching can also be determined according to sound size.If big sound, then proprietary face is synthesized in reproduction image, if little sound, then only the face of smiling face is synthesized to reproduction image medium.Although additionally, done omission for the purpose of simplifying the description, but when the expression of appreciator is no longer smiling face, release the synthesis of step S303, make face image keep out of the way outside the picture reproducing image or periphery.In addition it is also possible to be the part of not free change and replace without contrast portion.When personage is subject, if not hiding the position of character facial, then other position can also.
In addition, in the judgement of step S301, when tupe is not automatically change pattern, or in the judgement of step S302, when the countenance of appreciator is not changed to smiling face, control portion 107 determines whether the external signal (step S304) that be have input the meaning representing the synthesising position changing face image by appreciator's remote controller 400.In the judgement of step S304, when have input the external signal of the meaning representing the synthesising position changing face image, control portion 107 in being subsequently sent to the image of frame of TV200, position specified by appreciator's remote controller 400, undertaken synthesizing (step S305) by record face image in record portion 105.After face image synthesizes, control portion 107 would indicate that the information of the position of the frame having carried out face image synthesis is as synthesizing historical record in record portion 105.
After the synthesis of step S303 or step S305, the image of the control portion 107 frame to being subsequently sent to TV200 gives index information (step S306).By this way, it is possible to assist as retrieval when again watching subsequently.Afterwards, the image of the frame after having synthesized face image is sent to TV200 (step S307) by control portion 107.Afterwards, control portion 107 terminates the process of Fig. 7.It addition, after the synthesis of face image, control portion 107 would indicate that the information of the position of the frame having carried out face image synthesis is as synthesizing historical record in record portion 105.
So, in the present embodiment, in dynamic image, give index information by automatic or manual, the point being considered lively atmosphere in the reproduction of dynamic image can be specified by automatic or manual.Thus, when appreciating next time, in this way it is easy to determine the point of the lively atmosphere in dynamic image.Further, particularly, when many people have appreciated dynamic image, also can see the expression of each appreciator at that time, the dynamic image that appreciator's entertaining is higher can be generated.
And, in the judgement of step S304, when not inputting external signal, control portion 107 is such as after the scheduled time, position (such as the outside of the dynamic image 202a shown in Fig. 6 A) beyond main display part in being subsequently sent to the image of frame of TV200, record face image in record portion 105 is synthesized, the image of the frame after having synthesized face image is sent to TV200 (step S308).
Here, the explanation of Fig. 3 is turned again to.In the judgement of the step S110 of Fig. 3, when the reproduction destination of dynamic image is display part 202 of TV200, control portion 107 carries out the transfer processing to the communication pattern shown in Fig. 8.That is, control portion 107 sends the representative image (such as, the image of the first frame or impart the image of frame of index information) (step S401) of the dynamic image currently selected by appreciator via communication interface part 109 to TV200.
After sending representative image, control portion 107 sends remote controller operation display image (step S402) via communication interface part 109 to TV200.Remote controller operation display image be shown in Fig. 9 A and Fig. 9 B, when the dynamic image from digital camera 100 is shown on the display part 202 of TV200, be used for guiding the display image 202c of the operation of remote controller 400.By watching such remote controller operation display image 202c, appreciator is easy to understand, as long as which button of remote controller 400 just can carry out which kind of operation.
Here, the remote controller operation display image 202c shown in Fig. 9 A is the image being shown on the display part 202 of TV200 after the transmission of representative image.When pressing the reproduction button of remote controller 400 when defining the display image 202c of the remote controller operation shown in Fig. 9 A, from TV200 to digital camera 100, input represents the signal of reproduction order.On the other hand, when pressing the shooting button of remote controller 400, from TV200 to digital camera 100, input represents the signal of synthetic order.Additionally, the remote controller operation display image 202c shown in Fig. 9 B is shown in the image on the display part 202 of TV200 after the shooting button pressing remote controller 400.When pressing the reproduction button of remote controller 400 when defining the display image 202c of the remote controller operation shown in Fig. 9 B, from TV200 to digital camera 100, input represents the signal of reproduction order.On the other hand, when pressing the location change button of remote controller 400, the position of the face image 202b being shown on display part 202 is changed, and input represents the signal of the meaning of the synthesising position changing face image 202b from TV200 to digital camera 100.
After sending remote controller operation display image 202c, control portion 107 closes the display (step S403) of the display part 103 of digital camera 100.After closing the display of display part 103, control portion 107 carries out the process later for step S101 of Fig. 1.That is, owing in the communication mode, the dynamic image being recorded in digital camera 100 is shown on the display part 202 of TV200, it is thus regarded that appreciator will not watch the display part 103 of digital camera 100.Therefore, energy-conservation in order to realize, close the display of display part 103.After closing the display of display part 103, control portion 107 makes the mode of operation of digital camera 100 transfer to communication pattern (step S404).Furthermore it is possible to do not close the display of display part 103 and be indicated the display being in communication pattern shown in Fig. 4 D.
Below, illustrate that outside reproduction end processes with reference to Figure 10 and Figure 11.In Fig. 10, control portion 107 judges whether the synthesis history corresponding with the dynamic image of end of reproduction is recorded in record portion 105 (step S501).In the judgement of step S501, when synthesizing history and being recorded in record portion 105, control portion 107 sends for showing for being confirmed whether the image (step S502) by having synthesized the picture in record portion 105 of the dynamic image record after face image to appreciator to TV200.Figure 11 is the figure of an example of the confirmation screen on the display part 202 illustrating and being shown in TV200.In the example of Figure 11, the representative image 202a of the dynamic image of end of reproduction is shown on display part 202, and shows that this outside reproduces the remote controller operation display image 202c of the operation of the remote controller 400 for guiding appreciator during end processes.
After sending the image for showing the confirmation screen shown in Figure 11, control portion 107 determines whether that appreciator is operated by remote controller 400 and indicates preservation dynamic image (step S503).In the judgement of step S503, when indicating preservation, determine, according to synthesis history, the frame synthesized in dynamic image, undertaken synthesizing and record in record portion 105 (step S504) by the image of the face image recorded in record portion 105 with determined frame.By again recording the dynamic image after having synthesized face image, other member also can add situation when experiencing that such as everybody appreciates dynamic image subsequently.Such as, when the situation etc. using digital camera 100 to have taken athletic meeting, have recorded the dynamic image of this athletic meeting situation first to be appreciated by parent-child, if giving grand parents etc. by dynamic image now, then grand parents can experience just as having participated in the experience that parent-child is reunited.As it has been described above, when not having the entrance of face image to process in the dynamic image reproduced, when face image is in outside the picture of the dynamic image reproduced or is in periphery as shown in Figure 6A, it is believed that do not synthesize history.Only the face image shown in Fig. 6 B enters the object that scene is synthesis history.In such a case it is possible to utilize remote controller 400 to change the size of face.Further, when showing face same as before, owing to also someone is watched at be unwilling oneself face, thus display can be replaced with other face images such as A Fanda.
So, in the present embodiment, owing to being the form of the synthesis history that have recorded face image, thus also simply the face image recorded can be replaced into other image.
In step S501, synthesis history is not recorded in record portion 105, step S503 does not indicate preservation dynamic image, or after step S504, control portion 107 determines whether that the reproduction of dynamic image when appreciator is operated by remote controller 400 and indicates communication pattern terminates (step S505).In the judgement of step S505, when reproducing end of the dynamic image when indicating communication pattern, the mode of operation of digital camera 100 is changed to reproduction mode (step S506) by control portion 107.Afterwards, the later process of step S101 is carried out.On the other hand, in the judgement of step S505, when reproducing end of the dynamic image when not indicating communication pattern, control portion 107 determines whether that appreciator is operated by remote controller 400 and indicates playback (step S507).In the judgement of step S507, when not indicating playback, control portion 107 carries out the later process of step S505.Further, in the judgement of step S507, when indicating playback, control portion 107 performs the process later for step S201 of Fig. 5.
As described above, according to present embodiment, when being reproduced on the display part 202 of TV200 by the dynamic image in the record portion 105 being recorded in digital camera 100, also can reproduce the face image of the appreciator appreciating this dynamic image in the lump.Thus, the dynamic image that the appreciator of dynamic image is easily interested can be obtained.And, countenance for appreciator become smiling face and carried out the synthesis of face image after frame and specified the frame of synthesising position of face image by appreciator, by giving index information to these, also the retrieval below can determine the important scenes in dynamic image.
It is additionally, since in TV200 the dynamic image to reproduce and is only the dynamic image selected by digital camera 100, thus the private dynamic image that record is in digital camera 100 unexpectedly will not carry out big picture on the display part 202 of TV200 and show.
Here, in the above-described embodiment, the face image of the person of will appreciate that synthesizes with the dynamic image reproduced on the display part 202 of TV200.On the other hand, present embodiment can also apply to the situation that the face image of the person of will appreciate that and the dynamic image reproduced on the display part 103 of digital camera 100 carry out synthesizing.And it is possible to make TV200 have the image pickup part of the face image for shooting appreciator.
Further, in the above-described embodiment, in units of the frame of dynamic image, synthesize face image, as long as thus make the synthesising position of face image stagger by each frame, just face image also can be made to carry out animation etc..
And, in the above-described embodiment, carrying out synthesizing and reproducing on TV200 with record dynamic image in digital camera 100 by face image, but be not limited to this, the method for present embodiment can apply to the various portable equipments with dynamic image camera function.
And, here to apply to be changed to premise and be illustrated to dynamic image, but, certainly can be used for such purposes: show while still image on TV200, the image of the face image that synthesis obtains in reproducing or the A Fanda etc. based on facial image information.Thus, when watching a large amount of still image, on the spot it is known that or other people is it is known which image has popularity etc..
Describe the present invention above according to embodiment, but the present invention is not limited to above-mentioned embodiment, certainly can carry out various deformation and application in the scope of the purport of the present invention.
And, comprise the invention in each stage in the above-described embodiment, by by appropriately combined for disclosed multiple constitutive requirements, various invention can be extracted.Such as, even if deleting some constitutive requirements from the whole constitutive requirements shown in embodiment, also can solve the problems referred to above, when obtaining the effect above, deleting the structure after these constitutive requirements and also can extract as invention.
Claims (6)
1. a camera head, it is characterised in that this camera head has:
Image pickup part, it obtains dynamic image；
Record portion, it records the dynamic image obtained by above-mentioned image pickup part；
Face detection portion, it detects face from the dynamic image that above-mentioned image pickup part obtains；And
Combining unit, the dynamic image that its dynamic image in being recorded in above-mentioned record portion obtains making above-mentioned image pickup part work synthesizes,
The dynamic image that above-mentioned combining unit determines to make the work of above-mentioned image pickup part according to sound variation or the expression shape change of face that detected by above-mentioned face detection portion and obtains is synthesized to the opportunity in the dynamic image being recorded in above-mentioned record portion.
2. camera head according to claim 1, it is characterised in that above-mentioned record portion record has been carried out the image after synthesis by above-mentioned combining unit.
3. camera head according to claim 1, it is characterised in that above-mentioned combining unit carries out above-mentioned synthesis when above-mentioned camera head is connected with the external equipment reproducing the dynamic image being recorded in above-mentioned record portion.
4. camera head according to claim 3, it is characterised in that above-mentioned combining unit carries out above-mentioned synthesis when have input, from said external equipment, the signal representing synthetic order.
5. camera head according to any one of claim 1 to 4, it is characterized in that, the dynamic image corresponding with the region limited in the dynamic image that above-mentioned combining unit will make when above-mentioned reproduction above-mentioned image pickup part work and obtain, synthesizes with the dynamic image in above-mentioned reproduction.
6. an image capture method, it is characterised in that this image capture method includes:
Dynamic image is obtained by image pickup part；
Record portion will be recorded in by the dynamic image of above-mentioned acquirement；
From the above-mentioned dynamic image obtained, face is detected by face detection portion；
The dynamic image obtained making above-mentioned image pickup part work on dynamic image in being recorded in above-mentioned record portion synthesizes,
In above-mentioned building-up process, determine to make the work of above-mentioned image pickup part according to sound variation or the expression shape change of face that detected by above-mentioned face detection portion and the dynamic image that obtains is synthesized to the opportunity in the dynamic image being recorded in above-mentioned record portion.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009158881A JP5457092B2 (en) | 2009-07-03 | 2009-07-03 | Digital camera and composite image display method of digital camera |
| JPJP2009-158881 | 2009-07-03 | ||
| CN201010222803.3A CN101945216B (en) | 2009-07-03 | 2010-07-02 | Camera head and moving image reproduction method |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010222803.3A Division CN101945216B (en) | 2009-07-03 | 2010-07-02 | Camera head and moving image reproduction method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105721752A true CN105721752A (en) | 2016-06-29 |
| CN105721752B CN105721752B (en) | 2019-04-05 |
Family
ID=43436958
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610186833.0A Expired - Fee Related CN105721752B (en) | 2009-07-03 | 2010-07-02 | Photographic device and image capture method |
| CN201010222803.3A Expired - Fee Related CN101945216B (en) | 2009-07-03 | 2010-07-02 | Camera head and moving image reproduction method |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010222803.3A Expired - Fee Related CN101945216B (en) | 2009-07-03 | 2010-07-02 | Camera head and moving image reproduction method |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP5457092B2 (en) |
| CN (2) | CN105721752B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106341608A (en) * | 2016-10-28 | 2017-01-18 | 维沃移动通信有限公司 | Emotion based shooting method and mobile terminal |
| CN112839191A (en) * | 2017-03-16 | 2021-05-25 | 卡西欧计算机株式会社 | Moving image processing device, moving image processing method, and recording medium |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6119534B2 (en) * | 2013-09-30 | 2017-04-26 | 株式会社Ｊｖｃケンウッド | Imaging display apparatus and control method |
| CN104637078B (en) | 2013-11-14 | 2017-12-15 | 腾讯科技（深圳）有限公司 | A kind of image processing method and device |
| JP6289107B2 (en) * | 2014-01-14 | 2018-03-07 | キヤノン株式会社 | Image reproduction apparatus, control method thereof, and control program |
| CN104869283B (en) * | 2015-05-11 | 2018-12-14 | 联想(北京)有限公司 | A kind of image pickup method and electronic equipment |
| JP2017038344A (en) * | 2015-08-13 | 2017-02-16 | 辰巳電子工業株式会社 | Game imaging apparatus and image processing method |
| JP2017046162A (en) * | 2015-08-26 | 2017-03-02 | 隆正 光信 | Synthetic moving image creation system, synthetic moving image creation support system and synthetic moving image creation program |
| JP7005340B2 (en) * | 2017-12-27 | 2022-01-21 | キヤノン株式会社 | Electronics |
| JP7281951B2 (en) * | 2019-04-22 | 2023-05-26 | シャープ株式会社 | ELECTRONIC DEVICE, CONTROL DEVICE, CONTROL PROGRAM AND CONTROL METHOD |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1156377A (en) * | 1995-12-27 | 1997-08-06 | 娱乐消遣技术株式会社 | Karaoke system |
| JP2000069348A (en) * | 1998-08-20 | 2000-03-03 | Canon Inc | Image pickup device |
| CN1520159A (en) * | 1998-03-16 | 2004-08-11 | ������������ʽ���� | Digita pick-up device able to process image |
| CN1841187A (en) * | 2005-04-01 | 2006-10-04 | 佳能株式会社 | Image pickup apparatus and control method thereof |
| CN101056362A (en) * | 2006-04-14 | 2007-10-17 | 富士胶片株式会社 | Image display control apparatus, method of controlling the same, and control program therefor |
| CN101472063A (en) * | 2007-12-28 | 2009-07-01 | 希姆通信息技术（上海）有限公司 | Method for capturing smiling face by mobile phone camera |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2999501B2 (en) * | 1990-02-26 | 2000-01-17 | パイオニア株式会社 | Recording medium playing device |
| JPH04183183A (en) * | 1990-11-19 | 1992-06-30 | Ee D S:Kk | Image signal processor |
| ITRM920546A1 (en) * | 1992-07-17 | 1994-01-17 | Giorgio Belmonte | MULTIFUNCTIONAL SYSTEM FOR EXTEMPORARY SHOOTING AND VIDEO RECORDING, OVERLAYED WITH MUSIC BACKING TRACKS AND VIDEO IMAGES |
| JP2000312336A (en) * | 1999-04-27 | 2000-11-07 | Koji Nakamura | Video television device |
| CN1383543A (en) * | 2000-06-20 | 2002-12-04 | 皇家菲利浦电子有限公司 | Karaoka system |
| KR20060059862A (en) * | 2003-08-11 | 2006-06-02 | 마츠시타 덴끼 산교 가부시키가이샤 | Photographing system and photographing method |
| CN201042038Y (en) * | 2006-09-08 | 2008-03-26 | 郭鹏飞 | A video advertisement display screen for receiver playing real time roles |
| JP4596280B2 (en) * | 2007-12-14 | 2010-12-08 | ソニー株式会社 | Video output device and method for forcibly displaying menu screen of video output device |
-
2009
- 2009-07-03 JP JP2009158881A patent/JP5457092B2/en not_active Expired - Fee Related
-
2010
- 2010-07-02 CN CN201610186833.0A patent/CN105721752B/en not_active Expired - Fee Related
- 2010-07-02 CN CN201010222803.3A patent/CN101945216B/en not_active Expired - Fee Related
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1156377A (en) * | 1995-12-27 | 1997-08-06 | 娱乐消遣技术株式会社 | Karaoke system |
| CN1520159A (en) * | 1998-03-16 | 2004-08-11 | ������������ʽ���� | Digita pick-up device able to process image |
| JP2000069348A (en) * | 1998-08-20 | 2000-03-03 | Canon Inc | Image pickup device |
| CN1841187A (en) * | 2005-04-01 | 2006-10-04 | 佳能株式会社 | Image pickup apparatus and control method thereof |
| CN101056362A (en) * | 2006-04-14 | 2007-10-17 | 富士胶片株式会社 | Image display control apparatus, method of controlling the same, and control program therefor |
| CN101472063A (en) * | 2007-12-28 | 2009-07-01 | 希姆通信息技术（上海）有限公司 | Method for capturing smiling face by mobile phone camera |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106341608A (en) * | 2016-10-28 | 2017-01-18 | 维沃移动通信有限公司 | Emotion based shooting method and mobile terminal |
| CN112839191A (en) * | 2017-03-16 | 2021-05-25 | 卡西欧计算机株式会社 | Moving image processing device, moving image processing method, and recording medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101945216A (en) | 2011-01-12 |
| JP2011015279A (en) | 2011-01-20 |
| JP5457092B2 (en) | 2014-04-02 |
| CN105721752B (en) | 2019-04-05 |
| CN101945216B (en) | 2016-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101945216B (en) | Camera head and moving image reproduction method | |
| KR101000605B1 (en) | Image pickup apparatus, image recording apparatus and image recording method | |
| JP4332365B2 (en) | METADATA DISPLAY SYSTEM, VIDEO SIGNAL RECORDING / REPRODUCING DEVICE, IMAGING DEVICE, METADATA DISPLAY METHOD | |
| KR101905648B1 (en) | Apparatus and method for shooting a moving picture of camera device | |
| US9940969B2 (en) | Audio/video methods and systems | |
| JP4877852B2 (en) | Image encoding apparatus and image transmitting apparatus | |
| JP4332364B2 (en) | Video recording system and video recording method | |
| KR101530826B1 (en) | Playing method and the system of 360 degree spacial video | |
| JP2007266713A (en) | Monitoring system, monitoring method, and program | |
| JP4938615B2 (en) | Video recording / playback device | |
| KR20160021706A (en) | Playing method and the system of 360 degree spacial video | |
| JP5292399B2 (en) | Content editing device | |
| CN1848917B (en) | Camera system with pip in viewfinder | |
| JP4583717B2 (en) | Imaging apparatus and method, image information providing system, program, and control apparatus | |
| JP4946935B2 (en) | Imaging device | |
| US20100129049A1 (en) | Editing apparatus, control method of the editing apparatus, and image pickup apparatus | |
| JP6351213B2 (en) | IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD AND SYSTEM | |
| JP4371170B2 (en) | Imaging apparatus, image recording apparatus, and image recording method | |
| JP6594485B2 (en) | IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD AND SYSTEM | |
| JP5963921B2 (en) | Digital camera and composite image display method of camera | |
| JP6602425B2 (en) | IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD AND SYSTEM | |
| JP5774731B2 (en) | Digital camera and composite image display method of digital camera | |
| JP5654148B2 (en) | Digital camera and composite image display method of digital camera | |
| JP2008228014A (en) | Video conference system, conference video processing method, program and recording medium | |
| JP2021040217A (en) | Imaging apparatus, control method of the same, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211206 Address after: Tokyo, Japan Patentee after: Aozhixin Digital Technology Co.,Ltd. Address before: Tokyo, Japan Patentee before: OLYMPUS Corp. |
|
| TR01 | Transfer of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190405 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |