JP6596746B2 - Golf video information automatic generation system and golf video information automatic generation method - Google Patents

Description

  More particularly, the present invention relates to a golf video information automatic generation system and a golf video information automatic generation method. More specifically, a user who performs a golf round on a golf course hits a golf ball and the hit ball flies. The present invention relates to a system that effectively records and edits a series of processes of landing near a point and provides contents that can be memorized for a golf round to a corresponding user, and a process driven by the system Is.

  The majority of golfers who play golf rounds at the golf course have the ball shot in the course of the golf round properly land on the green, the ball land very close to the hole cup on the green, or sometimes like hole-in-one or Albatross Sometimes experience amazing records.

  For example, if a user who has never played a proper on-green when playing a golf round usually hit a green tee shot in the Par3 hole, Golf shots will be a truly amazing experience.

  In addition, there are many cases in which companion rounds compete in the Par3 hole for how close the ball from the tee shot lands to the hole cup on the green, that is, a near pin competition. Even if you win in the near-pin competition, it will be an amazing experience for the user.

  In particular, when recording a hole-in-one in the Par3 hole, it will be a surprising experience that the user will never forget.

  However, as mentioned above, golfers will have a very surprising experience during the golf round process, but in the past content that golfers could record such a surprising experience and commemorate it. There was a problem that the technology related to the system that can be made and provided was not realized.

  However, Japanese Unexamined Patent Publication No. 2013-248381 (hole-in-one confirmation system and its camera), Japanese Unexamined Patent Publication No. 2004-46648 (hole-in-one authentication system) and Japanese Unexamined Patent Publication No. 2008-167245 (hole-in-one near-pin). In a lot of prior art documents such as (Authorization System), a camera is installed on the green side, and the shot video of the camera is analyzed and confirmed whether a golf shot shot with a tee box is hole-in-one. Techniques for determining whether there is a near pin or near pin are known.

  However, the publicly-known technology disclosed in the above-mentioned publications merely confirms whether the golf shot made by the user has become hole-in-one, and informs the user of that or related to hole-in-one or near-pin around the green It is not possible to record and provide a series of processes such as the movement of a ball on the green from the user's golf shot, simply by providing the captured video. There was a problem that it was not enough as commemorative content.

Japanese Unexamined Patent Application Publication No. 2013-248381 Japanese Unexamined Patent Publication No. 2004-46648 Japanese Unexamined Patent Publication No. 2008-167245

  The present invention provides a series of processes from a golf shot to a movement on an area including a target point of the golf shot ball for a user who is playing a golf round outside such as simple hole-in-one confirmation or near-pin authentication. Golf video information automatic generation system and golf video information automatic generation method capable of providing video content that can be a memorial to a golf shot to a user by editing video information to be displayed and automatically generating golf video information It is for providing.

  According to an embodiment of the present invention, a system for automatically generating golf video information based on a user's golf shot in a golf course includes a first shooting unit that acquires a video of the user's golf shot in a shooting area, and a target point. A second image capturing unit that captures an area including the image, and images captured from each of the first image capturing unit and the second image capturing unit, and images collected from each of the first image capturing unit and the second image capturing unit. A video information processing apparatus for automatically generating the golf video information by determining an extraction section and editing each video extracted by the determined video extraction section according to a preset item.

  Meanwhile, according to another embodiment of the present invention, a system for automatically generating golf video information based on a user's golf shot at a golf course is installed in a tee box and displays a video of the user's golf shot within a shooting area. A first shooting unit for acquiring and shooting a side surface of the user who makes a golf shot, a second shooting unit for shooting an area including green, and images shot from the first shooting unit and the second shooting unit, respectively. Collecting, determining an extraction section of the video collected from each of the first shooting unit and the second shooting unit, and editing each video extracted by the determined video extraction section according to a preset item. And a video information processing apparatus that automatically generates the golf video information.

  Meanwhile, a system for automatically generating golf video information based on a user's golf shot at a golf course according to still another embodiment of the present invention is installed in a tee box, and an image of the user's golf shot within a shooting area. A tee box shooting unit for acquiring the image, a fairway shooting unit installed so as to shoot an area on the fairway, and collecting images shot from the tee box shooting unit and the fairway shooting unit, respectively, and shooting the tee box. The golf video information is automatically obtained by determining an extraction section of the video collected from each of the unit and the fairway shooting unit, and editing each video extracted by the determined video extraction section according to a preset matter. With video information processing device Including.

  Meanwhile, a system for automatically generating golf video information based on a user's golf shot at a golf course according to another embodiment of the present invention is installed on one side of a specific hole of the golf course and used in a shooting area. A first shooting unit for acquiring an image of the golf shot of the person, and is installed on the other side of the specific hole and is capable of pan / tilt zoom driving, and zooms in, zooms out and at least up / down and left / right according to preset items A second photographing unit configured to photograph at least one of the view changes by rotation to one side and photograph the user by taking a golf shot, and the first photographing unit and the second photographing unit. Each captured video is collected and collected from each of the first and second imaging units. By editing of the preset items each picture extracted from the picture includes a video information processing apparatus which automatically generates the golf video information.

  Meanwhile, according to an embodiment of the present invention, a method for automatically generating golf video information of a system for automatically generating golf video information based on a user's golf shot on a golf course is shot by a first shooting unit including at least one camera. Collecting and storing in the storage unit images captured when a user makes a golf shot in the area, and shooting the area including the target point by a second imaging unit including at least one camera. Collecting the video to be stored in the storage unit, determining an extraction section of the video collected from each of the first shooting unit and the second shooting unit, and each video stored in the storage unit By editing each video extracted by the determined video extraction section from a predetermined item, the golf video is recorded. And generating an automatic information.

  Meanwhile, according to another embodiment of the present invention, a method for automatically generating golf image information of a system for automatically generating golf image information by a user's golf shot on a golf course is installed on one side of a specific hole of the golf course. A first shooting unit video collecting and storing stage that collects and stores a video shot of a user's golf shot taken by the first shooting unit and storing it in a storage unit; Collecting images captured by the user shooting a golf shot by performing at least one of zooming in, zooming out, and changing the view by rotating to at least one of up / down and left / right by a possible second shooting unit, A second photographing unit video collecting and storing step stored in the storage unit, and extracted from the first photographing unit; It was and generating automatically the golf video information by editing the first extraction image and predetermined matters second extraction image extracted from the second imaging unit.

  The golf video information automatic generation system and the golf video information automatic generation method according to the present invention were shot from a golf shot to a user who is playing a golf round in addition to simple hole-in-one confirmation or near-pin authentication. Provide video content that can be used as a memorial to golf shots by editing video information that shows a series of processes up to the movement of the ball on the area including the target point and automatically generating golf video information There is an effect that can.

It is the figure which showed the example by which the golf video information automatic generation system by one Example of this invention was installed in the specific hole of a golf course.

1 is a block diagram showing a configuration of a golf video information automatic generation system according to an embodiment of the present invention shown in FIG.

5 is a flowchart for explaining a golf video information automatic generation method used in a golf video information automatic generation system according to an embodiment of the present invention;

FIG. 3 is a diagram illustrating an example of a video image taken by a first camera of a golf video information automatic generation system according to an embodiment of the present invention, and illustrating a method for performing video processing on the corresponding video image.

It is the figure which showed what detected the ball | bowl in each image | video which showed the image | video of the n + 5th frame image | photographed with the 1st camera in time series.

It is the figure which showed what detected the ball | bowl in each image | video which showed the image | video of the m + 5th frame image | photographed with the 1st camera in time series.

1 shows an example of an image taken by the third camera of the golf image information automatic generation system according to an embodiment of the present invention, and provides a user on the green such as a display of a distance between a hole cup and a ball in the corresponding image. It is the figure which showed the example displayed about possible golf information.

It is the figure which showed an example which produces | generates golf video information by extracting and editing a required image | video from each camera image | video by the video information processing apparatus of the golf video information automatic generation system by one Example of this invention.

It is a flowchart for demonstrating the golf video information automatic generation method used for the golf video information automatic generation system by other one Example of this invention.

It is the figure which showed an example which produces | generates golf image | video information by extracting and editing a required image | video from each imaging | photography unit image | video by the golf image | video information automatic generation method by the flowchart shown in FIG.

It is the figure which showed an example of the edited image demonstrated in FIG. 10 in time series.

It is the figure which showed an example of the edited image demonstrated in FIG. 10 in time series.

It is the figure which showed an example of the edited image demonstrated in FIG. 10 in time series.

  The golf video information automatic generation system and the golf video information automatic generation method according to the present invention will be described more specifically based on the drawings.

  First, a golf video information automatic generation system according to an embodiment of the present invention will be described with reference to FIGS. 1 and 2.

  As shown in FIGS. 1 and 2, a golf video information automatic generation system according to an embodiment of the present invention includes a first photographing unit 100 installed on one side of one hole of a golf course, on the opposite side of the corresponding hole. The second photographing unit 200 installed, and the first photographing unit 100 and the second photographing unit 200 are connected to each other and perform video analysis by receiving images photographed from the respective photographing units through wired or wireless communication. A video information processing apparatus 500 that automatically generates golf video information to be provided to the user by extracting and editing an appropriate video from the received video can be included.

  Each of the first photographing unit 100 and the second photographing unit 200 may include only one camera, or may include two or more cameras. When one photographing unit 100 or 200 includes two or more cameras, each camera is preferably configured to photograph the same region at different positions.

  The system and method for automatically generating golf image information according to the present invention includes all images of a series of processes from when a user makes a golf shot to when the ball by the corresponding golf shot reaches near the target point and stops. Thus, since video editing is performed automatically, it can be said that the degree of utilization is high when the user sends the ball from the start point to the target point with a single golf shot.

  Here, the target point described above can be a hole cup on the green, or an arbitrary point on the fairway around the green.

  The golf video information automatic generation system according to the present invention automatically generates a video about a series of processes from when a user makes a golf shot to when the ball by the golf shot reaches a target point and stops. Therefore, it is preferable not only when the ball can immediately reach the green by a golf shot with a tee box like the Par3 hole, but also because it is possible to make a hole-in-one and the like.

  FIG. 1 shows an example in which the first photographing unit 100 is installed in the tea box TB area of the Par3 hole and the second photographing unit 200 is installed around the green G.

  1 shows a case where the first photographing unit 100 includes the first camera 110 and the second camera 120, and the second photographing unit 200 includes the third camera 210 and the fourth camera 220.

  The first camera 110 of the first photographing unit 100 is installed so as to shoot an image with an angle of view looking at the side of the user who makes a golf swing, and the second camera 120 has an angle of view looking at the front of the user who makes a golf swing. It is preferable to be installed so as to take a picture.

  The second photographing unit 200 may include a single camera. However, when two or more cameras such as the third camera 210 and the fourth camera 220 are installed as shown in FIG. It is preferable that the camera is installed so as to shoot a video at an angle of view in which the area including the green G is viewed from different viewing angles.

  In FIG. 1, HC indicates the hole cup on the green G, and FL indicates the flagpole inserted into the hole cup hc.

  On the other hand, as shown in FIG. 1, in order to generate the video content of the golf video information provided to the user as a more dramatic high-class video with more various viewing angles, as shown in FIG. It is also possible to install 310, 320.

  In addition, for example, when the hole shown in FIG. 1 is a Par4 hole or a Par5 hole, a golf shot made by the tee box TB cannot reach the green G immediately, and should land at an intermediate point. Is common. At this time, as shown in FIG. 1, the third photographing units 310 and 320 can function similarly to the second photographing units 210 and 220.

  That is, when the golf video information automatic generation system according to the present invention is installed in the Par4 hole or the Part5 hole, the target point may be a point on the target area EV on the fairway, for example, instead of the hole cup on the green.

  Therefore, it is confirmed from the image taken by the fifth camera 310 or the sixth camera 320 of the third photographing unit how close the golf shot made by the user with the tee box TB lands on the target area EV on the fairway. (It is possible to determine and determine whether it has landed in the target area or how close it is to the center by calculating and tracking the position of the ball in the image, which will be described later). It is possible to analyze and discriminate the photographed video of the third photographing unit and inform the user of the result or transmit it to the server so that the server can record the result. Is possible.

  In addition, as described above, the video of the third shooting unit is analyzed, and each of the golf round users who took golf shots in the tee box is centered on the target area EV prepared in advance on the fairway. It is possible to determine the rank in the order of landing closest, and to give a prize determined according to the rank according to the determined rank according to the video analysis result of the third photographing unit.

  In addition, as shown in FIG. 1, even if the target area EV is not intentionally determined, a longest game (Longest Game) played in a Par4 hole or a Par5 hole at a normal golf course is performed. Of these, the winner of the game where the tee shot ball records the farthest distance on the fairway is the winner (by grasping the position information of the ball in the video) by analyzing the video shot of the third shooting unit. Can be determined accurately).

  Whether the event has been won by determining whether the ball has landed in the target area or whether the player has won the longest game can be determined or determined by analyzing the shot image of the third shooting unit. The player or winner is provided with a prize prepared in advance by a golf course company, or is automatically generated by the video information processing device by video editing using the respective video shots of the first shooting unit and the third shooting unit. Golf video information can be provided (the video information processing apparatus determines or determines whether it is a winner or a winner and automatically transmits the automatically generated golf video information to the mobile terminal of the user) Can be processed).

  Here, the tea box photographing unit and the fairway photographing unit described in claims 11 to 13 of the present application are the same as the first photographing unit and the third photographing unit, respectively.

  On the other hand, the cameras of the respective photographing units as described above are connected to the video information processing apparatus 500 to communicate with each other, and videos acquired by the cameras are transmitted to the video information processing apparatus 500 and collected. The device 500 extracts appropriate video from each video collected from each camera, and combines the extracted video with each other or inserts video from another camera as a sub video into the video of a specific camera. And the golf video information is finally automatically generated.

  As described above, the video information processing apparatus 500 extracts an appropriate video from each video collected from each camera of each shooting unit in order to automatically generate golf video information. At this time, the golf video information is generated by extracting and editing an appropriate video by a previously programmed information processing unit as to which segment video is appropriate to be extracted.

  That is, the video information processing apparatus 500 analyzes video collected from each camera to determine an appropriate video extraction section, and extracts an appropriate video according to the determined video. This matter will be described later.

  On the other hand, as shown in FIG. 2, the video information processing apparatus 500 roughly includes a storage unit 510 and an information processing unit 520. The information processing unit 520 includes a video management unit 521, a trigger processing unit 522, and ball tracking. The processing unit 523, the hole cup position sensing unit 524, and the video editing unit 525 may be included.

  Here, the video management unit 521, the trigger processing unit 522, the ball tracking processing unit 523, the hole cup position sensing unit 524, the video editing unit 525, and the like may be implemented by hardware or software, respectively, Each function performed by 520 may be shown separately.

  The storage unit 510 is a part for storing videos collected from the cameras such as the shooting units 100 and 200, and the video management unit 521 is a video shot from the cameras such as the shooting units 100 and 200, respectively. Are collected for each camera and stored in the storage unit 510 for management.

  The trigger processing unit 522 detects that the ball is moved by hitting by image processing on the image of the first camera 110 or the second camera 120 of the first photographing unit 100 stored in the storage unit 510, and the trigger processing unit 522 A trigger signal is generated when it senses that the ball is moved by hitting.

  The trigger processing unit 522 detects the movement of the ball by hitting the ball by using an algorithm that detects a ball from a difference image of two different frame images with respect to a number of frame images. Detecting the ball makes it possible to sense the ball. More specific explanation about this will be described later.

  On the other hand, the video information processing apparatus 500 of the golf video information automatic generation system according to another embodiment of the present invention, as described above, uses an externally generated trigger instead of a trigger processing unit that generates a trigger signal by video analysis. A signal can be received and used as a trigger signal.

  That is, a golf terminal used in the course of a golf round (MT: a terminal that inputs and manages a golf score while usually being carried by a caddy, such as a golf auxiliary terminal or a smartphone that each golfer carries) When a user makes a golf shot using a mobile terminal, another user operates the golf terminal (MT) according to the time of impact and sends a shot signal to the video information processing apparatus 500. If transmitted, the video information processing apparatus 500 can receive the shot signal and use it as the trigger signal. Specific matters regarding this will also be described later.

  On the other hand, the ball tracking processing unit 523 detects the ball in the image by analyzing the captured image of the camera 210 or 220 included in the second shooting unit 200 installed around the target point, that is, around the green. This is a part having a function of tracking the ball by generating the position information.

  The ball tracking processing unit 523 determines when the movement of the ball has stopped by continuously tracking the ball around the target point, such as when the ball has landed on the green.

  Then, as described above, the ball tracking processing unit 523 continuously tracks the position of the ball by video analysis and determines whether it is a hole-in-one by using the position of the hole cup on the green and the position of the ball. The distance between the ball and the hole cup can also be calculated.

  Meanwhile, the hole cup position sensing unit 524 senses the position of the hole cup on the green in real time by analyzing the captured image of the camera 210 or 220 included in the second photographing unit 200 installed around the green. When the hole cup position is changed, the function of updating the changed hole cup position information is performed.

  Normally, the position of the hole cup on the green is frequently changed in each hole of the golf course. Therefore, the golf video information automatic generation system according to the embodiment of the present invention does not have the position information of the hole cup on the green as fixed position information, but the hole cup position every time the system operates or at a preset cycle. Newly grasp and update.

  The hole cup position sensing unit 524 can directly recognize and recognize the position of the hole cup on the green by a predetermined image processing for the image collected from the camera that captures the area including the green around the green. It is also possible to recognize the flagpole inserted into the hole cup and recognize the lower end position of the flagpole as the hole cup position.

  When the hole cup position sensing unit 524 maintains the hole cup position information on the green as the latest information, the ball tracking processing unit 523 determines whether it is a hole-in-one or a near-pin and determines whether the hole cup is between the ball cup and the ball. The distance can be calculated accurately.

  On the other hand, the video editing unit 525 extracts videos necessary for generating golf video information that is finally created from the videos for each camera managed by the video management unit 521, and combines the extracted videos with each other. This is a part for performing video editing such as inserting a specific extracted video as a sub video into another extracted video.

  The video editing unit 525 determines a video extraction section for each camera-specific video, extracts a necessary video from the camera-specific video according to the determined extraction section, and uses the trigger processing unit 522 or an external golf terminal. The extraction period of the video is determined using information such as the time of the trigger signal generated by the above, the time when no more balls are detected in the video of the first camera, and the time when the ball that is hit and moves stops on the green. Specific matters regarding this will also be described later.

  Here, the “time point” may be time information or video frame information. For example, 'Trigger signal generation time' can mean the time when the trigger signal is generated by the trigger processing unit, or it can mean the corresponding video frame when the trigger signal is generated. Can mean both.

  The 'time when no more balls are detected' can also mean time information when no balls are detected by video analysis or the corresponding video frame when no balls are detected, and the 'ball stopped on the green “Time” may also mean time information or corresponding video frame information when there is no movement of the ball in the ball tracking process.

  The “extracted section” may be a time section or a frame section. For example, if it is a section from the trigger time to the time when no more balls are detected, video frames corresponding to the time interval between the time when the trigger occurred and the time when no more balls are detected are extracted It may also mean that the video frame corresponding to the frame section between the corresponding video frame when the trigger occurs and the corresponding video frame when no more balls are detected is extracted.

  Meanwhile, a golf video information automatic generation method used in a golf video information automatic generation system according to an embodiment of the present invention will be described with reference to FIG.

  In the flowchart shown in FIG. 3, the first camera 110 (see FIG. 1) and the second camera 120 (see FIG. 1) are placed in a tee box TB (see FIG. 1) in a hole such as a Par3 hole that allows hole-in-one with a tee box. Is shown, and a golf video information automatic generation method performed by the video information processing apparatus 500 (see FIG. 1) when the third camera 210 (see FIG. 1) is installed around the green G is shown.

  Here, the first camera takes a picture with an angle of view looking at the side of the user who takes the golf swing posture (takes a picture from the rear in the ball traveling direction), and the second camera takes the golf swing posture. An image is taken at an angle of view in front of the person (taken from the side in the direction of ball movement).

  If the system starts to operate, the first camera and the second camera installed around the tee box start to shoot images (S10), respectively, and the image management unit 521 (see FIG. 2) displays the first camera and the second camera. Are collected and stored in the storage unit 510 (see FIG. 2) (S12).

  When the user hits a ball by hitting a golf ball with a tee box, a trigger signal is generated by the trigger processing unit 522 (see FIG. 2) or a trigger signal is received from an external golf terminal (S20).

  As described above, when the trigger signal is generated, the third camera installed around the green starts shooting the video (S22), and the video management unit collects the video shot from the third camera and stores it in the storage unit. To do.

  As described above, when the trigger signal is generated, the video editing unit 525 (see FIG. 2) determines the trigger time (S24).

  On the other hand, the trigger processing unit applies a difference image and a ball detection method to the captured image of the first camera stored in the storage unit to detect a moving ball in the image (S30).

  Since the image captured by the first camera is an image captured at an angle of view seen from the back of the tee box in the direction of ball movement, if the ball flies somewhat far away, no more balls can be detected in the image ( S40). At this time, the video editing unit determines when no more balls are detected in the video image taken by the first camera, that is, when there are no more balls in the first camera video (S42).

  Alternatively, when the preset time has elapsed from the trigger time (S40), the video editing unit determines the time when the preset time has passed as the time when the ball has run out (S42).

  As described above, when it is determined that there is no ball in the video of the first camera, the video management unit ends collection of the first camera shooting video (S44) (the first camera also ends shooting).

  Then, the ball tracking processing unit 523 (see FIG. 2) of the video information processing apparatus detects the ball by applying the difference video and the ball detection method to the video shot by the third camera shooting the green area. Thus, the position of the ball is tracked (S50).

  If the ball does not move any further after the ball tracking processing unit advances, for example, if the ball stops after rolling on the green (S60), the video editing unit determines when the ball stops on the green. (S64).

  As described above, when it is determined that the ball has stopped on the video of the third camera, the video management unit ends collection of the video shot by the third camera (S62) (the third camera also ends shooting).

  At this time, since the ball tracking processing unit knows the position of the hole cup in advance and also knows the position information of the ball through video analysis, it determines whether it is a hole-in-one using the position of the hole cup and the position information of the ball. (S70).

  If a hole-in-one occurs, the video editing unit inserts a hole-in-one celebration content prepared in advance into the finally generated golf video information (S72).

  If it is not a hole-in-one, the ball tracking processing unit calculates the distance between the hole cup and the ball (S80), and the video editing unit finally determines the distance between the calculated hole cup and the ball in the generated golf video information. The distance information is displayed (S82).

  On the other hand, the video editing unit uses the trigger time determined in step S24, the time when the ball disappears in the first camera image determined in step S42, and the time when the ball determined in step S64 stops on the green. A video is extracted from each camera video stored in the storage unit on the basis of each determined time point, and the extracted video is edited according to preset matters. The golf video information is finally generated by inserting the stage hole-in-one celebration content or the distance information display of step S82 (S100).

  A specific example related to automatic generation of golf video information according to the flowchart shown in FIG. 3 will be described with reference to FIGS.

  FIG. 4 shows an example of the video 101 taken by the first camera, and is a diagram for explaining a method of performing video processing on the corresponding video.

  It is necessary to determine the trigger time and the time when the ball has run out based on the video imaged by the first camera, and this is performed by analyzing the video imaged by the first camera by predetermined video processing.

  In order to facilitate analysis by video processing, as shown in FIG. 4, the tee markers 1 and 2 are always recognized in the corresponding video using the tee markers 1 and 2 that are always prepared in the tee box, and the recognition is performed. The region of interest ROI including the tee markers 1 and 2 is set, and the extracted region of interest ROI is used for video processing by extracting a portion corresponding to the region of interest ROI for each frame of the image captured by the first camera. Part can be used.

  First, if the region of interest ROI is set as described above, it is triggered by extracting and analyzing only the set region of interest ROI from the images of all frames of the first camera as the golf shot progresses. Alternatively, it is possible to easily determine the disappearance of the ball.

  On the other hand, (a) to (f) of FIG. 5 show the images of the n + 5th frame from the nth frame taken by the first camera in time series, and the ball is detected in each image. (Where n is an arbitrary natural number).

  5A shows an nth frame image, FIG. 5B shows an n + 1th frame image, FIG. 5C shows an n + 2th frame image, FIG. 5D shows an n + 3rd frame image, and FIG. 5E shows an n + 4th frame. The image and (f) show the n + 5th frame image, respectively, and it is possible to detect the moving ball as indicated by b1, b2, b3, b4, b5 and b6 in each frame image.

  Such ball detection can be performed by a difference image and a ball detection method. For example, if a predetermined image preprocessing such as a difference image between the nth frame image and the (n + 1) th frame image and normalization thereof is performed, only a portion with motion is left in the image, including a ball. It is.

  The ball size, aspect ratio, straightness, etc. are set in advance, and the ball is detected by a method that removes unnecessary parts from the video generated by the difference video according to the preset items. Can do.

  For example, the user's head, body, legs, etc., as well as a golf club part and a ball part, which are moving parts, are detected from the difference image. The user's head, torso, leg, etc. can be easily removed with the ball size information and aspect ratio information set in advance, and in the case of a golf club part, it can only move along a curved track. Since the straightness can be easily removed according to a preset item, the ball can be easily detected by removing all unnecessary portions by such a method.

  Reference numerals b1 to b6 indicate balls detected on the respective frame images shown in FIGS. 5A to 5F by the ball detection method as described above.

  The time point when the trigger processing unit of the video information processing apparatus of the system according to the present invention first detects a ball by the ball detection method immediately becomes the trigger time point.

  When the ball b1 is detected in the nth frame image of the first camera image shown in FIG. 5A, the nth frame is determined as the trigger time, or the time when the ball is detected in the nth frame image is the trigger time. Can be determined.

  If the trigger time is determined by receiving an external trigger signal instead of the trigger processing unit, when the other user or caddy operates the golf terminal and generates the trigger signal (corresponding time or The frame at the corresponding time) is the trigger time.

  When the trigger signal is generated by the video processing of the trigger processing unit and the trigger time determined by receiving the trigger signal from the outside may be different, the golf club head is not always impacted by the golf swing of the user Need not be determined as the trigger time. Because the video is extracted and edited only for a preset section before and after the trigger time as the trigger time, appropriate golf video information can be generated even if the impact time does not become the trigger time. is there.

  On the other hand, (a) to (f) of FIG. 6 show images of the m + 5th frame from the mth frame taken by the first camera in time series, and the ball is detected in each image. Where m is an arbitrary natural number and m is greater than n.

  6A shows an m-th frame image, FIG. 6B shows an m + 1-th frame image, FIG. 6C shows an m + 2-th frame image, FIG. 6D shows an m + 3-th frame image, and FIG. 6E shows an m + 4-th frame. (F) shows the m + 5th frame image, and it is possible to detect a moving ball as indicated by B1, B2, B3, B4 and B5 in each frame image (in FIG. 6, m + 5th). The ball was not detected in the frame image).

  Here, the method of detecting the ball is as described above with reference to FIG.

  As described above, even after the trigger signal is generated, the trigger processing unit analyzes the image of the first camera for each frame and detects the ball. However, since the ball is not detected in the m + 5th frame image, that is, the ball in the image. Therefore, it is possible to determine that the corresponding frame is the time when the ball is exhausted or the time when the ball is not detected in the video is the time when the ball is exhausted.

  On the other hand, FIG. 7 shows an example of an image 201 taken by the third camera, and golf information that can be provided to the user on the green, such as a display of the distance between the hole cup and the ball, is displayed on the corresponding image. An example is shown.

  From the video of the third camera illustrated in FIG. 7, the ball tracking processing unit of the video information processing apparatus of the present invention detects the ball ba in the corresponding video (the ball detection method is as described above), and the video for each frame. Each time the position of the ball is tracked by calculating the position information of the ball.

  Since the position information of the ball ba can be calculated for each frame, the ball trajectory tr can be displayed in the finally generated golf video information as shown in FIG.

  In addition, the hole cup position sensing unit 524 (see FIG. 2) of the video information processing apparatus according to the present invention directly searches for the hole cup hc on the green g in the video 201 or the flag cup fl inserted in the hole cup. The position can be calculated.

  Since the hole cup hc or the flagpole fl has a hue that is clearly distinguished from the green G, the image of the third camera can be converted into an HSV image, and the hole cup or flagpole can be searched for by color analysis on the converted image.

  When searching for a flagpole, the color distribution of the flagpole can be determined in the video to determine whether the flagpole is standing or lying down. If the flagpole is lying down, the position of the hole cup is not detected. When the flag pole is set up, the lower end of the flag pole can be specified as the hole cup position.

  Since the ball tracking processing unit knows the position information of the ball by the ball detection method in the image and the position of the hole cup grasped by the hole cup position sensing unit, the position information of the hole cup and the position information of the ball It is possible to determine whether or not the ball ba is holed into the hole cup hc by using, and when the ball ba stops, the distance between the hole cup hc and the ball ba can also be calculated.

  As described above, the video editing unit of the video information processing apparatus of the present invention inserts and displays the previously prepared hole-in-one celebration content in the golf video information when the ball is holed in the hole cup, that is, in the case of hole-in-one. As shown in FIG. 7, when the distance between the ball ba and the hole cup hc is calculated, the calculated distance information can be displayed on the golf video information.

  In addition, as shown in FIG. 7, by displaying a virtual object such as a concentric circle Ra around the grasped hole cup position, it is possible to visually display how close the ball ba is to the hole cup hc. Content can also be inserted.

  On the other hand, FIG. 8 shows an example in which golf video information is generated by extracting and editing necessary video from each camera video by the video editing unit.

  In FIG. 8, IM-1 is a captured image of the first camera, which is an image collected by the image management unit and stored in the storage unit, and IM-2 is a captured image of the second camera, IM-3 indicates a video collected by the management unit and stored in the storage unit, and IM-3 is a captured video of the third camera, indicates a video collected by the video management unit and stored in the storage unit, and IM-G Indicates a video obtained by editing a video extracted from each video.

  In order to extract images necessary for generating golf image information from the respective images IM-1, IM-2, and IM-3, the trigger time (see step S24 in FIG. 3), the time when the ball runs out ( It is preferable to determine the time point (see step S42 in FIG. 3) and the time point when the ball stops (see step S64 in FIG. 3). Here, the trigger time is T1, the time when the ball runs out is T2, and the time when the ball stops is T3.

  Of the respective time points, the trigger time point T1 must be determined, and the time point T2 when the ball runs out and the time point T3 when the ball stops are not necessarily determined, and the time interval or frame from the trigger time point is not necessarily determined. Necessary in order to generate golf video information from each video IM-1, IM-2, IM-3 in a manner in which a segment is set in advance and a video corresponding to a preset time or frame interval is extracted after the trigger time It is possible to extract an image.

  However, it is difficult to generate an appropriate video of the ball in the fixed video extraction section due to various sudden variables such as the distance that each golfer varies, and the hit ball hits a rock and jumps further onto the green. In view of this, it may be more advantageous to generate an appropriate image of the ball by determining each time point by video analysis and determining the video extraction interval according to the determined time point. Below, the case where a video extraction area is determined by each determined time point is demonstrated.

  As shown in FIG. 8, if the trigger time T1 and the time T2 when the ball runs out are determined by analyzing the video of the first camera, the video IM-1 of the first camera is set in advance before the trigger time T1. The video corresponding to the section S1-1 and the video corresponding to the section S1-2 from the trigger time T1 to the time T2 when the ball is lost can be extracted.

  Of course, if the time T2 at which the ball runs out is not determined separately, a section set in advance from the trigger time T1 can be extracted as the S1-2 section. Even when the time point T2 at which the ball runs out is determined, the S1-2 interval does not need to be the interval T1 to T2, and the interval from the time point T1 to a time point slightly before or slightly later than the time point T2 is defined as S1-. Two sections can be determined and extracted.

  In the IM-1 video, the video extracted corresponding to the S1-1 section and the S1-2 section is referred to as E1.

  On the other hand, the video extracted from the video of the second camera can be variously determined depending on which content constitutes the edited golf video. Since the image of the second camera is an image taken at the angle of view of the user from the front, it can be used in situations where the golf ball is hit by flying as a sub image in the image of the first camera or the image of the third camera. It is possible to extract a person's facial expression for the purpose of being included in the video together.

  Therefore, in FIG. 8, it is possible to extract the video corresponding to the preset section S2 from the trigger time T1 with respect to the video IM-2 of the second camera, and from the video IM-2 of the second camera to the S2 section. The extracted video is called E2.

  On the other hand, as shown in FIG. 8, if the time point T3 when the ball stops is determined by analyzing the video of the third camera, the ball stops from the time T2 when the ball disappears from the video IM-3 of the third camera. A section S3 up to time T3 can be extracted.

  Of course, if the time T3 when the ball stops is not determined separately, a section preset from the trigger time T1 or a section preset from the time T2 when the ball runs out can be extracted as the S3 section.

  The video extracted in the S3 section from the video IM-3 of the third camera is referred to as E3.

  As described above, if the images E1, E2, and E3 are extracted from the first camera image IM-1, the second camera image IM-2, and the third camera image IM-3, respectively, the edited image IM is used. -G can be made.

  That is, as shown in FIG. 8, video editing can be performed by combining the E1 video and the E3 video, and inserting the E2 video as a sub video into the combined video.

  In the case of a sub video, only a specific part, for example, the user's upper body or face, can be extracted from the original video, and an enlarged video of the user can be used.

  In the golf video information automatic generation system according to an embodiment of the present invention, an image obtained by editing the E1, E2, and E3 images is displayed with the display of the ball trajectory tr as described in FIG. 7, the display of the concentric circle Ra on the green, Insert the display of the distance between the hole cup and the ball, the display of congratulatory content for hole-in-one, etc. or 'Nice Shot! ',' Nearest Winner! The final golf video information can be automatically generated by inserting a comment display or the like.

  When the generation of the golf video information is finally completed, the video information processing apparatus 500 (see FIG. 1) transmits the generated golf video information to a golf course management server or a separate server and stores and manages it in the server. The user can receive golf video information about his commemorative golf shot by connecting to the server using a PC or a mobile terminal and downloading the corresponding golf video information. .

  On the other hand, FIGS. 3 to 8 illustrate the case where the first camera and the second camera are installed in the tee box, the third camera is installed in the green area, and the golf video information is generated by collecting videos from each. Yes. The system and method for automatically generating golf video information according to the present invention are not limited to this case, and can be variously implemented not only when two cameras are used, but also when four or more cameras are used.

  For example, when the first camera is installed in the tee box and only the third camera is installed in the green area, except for the portion related to the video IM-2 of the second camera and the video E2 extracted from it in FIG. Golf video information can be generated using the video and the E3 video.

  Further, for example, when the first camera and the second camera are installed in the tea box and the third camera and the fourth camera are installed in the green area (see FIG. 1), the image of the fourth camera in FIG. A method of determining a video extraction section based on at least one time point of T1, T2, and T3, extracting a video from the determined section, and inserting it as a sub-video on the edited video or combining it with an E3 video (The video from the 4th camera is filmed in the green area at a different viewing angle from the 3rd camera, so the video is extracted at appropriate intervals between the 3rd camera video and the 4th camera video. And can be inserted into the E3 video as a sub video and processed so that the video of the fourth camera becomes a video shot by enlarging the area around the hole cup)

  Also, for example, when the third shooting unit (fifth camera and sixth camera, see FIG. 1) is installed between the tea box and green, the video is extracted from the video of the third shooting unit in an appropriate section. Thus, the video editing can be performed by appropriately combining or inserting between the E1 video and the E3 video in FIG.

  Meanwhile, a golf video information automatic generation system and a golf video information automatic generation method used therefor according to another embodiment of the present invention will be described with reference to FIGS.

  According to another embodiment of the present invention, a golf image information automatic generation system includes a first shooting unit installed on one side of a specific hole of a golf course, a second shooting unit installed on the other side, and the first A video information processing apparatus connected to the imaging unit and the second imaging unit is included. Also in this embodiment, the configuration and function of the video information processing apparatus can be applied in substantially the same manner.

  Here, the first photographing unit may be realized by the first camera shown in FIG. 1 or may be realized by the second camera, and is not necessarily installed in the tee box. It can be installed at some distance from the box.

  The second photographing unit may be realized by the third camera shown in FIG. 1 or may be realized by the fourth camera. The second photographing unit does not necessarily have to be installed around the green, and is slightly separated from the green. It can also be installed at a certain distance.

  Hereinafter, the first photographing unit means a camera device installed in the vicinity where the user takes a golf shot, and the second photographing unit means a camera device installed in the vicinity of a target point (for example, a hole cup on the green). Is defined to mean

  FIG. 9 is a flowchart for explaining a golf video information automatic generation method used in a golf video information automatic generation system according to another embodiment of the present invention.

  The second shooting unit of the golf video information automatic generation system according to the present invention to which the golf video information automatic generation method according to the flowchart shown in FIG. 9 is applied is implemented by a PTZ camera device capable of pan-tilt-zoom. The

  The pan function of the PTZ camera is a function that rotates the camera left and right, the tilt function is a function that rotates the camera up and down, and the zoom function is a function that enlarges or reduces the image.

  If the system starts to operate, the first shooting unit starts shooting the user's golf shot, and the second shooting unit also starts shooting the image (S210). At this time, the second shooting unit looks at the position where the user takes a golf shot in a state where it is installed at a distance (for example, around the green) slightly away from the position where the user takes a golf shot (for example, a tee box). Shooting is started in a zoomed-in state (Zoom-In) at a preset first magnification (hereinafter, the user of the second shooting unit looks at a position where a golf shot is taken and zooms in at a preset first magnification) (Zoom-In) is called “basic state”).

  The video management unit 521 (see FIG. 2) collects the video shot from each of the first shooting unit and the second shooting unit and stores it in the storage unit 510 (see FIG. 2) (S220).

  When the user hits the ball by hitting a golf shot with a tee box, a trigger signal is generated by the trigger processing unit 522 (see FIG. 2) or a trigger signal is received from an external golf terminal (S230). When the trigger signal is generated in this way, the video editing unit 525 (see FIG. 2) determines the trigger time (S232).

  Also, as described above, when the trigger signal is generated, the second photographing unit shoots images in the basic state, and then captures video information captured while gradually zooming out (Zoom-Out) at a preset second magnification. The data is transmitted to the processing device (S310).

  As described above, when the second photographing unit zooms out gradually and reaches the preset second magnification (which may be a basic magnification or a higher magnification), the zoom-out is completed ( S320).

  After the zoom-out is completed, the second photographing unit performs punching, that is, rotates up and down, rotates left and right, or rotates up and down and left and right to photograph a predetermined area including the target point. In other words, the second photographing unit is driven to perform punching of the second photographing unit so as to obtain a corresponding view in which the green including the hole cup is included in the photographing range to be viewed.

  Here, the second photographing unit can perform the punching by rotating at a preset vertical and / or horizontal angle from the beginning, and the video information processing apparatus is transmitted from the second photographing unit. The punching can be performed by recognizing the position of the hole cup by analyzing the image and transmitting the angle information of the up and down and / or left and right to be rotated to the second photographing unit. It includes an image analysis unit, recognizes the hole cup position by its own image analysis, calculates rotation angle information based on the hole cup position, and thereby performs the punching.

  As described above, after punching the second image capturing unit, the second image capturing unit captures a green image and transmits the captured image to the image information processing apparatus (S340).

  On the other hand, in the case of an image shot by the first shooting unit with an angle of view seen from the back of the tee box in the direction of ball movement, if the ball flies a little far away by hitting, the ball can no longer be detected in the image. At this time, the video editing unit may determine a time point when no more balls are detected in the captured image of the first shooting unit, that is, a time point when the ball is exhausted in the first shooting unit image.

  After that, when generating the golf video information, the video editing unit can determine the video extraction section to be extracted from the video of the first shooting unit based on the time when the ball is exhausted, or as described above If a preset time elapses from the trigger time without determining the time when the ball has run out, the video up to the elapsed time can be extracted from the video of the first photographing unit. FIG. 9 shows the latter.

  That is, the video information processing apparatus determines whether a preset time has elapsed after the trigger signal has been generated (S400), and if the preset time has elapsed, the video image taken by the first imaging unit. (S410) (the first photographing unit also finishes photographing).

  Then, the ball tracking processing unit 523 (see FIG. 2) of the video information processing apparatus detects the ball by applying a difference video, a ball detection method, and the like to the shot video of the second shooting unit shooting the green area. Thus, the position of the ball is tracked (S420).

  If the ball does not move any further after the ball tracking processing unit advances, for example, if the ball stops after rolling on the green (S500), the video editing unit determines when the ball stops on the green. (S502).

  When it is determined that the ball has stopped in the video of the second shooting unit as described above, the video management unit ends collection of the second shooting unit shooting video (S350) (the second shooting unit also ends shooting). ). At this time, the second photographing unit returns to the basic state by zooming in and punching (S360).

  Since the ball tracking processing unit also knows the position information of the ball through video analysis that already knows the position of the hole cup, it can determine whether it is a hole-in-one using the position of the hole cup and the position information of the ball ( S520).

  If a hole-in-one occurs, the video editing unit inserts a hole-in-one celebration content prepared in advance into the finally generated golf video information (S521).

  If it is not a hole-in-one, the ball tracking processing unit calculates the distance between the hole cup and the ball (S540), and the video editing unit finally determines the distance between the calculated hole cup and the ball in the generated golf video information. The distance information is displayed (S550).

  On the other hand, the video editing unit uses the trigger time determined in step S232 and the time point stopped on the green of the ball determined in step S502 to store the video editing unit in the storage unit based on the determined time points. Each video is extracted from each shooting unit video, and the extracted video is edited according to preset items. If necessary, the content of the hole-in-one celebration in step S521 or the distance information display in step S550 is displayed. Etc. are finally generated to generate golf video information (S600).

  A specific example related to automatic generation of golf video information according to the flowchart shown in FIG. 9 will be described with reference to FIGS.

  FIG. 10 is a diagram showing an example of generating golf video information by extracting and editing a necessary video from each shooting unit video by the golf video information automatic generation method according to the flowchart shown in FIG.

  In FIG. 10, IM-A indicates a captured image of the first imaging unit, indicates an image collected by the image management unit and stored in the storage unit, and IM-B indicates a captured image of the second imaging unit. Therefore, IM-G indicates a video obtained by editing a video extracted from each video and collected by the video management unit and stored in the storage unit.

  In order to extract images necessary for generating golf image information from the respective images IM-A and IM-B, a trigger time (see step S232 in FIG. 9) and a time point when the ball stops (S502 in FIG. 9). It is preferable to determine each stage), and the time when the ball described in FIG.

  Here, the trigger time is T1, the time when the ball runs out or the time of the preset section from the trigger time is T2, and the time when the ball stops is T3. The matters regarding T1, T2 and T3 are shown in FIG. As explained.

  As shown in FIG. 10, the video corresponding to the preset section R1-1 before the trigger time T1 from the video IM-A of the first photographing unit and the section R1-2 from the trigger time T1 to the time T2 are supported. A video to be extracted can be extracted.

In the IM-A video, the video extracted corresponding to the R1-1 section and the R1-2 section is referred to as ER1.
On the other hand, as shown in FIG. 10, if the time T3 when the ball stops is determined by analyzing the video of the second shooting unit, the time when the ball stops from the trigger time T1 from the video IM-B of the second shooting unit. A section R2 up to T3 can be extracted.

  Of course, if the time T3 at which the ball stops is not determined separately, a section preset from the trigger time T1 can be extracted as the R2 section.

  Here, as described with reference to FIG. 9, the video IM-B of the second photographing unit shows a zoomed-in video with respect to the tee box area in the basic state (Sa), and from the trigger time T1 (or before or after that in advance). The zoom-out video is displayed (Sb), and when zoom-out is completed, the view (green area including the hole cup) changed by punching is displayed (Sc), and then the same view is displayed. An image of maintaining or enlarging the corresponding view is shown (Sd).

  The matters regarding the ball tracking in S420 of FIG. 9 and the subsequent steps can be processed by analyzing using the Sd image.

  The video extracted in the R2 section from the video IM-B of the second photographing unit is referred to as ER2. Preferably, the ER2 image includes all of the zoom-in image (Sa), the zoom-out image (Sb), the view (Sc) changed by punching and the image (Sd) that maintains or enlarges the corresponding view thereafter. Finally, the golf video information by the user's golf shot can appear more dramatic in the video that has been edited.

  As described above, if the images of ER1 and ER2 are extracted from the first shooting unit image IM-A and the second shooting unit image IM-B, respectively, the edited image IM-G can be created using the extracted images.

  Inserting or displaying a predetermined content or the like in the edited video IM-G is the same as that described with reference to FIG. 8, and a detailed description thereof will be omitted.

  Finally, when the generation of the golf video information is completed, the video information processing apparatus transmits the generated golf video information to a golf course management server or a separate server, and stores and manages it in the server. The user can receive golf video information about his commemorative golf shot by connecting to the server using a PC or a mobile terminal and downloading the corresponding golf video information.

  On the other hand, FIG. 11 shows an example of the edited video of the ER1 video and the ER2 video described in FIG. 10 in time series.

  FIGS. 11A and 11B show examples of the ER1 video extracted from the first photographing unit, and show a scene where the user is making a golf shot in the tee box area in the video.

  FIG. 11C shows an example of the ER2 video extracted from the second shooting unit, and shows a state where the tea box TB area is shot with a zoom-in video.

  FIG. 11D shows a state in which the tee box TB area in the video is far away due to zoom-out, and FIG. 11E shows the second photographing unit pantilting (that is, rotating up and down and / or left and right). ) Shows a state in which the camera view is changed, and FIG. 11 (f) shows a state in which the camera view change has been completed by punching (as can be seen from the image in FIG. 11 (f), The two shooting units are preferably punched so as to have a view including the green G area including the position of the hole cup hc / flagpole fl).

  In the image after FIG. 11 (f), a ball appears on the green (the second shooting unit is panting by zooming out and watching the green before the ball hit by the user reaches the green. (A) and (b) of FIG. 12 show that the second photographing unit is punched and the view is changed to shoot an image as it is, and FIG. In this state, the ball reaches the green, and as shown in FIG. 12B, the ball ba appears on the green G and the video until the movement is stopped is included in the golf video information. .

  On the other hand, the image after (f) of FIG. 11 can be connected to the images of (a) to (d) of FIG. FIGS. 13A to 13D show a case where an image enlarged at a preset magnification appears after the second photographing unit is punched. 13A shows a case where the view of the second photographing unit is changed by punching, and FIGS. 13B, 13C and 13D are preset based on the position of the hole cup hc. The image until the ball ba appears and stops in the state of being magnified at the scaled ratio is shown.

  The enlarged images shown in (b) to (d) of FIG. 13 may be images taken by the second shooting unit zooming in, and the image information processing apparatus is preset with respect to the images received from the second shooting unit. It can also be an image that has been enlarged and edited at a different magnification.

As described above, the golf video information automatic generation system and the golf video information automatic generation method according to the present invention collect videos for shooting each area at a specific hole of a golf course, and analyze the collected videos for editing. The target time point of the golf shot can be determined from the golf shot to the user who is playing a golf round by editing the extracted video. It can automatically generate video information that shows a series of processes up to the movement in the area including it, that is, golf video information, and provide it to the user, and such golf video information is generated very dramatically and automatically generated Therefore, the user who enjoys golf has the feature that it can be a very precious memento.
[Item 1]
A system for automatically generating golf video information based on a golf shot of a user at a golf course,
A first photographing unit for obtaining an image of a user's golf shot in a photographing region;
A second photographing unit for photographing an area including the target point;
Collecting images taken from each of the first photographing unit and the second photographing unit, determining an extraction interval of the images collected from each of the first photographing unit and the second photographing unit, A video information processing apparatus that automatically generates the golf video information by editing each video extracted by the extraction section according to preset matters;
System for automatically generating golf video information.
[Item 2]
The first photographing unit includes at least one of a first camera that photographs a side surface of a user who performs a golf swing and a second camera that photographs a front surface of the user who performs the golf swing. Item 3 comprising at least one of a third camera that captures an area including a target point and a fourth camera that captures an area including the target point at a different viewing angle from the third camera. The golf image information automatic generation system described in 1.
[Item 3]
The video information processing apparatus
A storage unit for storing images shot from the respective cameras of the first shooting unit and the second shooting unit;
A video management unit that collects videos shot from each camera of the first shooting unit and the second shooting unit, stores them in each storage unit, stores them in the storage unit, and generates the golf video information. Video extraction sections for each camera-specific video are determined, and video extracted from each camera-specific video stored in the storage unit according to the determined video extraction section is preset. Including an information processing unit including a video editing unit that automatically generates the golf video information by editing according to matters,
3. The system for automatically generating golf video information according to item 2, wherein the information processing unit is configured to transmit the automatically generated golf video information to a server or the personal terminal of the user.
[Item 4]
The information processing unit further includes a trigger processing unit that detects that the ball is moved by hitting by the image processing on the image of the first photographing unit, and generates a trigger signal when the ball moves by hitting in the corresponding image. And the video editing unit is configured to determine a video extraction section for generating the golf video information for each camera video based on a time point when the trigger signal is generated by the trigger processing unit. 4. The system for automatically generating golf video information according to item 3, wherein
[Item 5]
The information processing unit receives a trigger signal transmitted from the outside when the ball is hit by the user's golf swing, and the video editing unit is configured to receive the golf video information based on the trigger signal reception time from the outside. 4. The system for automatically generating golf video information according to item 3, wherein a video extraction section for generating the video is determined for each of the video for each camera.
[Item 6]
The information processing unit senses that the ball is moved by hitting by image processing on the image of the first photographing unit, and generates a trigger signal when detecting that the ball moves by hitting in the corresponding image; A ball tracking processing unit that detects a ball by video processing on the video of the second photographing unit and determines when the movement of the ball stops, and the video editing unit generates a trigger signal by the trigger processing unit A video extraction section for generating the golf video information is determined for each camera video based on the time and the time when the movement of the ball determined by the ball tracking processing unit stops. 4. The golf video information automatic generation system according to item 3, wherein
[Item 7]
A system for automatically generating golf video information based on a golf shot of a user at a golf course,
A first photographing unit that is installed in a tee box, obtains an image of a user's golf shot in a photographing region, and photographs a side of the user who makes the golf shot;
A second photographing unit for photographing an area including green;
Collecting images taken from each of the first photographing unit and the second photographing unit, determining an extraction interval of the images collected from each of the first photographing unit and the second photographing unit, A video information processing apparatus that automatically generates the golf video information by editing each video extracted by the extraction section according to preset matters;
System for automatically generating golf video information.
[Item 8]
The video information processing apparatus
A storage unit for storing images shot from the first shooting unit and the second shooting unit;
A video management unit that collects videos shot from the first shooting unit and the second shooting unit, and stores and manages the videos in the storage unit for each shooting unit; and for generating the golf video information A video extraction section is determined for each of the shooting unit videos, and a video extracted from each of the shooting unit videos stored in the storage unit according to the determined video extraction section is set in advance. Including an information processing unit including a video editing unit that automatically generates the golf video information by editing according to matters,
8. The golf video information automatic generation system according to item 7, wherein the information processing unit is configured to transmit the automatically generated golf video information to a server or the user's personal terminal.
[Item 9]
The information processing unit further includes a ball tracking processing unit that detects a ball by video processing on the video of the second photographing unit and determines when the movement of the ball stops, and the video editing unit is configured to analyze video or externally A video extraction interval for generating the golf video information is defined for each video of each shooting unit based on the time when a trigger signal is generated by signal input and the time when the movement of the ball determined by the ball tracking processing unit stops. Item 9. The golf video information automatic generation system according to Item 8, wherein the system is configured to determine each of them.
[Item 10]
The information processing unit recognizes the hole cup on the green or the flag cup of the hole cup from the image of the second shooting unit and senses the position of the hole cup on the green in real time; A ball tracking processing unit that tracks the position of the ball by image processing on the image of the second photographing unit, the ball tracking processing unit including the position of the hole cup sensed by the hole cup position sensing unit, It is configured to determine at least one of hole-in-one using the position of the tracked ball and to calculate the distance between the ball and the hole cup, and the video editing unit is configured by the ball tracking processing unit. If it is determined to be hole-in-one, the golf generated above When content for hole-in-one celebration is inserted into the image information, and the distance between the ball and the hole cup is calculated by the ball tracking processing unit, the calculated ball and hole cup are included in the generated golf video information. Item 9. The golf video information automatic generation system according to Item 8, wherein a distance between the two is displayed.
[Item 11]
A system for automatically generating golf video information based on a golf shot of a user at a golf course,
A tee box shooting unit that is installed in the tee box and acquires a video of the user's golf shot in the shooting area;
A fairway photography unit installed to photograph an area on the fairway;
Collect video taken from each of the tee box photography unit and the fairway photography unit, determine an extraction section of the video collected from each of the tee box photography unit and the fairway photography unit, and determine the extracted video extraction section A video information processing apparatus that automatically generates the golf video information by editing each video extracted in accordance with preset items;
System for automatically generating golf video information.
[Item 12]
The fairway photographing unit is configured to photograph a target area set in advance on the fairway, and the video information processing apparatus analyzes a video collected from the fairway photographing unit and determines a ball position in the corresponding video. It is configured to determine whether the ball has landed in the target area by a golf shot performed by each user of the golf round by calculating, and the determination result is notified to the user or transmitted to the server. Item 12. The golf video information automatic generation system according to Item 11, wherein the system is recorded.
[Item 13]
The video information processing apparatus determines the user who recorded the longest flight distance among golf round users by analyzing the video collected from the fairway shooting unit and calculating the position of the ball from the video. Alternatively, the order is determined for the user based on the flight distance, and the result of the determination or determination is notified to the user or transmitted to a server for recording. The golf video information automatic generation system according to item 11, wherein
[Item 14]
A system for automatically generating golf video information based on a golf shot of a user at a golf course,
A first shooting unit installed on one side of a specific hole of a golf course and acquiring an image of a user's golf shot in a shooting area;
It is installed on the other side of the specific hole and can be pan / tilt / zoom driven. A second shooting unit configured to take a picture of the user shooting a golf shot;
Collecting images captured from the first and second imaging units, and extracting each image extracted from the first and second imaging units according to preset matters. A video information processing apparatus that automatically generates the golf video information by editing;
System for automatically generating golf video information.
[Item 15]
The second photographing unit is set in advance by a trigger signal of the video information processing apparatus or an externally input trigger signal after zooming in at a first preset magnification to acquire an image of the user's golf shot. Zoomed out at the second magnification, and is configured to capture a video by rotating at least one of up and down and left and right so that the region including the target point is included in the imaging region, The zoomed-in video and the zoom based on the trigger signal based on the video collected from the first shooting unit and the video extracted for the preset section based on the trigger signal and the video collected from the second shooting unit It includes an out image and an image of the area including the target point that is rotated and photographed in at least one of up / down and left / right. The golf video information, characterized in that it is configured to automatically generate, golf video information automatic generation system of claim 14 by combining the the video extraction.
[Item 16]
A golf video information automatic generation method of a system for automatically generating golf video information by a golf shot of a user at a golf course,
Collecting and storing in a storage unit images captured by a first shooting unit including at least one camera for a golf shot of a user within the shooting area;
Collecting and storing in the storage unit images captured for an area including a target point by a second imaging unit including at least one camera;
Determining an extraction section of video collected from each of the first and second imaging units;
Automatically generating the golf video information by editing each video extracted by the determined video extraction section from each video stored in the storage unit according to preset matters;
A method for automatically generating golf video information.
[Item 17]
The stage of determining the video extraction section is as follows:
When a trigger signal is generated by detecting that the ball is moved by hitting by image processing on the image of the first photographing unit, or when a trigger signal is received from the outside when the ball is hit by the golf swing of the user Determining a video extraction section for generating the golf video information for each camera unit video based on the generation time or reception time of the determined trigger signal; Item 18. The method for automatically generating golf video information according to Item 16, wherein
[Item 18]
The stage of determining the video extraction section is as follows:
When a trigger signal is generated by detecting that the ball is moved by hitting by image processing on the image of the first photographing unit, or when a trigger signal is received from the outside when the ball is hit by the golf swing of the user Determining the time when the ball stops moving by detecting the ball by image processing on the image of the second photographing unit, and the time when the trigger signal is generated or received and the movement of the ball The golf video according to item 16, further comprising a step of determining a video extraction section for generating the golf video information for each camera video of each of the photographing units with reference to a point of time of stopping. Automatic information generation method.
[Item 19]
Tracking the position of the ball by image processing on the image of the second photographing unit, and calculating the distance between the ball and the target point using the position of the target point and the position of the tracked ball. In addition,
27. The golf according to item 16, wherein the step of automatically generating the golf video information includes a step of displaying the calculated distance information between the ball and the target point on the generated golf video information. Video information automatic generation method.
[Item 20]
The first photographing unit is installed in a tee box, and is configured to include a camera that photographs a side surface of a user who makes a golf shot,
The stage of determining the video extraction section is as follows:
Recognizing at least one tee marker installed in the tee box from an image of the first photographing unit, and setting a region of interest having a preset size based on the recognized at least one tee marker; Extracting a video corresponding to the set region of interest from a plurality of frames, generating a trigger signal by detecting movement of a ball hit by a differential video analysis, and generating the trigger signal And determining a video extraction section for generating the golf video information with respect to each camera video of each of the photographing units based on the time point of the golf video information. Automatic generation method.
[Item 21]
The second photographing unit is configured to include a camera for photographing an area including green,
Tracking the position of the ball by image processing on the image of the second photographing unit, and determining whether it is a hole in one using the position of the hole cup on the green and the position of the tracked ball; or Calculating the distance between the hole cups,
The step of automatically generating the golf video information is as follows:
If the result of tracking the ball position is determined to be hole-in-one, the content for hole-in-one celebration is inserted into the generated golf video information. If the result of tracking the ball position is not hole-in-one, the generated is Item 17. The method for automatically generating golf image information according to item 16, further comprising the step of displaying the calculated distance between the ball and the hole cup in the golf image information.
[Item 22]
The second photographing unit is configured to include a camera for photographing an area including green,
The step of tracking the position of the ball by image processing on the image of the second shooting unit for each golf shot of each user who makes a golf round, and the position of the hole cup on the green and the position of the tracked ball Further comprising determining when the ball is closest to the hole cup with respect to the golf shot of each user using the golf round,
The step of automatically generating the golf video information is as follows:
Item 16 further includes the step of inserting a content for near list celebration into golf video information about a user's golf shot determined to be when the ball is closest to the hole cup. The method for automatically generating golf video information as described.
[Item 23]
The second photographing unit is configured to include a camera for photographing an area including green,
Recognizing the hole cup on the green or the flag cup of the hole cup from the image of the second shooting unit and detecting the position of the hole cup on the green in real time, and the image of the image of the second shooting unit Tracking the position of the ball by processing, determining whether it is a hole-in-one using the position of the hole cup determined by the real-time sensing and the position of the tracked ball, and between the ball and the hole cup. Further comprising performing at least one of the distance calculations;
The step of automatically generating the golf video information is as follows:
Item 17. The method for automatically generating golf image information according to item 16, further comprising the step of displaying the result of determining whether the hole is in one or calculating the distance between the ball and the hole cup on the golf image information.
[Item 24]
A golf video information automatic generation method of a system for automatically generating golf video information by a golf shot of a user at a golf course,
A first shooting unit image collection and storage stage for collecting images of a user's golf shots shot by a first shooting unit installed on one side of a specific hole of a golf course and storing them in a storage unit;
The user can zoom in, zoom out and change the view by rotating to at least one of up / down and left / right by a second imaging unit that is installed on the other side of the specific hole and can be driven by pan / tilt / zoom A second shooting unit video collecting and storing step for collecting and storing the video shot by golf shot in the storage unit;
Automatically generating the golf video information by editing the first extracted video extracted from the first shooting unit and the second extracted video extracted from the second shooting unit according to preset matters;
A method for automatically generating golf video information.
[Item 25]
The second shooting unit image collection and storage stage includes:
According to a step of acquiring an image of the user's golf shot in a basic state zoomed in at a first magnification set in advance by the second photographing unit, and a trigger signal of the image information processing device or a trigger signal input from the outside Acquiring the image while the second photographing unit is zoomed out at the second magnification set in advance in the basic state, and the second photographing unit is rotationally driven up and down and / or left and right, Recognizing position information and acquiring a video for an area including the target point, and collecting the respective acquired videos by the video information processing apparatus and storing them in the storage unit. The method for automatically generating golf video information according to item 24.
[Item 26]
The step of automatically generating the golf video information is as follows:
Extracting a video for a preset section from the video collected from the first shooting unit with reference to the trigger signal; and the zoom-in video based on the trigger signal from the video collected from the second shooting unit; Extracting a video so as to include a zoomed-out video and a video of a region including the target point rotated and rotated at least one of up and down and left and right, and combining each of the extracted videos or each of the extractions The golf video information is automatically generated by combining the combined videos and inserting preset content into the combined videos or performing preset video processing on the extracted videos. 26. The method for automatically generating golf video information according to item 25, further comprising:
[Item 27]
The step of automatically generating the golf video information is as follows:
Extracting a video for a preset section from the video collected from the first shooting unit with reference to the trigger signal; and the zoom-in video based on the trigger signal from the video collected from the second shooting unit; Zoomed in at a magnification determined by the position of the target point with respect to the zoomed-out image, the image of the region including the target point and the image of the region including the target point, which is rotated and photographed in at least one of the vertical and horizontal directions Extracting a video to include a video and combining the extracted videos or combining the extracted videos and inserting preset content in the combined video; or The golf video information is automatically generated by performing preset video processing on each extracted video. Characterized in that it comprises a floor, a golf video information automatically generating method of claim 25.

DESCRIPTION OF SYMBOLS 100 1st imaging | photography unit 110 1st camera 120 2nd camera 200 2nd imaging | photography unit 210 3rd camera 220 4th camera 500 Image | video information processing apparatus 510 Storage part 520 Information processing part 521 Image | video management part 522 Trigger process part 523 Ball tracking process 524 Hall cup position sensing unit 525 Video editing unit

Claims (9)

A system for automatically generating golf video information based on a golf shot of a user at a golf course,
A first photographing unit for obtaining an image of a user's golf shot in a photographing region;
A second photographing unit for photographing an area including the target point;
A storage unit for storing videos shot from the first shooting unit and the second shooting unit; and an extraction section of videos collected from the first shooting unit and the second shooting unit; A video editing unit that automatically generates the golf video information by editing each video extracted by the video extraction section according to preset matters, and a ball is hit by video processing on the video of the first shooting unit The movement of the ball is detected by a trigger processing unit that generates a trigger signal when the movement of the ball is detected by hitting in the corresponding image, and the ball is detected by image processing on the image of the second photographing unit. a video information processing apparatus which includes a ball tracking processing unit for determining a stop point in time, only contains,
The video editing unit includes a video extraction section for generating the golf video information based on a time point when the trigger signal is generated by the trigger processing unit and a time point when the movement of the ball determined by the ball tracking processing unit stops. A system for automatically generating golf video information that is determined for each video .   The first photographing unit includes at least one of a first camera for photographing a side surface of a user who performs a golf swing and a second camera for photographing a front surface of the user who performs the golf swing. 2. The golf according to claim 1, comprising at least one of a third camera that captures an area including a target point and a fourth camera that captures an area including the target point at a different viewing angle from the third camera. Automatic video information generation system. A system for automatically generating golf video information based on a golf shot of a user at a golf course,
A first photographing unit that is installed in a tee box, obtains a video of a user's golf shot in a photographing region, and photographs a side of the user who makes the golf shot;
A second photographing unit for photographing an area including green;
Collecting images captured from each of the first imaging unit and the second imaging unit, determining an extraction interval of the images collected from each of the first imaging unit and the second imaging unit, A video information processing apparatus for automatically generating the golf video information by editing each video extracted by the extraction section according to a preset item;
Only including,
The video information processing apparatus
A storage unit for storing images shot from the first shooting unit and the second shooting unit;
A video management unit that collects videos shot from each of the first shooting unit and the second shooting unit, and stores and manages the videos by each shooting unit; and for generating the golf video information A video extraction section is determined for each video by each shooting unit, and a video extracted from each of the video by each shooting unit stored in the storage unit according to the determined video extraction section is preset. An information processing unit including a video editing unit that automatically generates the golf video information by editing according to matters
Including
The information processing unit is configured to transmit the automatically generated golf video information to a server or the user's personal terminal,
The information processing unit further includes a ball tracking processing unit that detects a ball by video processing on the video of the second photographing unit and determines when the movement of the ball stops, and the video editing unit analyzes video or externally A video extraction interval for generating the golf video information is defined for each video of each shooting unit based on a time point when a trigger signal is generated by signal input and a time point when the movement of the ball determined by the ball tracking processing unit stops. A system for automatically generating golf video information configured to determine each of A system for automatically generating golf video information based on a golf shot of a user at a golf course,
A first photographing unit that is installed in a tee box, obtains a video of a user's golf shot in a photographing region, and photographs a side of the user who makes the golf shot;
A second photographing unit for photographing an area including green;
Collecting images captured from each of the first imaging unit and the second imaging unit, determining an extraction interval of the images collected from each of the first imaging unit and the second imaging unit, A video information processing apparatus for automatically generating the golf video information by editing each video extracted by the extraction section according to a preset item;
Including
The video information processing apparatus
A storage unit for storing images shot from the first shooting unit and the second shooting unit;
A video management unit that collects videos shot from each of the first shooting unit and the second shooting unit, and stores and manages the videos by each shooting unit; and for generating the golf video information A video extraction section is determined for each video by each shooting unit, and a video extracted from each of the video by each shooting unit stored in the storage unit according to the determined video extraction section is preset. An information processing unit including a video editing unit that automatically generates the golf video information by editing according to matters,
The information processing unit is configured to transmit the automatically generated golf video information to a server or the user's personal terminal,
The information processing unit recognizes a hole cup on the green or a flag pole of the hole cup from the image of the second photographing unit, and detects a position of the hole cup on the green in real time; A ball tracking processing unit that tracks the position of the ball by image processing on the image of the second photographing unit, the ball tracking processing unit including the position of the hole cup sensed by the hole cup position sensing unit, It is configured to perform at least one of determination of whether it is a hole-in-one using a tracked ball position and calculation of a distance between the ball and the hole cup, and the video editing unit is configured by the ball tracking processing unit. If it is determined as a hole-in-one, the generated golf When a content for hole-in-one celebration is inserted into the image information, and the distance between the ball and the hole cup is calculated by the ball tracking processing unit, the calculated ball and hole cup are included in the generated golf video information. Gore Ruch video information automatic generation system so as to display the distance between. A system for automatically generating golf video information based on a golf shot of a user at a golf course,
A tee box shooting unit that is installed in the tee box and acquires a video of the user's golf shot in the shooting area;
A fairway photography unit installed to photograph an area on the fairway;
Collecting images shot from the tea box shooting unit and the fairway shooting unit, respectively, determining an extraction interval of the images collected from the tea box shooting unit and the fairway shooting unit, and determining the determined image extraction interval A video information processing apparatus that automatically generates the golf video information by editing each video extracted by the method according to preset matters;
Only including,
The fairway photographing unit is configured to photograph a target area set in advance on the fairway, and the video information processing apparatus analyzes a video collected from the fairway photographing unit and determines a ball position in the corresponding video. By calculating, it is configured to determine whether the ball has landed in the target area by a golf shot performed by each user of the golf round, and informs the user of the determination result or transmits it to the server Golf video information automatic generation system to record . A system for automatically generating golf video information based on a golf shot of a user at a golf course,
A tee box shooting unit that is installed in the tee box and acquires a video of the user's golf shot in the shooting area;
A fairway photography unit installed to photograph an area on the fairway;
Collecting images shot from the tea box shooting unit and the fairway shooting unit, respectively, determining an extraction interval of the images collected from the tea box shooting unit and the fairway shooting unit, and determining the determined image extraction interval A video information processing apparatus that automatically generates the golf video information by editing each video extracted by the method according to preset matters;
Including
The video information processing apparatus determines a user who records the longest flight distance among golf round users by analyzing a video collected from the fairway photographing unit and calculating a position of the ball based on the video. Alternatively, the golf video information is configured to determine the rank for the user based on the flight distance, and informs the user of the determination or determination result or transmits the information to a server for recording. Automatic generation system. A system for automatically generating golf video information based on a golf shot of a user at a golf course,
A first shooting unit installed on one side of a specific hole of a golf course and acquiring an image of a user's golf shot in a shooting area;
It is installed on the other side of the specific hole and can be pan / tilt / zoom driven. A second shooting unit configured to take a picture of the user taking a golf shot;
Collecting images taken from the first and second imaging units, respectively, and extracting each image extracted from the first and second imaging units according to preset matters. A video information processing apparatus that automatically generates the golf video information by editing;
Only including,
The second photographing unit is preliminarily set by a trigger signal of the video information processing apparatus or an externally input trigger signal after being zoomed in at a first preset magnification and acquiring an image of the user's golf shot. Zoomed out at the second magnification, and configured to shoot images by rotating at least one of up and down and left and right so that the area including the target point is included in the shooting area,
The video information processing apparatus uses the video collected from the first shooting unit as a reference based on the trigger signal based on the video extracted for a preset section based on the trigger signal and the video collected from the second shooting unit. The golf video information is automatically generated by combining the zoomed-in video, the zoom-out video, and the video extracted so as to include the video of the area including the target point rotated and photographed in at least one of the vertical and horizontal directions. A golf video information automatic generation system configured as described above . A golf video information automatic generation method of a system for automatically generating golf video information by a golf shot of a user at a golf course,
Collecting and storing in a storage unit images captured by a first shooting unit including at least one camera for a golf shot of a user within the shooting area;
Collecting images stored in an area including a target point by a second imaging unit including at least one camera and storing the images in the storage unit;
Determining an extraction interval of video collected from each of the first and second imaging units;
Automatically generating the golf video information by editing each video extracted by the determined video extraction section from each video stored in the storage unit according to preset matters;
Only including,
The step of determining an extraction interval of the video includes
When a trigger signal is generated by detecting that the ball is moved by hitting by image processing on the image of the first photographing unit, or when a trigger signal is received from the outside when the ball is hit by the golf swing of the user And determining a video extraction section for generating the golf video information for each camera unit video based on the generation time or reception time of the determined trigger signal. A method for automatically generating golf video information. A golf video information automatic generation method of a system for automatically generating golf video information by a golf shot of a user at a golf course,
Collecting and storing in a storage unit images captured by a first shooting unit including at least one camera for a golf shot of a user within the shooting area;
Collecting images stored in an area including a target point by a second imaging unit including at least one camera and storing the images in the storage unit;
Determining an extraction interval of video collected from each of the first and second imaging units;
Automatically generating the golf video information by editing each video extracted by the determined video extraction section from each video stored in the storage unit according to preset matters;
Including
The first photographing unit is installed in a tee box and configured to include a camera that photographs a side surface of a user who makes a golf shot,
The step of determining an extraction interval of the video includes
Recognizing at least one tee marker installed in the tee box from an image of the first photographing unit, and setting a region of interest having a preset size based on the recognized at least one tee marker; Extracting a video image corresponding to the set region of interest from a plurality of frames, generating a trigger signal by detecting movement of a ball hit by a differential video analysis, and generating the trigger signal time points and determining each image extraction section for generating the golf video information to a reference to the camera by the image of the shooting units, rubber Ruff video information automatically generated methods.