KR101025774B1 - Method to efficiently process image data from the video presenter - Google Patents

Abstract

The present invention is an image data processing method in which a computer processes image data from a video presenter to display a moving image and capture still images when a still image capture signal is generated. Here, the displaying of the moving picture includes steps (a) to (d). In step (a), the computer receives data of odd frames. In step (b), the computer processes and displays the data of the received odd-numbered frames and receives the data of the next even-numbered frames. In step (c), the computer processes and displays the received even-numbered frame and receives the data of the next odd-numbered frame. In step (d), the computer performs steps (b) and (c) alternately and repeatedly.

Description

Method to efficiently process image data from the video presenter}

1 is a perspective view showing a video presenter and a computer executing an image data processing program according to the present invention.

FIG. 2 is a block diagram illustrating an internal configuration of the video presenter of FIG. 1.

3 is a flowchart showing an image data processing program according to the present invention executed by the computer of FIG.

4 is a flowchart illustrating an algorithm of the video display step of FIG. 3.

FIG. 5 is a flowchart illustrating a video display step of FIG. 3 in more detail.

6 is a flowchart illustrating a still image capturing step of FIG. 3 in detail.

<Description of the symbols for the main parts of the drawings>

1 ... video presenter, 15 ... video detector,

13a, 13b ... lighting device, 16 ...

18 ... lock button, 3 ... subject,

11 ... with a basin, 12 ... key input device,

14 ... remote receiver, 7 ... mouse,                 

5 ... computer, 6 ... keyboard,

2 ... monitor, S ... screen,

21 Paint, 3a ...

P1, P2 ... picture, 22 ... pointer,

15a ... optical system, 15b ... photoelectric conversion unit,

101 microprocessor, 102 timing circuit,

103 ... analog signal processing section, 104 ... analog-to-digital conversion section,

105 ... digital camera processor, 106 ... SDRAM,

107 frame-specification section, 108 video output section,

109 ... USB interface.

The present invention relates to a method for processing image data from a video presenter, and more particularly, to a computer processing image data from a video presenter to display a moving image and to capture a still image when a still image capture signal is generated. An image data processing method.

An example of a typical video presenter is the video presenter of US Pat. No. 5,822,013, which was filed and registered by the applicant. Such a video presenter provides image data to a computer while performing serial communication with a computer running its own image data processing program. Accordingly, the computer processes the image data from the video presenter to display the moving image and to capture the still image when the still image capture signal is generated.

Meanwhile, a protocol of high speed serial communication, for example, a protocol of "USB (Universal Serial Bus) 2.0" capable of data transmission of 480 Mbps (Mega bits per second), is used between a computer and a video presenter. Accordingly, the video presenter can transmit images to a computer at high speed. For example, the video presenter may transmit image data having a resolution of the extended graphics array (XGA) standard, for example, 1,024 × 768 pixels, to a computer at a rate of 20 frames per second (FPS).

However, from the computer's point of view, since it takes time to receive and process image data that is continuously and rapidly input, it is impossible to completely receive, process, and display all of the input image data. Therefore, although the video presenter can transmit images to the computer at high speed, there is a problem that the image quality of the video displayed on the monitor of the computer is not improved.

An object of the present invention is to provide a video data processing method that enables a computer to display a moving picture by completely receiving and processing all video data input at high speed from a video presenter.

The present invention for achieving the above object is a video data processing method wherein a computer processes video data from a video presenter to display a video and to capture a still picture when a still picture capture signal is generated. Here, the displaying of the moving picture includes steps (a) to (d). In step (a), the computer receives data of odd frames. In step (b), the computer processes and displays the data of the received odd-numbered frames and receives the data of the next even-numbered frames. In step (c), the computer processes and displays the received even-numbered frame and receives the data of the next odd-numbered frame. In step (d), the computer performs steps (b) and (c) alternately and repeatedly.

According to the image data processing method of the present invention, the reception and processing operations for the odd and even frames are alternately performed. Accordingly, since the receiving and processing operations can be twice as fast as a result, the computer can completely receive and process all the image data input from the video presenter at high speed to display a moving image.

Hereinafter, preferred embodiments according to the present invention will be described in detail.

Referring to FIG. 1, the video presenter 1 according to the present invention includes an image sensing unit 15, lighting devices 13a and 13b, a strut 16, a lock button 18, a subject 11, and a key input. Device 12, and remote receiving device 14.

The image sensing unit 15 that can move back and forth and rotates is provided with an optical system and a photoelectric conversion unit. An optical system for optically processing light from a subject includes a lens unit and a filter unit. A photoelectric conversion unit of a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) converts light incident from an object through an optical system into an electrical analog signal.

The user can move the strut 16 by pressing the lock button 18. Underneath the cover 11 is another lighting device. The key input device 12 is used to control the driving of each unit such as the image sensing unit 15 and the lighting devices 13a and 13b by a user's manipulation. On the other hand, the user operates a remote transmission device (not shown) to input a control signal to the remote reception device 14, thereby controlling the driving of each unit such as the image sensing unit 15 and the lighting devices 13a and 13b. Can be.

The computer 5 executing the image data processing program according to the present invention, that is, the dedicated program of the video presenter 1, processes the image data from the video presenter 1 and displays a moving image on the display screen S of the monitor 2. ) And capture a still image when a still image capture signal from the user is generated. To this end, the main control unit of the video presenter 1 is a high-speed serial communication protocol, and the computer 5 is connected via an interface of "USB (Universal Serial Bus) 2.0" protocol capable of data transmission of 480 Mbps (Mega bits per second). Communicate with Accordingly, the video presenter 1 rapidly transmits image data having a resolution of 1,024 X 768 pixels as a resolution of an extended graphics array (XGA) standard to a computer at a rate of 20 frames per second (FPS).

The computer 5 receives and processes the image data from the video presenter 1 to display the moving image on the display screen S of the monitor 2. Accordingly, the video of the subject 3 on the subject 11 is displayed on the display screen S of the monitor 2. The computer 5 also captures a still image from the video presenter 1 in accordance with a still image capture signal from the user (see FIG. 3).

Accordingly, the user can edit the still image from the video presenter 1 while executing the image data processing program according to the present invention. For example, the paint plate 21 is displayed on the display screen S of the monitor 2, and the user uses the mouse 7, the keyboard 6, and the paint plate 21 to draw on the subject image 3a. Since the fields P1 and P2 may be overlapped and drawn, the user may perform various descriptions. In FIG. 1, reference numeral 22 denotes a pointer of the mouse 7.

Of course, when the user does not edit the image by the computer 5, the output image data from the video presenter 1 can be directly input to the monitor 2.

Referring to FIG. 2, the video presenter 1 of FIG. 1 according to the present invention includes a key input device 12, a remote receiving device 14, a universal serial bus (USB) interface 109, an optical system 15a, and a photoelectric device. Converter 15b, analog signal processor 103, analog-digital converter 104, digital camera processor 105, timing circuit 102, microprocessor 101 as the main controller, SDRAM 106 as frame memory , A synchronous dynamic random access memory), a memory controller 107, and an image output unit 108. In FIG. 2, the same reference numerals as used in FIG. 1 indicate objects of the same function.

The optical system 15a optically processes light from a subject. The photoelectric conversion section 15b of the CCD or CMOS converts the light from the optical system 15a into an electrical analog signal. The timing circuit 102, which operates under the control of the microprocessor 101 as the main controller, for example, the timing generator element controls the operation of the photoelectric conversion section 15b. The analog signal processing unit 103, for example, a CDS-AGC (Correlation Double Sampler and Automatic Gain Controller) element processes an analog signal from the photoelectric conversion unit 15b to remove the high frequency noise and adjust the amplitude. The analog-digital converter 104 converts the analog signal from the analog signal processor 103 into red (R), green (G), and blue (B) digital signals. The digital camera processor 105 processes the digital signal from the analog-to-digital converter 104 to generate image data of " Y: Cb: Cr 4: 2: 2 " format, which is well known as a luminance and chromaticity format.

The SDRAM 106 as a frame memory stores image data from the digital camera processor 105 in units of frames. The memory control unit 107 composed of a Field Programmable Gate Array (FPGA) provides the frame data from the SDRAM 106 to the image output unit, and provides the frame data to the microprocessor 101 under the control of the microprocessor 101. Optionally enter Accordingly, the microprocessor 101 communicates with the computer (5 of FIG. 1) through the USB interface 109, and receives frame data from the memory controller 107 in response to a request from the computer 5. 5) to transmit.

Image output unit 108 For example, a video graphics array (VGA) engine element converts image data from the memory control unit 107 into an analog composite image signal and outputs the converted image data. When the video presenter (1 in FIG. 1) is directly connected to the monitor 2, the analog composite video signal from the image output unit 108 is directly input to the monitor 2. On the other hand, the microprocessor 101 controls the operations of the respective parts, for example, the timing circuit 102 and the digital camera processor 105 according to the signals input from the key input device 12 and the remote receiving device 14. .

1 to 3, an image data processing program according to the present invention executed by a central processing unit (CPU) of a computer 5 will be described.

First, it is checked whether the USB interface 109 of the video presenter 1 and the USB interface (not shown) of the computer 5 are well connected (step S1). If it is not well connected, the guidance message accordingly is displayed on the monitor 2 (step S2). If well connected, the following image data processing steps are performed.

First, initialization for USB communication with the video presenter 1 is performed (step S3). Next, while USB communication with the video presenter 1 is performed, data of consecutive frames from the video presenter 1 is processed to display a moving image of the subject 3 (step S4). Here, the reception and processing operations for odd and even frames are alternately performed. As a result, the receiving and processing operations can be twice as fast as a result, so that the computer 5 completely receives and processes all the image data inputted from the video presenter 1 at high speed so that the moving image is transmitted to the monitor 2. Can be displayed. An algorithm in which data of the unit frame is processed in this moving picture display step S4 will be described in detail with reference to FIGS. 4 and 5.

If a still image capture signal is generated from the user while displaying the moving image as described above (step S5), the data of a single frame from the video presenter 1 is processed to capture the still image (step S6). An algorithm in which data of a single frame is processed in this capturing step S6 will be described in detail with reference to FIG.

The steps S4 to S6 are repeated until the end signal is input (step S7). That is, before the still image capturing step S6 is performed, the moving image display step S4 is repeatedly performed, and the moving images are displayed by successively displaying the frames processed in each moving image display step.

Referring to FIGS. 1 and 4, the algorithm of the video display step S4 of FIG. 3 is classified into an initial flow and a subsequent flow, as follows.

In the first flow of the algorithm of the moving image display step S4, first, the central processing element of the computer 5 receives the odd frame data from the video presenter 1 (step S41a). Next, the central processing element of the computer 5 processes and displays the data of the received odd-numbered frame (step S42a) and receives the data of the next even-numbered frame (step S42b).

After the first flow, the following flow is repeatedly performed.

First, the central processing element of the computer 5 processes and displays the received even-numbered frame data (step S41b) and simultaneously receives data of the next odd-numbered frame (step S41a).

Next, the central processing element of the computer 5 processes and displays the data of the received odd-numbered frame (step S42a) and receives the data of the next even-numbered frame (step S42b).

According to the moving image display algorithm as described above, reception and processing operations for odd and even frames are alternately performed. As a result, the receiving and processing operations can be twice as fast as a result, so that the computer 5 completely receives and processes all the image data inputted from the video presenter 1 at high speed so that the moving image is transmitted to the monitor 2. Can be displayed.

FIG. 5 shows the video display step S4 of FIG. 3 in more detail. Steps S41a1, S41a2, and S41a3 of FIG. 5 are included in step S41a of FIG. 4. Steps S41b1, S41b2, and S41b3 of FIG. 5 are included in step S41b of FIG. 4. Steps S42a1, S42a2, and S42a3 of FIG. 5 are included in step S42a of FIG. 4. Steps S42b1, S42b2, and S42b3 of FIG. 5 are included in step S42b of FIG. 4. Referring to Figures 1, 2, 4, and 5 will be described in more detail the video display step (S4) of Figure 3 as follows.

In step S41a of receiving the odd-frame data, the central processing element of the computer 5 first requests the microprocessor 101 of the video presenter 1 for the odd-frame data (step S41a1). As a result, the microprocessor 101 of the video presenter 1 controls the memory control unit 107, and transmits data of the full standard frame from the memory control unit 107 via the USB interface 109 to the computer 5. To send. When the odd frame data is input from the video presenter 1, the central processing element of the computer 5 stores the input "Y: Cb: Cr 4: 2: 2" frame data in the first buffer ( Steps S41a2 and S41a3).

In the step S41b of processing the data of the even-numbered frame which is performed simultaneously with the step S41a, the central processing element of the computer 5 first forms the "Y: Cb: Cr 4: 2: 2" format stored in the second buffer. Frame data is converted into frame data in RGB (Red-Green-Blue) 24 format (step S41b1). Next, the central processing element of the computer 5 sends the image data of the RGB (Red-Green-Blue) 24 format to be used in the Graphic Device Interface (GDI) of the operating system (OS) of the computer 5. The data is converted into frame data in the (Device Independent Bitmap) format (step S41b2). Then, the central processing element of the computer 5 outputs frame data in the DIB (Device Independent Bitmap) format to the GDI (Graphic Device Interface) (step S41b3). Accordingly, the frame data of the full standard from the video presenter 1 is displayed by the OS (Operating System) of the computer 5.

In the step S42a of processing the odd-frame data, the central processing element of the computer 5 first outputs the RGB (Red) frame data of the "Y: Cb: Cr 4: 2: 2" format stored in the first buffer. (Green-Blue) to frame data of 24 format (step S42a1). Next, the central processing element of the computer 5 sends the image data of the RGB (Red-Green-Blue) 24 format to be used in the Graphic Device Interface (GDI) of the operating system (OS) of the computer 5. The data is converted into frame data in the (Device Independent Bitmap) format (step S42a2). Then, the central processing element of the computer 5 outputs frame data in the DIB (Device Independent Bitmap) format to the GDI (Graphic Device Interface) (step S42a3). Accordingly, the frame data from the video presenter 1 is displayed by the operating system (OS) of the computer 5.

In step S42b of receiving data of an even-numbered frame performed simultaneously with the step S42a, the central processing element of the computer 5 first sends data of the even-numbered frame to the microprocessor 101 of the video presenter 1. Request (step S42b1). As a result, the microprocessor 101 of the video presenter 1 controls the memory control unit 107, and transmits data of the full standard frame from the memory control unit 107 via the USB interface 109 to the computer 5. To send. When data of even-numbered frames are input from the video presenter 1, the central processing element of the computer 5 transmits the input "Y: Cb: Cr 4: 2: 2" format frame data different from the first buffer. 2 is stored in the buffer (steps S42b2 and S42b3).

1, 2, and 6, the algorithm for processing the frame data in the still image capture step (S6) of Figure 3 will be described in detail as follows.

First, the central processing element of the computer 5 requests frame data from the microprocessor 101 of the video presenter 1 (step S601). As a result, the microprocessor 101 of the video presenter 1 controls the memory control unit 107, and transmits data of the full standard frame from the memory control unit 107 via the USB interface 109 to the computer 5. To send.

When the frame data of the full standard is input from the video presenter 1 (step S602), the central processing element of the computer 5 converts the input frame data of the "Y: Cb: Cr 4: 2: 2" format into red (R). ), And are converted to the " RGB24 " format, which are well known as green (G) and blue (B) formats (step S603). Further, the frame data of the " RGB24 " format is converted into a " Device Independent Bitmap (DIB) " format so that it can be used in the GDI (Graphic Device Interface) of the operating system (Operating System) (step S604).

In this case, as the frame data is converted into the "RGB24" format in step S603, the reproducibility of the image may be deteriorated. Accordingly, the central processing element of the computer 5 performs dithering on the frame data of the full standard in the "Device Independent Bitmap" (DIB) format (step S605). Here, dithering is an image processing technique well known as a digital halftone processing technique.

Then, the central processing element of the computer 5 outputs the frame data of the "Device Independent Bitmap (DIB)" format to the Graphic Device Interface (GDI) (step S606). Accordingly, the frame data from the video presenter 1 is displayed by the operating system (OS) of the computer 5.

Next, the central processing element of the computer 5 stores the frame data of the " Device Independent Bitmap (DIB) " format in the frame buffer (step S607). Next, the central processing element of the computer 5 waits for a storage signal or a capture end signal from the user. When the storage signal is input from the user, the central processing element of the computer 5 stores the data stored in the frame buffer in the folder designated by the user (steps S608 and S609). When the capture end signal is input from the user, the performance of the still image capturing step S6 is terminated (step S610).

As described above, according to the image data processing method according to the present invention, reception and processing operations for odd and even frames are alternately performed. Accordingly, the receiving and processing operations can be twice as fast as a result, so that the computer can completely receive and process all of the image data input from the video presenter at high speed to display the moving image.

The present invention is not limited to the above embodiments, but may be modified and improved by those skilled in the art within the spirit and scope of the invention as defined in the claims.

Claims (11)

In the image data processing method for a computer to process the image data from the video presenter to display a moving image and to capture a still image when a still image capture signal is generated, The step of displaying the video, (a) receiving data of an odd numbered frame; (b) process and display data of the received odd-numbered frame and receive data of the next even-numbered frame; (c) process and display data of the even-numbered frame and receive data of the next odd-numbered frame; And (d) image data processing method comprising repeatedly performing steps (b) and (c) alternately. The method of claim 1, wherein in receiving the data of the odd frame in the steps (a) and (c), Requesting an odd number of frames of data from the video presenter; And And when the odd frame data is input from the video presenter, storing the input frame data in a first buffer. The method of claim 2, wherein in processing the data of an odd numbered frame in the step (b), Converting frame data stored in the first buffer into frame data of a red-green-blue (RGB) format; Converting the image data of the RGB (Red-Green-Blue) format into frame data of the Device Independent Bitmap (DIB) format; And And outputting the frame data in the device independent bitmap (DIB) format to a graphic device interface (GDI). The method of claim 3, wherein in receiving the data of the even frame in the step (b), Requesting an even-numbered frame of data from the video presenter; And And storing the input frame data in a second buffer when data of an even frame is input from the video presenter. The method of claim 4, wherein in processing the data of the even-numbered frame in the step (c), Converting frame data stored in the second buffer into frame data of a red-green-blue (RGB) format; Converting the image data of the RGB (Red-Green-Blue) format into frame data of the Device Independent Bitmap (DIB) format; And And outputting the frame data in the device independent bitmap (DIB) format to a graphic device interface (GDI). The method of claim 1, And the step (d) is performed until the still image capture signal is generated. The method of claim 1, wherein capturing the still image comprises: (e) requesting frame video from the video presenter; (f) converting the input frame data into frame data in a red-green-blue format when frame data is input from the video presenter; (g) converting the image data of the RGB (Red-Green-Blue) format into frame data of the Device Independent Bitmap (DIB) format; (h) outputting the frame data in the Device Independent Bitmap (DIB) format to a Graphic Device Interface (GDI); (i) storing the frame data of the device independent bitmap (DIB) format in a frame buffer; And (j) A method of processing image data including waiting for a signal from a user. The method of claim 7, wherein And storing a data stored in the frame buffer in a designated folder when a storage signal is input from a user. The method of claim 7, wherein And displaying the moving image when a capture end signal is input from a user. The method of claim 7, wherein step (h) is (h1) performing half-tone processing on the frame data of the device independent bitmap (DIB) format; And and (h2) outputting frame data subjected to the half-tone processing to the graphic device interface (GDI). The method according to claim 10, wherein in step (h1), And the half-tone processing is performed by dithering.

Images