KR20240030921A - System for providing user centric multiview and method thereof - Google Patents

Abstract

The present invention discloses a user-centered multi-view providing system and method. In other words, the present invention provides a multi-view of one or more sub-screens according to the user's selection in addition to the main screen provided by live streaming, so that the user can freely directly select multiple broadcast images and watch multiple broadcast images simultaneously. By allowing you to obtain more information than before, you can watch only the parts you want, and content that requires a screen from multiple angles can be provided in a more realistic way.

Description

System for providing user centric multiview and method thereof}

The present invention relates to a user-centered multi-view provision system and method. In particular, a user-centered multi-view provision system that provides one or more sub-screens according to user selection as a multi-view in addition to the main screen provided by live streaming, and a user-centered multi-view provision system and method. It's about how.

Live streaming refers to playing music or video files in real time while connected to the Internet, without downloading or storing them on a portable terminal such as a smartphone or computer, or such a playback technology or technique.

In this type of live streaming, multiple video targets are selected through a switcher, and videos according to the selected video targets are streamed in real time to the broadcast screen.

Accordingly, users are only provided with broadcast screens edited by broadcast editors, and users are not provided with the video they want on time.

Korean Patent Publication No. 10-2020-0022640 [Title: Segmented image selection system and method using a high-definition camera]

The purpose of the present invention is to provide a user-centered multi-view provision system and method that provides one or more sub-screens according to user selection as a multi-view in addition to the main screen provided by live streaming.

Another object of the present invention is to provide a user-centered multi-view providing system that configures a main screen under editor control and the plurality of video information into a single screen among a plurality of video information captured for live streaming and provides it to the user through a server. and providing a method thereof.

A user-centered multi-view providing system according to an embodiment of the present invention includes a server that stores broadcast content for a plurality of performance information; And when specific performance information is selected from one or more performance information provided by a website accessed through a web browser, the basic information corresponding to the specific performance information transmitted from the server is linked with the server that manages the website. Receive broadcast content including a screen, coordinate information for the basic screen, and audio information synchronized to the main screen, and use a script language that works with the web browser to receive coordinate information for the basic screen in the received broadcast content. As a basis, it may include a user terminal that separates a main screen and a plurality of resolution setting sub-video information from the basic screen, and renders and outputs audio information synchronized to the separated main screen and the received main screen.

As an example related to the present invention, the basic screen includes a main screen corresponding to image information selected from among a plurality of image information acquired by a plurality of main cameras, and a plurality of sub image information acquired by a plurality of sub cameras. It may be composed of a plurality of resolution setting sub-video information with a set resolution.

The user-centered multi-view provision method according to an embodiment of the present invention is when specific performance information is selected from one or more performance information provided by a website accessed through a web browser on a user terminal, by the user terminal, the web In conjunction with a server that manages the site, receiving broadcast content including a basic screen corresponding to the specific performance information transmitted from the server, coordinate information for the basic screen, and voice information synchronized to the main screen; By the user terminal, a main screen and a plurality of resolution setting sub-video information are separated from the basic screen based on coordinate information about the basic screen in the received broadcast content using a script language that interoperates with the web browser. step; and rendering and outputting, by the user terminal, voice information synchronized to the separated main screen and the received main screen.

As an example related to the present invention, the step of receiving the broadcast content includes, when specific performance information is selected among the one or more performance information, the user terminal sends the selected specific performance information and the identification information of the user terminal to the server. The process of transferring to; Confirming, by the server, broadcast content corresponding to the specific performance information among a plurality of broadcast content for each performance information pre-stored in the server; transmitting, by the server, the broadcast content including a basic screen related to the confirmed broadcast content, coordinate information for the basic screen, and voice information synchronized to the main screen to the user terminal; and receiving the broadcast content transmitted from the server by the user terminal.

As an example related to the present invention, when a preset marker displayed on one side of the main screen in the user terminal is selected, the size of the main screen is adjusted by the user terminal to a preset area in the screen of the user terminal. The method may further include displaying the plurality of separated resolution-set sub-video information in the form of thumbnails in another preset area of the screen of the user terminal.

As an example related to the present invention, when one resolution setting sub-image information is selected among a plurality of resolution setting sub-image information in the form of a thumbnail displayed on one side of the screen in the user terminal, by the user terminal, the user terminal The size of the main screen is adjusted and displayed in a preset area 2-1 of the screen of the user terminal, and the screen size of the selected resolution setting sub-video information is adjusted and displayed in a preset area 2-2 of the screen of the user terminal. The method may further include displaying on a screen, and displaying the plurality of separated resolution setting sub-video information in the form of thumbnails in preset areas 2-3 of the screen of the user terminal.

As an example related to the present invention, a touch gesture by the user of the user terminal for any one resolution setting sub-image information among a plurality of resolution setting sub-image information in the form of a thumbnail displayed on one side of the screen in the user terminal is detected. At this time, the size of the main screen is adjusted and displayed by the user terminal in a preset 2-1 area of the screen of the user terminal, and the selected resolution is displayed in a preset 2-2 area of the screen of the user terminal. It further includes the step of adjusting the screen size of the setting sub-video information to display it as a sub-screen, and displaying the plurality of separated resolution setting sub-video information in the form of thumbnails in preset second and third areas of the screen of the user terminal. In addition, touch gestures by the user of the user terminal include tap, touch & hold, double tap, drag, flick, and swipe. It can include either one.

As an example related to the present invention, when a touch gesture by a user of the user terminal is detected for any one sub-screen among one or more sub-screens displayed on one side of the screen in the user terminal, the screen is displayed by the user terminal. The method may further include deleting the sub-screen corresponding to the other touch gesture and then reconstructing and displaying the screen.

As an example related to the present invention, by the user terminal, among the main screen and one or more sub screens displayed on the user terminal, by touching and dragging the outline of the main screen or the sub screen, within the screen adjusting the divided screen size; Among the main screen and the one or more sub-screens displayed on the user terminal, when a pinch by the user of the user terminal occurs on the main screen or the sub-screen, the main screen or the sub-screen is displayed by the user terminal on the screen. adjusting the size of the sub screen; And among the main screen and one or more sub-screens displayed on the user terminal, when a drag and drop by a user of the user terminal on the main screen or the sub-screen occurs, by the user terminal, within the screen. It may further include adjusting the position of the main screen or the sub screen.

As an example related to the present invention, among a plurality of resolution setting sub-image information in the form of thumbnails displayed on one side of the screen in the user terminal, another specific resolution setting sub-image information is dragged and dropped by the other specific resolution setting sub-image information. When video information is selected and then dragged and dropped to the main screen location, the method may further include exchanging and displaying the main screen and the selected other specific resolution setting sub-video information by the user terminal.

The present invention provides a multi-view of one or more sub-screens according to the user's selection in addition to the main screen provided by live streaming, so that the user can freely directly select multiple broadcast images and watch multiple broadcast images at the same time. As a result, you can obtain more information than before, watch only the parts you want, and in the case of content that requires a screen from multiple angles, you can provide it with a more realistic feel.

In addition, the present invention configures the main screen according to editor control and the plurality of video information into one screen among the plurality of video information captured for live streaming and provides it to the user through the server, so that multiple cameras can be used in real-time broadcasting. It has the effect of resolving the phenomenon of synchronization between multiple video information captured through and audio information collected through one or more microphones.

Figure 1 is a block diagram showing the configuration of a user-centered multi-view providing system according to an embodiment of the present invention.
Figures 2 and 3 are flowcharts showing a user-centered multi-view providing method according to an embodiment of the present invention.
Figure 4 is a diagram showing an example of a basic screen according to an embodiment of the present invention.
5 to 14 are diagrams showing examples of screens of a user terminal according to an embodiment of the present invention.

It should be noted that the technical terms used in the present invention are only used to describe specific embodiments and are not intended to limit the present invention. In addition, the technical terms used in the present invention, unless specifically defined in a different sense in the present invention, should be interpreted as meanings generally understood by those skilled in the art in the technical field to which the present invention pertains, and are not overly comprehensive. It should not be interpreted in a literal or excessively reduced sense. Additionally, if the technical terms used in the present invention are incorrect technical terms that do not accurately express the idea of the present invention, they should be replaced with technical terms that can be correctly understood by those skilled in the art. In addition, general terms used in the present invention should be interpreted according to the definition in the dictionary or according to the context, and should not be interpreted in an excessively reduced sense.

Additionally, as used in the present invention, singular expressions include plural expressions unless the context clearly dictates otherwise. In the present invention, terms such as “consists of” or “comprises” should not be construed as necessarily including all of the various components or steps described in the invention, and some of the components or steps may not be included. It may be possible, or it should be interpreted as being able to further include additional components or steps.

Additionally, terms containing ordinal numbers, such as first, second, etc., used in the present invention may be used to describe constituent elements, but the constituent elements should not be limited by the terms. Terms are used only to distinguish one component from another. For example, a first component may be named a second component without departing from the scope of the present invention, and similarly, the second component may also be named a first component.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the attached drawings. However, identical or similar components will be assigned the same reference numbers regardless of the reference numerals, and duplicate descriptions thereof will be omitted.

Additionally, when describing the present invention, if it is determined that a detailed description of related known technologies may obscure the gist of the present invention, the detailed description will be omitted. In addition, it should be noted that the attached drawings are only intended to facilitate easy understanding of the spirit of the present invention, and should not be construed as limiting the spirit of the present invention by the attached drawings.

Figure 1 is a block diagram showing the configuration of a user-centered multi-view providing system 10 according to an embodiment of the present invention.

As shown in FIG. 1, the user-centered multi-view providing system 10 includes a plurality of main cameras 100, a plurality of microphones 200, a plurality of sub cameras 300, a switcher 400, and a field terminal ( 500), a server 600, and a user terminal 700. Not all of the components of the user-centered multi-view providing system 10 shown in FIG. 1 are essential components, and the user-centered multi-view providing system 10 is made up of more components than those shown in FIG. 1. This may be implemented, or the user-centered multi-view providing system 10 may be implemented with fewer components.

The field terminal 500 and the user terminal 700 include a smart phone, a portable terminal, a mobile terminal, a foldable terminal, and a personal digital assistant. : PDA, PMP (Portable Multimedia Player) terminal, telematics terminal, navigation terminal, personal computer, laptop computer, Slate PC, tablet PC, ultrabook (ultrabook), wearable devices (e.g., smartwatch, smart glass, head mounted display (HMD), etc.), Wibro terminal, IPTV (Internet Protocol Television) ) can be applied to various terminals such as terminals, smart TVs, digital broadcasting terminals, AVN (Audio Video Navigation) terminals, A/V (Audio/Video) systems, flexible terminals, digital signage devices, kiosks, etc. You can.

The server 600 may be implemented in the form of a web server, database server, proxy server, etc. In addition, the server 600 may be equipped with a network load balancing mechanism or one or more of various software that allows the server 600 to operate on the Internet or other networks, and can be implemented as a computerized system through this. You can. Additionally, the network may be an http network, a private line, an intranet, or any other network. Furthermore, the connection between the plurality of main cameras 100, the plurality of microphones 200, the plurality of sub cameras 300, the switcher 400, the field terminal 500, the server 600, and the user terminal 700 provides data can be connected to a secure network to avoid attacks by random hackers or other third parties. Additionally, the server 600 may include a plurality of database servers, and these database servers may be implemented in such a way that they are separately connected to the server 600 through any type of network connection, including a distributed database server architecture. there is.

The plurality of main cameras 100, the plurality of microphones 200, the plurality of sub cameras 300, the switcher 400, the field terminal 500, the server 600, and the user terminal 700 ) Each includes a communication unit (not shown) to perform communication functions with other terminals, a storage unit (not shown) to store various information and programs (or applications), and a display unit to display various information and program execution results. (not shown), an audio output unit (not shown) for outputting audio information corresponding to the various information and program execution results, and a control unit (not shown) for controlling various components and functions of each terminal. You can.

The plurality of main cameras 100 include the plurality of microphones 200, the plurality of sub cameras 300, the switcher 400, the field terminal 500, the server 600, and the user terminal 700. ) communicate with others. Here, the plurality of main cameras 100 may be main devices that acquire image information related to the scene (or performance hall) under the control of an expert.

Additionally, the main camera 100 processes image frames such as still images or moving images obtained by an image sensor (camera module or camera) in video call mode, shooting mode, video conference mode, etc. That is, the image data obtained by the image sensor is encoded/decoded according to the codec (CODEC) to meet each standard. The processed image frame may be displayed on a display/display unit (not shown) configured on one side of the main camera 100. As an example, the main camera 100 captures an object (or subject) (user image or video conference participant) and outputs a video signal corresponding to the captured image (subject image).

In addition, the image frame processed by the main camera 100 is stored in a memory (not shown) configured (or installed) in the main camera 100 or sent to the switcher 400 and the field through a communication unit (not shown). It may be transmitted to the terminal 500, the server 600, the user terminal 700, etc.

Additionally, the plurality of main cameras 100 each acquire (or photograph) a plurality of image information related to the scene (or performance hall).

That is, the plurality of main cameras 100, which are respectively installed or configured to be movable at a plurality of preset locations in the field, each acquire a plurality of image information (or (filming/collecting). Here, the main camera 100 can acquire the image information at a preset resolution. At this time, the preset resolution (or format) is HD (High Definition, 1280×720), FHD (Full High Definition, 1920×1080), QHD (Quad High Definition, 2560×1440), and UHD (Ultra High Definition, 3840). ×2160), SUHD (Super Ultra High Definition, 7680×4320), etc.

In addition, the plurality of main cameras 100 transmit the acquired (or photographed) plurality of image information, visual information (or synchronization/sync signal information), identification information of the main camera 100, etc. to the switcher ( 400) and transmit (or provide) it. Here, the identification information of the main camera 100 includes mobile IP, mobile MAC, SIM (subscriber identification module) card unique information, serial number, etc.

In this way, the plurality of main cameras 100 can transmit image information acquired (or filmed) in real time in the field to the switcher 400.

The plurality of microphones 200 are connected to the plurality of main cameras 100, the plurality of sub cameras 300, the switcher 400, the field terminal 500, the server 600, and the user terminal 700. ) communicate with others. Here, the plurality of microphones 200 may be a main device for acquiring (or collecting) voice information (or sound/voice signal/information) related to the field under the control of an expert at the field (or performance hall). .

In addition, the microphone 200 receives external sound signals (including the user's voice (voice signal or voice information)) through a microphone in call mode, recording mode, voice recognition mode, video conference mode, video call mode, etc. It receives and processes it into electrical voice data. Additionally, the processed voice data can be output through a speaker (not shown) configured on one side of the microphone 200 or converted into a form that can be transmitted to an external terminal through a communication unit (not shown). Additionally, the microphone 200 may be implemented with various noise removal algorithms to remove noise generated in the process of receiving an external acoustic signal.

Additionally, the plurality of microphones 200 each collect (or obtain) a plurality of voice information (or sound information) related to the scene (or performance hall).

That is, the plurality of microphones 200, respectively installed or movable in a plurality of different preset locations in the field, each collect (or acquire) a plurality of voice information related to the field.

In addition, the plurality of microphones 200 transmit the collected (or acquired) plurality of voice information, visual information (or synchronization/sync signal information), identification information of the corresponding microphone 200, etc. to the switcher 400. ) is transmitted (or provided) to. Here, the identification information of the microphone 200 includes mobile IP, mobile MAC, SIM (subscriber identification module) card unique information, serial number, etc.

In this way, the plurality of microphones 200 can transmit voice information acquired (or collected) in real time in the field to the switcher 400.

The plurality (or one or more) sub cameras 300 include the plurality of main cameras 100, the plurality of microphones 200, the switcher 400, the field terminal 500, the server 600, It communicates with the user terminal 700, etc. Here, the sub-camera 300 may be configured in an independent form or may be configured in an embedded form on one side of a terminal (not shown) possessed by any user located in the field. At this time, the terminal is a smartphone, mobile terminal, mobile terminal, foldable terminal, personal information terminal, PMP terminal, telematics terminal, navigation terminal, personal computer, laptop computer, slate PC, tablet PC, ultrabook, wearable device, etc. It can be applied to various terminals.

Additionally, the sub camera 300 processes image frames such as still images or moving images obtained by an image sensor (camera module or camera) in video call mode, shooting mode, video conference mode, etc. That is, the corresponding image data obtained by the image sensor is encoded/decoded according to the codec to meet each standard. The processed image frame may be displayed on a display/display unit (not shown) configured on one side of the sub-camera 300. As an example, the sub-camera 300 captures an object (or subject) (user image or video conference participant) and outputs a video signal corresponding to the captured image (subject image).

In addition, the image frame processed by the sub-camera 300 is stored in a memory (not shown) configured (or installed) in the corresponding sub-camera 300 or sent to the switcher 400 and the field through a communication unit (not shown). It may be transmitted to the terminal 500, the server 600, the user terminal 700, etc.

Additionally, the plurality (or one or more) sub cameras 300 each acquire (or photograph) a plurality of (or one or more) sub image information related to the scene (or performance hall). Here, the sub-camera 300 can acquire the image information at a preset resolution. At this time, the preset resolution (or format) includes HD, FHD, QHD, UHD, SUHD, etc.

That is, the plurality of sub cameras 300 are installed or configured to be movable at a plurality of different preset locations in the field, and are divided into a plurality of (or one) cameras under the control of another photographer who controls each sub camera 300. (or above) sub-video information is acquired (or photographed/collected) respectively. At this time, the sub-camera 300, which corresponds one-to-one to a specific performer (or a specific place/area) performing at the scene, is a specific performer (or a specific location) assigned (or set/corresponding to) the sub-camera 300. Only sub-video information related to /area) can be acquired (or filmed).

In addition, the plurality of sub cameras 300 may display the acquired (or photographed) plurality of sub image information, visual information (or synchronization/sync signal information), identification information of the corresponding sub camera 300, etc. It is transmitted (or provided) to the terminal 500. Here, the identification information of the sub camera 300 includes mobile IP, mobile MAC, SIM (subscriber identification module) card unique information, serial number, etc.

In this way, the plurality of sub cameras 300 can transmit image information related to a specific person acquired (or photographed) in real time at the site to the field terminal 500.

The switcher 400 includes the plurality of main cameras 100, the plurality of microphones 200, the plurality of sub cameras 300, the field terminal 500, the server 600, and the user. Communicates with terminal 700, etc.

In addition, the switcher 400 is a video mixer that is used to select a plurality of video information, can synthesize video and add special effects, and processes audio information (or audio information/signal) together with video information.

In addition, the switcher 400 includes a plurality of image information transmitted (or provided) from the plurality of main cameras 100 and the plurality of microphones 200, visual information, identification information of the main camera 100, A plurality of voice information, visual information, identification information of the corresponding microphone 200, etc. are received.

In addition, the switcher 400 selects one specific video information among the plurality of received video information and the plurality of received voices according to the editor selection (or user/editor input/touch/control) of the switcher 400. One or more voice information among the information is edited (or switched) and transmitted to the field terminal 500. At this time, the specific video information transmitted to the field terminal 500 by the switcher 400 becomes the main screen displayed on the user terminal 700, which is an end user, and is displayed on the field terminal 500 by the switcher 400. ) may be the main voice information output from the user terminal 700.

That is, the switcher 400 bypasses any one specific video information among the plurality of video information and transmits it to the field terminal 500 according to the editor control, and transmits one specific video information from the plurality of audio information. The above voice information is bypassed and transmitted to the field terminal 500. At this time, the switcher 400 bypasses not only the specific video information and the one or more audio information, but also the visual information related to the specific video information and the visual information related to the one or more audio information, thereby bypassing the field terminal 500. ) is sent to

The field terminal 500 includes the plurality of main cameras 100, the plurality of microphones 200, the plurality of sub cameras 300, the switcher 400, the server 600, and the user terminal 700. ) communicate with others. Here, the field terminal 500 may be a terminal (or device/device) that comprehensively manages a plurality of video information, a plurality of audio information, a plurality of sub-video information, etc. collected at the relevant site (or performance hall).

In addition, the field terminal 500 receives a plurality of sub-image information, visual information, identification information of the corresponding sub-camera 300, etc. transmitted from each of the plurality of sub-cameras 300.

Additionally, the field terminal 500 receives specific video information transmitted from the switcher 400, one or more audio information transmitted from the switcher 400, visual information, etc.

Additionally, the field terminal 500 configures (or creates) a main screen based on the received specific video information according to administrator input (or administrator/user selection/touch/control).

Additionally, the field terminal 500 configures the one or more received voice information as main voice information.

Additionally, the field terminal 500 synchronizes the configured main screen with the one or more received voice information, and configures (or generates) voice information synchronized to the main screen. At this time, the field terminal 500 synchronizes the main screen and the one or more audio information based on visual information related to specific video information corresponding to the configured main screen and visual information related to the one or more audio information.

Additionally, the field terminal 500 configures (or generates) one basic screen based on the configured main screen and the received plurality of sub-video information.

That is, the field terminal 500 sets (or determines) the resolution of each of the plurality of sub-video information according to the number of the received plurality of sub-video information at a certain ratio of the resolution of the configured main screen, Create (or configure/form) resolution setting sub-video information.

In addition, the field terminal 500 configures (or creates) one basic screen by combining the configured main screen and a plurality of resolution setting sub-video information for which the resolution is set.

In the embodiment of the present invention, the field terminal 500 mainly uses the main screen and the received plurality of sub-video information to configure the basic screen, but the field terminal 500 is not limited to this, and the field terminal 500 uses both the main screen and the plurality of received sub-video information to configure the basic screen. The terminal 500 may select at least one sub-video information from among the plurality of sub-video information according to administrator control, and configure one basic screen based on the main screen and the selected at least one sub-video information. there is.

For example, in a state of receiving four sub-video information, the field terminal 500 selects two sub-video information among the four sub-video information according to the administrator's selection, and combines the selected two sub-video information and the Construct one basic screen based on the configured main screen.

In this way, in a state where four sub-video information is actually provided and two sub-video information are included in the basic screen and provided to the user terminal 700, the field terminal 500 is connected to the server ( 600) and the user terminal 700, when the user terminal 700 requests any one of the remaining two sub-video information other than the two sub-video information included in the basic screen. , any sub-video information requested by the user terminal 700 may be provided to the user terminal 700.

In addition, the field terminal 500 displays broadcast content including the configured (or created) basic screen (or one basic screen), coordinate information for the configured basic screen, voice information synchronized to the main screen, etc. Transmitted to the server 600. Here, the coordinate information for the basic screen includes coordinate information for the corresponding main screen on the basic screen, coordinate information for each sub-video information for multiple resolution settings, and is based on the upper left vertex in a square shape (x, y , width, height). At this time, the x and y represent the x and y coordinates of the corresponding upper left vertex, the width represents the horizontal length information of the square, and the height represents the vertical length information of the square.

The server 600 includes the plurality of main cameras 100, the plurality of microphones 200, the plurality of sub cameras 300, the switcher 400, the field terminal 500, and the user terminal 700. ) communicate with others. Here, the server 600 may be a server that provides broadcast content to the user terminal 700 in real time, such as Amazon's Amazon Web Services (AWS), Naver's real-time broadcast server, YouTube, and broadcasting station server. Includes etc.

Additionally, the server 600 performs membership registration procedures for users such as the user terminal 700.

Additionally, the server 600 registers personal information related to users such as the user terminal 700. At this time, the server 600 registers (or manages) the relevant personal information, etc. in a DB server (not shown), and receives consent to use personal information in the form of an electronic document in advance from the user of the corresponding user terminal 700. It may be a state.

Additionally, the server 600 performs a member management function for users such as the user terminal 700.

In addition, the server 600 provides a dedicated app and/or website that provides a broadcast streaming service function, a broadcast content provision function, etc. to the user terminal 700, etc.

Additionally, the server 600 provides a bulletin board function for announcements, events, etc.

Additionally, the server 600 receives broadcast content including a basic screen transmitted from the field terminal 500, coordinate information for the basic screen, and voice information synchronized to the main screen.

In addition, the server 600 maps broadcast content including the received basic screen, coordinate information for the basic screen, voice information synchronized to the main screen, etc. with performance information related to the site (or performance hall), and maps it to the corresponding server. It is stored (or registered) in (600) (or database (not shown)). Here, the performance information includes performance name, performance date and time, performance location, running time, introduction information, cast information, agency information, etc.

In addition, when specific performance information is selected among one or more performance information displayed on the user terminal 700 according to user selection (or user input/touch/control) of the user terminal 700, the server 600 Specific performance information transmitted from the user terminal 700, identification information of the user terminal 700, etc. are received.

Additionally, the server 600 confirms (or searches for) broadcast content corresponding to the received specific performance information among a plurality of broadcast content for each performance information previously stored (or registered) in the server 600.

In addition, the server 600 uses a preset transmission protocol to transmit the broadcast content, including the basic screen related to the confirmed (or searched) broadcast content, coordinate information for the basic screen, and voice information synchronized to the main screen. and transmits it to the user terminal 700. At this time, the server 600 optimally configures the basic screen related to the confirmed (or searched) broadcast content, coordinate information for the basic screen, and the main screen in consideration of the Adaptive Bitrate Streaming (ABR) of the user terminal 700. Voice information synchronized to the screen may also be transmitted to the user terminal 700. Additionally, the transmission protocol includes Real-Time Messaging Protocol (RTMP), HLS (Https Live Streaming), WebRTC (Web Real-Time Communication), etc.

The user terminal 700 includes the plurality of main cameras 100, the plurality of microphones 200, the plurality of sub cameras 300, the switcher 400, the field terminal 500, and the server 600. ) communicate with others. Here, the user terminal 700 may be a terminal owned by a user who receives a broadcast streaming service function, a broadcast content provision function, etc. provided in real time at the site (or performance hall).

In addition, the user terminal 700 is used to receive broadcast streaming service functions, broadcast content provision functions, etc. through a dedicated app and/or website provided by the server 600 by linking with the server 600. A user registers as a member and registers personal information, etc. in the server 600. At this time, the personal information includes ID, email address, password (or password), name, gender, date of birth, contact information, address (or address information), etc.

Additionally, the user terminal 700 may register as a user on the server 600 using SNS account information or other site account information registered by the user of the user terminal 700. Here, the SNS account may be information related to Facebook, Twitter, Instagram, Kakao Story, Naver Blog, etc. Additionally, the other site account may be information related to YouTube, Kakao, Naver, etc.

In addition, when performing the membership registration process, the user terminal 700 must complete the authentication function through an identity authentication method (including mobile phone, credit card, i-PIN, etc.) to complete the membership registration process for the server 600. It can be completed normally.

In addition, after membership registration is completed, the user terminal 700 opens a dedicated app (or application/application/specific app) provided by the server 600 in order to use the service provided by the server 600. Installed on the corresponding user terminal (700). At this time, the dedicated app includes Native App, Mobile WebApp, Responsive Web App (Mobile WebApp Design: RWD), Adaptive Web Design (AWD), Hybrid App, etc. It may be an app for performing broadcast streaming service functions, broadcast content provision functions, etc.

Additionally, after membership registration is completed, the user terminal 700 can display a discount coupon provided by the server 600 through the corresponding dedicated app. At this time, the discount coupon may be a discount coupon that includes discount information of a certain percentage when using the broadcast streaming service function, broadcast content provision function, etc. provided by the server 600.

Additionally, the user terminal 700 accesses (or connects to) a website (or URL link) provided by the server 600 through a web browser.

Additionally, the user terminal 700 receives one or more performance information provided by the connected website and displays (or outputs) the one or more performance information received. Here, the performance information includes performance name, performance date and time, performance location, running time, introduction information, cast information, agency information, etc.

In addition, when specific performance information is selected among one or more performance information displayed on the user terminal 700 according to user selection (or user input/touch/control) of the user terminal 700, the user terminal 700 In conjunction with the server 600 that manages the website, the basic screen corresponding to the specific performance information transmitted from the server 600, coordinate information for the basic screen, voice information synchronized to the main screen, etc. Receive broadcast content including.

That is, when specific performance information is selected among one or more performance information displayed on the user terminal 700 according to user selection (or user input/touch/control) of the user terminal 700, the user terminal 700 Transmits the selected specific performance information, identification information of the user terminal 700, etc. to the server 600. Here, the identification information of the user terminal 700 includes MDN (Mobile Directory Number), mobile IP, mobile MAC, SIM (subscriber identity module) card unique information, serial number, etc.

Additionally, the user terminal 700 receives the broadcast content including a basic screen transmitted from the server 600, coordinate information for the basic screen, and voice information synchronized to the main screen. Here, the broadcast content may be real-time broadcast content (or real-time broadcast stream).

In addition, the user terminal 700 uses a script language (including, for example, JavaScript, etc.) that works with the corresponding web browser to select a main screen and a plurality of screens from the basic screen based on the coordinate information about the received basic screen. The resolution setting sub-video information (or a plurality of sub-video information whose resolution has been reset) is separated (or divided/organized).

Additionally, the user terminal 700 renders and outputs voice information synchronized to the separated (or divided/configured) main screen and the received corresponding main screen. At this time, the user terminal 700 displays the main screen on the entire screen of the user terminal 700 or a partial area of the entire screen. In addition, the user terminal 700 displays a marker on one side of the screen (or full screen/partial screen) on which the main screen is displayed, and on the other side of the screen (or full screen/partial screen) on which the main screen is displayed. Display another marker on . Here, the marker (or sub-video marker) is used to additionally display the plurality of separated resolution setting sub-video information in the form of a thumbnail, and the other marker (or chat marker) is used to control the server 600. It may be used to perform a chat function between the user terminal 700 and one or more other user terminals (not shown).

In this way, the user terminal 700 links with the server 600 for broadcast content corresponding to specific performance information selected by the user of the user terminal 700, and performs real-time stringing for the broadcast content in real time. can be provided.

In addition, when a preset marker displayed on one side of the main screen in the user terminal 700 is selected, the user terminal 700 selects a preset area (or area 1-1) of the screen of the user terminal 700. ), the size of the main screen (or the resolution of the main screen) is adjusted (or adjusted) and displayed in another preset area (or 1-2 area/remaining area) of the screen of the user terminal 700. The separated (or divided/organized) plurality of resolution setting sub-video information is displayed in the form of a thumbnail. At this time, the resolution setting sub-video information (for example, resolution 360 × 540) may be displayed in the form of a thumbnail with the resolution reset (for example, 180 × 270).

In addition, when a preset marker displayed on one side of the main screen in the user terminal 700 is selected, the user terminal 700 displays the main screen, which is the lower layer, on a screen divided into a lower layer and an upper layer. The plurality of separated resolution setting sub-video information, which are upper layers, may be displayed in the form of a thumbnail on one side of the screen (including, for example, the right area, etc.).

In addition, when any one resolution setting sub-video information is selected among a plurality of resolution setting sub-video information in the form of thumbnails displayed on one side of the screen in the user terminal 700, the user terminal 700 displays the corresponding user terminal ( The size of the main screen (or the resolution of the main screen) is re-adjusted (or adjusted) and displayed in the preset 2-1 area of the screen of the corresponding user terminal 700, and the preset 2-1 area of the screen of the corresponding user terminal 700 is displayed. - Adjust (or adjust) the screen size of the selected resolution setting sub-video information in area 2 and display it as a sub-screen, and display it as a sub-screen in the separated (or divided) area in preset areas 2-3 of the screen of the user terminal 700. The screen of the user terminal 700 is configured as a multi-view by displaying a plurality of resolution setting sub-video information (set/configured) in the form of a thumbnail. At this time, the 2-3 area and the previous area (or the 1-2 area/remaining area) may have the same size. Additionally, the sub screen may be a screen (or resized image information) corresponding to one resolution setting sub image information selected from among the plurality of resolution setting sub image information in the thumbnail form.

In this way, when one or more resolution setting sub-image information is sequentially selected from among the plurality of resolution setting sub-image information in the thumbnail form, the user terminal 700 selects the user according to the number of resolution setting sub-image information selected. By dividing the screen of the terminal 700, the main screen and one or more sub screens according to the number of the selected resolution setting sub video information (or one or more sub screens corresponding to the selected one or more resolution setting sub video information) are multiplayer. It can be displayed as a view.

In addition, a touch gesture by the user of the user terminal 700 for any one resolution setting sub-image information among a plurality of resolution setting sub-image information in the form of a thumbnail displayed on one side of the screen in the user terminal 700 is detected. In this case, the user terminal 700 re-adjusts (or adjusts) the size of the main screen (or the resolution of the main screen) and displays it in the preset 2-1 area on the screen of the user terminal 700. , adjusting (or adjusting) the screen size of the selected resolution setting sub-video information in a preset area 2-2 on the screen of the user terminal 700 and displaying it as a sub-screen, and displaying it as a sub-screen among the screens of the user terminal 700. The plurality of separated (or divided/configured) resolution setting sub-image information is displayed in the form of thumbnails in the preset area 2-3, thereby configuring the screen of the user terminal 700 into a multi-view. Here, the touch gestures by the user of the user terminal 700 include tap, touch & hold, double tap, drag, flick, and swipe. ), etc.

That is, tap, touch & hold, double tap, drag, flick, and When one of the swiping events occurs (or is detected/confirmed), the user terminal 700 displays the size of the main screen (or the The resolution of the main screen is re-adjusted (or adjusted) and displayed, and the screen size of the specific resolution setting sub-video information is adjusted (or adjusted) in the preset 2-2 area on the screen of the user terminal 700. Displaying as a sub screen, and displaying the separated (or divided/configured) plurality of resolution setting sub-video information in the form of a thumbnail in a preset 2-3 area of the screen of the user terminal 700, the user terminal 700 The screen at (700) is configured as a multi-view.

“Tap” refers to an action in which a user touches the screen using a finger or a touch tool (eg, an electronic pen) and then immediately lifts the screen without moving it.

“Touch & hold” refers to an operation in which a user touches the screen using a finger or a touch tool (eg, an electronic pen) and then maintains the touch input for more than a threshold time (eg, 2 seconds). That is, this means that the time difference between the touch-in time and the touch-out time is more than a threshold time (eg, 2 seconds). In order to allow the user to recognize whether the touch input is a tap or a touch & hold, a feedback signal may be provided visually, audibly, or tactilely when the touch input is maintained for more than a threshold time. The critical time may change depending on implementation examples.

“Double tap” refers to the action of a user touching the screen twice using a finger or a touch tool (stylus).

“Drag” refers to an action in which a user touches a finger or touch tool on the screen and then moves the finger or touch tool to another location on the screen while maintaining the touch. Due to the drag operation, the object is moved or a panning operation, which will be described later, is performed.

“Panning” refers to a case where a user performs a drag operation without selecting an object. Because panning does not select a specific object, the object does not move within the page, but the page itself moves within the screen, or a group of objects moves within the page.

“Flick” refers to a user's dragging motion using a finger or a touch tool at a threshold speed (eg, 100 pixel/s) or higher. Dragging (or panning) and flicking can be distinguished based on whether the movement speed of the finger or touch tool is above a threshold speed (eg, 100 pixel/s).

“Drag & drop” refers to the action of a user dragging an object to a certain location on the screen using a finger or a touch tool and then dropping it.

“Pinch” refers to the action of a user moving two fingers in different directions while touching the screen. This is a gesture to enlarge (Pinch Open) or reduce (Pinch Close) an object or page, and the enlargement or reduction value is determined depending on the distance between the two fingers.

“Swipe” is an action of touching an object on the screen with a finger or a touch tool and moving it a certain distance in the horizontal or vertical direction. Movement in a diagonal direction may not be recognized as a swipe event.

In addition, when another touch gesture by the user of the user terminal 700 is detected for any one of the one or more sub-screens displayed on one side of the screen in the user terminal 700, the user terminal 700 ) deletes the sub-screen corresponding to the other touch gesture from the screen, then reorganizes and displays the screen.

That is, when another touch gesture by the user of the corresponding user terminal 700 is detected for any one of the one or more sub-screens displayed on one side of the screen in the user terminal 700, the user terminal 700 ) deletes the sub-screen corresponding to the other touch gesture from the screen and re-sizes (or adjusts) the main screen displayed in the preset 2-1 area on the screen of the user terminal 700. and displaying the remaining sub-screens from which the sub-screens corresponding to the other touch gestures are excluded (or deleted) from the one or more sub-screens being displayed in a preset area 2-2 on the screen of the corresponding user terminal 700, The screen of the user terminal 700 is displayed in the form of a thumbnail by displaying the separated (or divided/configured) plurality of resolution setting sub-video information in preset areas 2-3 of the screen of the user terminal 700. Configured with multi-view. Here, other touch gestures by the user of the user terminal 700 include tap, touch & hold, double tap, drag, flick, swipe, etc.

In this way, any one of the following events among tap, touch & hold, double tap, drag, flick, and swipe is applied to any one specific sub screen among one or more sub screens displayed on one side of the screen in the user terminal 700. When occurs (or is detected/confirmed), the user terminal 700 may reconfigure and display the screen with the specific sub-screen excluded from the previous screen.

In addition, the user terminal 700 divides the screen by touching and dragging the outline of the main screen or the sub screen among the main screen and one or more sub screens displayed on the user terminal 700. Adjust the screen size.

That is, when an event occurs that increases or decreases the outline by touch and drag while the outline of the main screen or the sub screen is selected among the main screen and the one or more sub screens displayed on the user terminal 700. , the user terminal 700 adjusts the size (including, for example, enlargement, reduction, etc.) of the selected main screen or sub-screen in response to the increase or decrease of the outline by the touch and drag, and adjusts the size (or resolution) ) adjusts the size of the remaining video information (including, for example, the main screen, one or more sub screens, a thumbnail screen, etc.) in proportion to the size of the main screen or sub screen to be adjusted, and reconstructs the screen, Display the screen. In this way, as the user terminal 700 adjusts the screen size of the main screen or the sub screen in the entire screen, it can automatically adjust the screen size of the remaining video information.

In addition, among the main screen and the one or more sub-screens displayed on the corresponding user terminal 700, a pinch occurs (or is detected/confirmed) by the user of the corresponding user terminal 700 with respect to the main screen or the sub-screen. In this case, the user terminal 700 adjusts the size of the main screen or the sub screen on the screen.

That is, when a preset pinch occurs (or is detected/confirmed) for the main screen or the sub screen among the main screen and the one or more sub screens displayed on the corresponding user terminal 700, the user terminal 700 ) enlarges (or reduces) the size of the main screen or the sub-screen corresponding to the pinch on the screen (or entire screen) to a preset resolution, and is proportional to the size of the main screen or sub-screen whose size is adjusted. The screen is reconstructed by adjusting the size of the remaining video information (including, for example, the main screen, one or more sub-screens, a thumbnail-type screen, etc.), and the reconstructed screen is displayed. In this way, as the user terminal 700 adjusts the screen size of the main screen or the sub screen in the entire screen, it can automatically adjust the screen size of the remaining video information.

In addition, among the main screen and the one or more sub-screens displayed on the corresponding user terminal 700, drag and drop by the user of the corresponding user terminal 700 occurs (or is detected / In the case of confirmation), the user terminal 700 adjusts the position of the main screen or the sub screen within the screen.

That is, among the main screen and the one or more sub-screens displayed on the corresponding user terminal 700, when the main screen or a specific sub-screen is selected and its position within the screen is changed by dragging and dropping, the user The terminal 700 changes the position of the main screen or a specific sub-screen corresponding to the drag and drop to the dropped position, and the remaining video information (including, for example, the main screen, one or more sub-screens, a thumbnail-type screen, etc.) By adjusting the position of , the screen is reconstructed and the reconstructed screen is displayed. In this way, the user terminal 700 can automatically adjust the positions of the remaining image information as the position of the main screen or the sub screen changes in the entire screen.

In addition, among the plurality of resolution setting sub-video information in the form of thumbnails displayed on one side of the screen in the user terminal 700, the other specific resolution setting sub-video information can be selected by dragging and dropping the other specific resolution setting sub-video information. When is selected and then dragged and dropped to the main screen location, the user terminal 700 exchanges (or replaces/replaces/replaces) the main screen with the selected other specific resolution setting sub-video information and displays it. At this time, for the main screen displayed in the thumbnail area, the user terminal 700 displays another marker on one side of the main screen in the thumbnail area to distinguish the screen as the main screen, or displays an email in the thumbnail area. The border of the screen can also be displayed by setting it to a preset color and/or thickness.

That is, when a drag and drop occurs (or is detected/confirmed) for another specific resolution setting sub-image information among a plurality of resolution setting sub-image information in the form of a thumbnail displayed on one side of the screen in the user terminal 700, The user terminal 700 exchanges and displays the main screen and other specific resolution setting sub-video information corresponding to the drag and drop within the screen. At this time, the user terminal 700 adjusts the size (or resolution) of other specific resolution setting sub-video information corresponding to the drag and drop to match the size of the main screen, and adjusts the size of the main screen on the corresponding thumbnail. Other specific resolution settings are adjusted to match the size of the sub-video information. At this time, in addition to dragging and dropping the other specific resolution setting sub-video information, when another touch gesture by the user of the user terminal 700 is detected with respect to the other specific resolution setting sub-video information, the user terminal ( 700) may exchange and display the main screen and the other specific resolution setting sub-image information corresponding to the another touch gesture on the screen. Here, other touch gestures by the user of the user terminal 700 include tap, touch & hold, double tap, drag, flick, swipe, etc.

In this way, the user terminal 700 can provide (or display) only the desired screen for each member for streaming services related to idol or band performances, and in the case of solo artists, the desired screen is divided into face, whole body, instrument, etc. can only provide.

Accordingly, the multi-view providing system 10 according to an embodiment of the present invention does not require expensive hardware, is developed only through software, is easy to apply, and eliminates the 'lack of presence', a problem with current online live contents. We can provide realistic content that solves problems.

In the embodiment of the present invention, it is explained that the user terminal 700 performs a broadcast streaming service function, a broadcast content provision function, etc. in the form of a website, but the present invention is not limited thereto, and in addition to the website, the server 600 The broadcast streaming service function, the broadcast content provision function, etc. may be performed through a dedicated app provided to .

In addition, in the embodiment of the present invention, the description is focused on JavaScript, which is a client script language included in the script language, but is not limited thereto. In addition to the JavaScript, VB Script (Visual Basic Script) included in the client script language ) Or, the technical features of the present invention can be configured (or implemented) through ASP (Active Server Page), JSP (Java Server Page), PHP (Professional Hypertext Preprocessor), Python, etc. included in the server script language. You can.

In addition, in an embodiment of the present invention, the user terminal 700 uses the script language for the client to separate the main screen and a plurality of resolution setting sub-video information from the basic screen based on coordinate information about the basic screen. Thus, configuring the screen to be displayed on the user terminal 700 is mainly described, but is not limited to this, and the function for configuring the screen performed by the user terminal 700 at the request of the user terminal 700 After performing the process on the server 600, the screen resulting from the process on the server 600 is transmitted to the user terminal 700, and the user terminal 700 displays the screen transmitted from the server 600. It can also be configured to receive and display.

That is, when a preset marker displayed on one side of the main screen in the user terminal 700 is selected, the user terminal 700 displays information about the selected marker, identification information of the user terminal 700, etc. Transmitted to the server 600.

Additionally, the server 600 receives information about markers transmitted from the user terminal 700, identification information of the user terminal 700, etc.

In addition, the server 600 uses a server script language to select the main screen from the basic screen included in the broadcast content based on the broadcast content previously transmitted to the user terminal 700 and information about the received marker. The screen and the plurality of resolution setting sub-video information (or the plurality of sub-video information whose resolutions have been reset) are separated (or divided/organized).

In addition, the server 600 sets the size of the main screen (or the resolution of the main screen) in a preset area (or 1-1 area) according to the resolution (or screen size) supported by the corresponding user terminal 700. ) to adjust (or adjust) and display the separated (or divided/configured) plurality of resolution setting sub-video information in the form of a thumbnail in another preset area (or 1-2 area/remaining area) Configure (or create) the screen. At this time, the server 600 synchronizes one or more voice information corresponding to the configured screen and configures (or generates) voice information synchronized to the main screen.

Additionally, the server 600 transmits the generated screen, voice information synchronized to the main screen, etc. to the user terminal 700.

In addition, the user terminal 700 receives a screen transmitted from the server 600, voice information synchronized to the main screen, etc. in response to information about the previously transmitted marker, and the received screen and the main screen. Outputs synchronized voice information, etc.

In this way, the screen displayed on the user terminal 700 is processed and displayed by the user terminal 700 itself, or the screen processed by the server 600 is provided and displayed in conjunction with the server 600. can do.

Additionally, in this way, in addition to the main screen provided by live streaming, one or more sub-screens according to the user's selection can be provided as a multi-view.

In addition, among the plurality of video information captured for live streaming, the main screen under editor control and the plurality of video information can be configured into one screen and provided to the user through the server.

Hereinafter, the user-centered multi-view providing method according to the present invention will be described in detail with reference to FIGS. 1 to 14.

Figures 2 and 3 are flowcharts showing a user-centered multi-view providing method according to an embodiment of the present invention.

First, the plurality of main cameras 100 each acquire (or photograph) a plurality of image information related to the scene (or performance hall).

That is, the plurality of main cameras 100, which are respectively installed or configured to be movable at a plurality of preset locations in the field, each acquire a plurality of image information (or (filming/collecting). Here, the main camera 100 can acquire the image information at a preset resolution. At this time, the preset resolution (or format) is HD (High Definition, 1280×720), FHD (Full High Definition, 1920×1080), QHD (Quad High Definition, 2560×1440), and UHD (Ultra High Definition, 3840). ×2160), SUHD (Super Ultra High Definition, 7680×4320), etc.

In addition, the plurality of main cameras 100 transmit the acquired (or photographed) plurality of image information, visual information (or synchronization/sync signal information), identification information of the main camera 100, etc. to the switcher ( 400) and transmit (or provide) it. Here, the identification information of the main camera 100 includes mobile IP, mobile MAC, SIM (subscriber identification module) card unique information, serial number, etc.

Additionally, the plurality of microphones 200 each collect (or obtain) a plurality of voice information (or sound information) related to the scene (or performance hall).

That is, the plurality of microphones 200, respectively installed or movable in a plurality of different preset locations in the field, each collect (or acquire) a plurality of voice information related to the field.

In addition, the plurality of microphones 200 transmit the collected (or acquired) plurality of voice information, visual information (or synchronization/sync signal information), identification information of the corresponding microphone 200, etc. to the switcher 400. ) is transmitted (or provided) to. Here, the identification information of the microphone 200 includes mobile IP, mobile MAC, SIM (subscriber identification module) card unique information, serial number, etc.

Additionally, the plurality (or one or more) sub cameras 300 each acquire (or photograph) a plurality of (or one or more) sub image information related to the scene (or performance hall). Here, the sub-camera 300 can acquire the image information at a preset resolution. At this time, the preset resolution (or format) includes HD, FHD, QHD, UHD, SUHD, etc.

That is, the plurality of sub cameras 300 are installed or configured to be movable at a plurality of different preset locations in the field, and are divided into a plurality of (or one) cameras under the control of another photographer who controls each sub camera 300. (or above) sub-video information is acquired (or photographed/collected) respectively. At this time, the sub-camera 300, which corresponds one-to-one to a specific performer (or a specific place/area) performing at the scene, is a specific performer (or a specific location) assigned (or set/corresponding to) the sub-camera 300. Only sub-video information related to /area) can be acquired (or filmed).

In addition, the plurality of sub cameras 300 may display the acquired (or photographed) plurality of sub image information, visual information (or synchronization/sync signal information), identification information of the corresponding sub camera 300, etc. It is transmitted (or provided) to the terminal 500. Here, the identification information of the sub camera 300 includes mobile IP, mobile MAC, SIM (subscriber identification module) card unique information, serial number, etc.

As an example, the first to sixth main cameras 100, 100, respectively installed at a joint performance site for a plurality of singers record images related to the joint performance site at a preset first resolution (for example, 1920×1080). First to sixth image information are respectively acquired, and the obtained first to sixth image information, identification information of the first main camera to identification information of the sixth main camera, visual information, etc. Each is transmitted to the switcher 400.

In addition, the first to seventh microphones 200 installed at the joint performance site respectively acquire first to seventh voice information related to the joint performance site, and the acquired first voice information to 7th voice information, identification information of the first to 7th microphones, visual information, etc. are transmitted to the switcher 400, respectively.

In addition, with respect to the singer team A performing at the joint performance site, the first sub camera corresponding to the first singer in the singer team A is configured to capture images with the first singer at a preset second resolution (for example, 1080×920). Related first sub-image information is acquired, and the acquired first sub-image information, visual information, identification information of the first sub-camera, etc. are transmitted to the field terminal 500.

In addition, with respect to the singer team A performing at the joint performance site, the second sub camera corresponding to the second singer in the singer team A acquires second sub video information related to the second singer at the second resolution, , the acquired second sub-image information, visual information, identification information of the second sub-camera, etc. are transmitted to the field terminal 500.

In addition, with respect to the singer team A performing at the joint performance site, the third sub camera corresponding to the third singer in the singer team A acquires third sub video information related to the third singer at the second resolution, , the acquired third sub-image information, visual information, identification information of the third sub-camera, etc. are transmitted to the field terminal 500.

In addition, with respect to the singer team A performing at the joint performance site, the fourth sub camera corresponding to the fourth singer in the singer team A acquires the fourth sub video information related to the fourth singer at the second resolution, , the acquired fourth sub-image information, visual information, identification information of the fourth sub-camera, etc. are transmitted to the field terminal 500 (S210).

Thereafter, the switcher 400 includes a plurality of image information transmitted (or provided) from the plurality of main cameras 100 and the plurality of microphones 200, visual information, identification information of the main camera 100, A plurality of voice information, visual information, identification information of the corresponding microphone 200, etc. are received.

In addition, the switcher 400 selects one specific video information among the plurality of received video information and the plurality of received voices according to the editor selection (or user/editor input/touch/control) of the switcher 400. One or more voice information among the information is edited (or switched) and transmitted to the field terminal 500.

That is, the switcher 400 bypasses any one specific video information among the plurality of video information and transmits it to the field terminal 500 according to the editor control, and transmits one specific video information from the plurality of audio information. The above voice information is bypassed and transmitted to the field terminal 500. At this time, the switcher 400 bypasses not only the specific video information and the one or more audio information, but also the visual information related to the specific video information and the visual information related to the one or more audio information, thereby bypassing the field terminal 500. ) is sent to

As an example, the switcher 400 receives first to sixth image information transmitted from the first to sixth main cameras, respectively, and identification information of the first main camera to identification of the sixth main camera. Information, visual information, etc. are received, and the third video information, visual information, etc. are bypassed to the field terminal 500 according to the editor's selection.

In addition, the switcher 400 includes first to seventh voice information transmitted from the first to seventh microphones, identification information of the first microphone to the seventh microphone, visual information, etc. is received, and the first to fifth voice information, visual information, etc. are bypassed to the field terminal 500 according to the editor's selection (S220).

Thereafter, the field terminal 500 receives a plurality of sub-image information, visual information, identification information of the corresponding sub-camera 300, etc. transmitted from each of the plurality of sub-cameras 300.

Additionally, the field terminal 500 receives specific video information transmitted from the switcher 400, one or more audio information transmitted from the switcher 400, visual information, etc.

Additionally, the field terminal 500 configures (or creates) a main screen based on the received specific video information according to administrator input (or administrator/user selection/touch/control).

Additionally, the field terminal 500 configures the one or more received voice information as main voice information.

Additionally, the field terminal 500 synchronizes the configured main screen with the one or more received voice information, and configures (or generates) voice information synchronized to the main screen. At this time, the field terminal 500 synchronizes the main screen and the one or more audio information based on visual information related to specific video information corresponding to the configured main screen and visual information related to the one or more audio information.

As an example, the field terminal 500 receives the first sub-image information, visual information, identification information of the first sub-camera, etc. transmitted from the first sub-camera.

Additionally, the field terminal 500 receives the second sub-image information, visual information, identification information of the second sub-camera, etc. transmitted from the second sub-camera.

Additionally, the field terminal 500 receives the third sub-image information, visual information, identification information of the third sub-camera, etc. transmitted from the third sub-camera.

Additionally, the field terminal 500 receives the fourth sub-image information, visual information, identification information of the fourth sub-camera, etc. transmitted from the fourth sub-camera.

Additionally, the field terminal 500 receives the third video information, visual information, first to fifth audio information, visual information, etc. transmitted from the switcher 400.

In addition, according to the administrator control, the field terminal 500 configures the received third video information as the main screen with a preset resolution of 1920 × 1080, and displays the received first audio information to the fifth audio information. is composed of the main voice information.

In addition, the field terminal 500 synchronizes the configured main screen and the main audio information based on visual information related to the third video information and each visual information related to the first to fifth audio information. Do it (S230).

Thereafter, the field terminal 500 configures (or generates) one basic screen based on the configured main screen and the received plurality of sub-video information.

That is, the field terminal 500 sets (or determines) the resolution of each of the plurality of sub-video information according to the number of the received plurality of sub-video information at a certain ratio of the resolution of the configured main screen, Create (or configure/form) resolution setting sub-video information.

In addition, the field terminal 500 configures (or creates) one basic screen by combining the configured main screen and a plurality of resolution setting sub-video information for which the resolution is set.

In addition, the field terminal 500 sends broadcast content including the configured (or created) basic screen (or one basic screen), coordinate information for the configured basic screen, voice information synchronized to the main screen, etc. to a server. Send to (600). Here, the coordinate information for the basic screen includes coordinate information for the corresponding main screen on the basic screen, coordinate information for each sub-video information for multiple resolution settings, and is based on the upper left vertex in a square shape (x, y , width, height). At this time, the x and y represent the x and y coordinates of the corresponding upper left vertex, the width represents the horizontal length information of the square, and the height represents the vertical length information of the square.

As an example, the field terminal 500 displays the received first to fourth sub-video information at a certain ratio (for example, about 1/3) of the resolution (for example, 1920 × 1080) of the configured main screen. The resolution of the information (for example, 360×540) is set, respectively, to generate first resolution setting sub-image information to fourth resolution setting sub-image information.

In addition, as shown in FIG. 4, the field terminal 500 displays the configured main screen (e.g., resolution 1920×1080 as third image information) 411 and the first resolution setting sub-image with the resolution reset. One basic screen (for example, resolution/frame size 2640×1080) (410) is configured based on the information or fourth resolution setting sub-video information (for example, resolution 360×540) (412). At this time, the field terminal 500 displays each coordinate information (e.g., related to the main screen) for the main screen 411 and the four resolution setting sub-video information 412 on the one basic screen 410. Coordinate information (0, 0, 1920, 1080), coordinate information related to the first resolution setting sub-image information (1921, 0, 360, 540), coordinate information related to the second resolution setting sub-image information ( 2281, 0, 360, 540), coordinate information related to the third resolution setting sub-image information (1921, 541, 360, 540), coordinate information related to the fourth resolution setting sub-image information (2281, 541, 360, 540), etc.) are generated.

In addition, the field terminal 500 includes the configured basic screen, coordinate information for the configured basic screen, voice information synchronized to the main screen (for example, including the first voice information to the fifth voice information, etc.), etc. The first broadcast content including is transmitted to the server 600 (S240).

Thereafter, the server 600 receives broadcast content including a basic screen transmitted from the field terminal 500, coordinate information for the basic screen, and voice information synchronized to the main screen.

In addition, the server 600 maps broadcast content including the received basic screen, coordinate information for the basic screen, voice information synchronized to the main screen, etc. with performance information related to the site (or performance hall), and maps it to the corresponding server. It is stored (or registered) in (600) (or database (not shown)). Here, the performance information includes performance name, performance date and time, performance location, running time, introduction information, cast information, agency information, etc.

As an example, the server 600 may display a basic screen transmitted from the field terminal 500, coordinate information for the basic screen, and voice information synchronized to the main screen (e.g., the first voice information to the fifth voice information). The first broadcast content including voice information, etc. is received.

In addition, the server 600 includes the received basic screen, coordinate information for the basic screen, voice information synchronized to the main screen (for example, including the first voice information to the fifth voice information, etc.), etc. The first broadcast content including the first performance information related to the joint performance site for the plurality of singers is mapped and stored in the server 600 (S250).

Afterwards, the user terminal 700 accesses (or connects to) a website (or URL link) provided by the corresponding server 600 through a web browser.

Additionally, the user terminal 700 receives one or more performance information provided by the connected website and displays (or outputs) the one or more performance information received. Here, the performance information includes performance name, performance date and time, performance location, running time, introduction information, cast information, agency information, etc.

As an example, the seventh user terminal 700 accesses the first website provided by the server 600 through a web browser preinstalled on the seventh user terminal.

Additionally, as shown in FIG. 5, the seventh user terminal displays first to third performance information 510 provided by the connected first website (S260).

Thereafter, when specific performance information is selected among one or more performance information displayed on the user terminal 700 according to user selection (or user input/touch/control) of the user terminal 700, the user terminal 700 In conjunction with the server 600 that manages the website, the basic screen corresponding to the specific performance information transmitted from the server 600, coordinate information for the basic screen, voice information synchronized to the main screen, etc. Receive broadcast content including.

That is, when specific performance information is selected among one or more performance information displayed on the user terminal 700 according to user selection (or user input/touch/control) of the user terminal 700, the user terminal 700 Transmits the selected specific performance information, identification information of the user terminal 700, etc. to the server 600. Here, the identification information of the user terminal 700 includes MDN, mobile IP, mobile MAC, SIM (subscriber identification module) card unique information, serial number, etc.

Additionally, the server 600 receives specific performance information transmitted from the user terminal 700, identification information of the user terminal 700, etc.

Additionally, the server 600 confirms (or searches for) broadcast content corresponding to the received specific performance information among a plurality of broadcast content for each performance information previously stored (or registered) in the server 600.

In addition, the server 600 sends the broadcast content, including a basic screen related to the confirmed (or searched) broadcast content, coordinate information for the basic screen, and voice information synchronized to the main screen, to the user terminal 700. send to

Additionally, the user terminal 700 receives the broadcast content including a basic screen transmitted from the server 600, coordinate information for the basic screen, and voice information synchronized to the main screen.

As an example, when the first performance information 511 is selected from the first to third performance information 510 displayed on the seventh user terminal, the seventh user terminal displays the selected first performance information, the Identification information of the seventh user terminal is transmitted to the server 600.

Additionally, the server 600 receives first performance information transmitted from the seventh user terminal, identification information of the seventh user terminal, etc.

Additionally, the server 600 identifies the first broadcast content corresponding to the received first performance information among a plurality of broadcast content for each performance information pre-stored in the server 600.

In addition, the server 600 transmits the confirmed first broadcast content (for example, including the basic screen, coordinate information for the basic screen, voice information synchronized to the main screen, etc.) to the seventh user terminal. do.

Additionally, the seventh user terminal receives the first broadcast content transmitted from the server 600 in response to the previously transmitted first performance information (S270).

Thereafter, the user terminal 700 uses a scripting language (including, for example, JavaScript, etc.) linked with the corresponding web browser to select a main screen and a plurality of screens from the basic screen based on the coordinate information about the received basic screen. The resolution setting sub-video information (or a plurality of sub-video information whose resolution has been reset) is separated (or divided/organized).

Additionally, the user terminal 700 renders and outputs voice information synchronized to the separated (or divided/configured) main screen and the received corresponding main screen. At this time, the user terminal 700 displays the main screen on the entire screen of the user terminal 700 or a partial area of the entire screen. In addition, the user terminal 700 displays a marker on one side of the screen (or full screen/partial screen) on which the main screen is displayed, and on the other side of the screen (or full screen/partial screen) on which the main screen is displayed. Display another marker on . Here, the marker (or sub-video marker) is used to additionally display the plurality of separated resolution setting sub-video information in the form of a thumbnail, and the other marker (or chat marker) is used to control the server 600. It may be used to perform a chat function between the user terminal 700 and one or more other user terminals (not shown).

In this way, the user terminal 700 links with the server 600 for broadcast content corresponding to specific performance information selected by the user of the user terminal 700, and performs real-time stringing for the broadcast content in real time. can be provided.

As an example, the seventh user terminal uses JavaScript that interoperates with a web browser installed on the seventh user terminal to display the received first broadcast content based on coordinate information about the basic screen included in the received first broadcast content. 1 The basic screen included in the broadcast content is separated into third video information corresponding to the main screen and first resolution setting sub-video information to fourth resolution setting sub-video information.

In addition, as shown in FIG. 6, the seventh user terminal displays the main screen 610 corresponding to the separated third video information, and audio information synchronized to the main screen (e.g., the first (including voice information or the fifth voice information, etc.) is output. At this time, as shown in FIG. 6, the seventh user terminal uses a chat function and a first marker 611 to display sub-video information in the form of a thumbnail on one side of the screen where the main screen 610 is displayed. Each second marker 612 for performing is displayed (S280).

Thereafter, when a preset marker displayed on one side of the main screen in the user terminal 700 is selected, the user terminal 700 selects a preset area (or area 1-1) of the screen of the user terminal 700. ), the size of the main screen (or the resolution of the main screen) is adjusted (or adjusted) and displayed in another preset area (or 1-2 area/remaining area) of the screen of the user terminal 700. The separated (or divided/organized) plurality of resolution setting sub-video information is displayed in the form of a thumbnail. At this time, the resolution setting sub-video information (for example, resolution 360 × 540) may be displayed in the form of a thumbnail with the resolution reset (for example, 180 × 270).

In addition, when a preset marker displayed on one side of the main screen in the user terminal 700 is selected, the user terminal 700 displays the main screen, which is the lower layer, on a screen divided into a lower layer and an upper layer. The plurality of separated resolution setting sub-video information, which are upper layers, may be displayed in the form of a thumbnail on one side of the screen (including, for example, the right area, etc.).

For example, when the first marker 611 displayed on one side of the main screen 610 in the seventh user terminal is selected, as shown in FIG. 7, the seventh user terminal displays The size of the main screen is adjusted and displayed in the preset 1-1 area 711, and the separated first resolution setting sub-video information is displayed in the 1-2 area 712, which is the remaining area of the screen 710. The through fourth resolution setting sub-video information is displayed in thumbnail form (S290).

Thereafter, when any one resolution setting sub-video information is selected among a plurality of resolution setting sub-video information in the form of thumbnails displayed on one side of the screen in the user terminal 700, the user terminal 700 displays the corresponding user terminal ( The size of the main screen (or the resolution of the main screen) is re-adjusted (or adjusted) and displayed in the preset 2-1 area of the screen of the corresponding user terminal 700, and the preset 2-1 area of the screen of the corresponding user terminal 700 is displayed. - Adjust (or adjust) the screen size of the selected resolution setting sub-video information in area 2 and display it as a sub-screen, and display it as a sub-screen in the separated (or divided) area in preset areas 2-3 of the screen of the user terminal 700. The screen of the user terminal 700 is configured as a multi-view by displaying a plurality of resolution setting sub-video information (set/configured) in the form of a thumbnail. At this time, the 2-3 area and the previous area (or the 1-2 area/remaining area) may have the same size. Additionally, the sub screen may be a screen (or resized image information) corresponding to one resolution setting sub image information selected from among the plurality of resolution setting sub image information in the thumbnail form.

In this way, when one or more resolution setting sub-image information is sequentially selected from among the plurality of resolution setting sub-image information in the thumbnail form, the user terminal 700 selects the user according to the number of resolution setting sub-image information selected. By dividing the screen of the terminal 700, the main screen and one or more sub screens according to the number of the selected resolution setting sub video information (or one or more sub screens corresponding to the selected one or more resolution setting sub video information) are multiplayer. It can be displayed as a view.

In addition, a touch gesture by the user of the user terminal 700 for any one resolution setting sub-image information among a plurality of resolution setting sub-image information in the form of a thumbnail displayed on one side of the screen in the user terminal 700 is detected. In this case, the user terminal 700 re-adjusts (or adjusts) the size of the main screen (or the resolution of the main screen) and displays it in the preset 2-1 area on the screen of the user terminal 700. , adjusting (or adjusting) the screen size of the selected resolution setting sub-video information in a preset area 2-2 on the screen of the user terminal 700 and displaying it as a sub-screen, and displaying it as a sub-screen among the screens of the user terminal 700. The plurality of separated (or divided/configured) resolution setting sub-image information is displayed in the form of thumbnails in the preset area 2-3, thereby configuring the screen of the user terminal 700 into a multi-view. Here, the touch gestures by the user of the user terminal 700 include tap, touch & hold, double tap, drag, flick, and swipe. ), etc.

That is, tap, touch & hold, double tap, drag, flick, and When one of the swiping events occurs (or is detected/confirmed), the user terminal 700 displays the size of the main screen (or the The resolution of the main screen is re-adjusted (or adjusted) and displayed, and the screen size of the specific resolution setting sub-video information is adjusted (or adjusted) in the preset 2-2 area on the screen of the user terminal 700. Displaying as a sub screen, and displaying the separated (or divided/configured) plurality of resolution setting sub-video information in the form of a thumbnail in a preset 2-3 area of the screen of the user terminal 700, the user terminal 700 The screen at (700) is configured as a multi-view.

For example, when the first resolution setting sub-image information 712-1 in the 1-2 area 712 is selected on the screen 710, as shown in FIG. 8, the seventh user terminal The size of the main screen displayed in the previous 1-1 area 711 is adjusted and displayed in the 2-1 area 810, and the first screen corresponding to the selected first resolution setting sub-image information 712-1 is displayed. Sub-video information is displayed as a sub-screen (or first sub-screen) in the 2-2 area 820, and the separated first resolution setting sub-video information to fourth resolution setting sub-video information in the form of a previous thumbnail are displayed. By displaying in the 2-3 area 830, the screen 800 is displayed in a multi-view format.

As another example, when a double tap occurs on the second resolution setting sub-image information 712-2 in the 1-2 area 712 on the screen 710, as shown in FIG. 9, the first 7 The user terminal adjusts the size of the main screen displayed in the previous 1-1 area 711 and displays it in the 2-1 area 910, and displays the second resolution setting sub-image information 712- related to the double tap. The second sub-image information corresponding to 2) is displayed as a sub-screen (or first sub-screen) in the 2-2 area 920, and the separated first resolution setting sub-image information to fourth sub-image information in the form of a preceding thumbnail is displayed. The resolution setting sub-image information is displayed in the 2-3 area 930, and the screen 900 is configured and displayed in a multi-view (S300).

In addition, when another touch gesture by the user of the user terminal 700 is detected for any one of the one or more sub-screens displayed on one side of the screen in the user terminal 700, the user terminal 700 ) deletes the sub-screen corresponding to the other touch gesture from the screen, then reorganizes and displays the screen.

That is, when another touch gesture by the user of the corresponding user terminal 700 is detected for any one of the one or more sub-screens displayed on one side of the screen in the user terminal 700, the user terminal 700 ) deletes the sub-screen corresponding to the other touch gesture from the screen and re-sizes (or adjusts) the main screen displayed in the preset 2-1 area on the screen of the user terminal 700. and displaying the remaining sub-screens from which the sub-screens corresponding to the other touch gestures are excluded (or deleted) from the one or more sub-screens being displayed in a preset area 2-2 on the screen of the corresponding user terminal 700, The screen of the user terminal 700 is displayed in the form of a thumbnail by displaying the separated (or divided/configured) plurality of resolution setting sub-video information in preset areas 2-3 of the screen of the user terminal 700. Configured with multi-view. Here, other touch gestures by the user of the user terminal 700 include tap, touch & hold, double tap, drag, flick, swipe, etc.

In this way, any one of the following events among tap, touch & hold, double tap, drag, flick, and swipe is applied to any one specific sub screen among one or more sub screens displayed on one side of the screen in the user terminal 700. When occurs (or is detected/confirmed), the user terminal 700 may reconfigure and display the screen with the specific sub-screen excluded from the previous screen.

As an example, in the screen 800 displayed on the seventh user terminal, a preset threshold time (e.g., When a touch & hold occurs for more than 2 seconds, the seventh user terminal reconstructs the screen by deleting the first sub screen 820 where the touch & hold occurred from the screen 800, and then reorganizes the screen as shown in FIG. 7. The illustrated screen 710 is displayed.

As another example, as shown in FIG. 10, with respect to the second sub screen (or second sub image information 1010) displayed in the 2-2 area on the screen 1000 displayed on the seventh user terminal When a swipe occurs, the seventh user terminal reconstructs the screen by deleting the second sub-screen 1010 where the swipe occurred from the screen 1000 and then displays the screen 800 shown in FIG. 8. Display (S310).

In addition, the user terminal 700 divides the screen by touching and dragging the outline of the main screen or the sub screen among the main screen and one or more sub screens displayed on the user terminal 700. Adjust the screen size.

That is, when an event occurs that increases or decreases the outline by touch and drag while the outline of the main screen or the sub screen is selected among the main screen and the one or more sub screens displayed on the user terminal 700. , the user terminal 700 adjusts the size (including, for example, enlargement, reduction, etc.) of the selected main screen or sub-screen in response to the increase or decrease of the outline by the touch and drag, and adjusts the size (or resolution) ) adjusts the size of the remaining video information (including, for example, the main screen, one or more sub screens, a thumbnail screen, etc.) in proportion to the size of the main screen or sub screen to be adjusted, and reconstructs the screen, Display the screen. In this way, as the user terminal 700 adjusts the screen size of the main screen or the sub screen in the entire screen, it can automatically adjust the screen size of the remaining video information.

In addition, among the main screen and the one or more sub-screens displayed on the corresponding user terminal 700, a pinch occurs (or is detected/confirmed) by the user of the corresponding user terminal 700 with respect to the main screen or the sub-screen. In this case, the user terminal 700 adjusts the size of the main screen or the sub screen on the screen.

That is, when a preset pinch occurs (or is detected/confirmed) for the main screen or the sub screen among the main screen and the one or more sub screens displayed on the corresponding user terminal 700, the user terminal 700 ) enlarges (or reduces) the size of the main screen or the sub-screen corresponding to the pinch on the screen (or entire screen) to a preset resolution, and is proportional to the size of the main screen or sub-screen whose size is adjusted. The screen is reconstructed by adjusting the size of the remaining video information (including, for example, the main screen, one or more sub-screens, a thumbnail-type screen, etc.), and the reconstructed screen is displayed. In this way, as the user terminal 700 adjusts the screen size of the main screen or the sub screen in the entire screen, it can automatically adjust the screen size of the remaining video information.

As an example, the left outline 821 of the first sub-screen 820 displayed in the 2-2 area in the entire screen 800 displayed on the seventh user terminal can be moved to the left by touching and dragging. As shown in FIG. 11, the seventh user terminal reduces the size of the main screen displayed in the previous 2-1 area 810 and displays it in the 2-1 area 1110, and when the touch and The first sub-image information 820 corresponding to the drag is enlarged by the moved distance (or pixel) and displayed in the 2-2 area 1120, and the separated first resolution setting sub-image information in the form of the preceding thumbnail is displayed. The fourth resolution setting sub-image information is displayed in the 2-3 area 1130, and the entire screen 1100 is displayed in a multi-view format.

As another example, when a pinch occurs on the main screen 810 displayed in the 2-1 area in the entire screen 800 displayed on the seventh user terminal, as shown in FIG. 12, the seventh user terminal The user terminal enlarges the size of the main screen corresponding to the pinch by a preset ratio (for example, 5%) and displays it in the 2-1 area 1210, and displays the screen in the preceding 2-2 area 820. The size of the first sub screen is reduced and displayed in the 2-2 area 1220, and the separated first resolution setting sub-video information to fourth resolution setting sub-video information in the form of a previous thumbnail is displayed in the 2-3 area ( 1230), the entire screen 1200 is configured and displayed as a multi-view (S320).

In addition, among the main screen and the one or more sub-screens displayed on the corresponding user terminal 700, drag and drop by the user of the corresponding user terminal 700 occurs (or is detected / In the case of confirmation), the user terminal 700 adjusts the position of the main screen or the sub screen within the screen.

That is, among the main screen and the one or more sub-screens displayed on the corresponding user terminal 700, when the main screen or a specific sub-screen is selected and its position within the screen is changed by dragging and dropping, the user The terminal 700 changes the position of the main screen or a specific sub-screen corresponding to the drag and drop to the dropped position, and stores the remaining video information (for example, including the main screen, one or more sub-screens, a thumbnail-type screen, etc.) By adjusting the position of , the screen is reconstructed and the reconstructed screen is displayed. In this way, the user terminal 700 can automatically adjust the positions of the remaining video information as the position of the main screen or the sub screen changes in the entire screen.

As an example, the entire screen 800 displayed on the seventh user terminal may be moved upward within the screen by dragging and dropping (or touching and dragging) with respect to the main screen 810 displayed in the 2-1 area. As shown in FIG. 13, the seventh user terminal moves the position of the main screen displayed in the previous 2-1 area 810 upward and displays it in the 2-1 area 1310, and The first sub screen located in the 2-2 area 1320 and the 2-3 area 1330, respectively, and the corresponding separated first resolution setting sub-video information to fourth resolution setting sub-video information in the form of the thumbnail are displayed as a whole. It is configured and displayed as a screen 1300 (S330).

In addition, among the plurality of resolution setting sub-video information in the form of thumbnails displayed on one side of the screen in the user terminal 700, the other specific resolution setting sub-video information can be selected by dragging and dropping the other specific resolution setting sub-video information. When is selected and then dragged and dropped to the main screen location, the user terminal 700 exchanges (or replaces) the main screen with the selected other specific resolution setting sub-video information and displays it. At this time, for the main screen displayed in the thumbnail area, the user terminal 700 displays another marker on one side of the main screen in the thumbnail area to distinguish the screen as the main screen, or displays an email in the thumbnail area. The border of the screen can also be displayed by setting it to a preset color and/or thickness.

That is, when a drag and drop occurs (or is detected/confirmed) for another specific resolution setting sub-image information among a plurality of resolution setting sub-image information in the form of a thumbnail displayed on one side of the screen in the user terminal 700, The user terminal 700 exchanges and displays the main screen and other specific resolution setting sub-video information corresponding to the drag and drop within the screen. At this time, the user terminal 700 adjusts the size (or resolution) of other specific resolution setting sub-video information corresponding to the drag and drop to match the size of the main screen, and adjusts the size of the main screen on the corresponding thumbnail. Other specific resolution settings are adjusted to match the size of the sub-video information. At this time, in addition to dragging and dropping the other specific resolution setting sub-video information, when another touch gesture by the user of the user terminal 700 is detected with respect to the other specific resolution setting sub-video information, the user terminal ( 700) may exchange and display the main screen and the other specific resolution setting sub-image information corresponding to the another touch gesture on the screen. Here, other touch gestures by the user of the user terminal 700 include tap, touch & hold, double tap, drag, flick, swipe, etc.

For example, when the third sub-image information 712-3 in the 1-2 area 712 is moved to the 1-1 area on the screen 710 by a drag and drop function, FIG. 14 As shown, the seventh user terminal displays the third sub-image information corresponding to the drag and drop function in the preset 1-1 area 1410 of the screen 1400 by adjusting the screen size, The separated first resolution setting sub-image information, second resolution setting sub-image information, fourth resolution setting sub-image information, and resized images are displayed in the remaining area 1-2 area 1420 of the screen 1400. The main screen is displayed in thumbnail form. At this time, a marker 1430 is displayed on one side of the main screen displayed in the thumbnail form to distinguish that the screen is the main screen (S340).

As described above, an embodiment of the present invention provides a multi-view of one or more sub-screens according to the user's selection in addition to the main screen provided by live streaming, so that the user can freely directly select a plurality of broadcast images, By allowing you to watch multiple broadcast videos at the same time, you can obtain more information than before, watch only the part you want, and in the case of content that requires a screen from multiple angles, it can be provided with a more realistic feel.

In addition, as described above, an embodiment of the present invention configures the main screen according to editor control and the plurality of video information into a single screen among the plurality of video information captured for live streaming and provides it to the user through the server. Thus, in real-time broadcasting, it is possible to eliminate the phenomenon of synchronization between a plurality of image information captured through a plurality of cameras and audio information collected through one or more microphones.

The above-described content can be modified and modified by anyone skilled in the art without departing from the essential characteristics of the present invention. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but are for illustrative purposes, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted in accordance with the claims below, and all technical ideas within the equivalent scope should be construed as being included in the scope of rights of the present invention.

10: User-centered multi-view provision system 100: Multiple main cameras
200: Multiple microphones 300: Multiple sub cameras
400: Switcher 500: Field terminal
600: Server 700: User terminal

Claims (10)

A server that stores broadcast content for a plurality of performance information; and
When specific performance information is selected from one or more performance information provided by a website accessed through a web browser, a basic screen corresponding to the specific performance information transmitted from the server is linked with the server that manages the website. , receiving broadcast content including coordinate information for the basic screen and audio information synchronized to the main screen, and using a script language that works with the web browser, based on coordinate information for the basic screen in the received broadcast content A user-centered multi-view comprising a user terminal that separates a main screen and a plurality of resolution setting sub-video information from the basic screen, and renders and outputs audio information synchronized to the separated main screen and the received main screen. Delivery system. According to claim 1,
The basic screen is,
A main screen corresponding to image information selected from among a plurality of image information acquired by a plurality of main cameras, and a plurality of resolution setting sub-image information that sets the resolution for the plurality of sub-image information acquired by a plurality of sub cameras. A user-centered multi-view provision system characterized by being configured. When specific performance information is selected from one or more performance information provided by a website accessed through a web browser on the user terminal, the user terminal transmits the information from the server in conjunction with the server that manages the website. Receiving broadcast content including a basic screen corresponding to specific performance information, coordinate information for the basic screen, and voice information synchronized to the main screen;
By the user terminal, a main screen and a plurality of resolution setting sub-video information are separated from the basic screen based on coordinate information about the basic screen in the received broadcast content using a script language that interoperates with the web browser. step; and
A user-centered multi-view providing method comprising rendering and outputting audio information synchronized to the separated main screen and the received main screen by the user terminal. According to claim 3,
The step of receiving the broadcast content is,
When specific performance information is selected from the one or more performance information, transmitting, by the user terminal, the selected specific performance information and identification information of the user terminal to the server;
Confirming, by the server, broadcast content corresponding to the specific performance information among a plurality of broadcast content for each performance information pre-stored in the server;
transmitting, by the server, the broadcast content including a basic screen related to the confirmed broadcast content, coordinate information for the basic screen, and voice information synchronized to the main screen to the user terminal; and
A user-centered multi-view providing method comprising receiving the broadcast content transmitted from the server by the user terminal. According to claim 3,
When a preset marker displayed on one side of the main screen in the user terminal is selected, the size of the main screen is adjusted and displayed in a preset area of the screen of the user terminal by the user terminal, and the user terminal A user-centered multi-view providing method, further comprising displaying the plurality of separated resolution-set sub-video information in the form of thumbnails in another preset area of the screen. According to claim 5,
When any one resolution setting sub-video information is selected among a plurality of resolution setting sub-image information in the form of thumbnails displayed on one side of the screen in the user terminal, a second pre-set image is displayed by the user terminal among the screens of the user terminal. The size of the main screen is adjusted and displayed in area -1, and the screen size of the selected resolution setting sub-video information is adjusted and displayed as a sub-screen in a preset area 2-2 of the screen of the user terminal, and the user terminal is displayed by adjusting the size of the main screen. A user-centered multi-view providing method further comprising displaying the plurality of separated resolution-set sub-image information in the form of thumbnails in preset areas 2-3 on the screen of the terminal. According to claim 5,
When a touch gesture by the user of the user terminal is detected for any one resolution setting sub-image information among a plurality of resolution setting sub-image information in the form of a thumbnail displayed on one side of the screen in the user terminal, by the user terminal , adjusting the size of the main screen and displaying it in a preset 2-1 area on the screen of the user terminal, and adjusting the screen size of the selected resolution setting sub-video information in a preset 2-2 area on the screen of the user terminal. further comprising adjusting and displaying a sub-screen, and displaying the plurality of separated resolution setting sub-image information in the form of a thumbnail in a preset second-third area of the screen of the user terminal,
The touch gesture by the user of the user terminal is,
User-centered multiplayer, characterized by including any one of tap, touch & hold, double tap, drag, flick, and swipe. How to provide a view. According to claim 5,
When a touch gesture by a user of the user terminal is detected on any one sub-screen among one or more sub-screens displayed on one side of the screen in the user terminal, the user terminal responds to the other touch gesture on the screen. A user-centered multi-view providing method further comprising the step of deleting the sub-screen and then reconstructing and displaying the screen. According to claim 5,
Adjusting the size of the divided screens within the screen by the user terminal by touching and dragging the outline of the main screen or the sub screen among the main screen and one or more sub screens displayed on the user terminal. step;
Among the main screen and the one or more sub-screens displayed on the user terminal, when a pinch by the user of the user terminal occurs on the main screen or the sub-screen, the main screen or the sub-screen is displayed by the user terminal on the screen. adjusting the size of the sub screen; and
Among the main screen and one or more sub-screens displayed on the user terminal, when a drag and drop by a user of the user terminal on the main screen or the sub-screen occurs, by the user terminal, the A user-centered multi-view providing method further comprising adjusting the position of the main screen or the sub screen. According to claim 5,
Among the plurality of resolution setting sub-video information in the form of thumbnails displayed on one side of the screen in the user terminal, the other specific resolution setting sub-video information is selected and dragged using a drag and drop function. A user-centered multi-view providing method further comprising the step of exchanging and displaying the main screen and the selected other specific resolution setting sub-video information by the user terminal when being dropped to the main screen position. .

Images