KR20220055644A - Digital Audio Book Production System and the Method - Google Patents

Abstract

The present invention relates to a system and a method for producing a digital audio book and, more specifically, to a system and a method for producing a digital audio book, capable of producing an on-demand digital audio book by converting text data into digital audio data, producing a digital audio book by selectively applying a voice which a user wants in a designated form, and producing a customized digital audio book by enabling a user to upload text data. In accordance with an embodiment of the present invention, the system for producing a digital audio book includes: a digital audio book server concluding a contract with a publisher server holding copyrights and collecting book data of the corresponding publisher to convert the data into digital text data, and then, converting the same data into raw digital audio data of a digital voice file format, and converting the raw digital audio data of the voice file format into a tone selected by a user terminal to provide the data to the user terminal; and a plurality of user terminals accessing the digital audio book server through a wired/wireless network to select raw digital audio data or a desired tone to download and execute designated digital audio data made by converting the raw digital audio file into a desired tone, and uploading text data to download and execute the raw digital audio data or the designated digital audio data in regard to the text data.

Description

Digital Audio Book Production System and the Method

The present invention relates to a digital audiobook production system and a method therefor, and more particularly, to convert text data into digital audio data to produce an on-demand digital audiobook, and to provide users with a designated type. A system and method for producing a digital audiobook by selectively applying a desired tone, and for producing a customized type digital audiobook by a user uploading text data.

Compared to analog audiobooks in which voice actors or volunteers record and save through reading (narration), digital audiobooks do not contain information such as text or images that have been published as books or that can be published without going through the narration process. It refers to a digital book that contains digital text data as digital audio data in an electronic recording medium or storage device, and then reads, sees, and listens to its contents with a computer or mobile terminal through a wired/wireless information and communication network.

This digital audiobook is implemented so that it is displayed visually and aurally through a terminal such as a PC equipped with a dedicated reader or display means on which text or images of books are displayed, and the user reads directly as the technology develops. Outputs the contents of the book as audio (digital audio data) so that the visually impaired, infants, children, etc. can become familiar with the book, or it can be useful in situations where visual data such as driving or exercise cannot be seen. (audible) This is a format that outputs data.

In particular, this digital audiobook offers a lower price compared to paper books from the buyer's point of view, saves time through online purchase (download from the e-book publisher's website), purchases necessary parts separately, as well as watching video materials while reading or background It provides the advantage of being able to listen to music, and from the standpoint of publishers, it is possible to obtain business profits by saving production and distribution costs such as printing and bookbinding, and by reducing inventory burden and easy updating of book contents.

However, if you want to produce an existing analog audiobook, you have to go through the excessive production cost and at least 7~8 hours of recording process for each book, because the publishing process of narration and recording is performed in a dedicated studio by employing voice actors. A problem arises that a production system cannot be established.

In particular, on the high walls of audiobook publishing houses equipped with excessive production costs, analog production time, and dedicated studios, various novels and essays published in real time around the world, such as literature and specialized books such as major technology, are displayed in audio. Since the book could not be produced, there was a problem in that only a very limited quantity of the audiobook itself was produced.

Registration No. 10-1789057 (Announcement date October 23, 2017)

The present invention has been devised to solve the above problems, and it is possible to easily and quickly produce an audiobook in real time at a lower cost, and through this, a digital audiobook that can be created as a digital audiobook as desired by books worldwide. An object of the present invention is to provide an audiobook production system and a method therefor.

A digital audiobook production system according to an embodiment of the present invention for achieving the above object concludes a contract with a publisher server having a copyright, collects book data of the publisher, converts it into digital text data, and converts it into digital audio file a digital audiobook server that converts raw digital audio data in the form of audio files, and converts the raw digital audio data in the form of audio files into tones selected by the user terminal, and provides the converted raw digital audio data to the user terminal; and

It connects to the digital audiobook server through a wired/wireless network to download and execute raw digital audio data or designated digital audio data obtained by selecting a desired tone and converting the raw digital audio file into a desired tone, and processing text data. a plurality of user terminals for uploading and downloading and executing raw digital audio data or designated digital audio data for the text data;

is comprised of

In addition, the user terminal is characterized in that the necessary part of the digital audio data is stored as audio and text data through search or extraction through a voice command when there is an important passage while listening to the digital audio data.

In addition, the digital audio book server translates the collected digital text data or digital text data uploaded from the user terminal into various languages, and converts the translated digital text data into raw digital audio data or designated digital audio data. do.

In addition, the digital audiobook server is characterized in that the digital text data uploaded from the user terminal or collected digital text data is analyzed in full context with artificial intelligence to generate raw digital audio data with tones suitable for the context.

In addition, the digital audio book server is characterized in that the user of the user terminal is divided into free general users and paid customer users, and managed, and differentially provides digital audio book services for general users and customer users.

In addition, the digital audio book server is characterized in that it analyzes the user's usage data through the user terminal with artificial intelligence and recommends digital audio data required or preferred by the user to the user terminal.

In the digital audiobook production method according to an embodiment of the present invention, (A) a user terminal accesses a digital audiobook server through a wired/wireless network and selects digital text data provided by the digital audiobook server or digital text data stored by itself uploading;

(B) converting the digital text file into raw digital audio data in the form of a digital audio file in a digital audio book server when the digital text file is selected;

(C) converting raw digital audio data into the selected tone (converted into designated digital audio data) in a digital audiobook server when a desired tone is selected by the user terminal, and providing the converted raw digital audio data to the user terminal;

(D) using the digital audio book service by executing the designated digital audio data provided by the user terminal;

(E) When uploading the self-stored digital text data in step (A), select the desired language and upload the digital text data uploaded from the digital audiobook server to the selected language to generate translated digital text data Then, it is characterized in that after the step (B) is performed.

In addition, in the step (B), the digital audiobook server analyzes the entire context with artificial intelligence and designates a tone matching the context.

and (F) searching (indexing) or extracting a necessary part through a voice command of a user terminal while executing the designated digital audio data of step (D);

(G) storing (paste) the extracted digital audio/text data in the user terminal when the necessary part is extracted (copy); and

(G') In the case of indexing, the step of repeatedly executing the indexed digital audio/text data or storing the indexed digital audio/text data in the user terminal is further performed.

According to the means to solve the above problems, the production of digital audiobooks is achieved by a system that is very inexpensive and capable of mass production in real time without relying on a separate studio or voice actor, which is a method that increases production cost and consumes excessive production time. By making this possible, it can become a platform that can dramatically raise the collective intelligence of all mankind by allowing users to listen to audiobooks cheaply and conveniently in an environment where books that have been or will be published around the world cannot be read through user terminals. .

1 is a block diagram of a digital audiobook production system according to an embodiment of the present invention.
FIG. 2 is an internal configuration diagram of the digital audiobook server shown in FIG. 1 .
3 is a flowchart illustrating a digital audiobook production method according to an embodiment of the present invention.
4 is a flowchart illustrating a method of indexing, extracting, and storing digital audio data through a voice command while executing digital audio data according to an embodiment of the present invention.

Hereinafter, the configuration and operation of the embodiment of the present invention will be described with reference to the accompanying drawings.

It should be noted that the same components in the drawings are indicated by the same reference numbers and symbols as much as possible even though they are indicated in different drawings.

In the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

In addition, when a part "includes" a certain component, this means that other components may be further included rather than excluding other components unless otherwise stated.

1 is a configuration diagram of a digital audiobook production system according to an embodiment of the present invention, and FIG. 2 is an internal configuration diagram of the digital audiobook server shown in FIG.

As shown in FIG. 1 , in the digital audiobook production system according to an embodiment of the present invention, a plurality of user terminals 100a, 100b, ..., 100n and a digital audiobook server 300 are connected through a wired/wireless network 200 . do.

The user terminals 100a, 100b, ..., 100n are terminals possessed by a user who is provided with a digital audiobook service by accessing the digital audiobook server 300 through the wired/wireless network 200, for example, a PC or a smartphone. can

To this end, the user terminals 100a, 100b, ..., 100n conveniently and freely download and execute raw digital audio data produced by the digital audio book server 300 and stored in the raw digital audio DB 312 . An on-demand digital audiobook service that allows you to listen to a variety of books (digital audio data) is available.

At this time, the user terminals 100a, 100b, ..., 100n select the desired tone, convert the raw digital audio data into the desired tone through the digital audiobook server 300, and store it in the designated digital audio DB 314. can

In addition, when the user terminals 100a, 100b, ..., 100n want to convert the text data stored in the user terminal into digital audio data, not the digital audio book that is produced in advance, the text data is converted into the user terminal 100a. ,100b,…,100n) upload to the digital audiobook server 300, convert it into raw digital audio data through the digital audiobook server 300, and select and convert the desired tone to produce customized digital audio data. there is.

In addition, the user terminals 100a, 100b, ..., 100n require digital audio data through search or extraction through a voice command when there is an important passage while listening to the digital audio data of the digital audio book server 300 while executing it. Parts can be saved as audio and text data.

Through this, in the case of an existing audiobook, if you want to save an important passage after listening to it, you can solve the hassle of stopping and recording it.

In addition, the user terminals 100a, 100b, ..., 100n translate the translated text data into digital audio data after translating it into a desired language through the text data translation function of the translation module 304 of the digital audio book server 300 . You can create transformations.

For example, text data in Korean is produced as digital audio data, but text data is translated into a selected (desired) language and the translated text data is produced as digital audio data, so that any text data can be converted into digital audio data of a desired language. and the user can switch to the desired language while listening to digital audio data, and through this, it can be usefully used for language learning.

In addition, the user terminals 100a, 100b, ..., 100n upgrade digital audio data through uploading to the digital audio book server 300 for inaccurate or inappropriate digital audio data and convert it into big data, thereby generating digital audio data of the digital audio server 300. can be continuously upgraded.

As shown in FIG. 2 , the digital audiobook server 300 includes a licensing module 301 , a TTS module 302 , a conversion module 303 , a translation module 304 and an analysis module 305 , It is connected to the publisher server 400 having the copyright for , and the tone server 500 having various tones similar to the narration of a voice actor by wire or wireless.

The licensing module 301 concludes an intellectual property right contract or a copyright contract with various publisher servers 400 , collects book data of the publisher, converts it into digital text, and stores and manages it in the digital text DB 310 .

The TTS module 302 converts various digital text data in the form of a text file stored in the digital text DB 310 into raw digital audio data in the form of a digital voice file, and stores and manages the data in the raw digital audio DB 312 .

Here, the TTS module 302 extracts an optimal prosody model through the TTS algorithm and converts it into a digital voice file form close to natural sound and natural tone.

The conversion module 303 converts raw digital audio data in the form of digital audio files stored in the raw digital audio DB 312 to a tone from the tone server 500 according to the request of the user terminals 100a, 100b, ..., 100n. The selected tone is converted into the selected tone and provided to the user terminals 100a, 100b, ..., 100n, and stored and managed in the designated digital audio DB 314.

The human ear is very sensitive and sensual, so it is easy to get tired of repetitive sounds and loses concentration. Even when using digital audiobooks, it is always new and does not easily get tired or lose concentration.

The translation module 304 includes various digital text data in the form of text files collected through the licensing module 301 and stored in the digital text DB 310, or digital text uploaded from the user terminals 100a, 100b, ..., 100n. The data is translated into various languages and stored and managed in the translated digital text DB 316 .

The translated digital text data is converted into designated digital audio data through the TTS module 302 and the conversion module 303 according to the request of the user terminal, and stored and managed in the designated digital audio DB 314 .

The analysis module 305 analyzes the user's usage data through the user terminals 100a, 100b, ..., 100n with artificial intelligence, and recommends and provides digital audio data required or preferred by the user.

In addition, the analysis module 305 analyzes the entire context of the collected digital text data or digital text data uploaded from the user terminals 100a, 100b, ..., 100n with artificial intelligence, and the optimal tone that best suits the context It generates raw (basic) digital audio data with , but converts it to the most natural and natural tones by generating digital audio data with tones that best match the context, especially for interactive texts.

And for the implementation of each module, the digital audio book server 300 operates a digital text DB 310, a raw digital audio DB 312, a designated digital audio DB 314, and a translation digital text DB 316, manage

On the other hand, the digital audiobook server 300 provides the users of the user terminals 100a, 100b, ..., 100n for free general users who do not pay digital audiobook service fees and paid customers who pay digital audiobook service fees. It is possible to classify users into users, store and manage them in a user DB (not shown), and provide digital audiobook services for general users and customer users differently (differently).

For example, the general user may not limit the daily or one-time usage data of the customer user while limiting the user's daily or one-time usage data, and the general user may have a translation service or analysis of the translation module 304 . While not providing the recommendation service of the module 305 , a translation or recommendation service may be provided to the customer user.

3 is a flowchart illustrating a digital audiobook production method according to an embodiment of the present invention.

The user accesses the digital audiobook server 300 through the wired/wireless network 200 using the user terminals 100a, 100b, ..., 100n (S302), logs in, and wants to use the digital audiobook service. Digital text data is selected from the digital text DB 310 or books (digital text data) stored in the user terminals 100a, 100b, ..., 100n are uploaded (S034).

When digital text data is selected in the digital text DB 310, the TTS module 302 converts the digital text data in the form of a text file into raw digital audio data in the form of a digital voice file and stores it in the raw digital audio DB 312. (S306).

To this end, AI can analyze the entire context and designate the optimal tone that best matches the context.

Next, when the user terminals 100a, 100b, ..., 100n select a desired tone from the tone server 500 (S308), the conversion module 303 converts the raw digital audio data into the selected tone (into designated digital audio data). converted) and stored in the designated digital audio DB 314 and provided to the user terminals 100a, 100b, ..., 100n (S310).

The user terminals 100a, 100b, ..., 100n use the digital audiobook service by executing the provided designated digital audio data.

In the case of uploading a book (digital text data) stored in the user terminals 100a, 100b, ..., 100n in step S304, the user may select and upload a desired language (S320).

At this time, the translation module 304 of the digital audiobook server 300 translates the uploaded digital text data into the selected language to generate translated digital text data (S322), and subsequent steps including step S306 for the translated digital text data carry out

4 is a flowchart illustrating a method of indexing, extracting, and storing digital audio data through a voice command while executing digital audio data according to an embodiment of the present invention.

In the step S312 of FIG. 3, that is, when the user wants to store the specified digital audio data while receiving the digital audio book service through the user terminals 100a, 100b, ..., 100n (S402), the user wants to save it. Through the voice command (Search by Voice Command) of the terminals 100a, 100b, ..., 100n, a search (Indexing) or a necessary part is extracted (Copy) (S404).

When the necessary part is extracted (Copy), the extracted digital audio/text data is stored in the user terminals 100a, 100b, ..., 100n (Paste) (S406), and the stored digital audio/text data is translated ( S408).

In the case of the indexing, the indexed digital audio/text data is repeatedly executed or stored in the user terminals 100a, 100b, ..., 100n (Paste) (S410), and the stored digital audio/text data is translated. (S412).

As described above, the present invention converts all books into digital audio data through a digital audiobook server to generate an on-demand digital audiobook, and selectively applies a user's desired tone in a designated type to digital Audiobooks can be downloaded, and by accessing a digital audiobook server from a user terminal and uploading text data, the user can convert them into customized type digital audio data and download them.

In addition, while executing and listening to the generated digital audio data, the necessary part of the digital audio data can be extracted and recorded as audio and text data through the first voice command, and the data can be repeatedly reproduced by searching with a keyword through the second voice command. Through this technology, useful knowledge and information can be acquired at all times by executing audible data usefully in situations where the user cannot see visual data, such as while driving or exercising.

Although the technical idea of the present invention has been described together with the accompanying drawings in the above, the preferred embodiment of the present invention is exemplarily described and does not limit the present invention.

In addition, it is a clear fact that various modifications and imitations are possible without departing from the scope of the technical spirit of the present invention by anyone having ordinary skill in the art.

100a, 100b,… ,100n: user terminal 200: wired and wireless network
300: digital audiobook server 301: licensing module
302: TTS module 303: conversion module
304: translation module 305: analysis module
400: publisher server 500: tone server

Claims (9)

Sign a contract with a publisher server having a copyright, collect book data of the publisher, convert it into digital text data, convert it to raw digital audio data in the form of a digital audio file, and raw data in the form of an audio file ) a digital audio book server that converts digital audio data into a tone selected by the user terminal and provides it to the user terminal; and
It connects to the digital audiobook server through a wired/wireless network, downloads raw digital audio data, or selects a desired tone, and converts the raw digital audio file into a desired tone, downloads and executes the text data. a plurality of user terminals for uploading and downloading and executing raw digital audio data or designated digital audio data for the text data;
A digital audiobook production system comprising a. According to claim 1,
The digital audio book production system, characterized in that the user terminal stores the necessary part of the digital audio data as audio and text data through search or extraction through a voice command when there is an important passage while listening to the digital audio data. 3. The method of claim 2,
wherein the digital audiobook server translates the collected digital text data or digital text data uploaded from the user terminal into various languages, and converts the translated digital text data into raw digital audio data or designated digital audio data. Audiobook production system. 3. The method of claim 2,
The digital audiobook server generates raw digital audio data with tones suitable for the context by analyzing the entire context of the collected digital text data or digital text data uploaded from the user terminal with artificial intelligence. production system. According to claim 1,
The digital audiobook server divides and manages users of the user terminal into free general users and paid customer users, and differentially provides digital audiobook services for general users and customer users. According to claim 1,
The digital audiobook server is a digital audiobook production system, characterized in that by analyzing the use data of the user through the user terminal with artificial intelligence, the digital audio data required or preferred by the user is recommended to the user terminal. (A) accessing a digital audiobook server through a wired/wireless network in a user terminal, selecting digital text data provided by the digital audiobook server, or uploading self-stored digital text data;
(B) converting the digital text file into raw digital audio data in the form of a digital audio file in a digital audio book server when the digital text file is selected;
(C) converting raw digital audio data into the selected tone (converted into designated digital audio data) in a digital audiobook server when a desired tone is selected by the user terminal, and providing the converted raw digital audio data to the user terminal;
(D) using the digital audio book service by executing the designated digital audio data provided by the user terminal;
(E) When uploading the self-stored digital text data in step (A), select the desired language and upload the digital text data uploaded from the digital audiobook server to the selected language to generate translated digital text data Then, the digital audio book production method, characterized in that performing after the step (B). 8. The method of claim 7
The digital audiobook production method, characterized in that in the step (B), the digital audiobook server analyzes the entire context with artificial intelligence and designates a tone that matches the context. 8. The method of claim 7
(F) searching (indexing) or extracting a necessary part through a voice command of a user terminal while executing the designated digital audio data of step (D);
(G) storing (paste) the extracted digital audio/text data in the user terminal when the necessary part is extracted (copy); and
(G') The digital audio book production method, characterized in that in the case of indexing, iteratively executing the indexed digital audio/text data or storing the indexed digital audio/text data in a user terminal.

Images