CN113870819A - Multimedia file playing method, terminal and storage medium - Google Patents
Multimedia file playing method, terminal and storage medium Download PDFInfo
- Publication number
- CN113870819A CN113870819A CN202111128382.2A CN202111128382A CN113870819A CN 113870819 A CN113870819 A CN 113870819A CN 202111128382 A CN202111128382 A CN 202111128382A CN 113870819 A CN113870819 A CN 113870819A
- Authority
- CN
- China
- Prior art keywords
- playing
- content
- audio
- music score
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000013507 mapping Methods 0.000 claims abstract description 48
- 238000004590 computer program Methods 0.000 claims description 3
- 238000007405 data analysis Methods 0.000 claims description 3
- 230000001755 vocal effect Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012905 input function Methods 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0008—Associated control or indicating means
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B15/00—Teaching music
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
- G10H2210/005—Musical accompaniment, i.e. complete instrumental rhythm synthesis added to a performed melody, e.g. as output by drum machines
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/005—Non-interactive screen display of musical or status data
- G10H2220/011—Lyrics displays, e.g. for karaoke applications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/005—Non-interactive screen display of musical or status data
- G10H2220/015—Musical staff, tablature or score displays, e.g. for score reading during a performance
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/091—Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/091—Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith
- G10H2220/096—Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith using a touch screen
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Acoustics & Sound (AREA)
- Reverberation, Karaoke And Other Acoustics (AREA)
Abstract
The invention relates to a multimedia file playing method, a terminal and a storage medium, comprising the following steps: playing the audio file and displaying the music score content; acquiring a play adjustment operation executed on the music score content; and adjusting the playing content of the audio file according to the playing adjustment operation and the mapping relation. The invention can adjust the audio file in playing to the inside corresponding to the music content by selecting the music content, thereby greatly improving the accuracy and the efficiency of adjusting the audio file.
Description
Technical Field
The present invention relates to the multimedia technology field, and in particular, to a multimedia file playing method, a terminal and a storage medium.
Background
At present, music learning mainly comprises offline teaching, online teaching and self-learning. Wherein, the self-learning is to learn by self according to teaching materials or audio files; the off-line teaching is that a teaching person carries out face-to-face teaching on a student according to teaching materials; with the continuous development of internet technology, especially the popularization of 5G technology, online teaching is increasingly adopted. However, no matter off-line teaching, on-line teaching or self-learning, when repeated teaching is needed for a certain key point or difficult point in the music score, when the audio file is used for assisting learning, the playing content of the audio file can be adjusted only by repeatedly dragging the playing progress bar of the audio file, so that the content of the key point or difficult point can be repeatedly played. However, the manual dragging of the progress bar cannot accurately control the audio content corresponding to the dragged playing progress bar, so that the dragging position of the progress bar needs to be adjusted for many times, and the use efficiency is low.
Disclosure of Invention
Therefore, it is necessary to provide a media file playing method for solving the technical problem that the playing content of the multimedia file cannot be accurately positioned by dragging the playing progress bar to adjust the playing content in the prior art.
In order to achieve the above object, the inventor provides a multimedia file playing method, where the multimedia file includes an audio file and a music score file, and the music score content of the music score file has a mapping relationship with the preset audio content of the audio file; the multimedia file playing method comprises the following steps:
playing the audio file and synchronously displaying the music score content;
acquiring a play adjustment operation executed on the music score content;
and adjusting the playing content of the audio file according to the playing adjustment operation and the mapping relation.
Further, the "adjusting the playing content of the audio file according to the playing adjustment operation and the mapping relationship" includes the following steps:
calculating the music score content corresponding to the playing adjustment operation according to the input position of the playing adjustment operation;
and obtaining the playing time point or the playing time period of the audio content corresponding to the music score content according to the mapping relation, and playing the audio content according to the playing time point or the playing time period.
Further, the input position is one of lyrics or a piece of lyrics in the music score content; or the input position is one of the notes or a segment of notes in the music score content; each lyric or each note comprising a start time point and an end time point;
when the input position is one of the lyrics or one of the notes, adjusting the input position to be the starting time point of the lyrics or the notes;
when the input position is a piece of lyrics or a piece of note, the input position is adjusted to be from the starting time point of starting the lyrics to the ending time point of ending the lyrics or from the starting time point of starting the note to the ending time point of ending the note.
Further, the mapping relationship includes setting time marks at different positions of the music score content, where the time marks are the starting points of playing time of corresponding audio content in the audio file;
the play adjustment operation includes: clicking a position point of the music score content;
the "playing the audio content according to the playing time point or the playing time period" includes: and obtaining a corresponding time mark according to the clicked position point, and playing the audio file by using the time mark as a playing starting point.
Further, the play adjustment operation further includes: segmenting the segment of the music score content;
the "playing the audio content according to the playing time point or the playing time period" further includes: and obtaining corresponding starting time marks and ending time marks according to the segments of the music score content selected by the segments, and playing the audio content in the time periods of the starting time marks and the ending time marks.
Further, the music score content is marked with a key mark and/or a difficulty mark, and the mapping relationship includes audio content playing time corresponding to the key mark and/or audio content playing time corresponding to the difficulty mark;
the play adjustment operation further includes: selecting the key point identification and/or the difficulty point identification;
the "playing the audio content according to the playing time point or the playing time period" includes: and acquiring an audio content playing time period corresponding to the difficult point identifier and/or an audio content playing time period corresponding to the important point identifier, and playing the audio content within the playing time.
Further, the key marks and/or the difficult marks are obtained through big data analysis or are marked manually.
Further, the music score content comprises music scores and/or lyrics; the mapping relationship specifically includes:
and mapping the music score to the audio content of the audio file, and/or mapping the lyrics to the audio content of the audio file.
Further, the method also comprises the following steps:
acquiring a singing audio or a playing audio;
and scoring the singing audio or the performance audio.
In order to solve the above technical problem, the present invention further provides another technical solution:
a terminal, the terminal comprising:
the audio playing module is used for playing audio files in the multimedia files;
the display module is used for synchronously displaying music score files corresponding to the audio files in the multimedia files, and the music score contents of the music score files and the audio contents of the audio files are preset with a mapping relation; and
and the adjusting module is used for acquiring the playing adjusting operation executed on the music score content and adjusting the playing content of the audio file according to the playing adjusting operation and the mapping relation.
In order to solve the above technical problem, the present invention further provides another technical solution:
a computer storage medium having stored thereon a computer program which, when executed by a processor, implements a multimedia file playback method as in any one of the above.
Different from the prior art, in the above technical scheme, a preset mapping relationship is set between the music content of the music file in the multimedia file and the audio content of the audio file, and the playing adjustment operation executed on the music content can be obtained, and the playing content of the audio file is adjusted according to the playing adjustment operation and the mapping relationship, so that the audio file in playing can be adjusted to the inside corresponding to the music content by selecting the music content, thereby greatly improving the accuracy and the adjustment efficiency of the audio file adjustment.
Drawings
FIG. 1 is a flowchart illustrating a method for playing a multimedia file according to an embodiment;
FIG. 2 is a flowchart illustrating the process of adjusting the playback content of the audio file according to an embodiment;
fig. 3 is a schematic block diagram of a terminal according to an embodiment;
FIG. 4 is a schematic diagram of a computer storage medium according to an embodiment;
description of reference numerals:
30. a terminal;
301. an audio playing module;
302. a display module;
303. an adjustment module;
40. a computer storage medium;
Detailed Description
To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.
Referring to fig. 1, a method for playing a multimedia file is disclosed in this embodiment. The multimedia file playing method can accurately adjust the audio content of the audio file during playing, thereby solving the technical problem that the playing content cannot be accurately positioned when the audio file is adjusted by adjusting the playing progress bar in the prior art.
The multimedia file playing method comprises an audio file and a music score file, wherein the music score content of the music score file and the audio content of the audio file are in a preset mapping relation.
The multimedia file playing method comprises the following steps:
s101, playing the audio file and synchronously displaying the music score content;
s102, acquiring a play adjustment operation executed on the music score content;
s103, adjusting the playing content of the audio file according to the playing adjustment operation and the mapping relation.
The music score content in the music score file can be displayed in modes of numbered musical notation, staff and the like, and the music score content can be provided with a plurality of pages, each page can be provided with a plurality of lines, and each line can be divided into a plurality of sections. The current music score file generally includes a numbered musical notation or a staff notation, or also includes lyrics.
The audio files are song audio files, specifically can be vocal accompaniment audio with the voice stripped and original vocal accompaniment audio with the voice and the accompaniment, and in some times, the audio files can also be pure music audio files with musical instrument playing such as piano music and violin music. The audio file has a certain playing duration, different audio contents are played in a pushing mode along a time axis, and the mapping relation is that the relationship is established between the music score contents (namely the positions of the music score contents) in the music score file and the playing time of the corresponding audio contents on the time axis. The mapping relation comprises setting time marks at different positions of the music score content, wherein the time marks are the starting points of the playing time of the corresponding audio content in the audio file.
The mapping relation between the music score content and the audio content can be preset during music score production, and in some cases, the existing music score file can be edited for the second time, so that the mapping relation is established between the existing music score file and the audio file. The audio file can be displayed in a touch display screen such as a smart phone and a tablet personal computer, and can also be displayed on a conventional display without a touch input function such as a computer display screen and a television display screen.
The music score content display process has a time axis thereof, the audio content playing process also has a corresponding time axis thereof, and the time axis of the music score content display and the time axis of the audio content playing are synchronized. The mapping relation between the music content and the audio content is mainly due to the corresponding relation established by the music content and the audio content based on the synchronous playing requirement and according to the playing time. After the playing content of the audio file is adjusted through step 103, the playing of the audio file and the display of the music score content are synchronized again.
In step S102, in the playing adjustment operation executed on the acquired content of the music score, the playing adjustment operation may be a touch input on a touch display screen, or may be executed through an external input device such as a keyboard, a mouse, or a remote controller.
In the above embodiment, the preset mapping relationship between the music content of the music file in the multimedia file and the audio content of the audio file is provided, and the playing adjustment operation executed on the music content can be acquired, and the playing content of the audio file is adjusted according to the playing adjustment operation and the mapping relationship, so that the audio file in playing can be adjusted to the inside corresponding to the music content by selecting the music content, thereby greatly improving the accuracy and the adjustment efficiency of the audio file adjustment.
Taking a singing song as an example, the starting time point of the original vocal accompaniment audio (i.e. the corresponding audio content) corresponding to the lyrics or the musical notes of the music score can be recorded into the content of the music score when the music score is played. And clicking lyrics or music note when the original vocal accompaniment audio is played, obtaining the clicked lyrics or music note by the system, obtaining the original vocal accompaniment start-stop time point information corresponding to the clicked lyrics or music note according to the mapping relation, and further jumping to the starting time point to play the original vocal accompaniment audio, thereby realizing the accurate positioning of the playing progress of the audio content where the lyrics or music note is located through the music. Therefore, the multimedia file playing method is particularly suitable for music teaching, the music score file can be displayed on a display and the corresponding audio file can be played in the teaching process, and when a certain part of audio content needs to be played repeatedly, a teacher or a student can adjust the playing progress of the player to the audio content corresponding to the music score content by selecting lyrics or notes in the audio content.
The multimedia file playing method is suitable for songs sung by human voice and simultaneously used for song files played by musical instruments only, so that the multimedia file playing method is also suitable for teaching of musical instruments such as pianos, violins and the like.
As shown in fig. 2, in step S103, adjusting the playing content of the audio file according to the playing adjustment operation and the mapping relationship includes the steps of:
s201, calculating music score content corresponding to the playing adjustment operation according to the input position of the playing adjustment operation;
s202, obtaining the playing time point or the playing time period of the audio content corresponding to the music score content according to the mapping relation, and playing the audio content according to the playing time point or the playing time period.
Position information (i.e., coordinate information) obtained by selection operations such as clicking, frame selection, segment selection, etc. on the music score content in the play adjustment operation acquired in step S102, so that the system compares the obtained position information with the position information of the music score content in step S201 to calculate on which part of the music score content the play adjustment operation falls, i.e., calculate the music score content corresponding to the play adjustment operation.
In a preferred embodiment, the input position is one of lyrics or a piece of lyrics in the music score content; or the input position is one of the notes or a segment of notes in the music score content; each lyric or each note comprising a start time point and an end time point;
when the input position is one of the lyrics or one of the notes, adjusting the input position to be the starting time point of the lyrics or the notes;
when the input position is a piece of lyrics or a piece of note, the input position is adjusted to be from the starting time point of starting the lyrics to the ending time point of ending the lyrics or from the starting time point of starting the note to the ending time point of ending the note.
In this embodiment, since each lyric or each note recorded in the music score file has a start time point and an end time point for playing, when the input position is a specific lyric or a specific note in the music score file, the start time point of the lyric or note is used as a corresponding input position, so as to meet the user's requirement, and corresponding audio is played from the start time point of the selected lyric or note. When the input position is a piece of lyric or a piece of music score, taking the starting lyric of the piece of lyric, namely the starting time point of the first lyric, as the starting time point of the input position, and taking the ending lyric of the piece of lyric, namely the ending time point of the last lyric, as the ending time point of the input position; or the start time of the note, i.e. the start time of the first note, is taken as the start time of the input position and the end time of the note, i.e. the end time of the last note, is taken as the end time of the input position.
In an embodiment, the mapping relationship includes setting time markers at different positions of the music score content, where the time markers are starting points of playing time of corresponding audio content in the audio file;
the play adjustment operation includes: clicking a position point of the music score content;
the "playing the audio content according to the playing time point or the playing time period" includes: and obtaining a corresponding time mark according to the clicked position point, and playing the audio file by using the time mark as a playing starting point.
The mapping relation comprises setting time marks at different positions of the music score content, wherein the time marks are the starting points of the playing time of the corresponding audio content in the audio file. In some embodiments, a time stamp may be set for each note position in the score content, such that each note has a mapping relationship with the start time of the corresponding audio content. In some embodiments, the music score content is divided into a plurality of sections, and a time stamp may be set on each section, so as to preset the mapping relationship between the music score content and the audio content in units of sections.
In the above embodiments, the play adjustment operation may support a plurality of input devices such as touch input, keyboard input, mouse input, and remote control input, and may also support a plurality of different input modes such as click and segment selection. The click operation refers to selecting a certain position point in the music score content through click operation such as single click or double click, for example, clicking a certain note in the music score content.
When the music score content is clicked, according to the clicked position point on the music score content, obtaining the time mark of the audio content corresponding to the clicked music score content, and playing the audio file with the time mark as a playing starting point, so that the audio file is positioned to the audio content corresponding to the music score content for playing.
The section selection can be realized by selecting the music score content through a mouse frame, or can be realized by clicking the music score content at different positions twice, wherein the music score content of the frame selection and the music score between the two clicking positions are the music score content of the section selection; the segment selection can also be realized by clicking the music score content at different positions twice or by touching and dragging with fingers in the touch display screen.
In a preferred embodiment, the play adjustment operation further includes: segmenting the segment of the music score content;
the "playing the audio content according to the playing time point or the playing time period" further includes: and obtaining corresponding starting time marks and ending time marks according to the segments of the music score content selected by the segments, and playing the audio content in the time periods of the starting time marks and the ending time marks.
When music score content is segmented, according to the segments of the segmented music score content, obtaining a starting time mark and an ending time mark corresponding to the music score content segments, and playing audio content within the time period of the starting time mark and the ending time mark, so that the audio file is positioned to the audio content corresponding to the segmented music score content for playing. For example, during the segment selection, a note or lyric can be selected as the starting position and then a note or lyric can be selected as the ending position on the content of the music score, the system determines which of the first selected lyric or note and the later selected lyric or note is the starting position or ending position, the system uses the starting time point of the starting note or lyric as the starting time of the segment selection, uses the ending time of the ending note or lyric as the ending time of the segment selection, and the system analyzes the content of the music score corresponding to the starting position and the ending position in the music score file, and according to the original vocal accompaniment audio time period corresponding to the mapping relation, playing the audio content of the time period, and realizing accurate song segment selection for classroom teaching.
In some embodiments, the music score content is marked with a key mark and/or a difficulty mark, and the mapping relationship includes an audio content playing time corresponding to the key mark and/or an audio content playing time corresponding to the difficulty mark;
the play adjustment operation further includes: selecting the key point identification and/or the difficulty point identification;
the "playing the audio content according to the playing time point or the playing time period" includes: and acquiring an audio content playing time period corresponding to the difficult point identifier and/or an audio content playing time period corresponding to the important point identifier, and playing the audio content in the playing time period.
In order to facilitate learning and select music score content when in use, key marks and/or difficult marks are marked in the music score content, the key marks are marked at the music score content positions corresponding to important skills or knowledge points in the audio content, and the difficult marks are marked at the music score content positions corresponding to skills or knowledge points with higher difficulty in the audio content. And the mapping relation comprises the audio content playing time corresponding to the key mark and/or the audio content playing time corresponding to the difficulty mark. When the system is used, the playing time period of the audio content corresponding to the difficult point identifier and/or the playing time period of the audio content corresponding to the important point identifier are/is obtained, and the audio content in the playing time is played. The key mark and the difficult mark can be marked in advance in the music score file when the user uses the music score file, or the key mark and the difficult mark in the music score file can be obtained through big data analysis and marked. For singing songs, the user or big data analyzes and gives a teaching method or singing notes corresponding to the emphasis and difficulty.
In the embodiment, the user selects the marked key marks and difficult marks, the system analyzes the starting and ending positions of the music score content corresponding to the key marks and the difficult marks and the corresponding original vocal accompaniment audio time periods, and plays the time periods, so that the aim of accurate teaching is fulfilled.
In some embodiments, the method for playing a multimedia file further includes:
acquiring a singing audio or a playing audio; and
and scoring the singing audio or the performance audio.
The singing audio or the playing audio can be input into the equipment operated by the multimedia file playing method through a microphone, and the equipment scores the singing audio or the playing audio. The scoring can be a comprehensive scoring of multiple dimensions such as intonation, beat, volume and the like, and the scoring result can be displayed through a display screen. In some embodiments, a corresponding teaching video may also be recommended for places where the user is not performing enough singing. For example, if the fact that the score of the user for singing in the treble is low is recognized, a singing method of the treble is recommended; or if the tremolo singing skill of the user is not correct, recommending the tremolo singing skill video.
As shown in fig. 3, in an embodiment, a terminal 30 is provided, and the terminal 30 may be configured to execute the multimedia file playing method according to any one of the above embodiments, so as to accurately adjust the audio content of the playing audio file. The terminal 30 includes:
the audio playing module 301, the audio playing module 301 is used for playing an audio file in the multimedia file;
the display module 302, the display module 302 is configured to display a music score file corresponding to the audio file in the multimedia file, where the music score content of the music score file and the audio content of the audio file have a preset mapping relationship; and
and the adjusting module 303, the adjusting module 303 is configured to obtain a play adjusting operation performed on the music score content, and adjust the play content of the audio file according to the play adjusting operation and the mapping relationship.
As shown in fig. 4, in another embodiment, a computer storage medium 40 is provided, on which a computer program is stored, which when executed by a processor implements a multimedia file playing method according to any of the above embodiments.
The preset mapping relationship between the music content of the music file in the multimedia file in the terminal 30 and the audio content of the audio file in the computer storage medium 40 can be obtained, the playing adjustment operation executed on the music content can be obtained, and the playing content of the audio file can be adjusted according to the playing adjustment operation and the mapping relationship, so that the audio file in playing can be adjusted to the interior corresponding to the music content by selecting the music content, and the accuracy and the adjustment efficiency of the audio file adjustment are greatly improved.
It should be noted that, although the above embodiments have been described herein, the invention is not limited thereto. Therefore, based on the innovative concepts of the present invention, the technical solutions of the present invention can be directly or indirectly applied to other related technical fields by making changes and modifications to the embodiments described herein, or by using equivalent structures or equivalent processes performed in the content of the present specification and the attached drawings, which are included in the scope of the present invention.
Claims (10)
1. The multimedia file playing method is characterized in that the multimedia file comprises an audio file and a music score file, and the music score content of the music score file and the audio content of the audio file are preset with a corresponding mapping relation; the multimedia file playing method comprises the following steps:
playing the audio file and synchronously displaying the music score content;
acquiring a play adjustment operation executed on the music score content;
and adjusting the playing content of the audio file according to the playing adjustment operation and the mapping relation.
2. The method for playing multimedia file according to claim 1, wherein said adjusting the playing content of said audio file according to said playing adjustment operation and said mapping relation comprises the following steps:
calculating the music score content corresponding to the playing adjustment operation according to the input position of the playing adjustment operation;
and obtaining the playing time point or the playing time period of the audio content corresponding to the music score content according to the mapping relation, and playing the audio content according to the playing time point or the playing time period.
3. The method for playing multimedia files according to claim 2, wherein the input position is one of lyrics or a piece of lyrics in the content of music score; or the input position is one of the notes or a segment of notes in the music score content; each lyric or each note comprising a start time point and an end time point;
when the input position is one of the lyrics or one of the notes, adjusting the input position to be the starting time point of the lyrics or the notes;
when the input position is a piece of lyrics or a piece of note, the input position is adjusted to be from the starting time point of starting the lyrics to the ending time point of ending the lyrics or from the starting time point of starting the note to the ending time point of ending the note.
4. The method according to claim 2 or 3, wherein the mapping relationship comprises setting time stamps at different positions of the music score content, and the time stamps are the starting points of playing time of corresponding audio content in the audio file;
the play adjustment operation includes: clicking a position point of the music score content;
the "playing the audio content according to the playing time point or the playing time period" includes: and obtaining a corresponding time mark according to the clicked position point, and playing the audio file by using the time mark as a playing starting point.
5. The method for playing back a multimedia file according to claim 2 or 3, wherein the playing back adjustment operation further comprises: segmenting the segment of the music score content;
the "playing the audio content according to the playing time point or the playing time period" further includes: and obtaining corresponding starting time marks and ending time marks according to the segments of the music score content selected by the segments, and playing the audio content in the time periods of the starting time marks and the ending time marks.
6. The method for playing multimedia files according to claim 2 or 3, wherein the music score content is marked with a key mark and/or a difficulty mark, and the mapping relationship comprises the audio content playing time corresponding to the key mark and/or the audio content playing time corresponding to the difficulty mark;
the play adjustment operation further includes: selecting the key point identification and/or the difficulty point identification;
the "playing the audio content according to the playing time point or the playing time period" includes: and acquiring an audio content playing time period corresponding to the difficult point identifier and/or an audio content playing time period corresponding to the important point identifier, and playing the audio content in the playing time period.
7. The method for playing multimedia files according to claim 6, wherein the key mark and/or the difficult mark are obtained by big data analysis or identified manually.
8. The multimedia file playing method according to claim 1, wherein the music score content comprises music scores and/or lyrics; the mapping relationship specifically includes:
and mapping the music score to the audio content of the audio file, and/or mapping the lyrics to the audio content of the audio file.
9. A terminal, characterized in that the terminal comprises:
the audio playing module is used for playing audio files in the multimedia files;
the display module is used for synchronously displaying music score files corresponding to the audio files in the multimedia files, and the music score contents of the music score files and the audio contents of the audio files are preset with a mapping relation; and
and the adjusting module is used for acquiring the playing adjusting operation executed on the music score content and adjusting the playing content of the audio file according to the playing adjusting operation and the mapping relation.
10. A computer storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the multimedia file playing method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111128382.2A CN113870819A (en) | 2021-09-26 | 2021-09-26 | Multimedia file playing method, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111128382.2A CN113870819A (en) | 2021-09-26 | 2021-09-26 | Multimedia file playing method, terminal and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113870819A true CN113870819A (en) | 2021-12-31 |
Family
ID=78994393
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111128382.2A Pending CN113870819A (en) | 2021-09-26 | 2021-09-26 | Multimedia file playing method, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113870819A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030188626A1 (en) * | 2002-04-09 | 2003-10-09 | International Business Machines Corporation | Method of generating a link between a note of a digital score and a realization of the score |
| US8304642B1 (en) * | 2006-03-09 | 2012-11-06 | Robison James Bryan | Music and lyrics display method |
| KR20130015173A (en) * | 2011-08-02 | 2013-02-13 | 주식회사 금영 | Lyrics displaying method in karaoke apparatus |
| CN109377818A (en) * | 2018-12-10 | 2019-02-22 | 北京金三惠科技有限公司 | A kind of music score playing module component of digital music tutoring system |
| CN109493684A (en) * | 2018-12-10 | 2019-03-19 | 北京金三惠科技有限公司 | A kind of multifunctional digital music lesson system |
| CN110570834A (en) * | 2019-09-27 | 2019-12-13 | 广州市迪声音响有限公司 | method, device and equipment for realizing synchronous display of song score in song playing process |
| CN111048058A (en) * | 2019-11-25 | 2020-04-21 | 福建星网视易信息系统有限公司 | Singing or playing method and terminal for adjusting song music score in real time |
-
2021
- 2021-09-26 CN CN202111128382.2A patent/CN113870819A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030188626A1 (en) * | 2002-04-09 | 2003-10-09 | International Business Machines Corporation | Method of generating a link between a note of a digital score and a realization of the score |
| US8304642B1 (en) * | 2006-03-09 | 2012-11-06 | Robison James Bryan | Music and lyrics display method |
| KR20130015173A (en) * | 2011-08-02 | 2013-02-13 | 주식회사 금영 | Lyrics displaying method in karaoke apparatus |
| CN109377818A (en) * | 2018-12-10 | 2019-02-22 | 北京金三惠科技有限公司 | A kind of music score playing module component of digital music tutoring system |
| CN109493684A (en) * | 2018-12-10 | 2019-03-19 | 北京金三惠科技有限公司 | A kind of multifunctional digital music lesson system |
| CN110570834A (en) * | 2019-09-27 | 2019-12-13 | 广州市迪声音响有限公司 | method, device and equipment for realizing synchronous display of song score in song playing process |
| CN111048058A (en) * | 2019-11-25 | 2020-04-21 | 福建星网视易信息系统有限公司 | Singing or playing method and terminal for adjusting song music score in real time |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11727904B2 (en) | Network musical instrument | |
| Dittmar et al. | Music information retrieval meets music education | |
| US5690496A (en) | Multimedia product for use in a computer for music instruction and use | |
| US8445766B2 (en) | Electronic display of sheet music | |
| US20220277715A1 (en) | Playback, recording, and analysis of music scales via software configuration | |
| US20120151344A1 (en) | Dynamic point referencing of an audiovisual performance for an accurate and precise selection and controlled cycling of portions of the performance | |
| US8183454B2 (en) | Method and system for displaying components of music instruction files | |
| JP2012532340A (en) | Music education system | |
| JP2016136251A (en) | Automatic transcription of musical content and real-time musical accompaniment | |
| Love | An ecological description of jazz improvisation. | |
| Killick | Global notation as a tool for cross-cultural and comparative music analysis | |
| CN101604486A (en) | Musical instrument playing and practicing method based on speech recognition technology of computer | |
| US7576280B2 (en) | Expressing music | |
| KR100894866B1 (en) | Piano tuturing system using finger-animation and Evaluation system using a sound frequency-waveform | |
| US10096306B2 (en) | Input support apparatus and method therefor | |
| Papiotis | A computational approach to studying interdependence in string quartet performance | |
| CN113870819A (en) | Multimedia file playing method, terminal and storage medium | |
| Chen | Design of music teaching system based on artificial intelligence | |
| Dannenberg | Human computer music performance | |
| JP5969421B2 (en) | Musical instrument sound output device and musical instrument sound output program | |
| Maslen | “Hearing” ahead of the sound: How musicians listen via proprioception and seen gestures in performance | |
| Han et al. | A Musical Performance Evaluation System for Beginner Musician based on Real-time Score Following. | |
| WO2011060504A1 (en) | Music tuition or practice method and apparatus | |
| US20240221707A1 (en) | Systems, methods, and computer program products for generating deliberate sequences of moods in musical compositions | |
| Liu | Application of Music Software in College Professional Music Using |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |