CN114385108A - Comment display method, device and storage medium in music playing process - Google Patents
Comment display method, device and storage medium in music playing process Download PDFInfo
- Publication number
- CN114385108A CN114385108A CN202111592494.3A CN202111592494A CN114385108A CN 114385108 A CN114385108 A CN 114385108A CN 202111592494 A CN202111592494 A CN 202111592494A CN 114385108 A CN114385108 A CN 114385108A
- Authority
- CN
- China
- Prior art keywords
- music
- comment
- information
- target
- music playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 127
- 238000004458 analytical method Methods 0.000 claims abstract description 46
- 230000006399 behavior Effects 0.000 claims description 67
- 238000001514 detection method Methods 0.000 claims description 58
- 230000007613 environmental effect Effects 0.000 claims description 8
- 239000000523 sample Substances 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 3
- 238000004891 communication Methods 0.000 description 7
- 230000001960 triggered effect Effects 0.000 description 6
- 230000035565 breathing frequency Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000001121 heart beat frequency Effects 0.000 description 4
- 230000000717 retained effect Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000036391 respiratory frequency Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000029058 respiratory gaseous exchange Effects 0.000 description 2
- 230000036760 body temperature Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/63—Querying
- G06F16/635—Filtering based on additional data, e.g. user or group profiles
- G06F16/636—Filtering based on additional data, e.g. user or group profiles by using biological or physiological data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/64—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/68—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/683—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/685—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using automatically derived transcript of audio data, e.g. lyrics
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physiology (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Cardiology (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Biomedical Technology (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Library & Information Science (AREA)
- Pathology (AREA)
- Pulmonology (AREA)
- Artificial Intelligence (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Human Computer Interaction (AREA)
- Reverberation, Karaoke And Other Acoustics (AREA)
- Indexing, Searching, Synchronizing, And The Amount Of Synchronization Travel Of Record Carriers (AREA)
Abstract
The application discloses a comment display method, a comment display device and a storage medium in a music playing process, wherein the comment display method in the music playing process comprises the following steps: in the music playing process, personal behavior characteristics of a target audience are analyzed, lyric information played by the current music is determined based on characteristic analysis results, and comment information related to the lyric information is displayed based on the target position of the lyric information. The technical problem that the experience effect of a user is not good in the song listening process is solved.
Description
Technical Field
The present application relates to the field of internet technologies, and in particular, to a comment display method and device during a music playing process, and a storage medium.
Background
With the rapid development of computer technology and mobile terminals, music applications become one of the important functions that consumers highly depend on mobile phones, in the traditional music applications, a comment box is provided below a song, a user needs to actively click the comment box and then input comment information to comment on the listened music, and then in the process of listening to the song, the comment content of the user on the song is displayed at the bottommost of all lyrics of the song through the existing song comment display mode, so that the substitution sense of listening to the song by the user is reduced, and the user experience effect is poor.
Disclosure of Invention
The application mainly aims to provide a comment display method, comment display equipment and a storage medium in a music playing process, and aims to solve the technical problem that in the prior art, a user is poor in experience effect in a song listening process.
In order to achieve the above object, the present application provides a comment displaying method in a music playing process, where the comment displaying method in the music playing process includes:
analyzing the personal behavior characteristics of a target audience in the music playing process;
determining lyric information played by the current music based on the feature analysis result;
and displaying comment information related to the lyric information based on the target position of the lyric information.
The application also provides a comment display device in the music playing process, the comment display device in the music playing process is a virtual system, the comment display device in the music playing process includes:
the characteristic analysis module is used for analyzing the personal behavior characteristics of the target audience in the music playing process;
and the determining module is used for determining the lyric information played by the current music based on the characteristic analysis result.
And the comment display module is used for displaying the comment information related to the lyric information based on the target position of the lyric information.
The application also provides a comment display device in the music playing process, the comment display device in the music playing process is an entity device, the comment display device in the music playing process includes: the comment display method comprises a memory, a processor and a comment display program in the music playing process stored on the memory, wherein the comment display program in the music playing process is executed by the processor to realize the comment display method in the music playing process.
The application also provides a storage medium which is a computer readable storage medium, a comment display program in the music playing process is stored on the computer readable storage medium, and the comment display program in the music playing process is executed by a processor to realize the steps of the comment display method in the music playing process.
The application provides a comment display method, equipment and a storage medium in the music playing process, compared with the technical means that a user can input comment information manually by clicking a comment box in the prior art to comment the music being listened to, the method comprises the steps of firstly analyzing the personal behavior characteristics of a target audience in the music playing process, further determining the lyric information played by the current music based on the characteristic analysis result, realizing the analysis based on the personal behavior characteristics of the target audience to determine whether a comment display system is automatically triggered in the song listening process, further displaying the comment information related to the lyric information based on the target position of the lyric information, and realizing the detection and analysis of the personal behavior characteristics of the target audience in the playing process, the method comprises the steps of judging which lyrics or melodies in a song can cause resonance of a target listener according to personal behavior characteristics of the target listener in a playing process, determining whether a comment display system is started for the target listener, determining lyric information corresponding to a current comment display time point according to the comment display time point, and displaying comment information related to the lyric information at the position of the lyric information, so that different listeners and different states of the listeners can see different comment positions and different corresponding comment contents when listening to the same music, and the comment display for the music is more targeted.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.
Fig. 1 is a schematic flowchart of a comment display method in the music playing process according to a first embodiment of the present application;
FIG. 2 is a flowchart illustrating a comment displaying method according to a second embodiment of the present application during music playing;
fig. 3 is a schematic flowchart of a comment displaying method in the music playing process according to a third embodiment of the present application;
FIG. 4 is a flowchart illustrating a fourth embodiment of a comment displaying method during music playing of the present application;
fig. 5 is a flowchart illustrating a fifth embodiment of a comment displaying method during music playing of the present application;
fig. 6 is a flowchart illustrating a sixth embodiment of a comment displaying method in the music playing process of the present application;
fig. 7 is a schematic flowchart of a seventh embodiment of a comment displaying method in the music playing process of the present application;
fig. 8 is a schematic structural diagram of a comment display device in a music playing process in a hardware operating environment according to an embodiment of the present application;
fig. 9 is a schematic diagram of functional modules of a comment display apparatus in the music playing process of the present application.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
In a first embodiment of the comment displaying method in the music playing process of the present application, referring to fig. 1, the comment displaying method in the music playing process includes:
step S10, analyzing the personal behavior characteristics of the target audience in the music playing process;
in this embodiment, it should be noted that when a target listener opens a music application of a mobile terminal to start listening to a song, a current music playing mode is detected by the mobile terminal of the target listener, where the mobile terminal includes a mobile phone, a tablet, a handheld computer, and other terminal devices, the music playing mode includes an earphone playing mode and a music playing mode, the earphone playing mode is a mode in which the target listener uses an earphone to play, for example, uses a bluetooth earphone, a wired earphone, and the like to play, the music playing mode is a mode in which music playing is performed by a speaker device, and the personal behavior characteristics include characteristic information of the target listener, such as heartbeat, respiration, pulse, and geographic location information.
It should be further noted that, for the personal behavior feature of the earphone playing mode, before the music playing, normal feature values of the heartbeat frequency, the breathing frequency, and the like of the target listener are recorded in advance through the mobile terminal, and are set as a pre-feature threshold according to the normal feature values, for example, the range corresponding to the feature threshold of the heartbeat frequency is 60-80 times/minute, and the range corresponding to the feature threshold of the breathing frequency is 15-25 times/minute.
In the music playing process, analyzing the personal behavior characteristics of a target audience, specifically, performing characteristic analysis based on the personal behavior characteristics corresponding to different music playing modes, comparing and analyzing the personal behavior characteristic information with a preset characteristic threshold value for the personal behavior characteristics of an earphone playing mode to obtain a characteristic analysis result, and determining whether to start a comment display system according to the characteristic analysis.
Further, for the personal behavior characteristics of the music play-out mode, the current position information of the target audience is determined, after the specific position information of the target audience is determined, the video recording function of the mobile terminal of the target audience is started to continuously update the target state image of the target audience, and then whether the target audience is in the silent rest state is judged based on the state similarity of the target state image, that is, whether the target audience is in the same position is judged, and then the silent time and the preset time length of the target audience in the silent rest state are compared and analyzed, so that whether the comment display system is started is determined according to the characteristic analysis result, and the comment display system is automatically triggered according to the personal behavior characteristics of the audience.
Step S20, based on the result of the feature analysis, determining the lyric information played by the current music;
in this embodiment, it should be noted that the comment information includes information such as lyric information of playing music, comment text information, and recorded video information, and in this application, the comment information may include comment information of a current target listener and comment information of other listeners, and it should be understood that when a comment is made on a lyric, a comment can be made on one or more lyrics, and the comment information of all listeners and the lyric information at a time point at which a comment operation is started are stored in an associated manner.
If the current music is in an earphone playing mode, when the comment display system is started, determining that the feature analysis result exceeds a comment display time point corresponding to a preset feature threshold, and then returning and searching specific lyric information of the comment display time point according to the comment display time point, further, if the music playing mode is the music playing mode, when the comment display system is started, determining a comment display time point when the silence time corresponding to the target audience exceeds a preset duration, and inquiring the lyric information corresponding to the current music based on the comment display time point.
Wherein the step of determining lyric information played by the current music based on the result of the feature analysis comprises:
step S21, if the current music is in the earphone playing mode, determining a comment display time point corresponding to the personal behavior characteristic exceeding a preset characteristic threshold value based on the characteristic analysis result; inquiring lyric information corresponding to the comment display time point;
in this embodiment, specifically, for a feature analysis result corresponding to the earphone playing mode, a comment presentation time point corresponding to a condition that a personal behavior feature in the feature analysis result exceeds a preset feature threshold is determined, and then lyric information played by current music is queried based on the comment presentation time point, for example, in a process of listening to a song by a target listener, the 1 st: and (3) when the heart beat, the breath or the pulse of the comment display time point of 06 seconds exceed a preset characteristic threshold, returning to inquire the 1 st: lyric information corresponding to 06 seconds.
Step S22, if the current music is in a music play mode, determining a comment display time point when the silence time corresponding to the target audience exceeds a preset time length based on the feature analysis result; and inquiring the lyric information corresponding to the comment display time point.
In the application, specifically, if the current music is in a music play-out mode, according to a feature analysis result of feature analysis performed on the individual behavior features, a comment display time point at which the corresponding silent time of the target audience exceeds a preset time length is determined, that is, a comment display time point at which the time when the target audience is at the same position exceeds the preset time length is determined, and then lyric information played by the current music is queried based on the comment display time point.
And step S30, displaying comment information related to the lyric information based on the target position of the lyric information.
In this embodiment, it should be noted that the target position is a position where the comment information is displayed, and in the present application, the comment information associated with the lyric information is displayed at the target position, so that different status characteristics of different song-listening persons such as different personal operation behaviors when listening to songs are realized, and different comment display positions are seen, that is, for the same song, different lyric information in songs corresponding to different listeners has different feelings, and further, the observed comment information has different positions and different comment contents.
Compared with the technical means that the user actively inputs comment information by clicking a comment box to comment the music being listened to in the prior art, the comment display method for the music playing process comprises the steps of firstly analyzing the personal behavior characteristics of a target audience in the music playing process, then determining lyric information played by the current music based on a characteristic analysis result, realizing the analysis based on the personal behavior characteristics of the target audience to determine whether a comment display system is automatically triggered in the music listening process, further displaying the comment information related to the lyric information based on the target position of the lyric information, and realizing the detection and analysis of the personal behavior characteristics of the target audience in the playing process, the method comprises the steps of judging which lyrics or melodies in a song can cause resonance of a target listener according to personal behavior characteristics of the target listener in a playing process, determining whether a comment display system is started for the target listener, determining lyric information corresponding to a current comment display time point according to the comment display time point, and displaying comment information related to the lyric information at the position of the lyric information, so that different listeners and different states of the listeners can see different comment positions and different corresponding comment contents when listening to the same music, and the comment display for the music is more targeted.
Further, referring to fig. 2, in another embodiment of the present application, based on the first embodiment of the present application, the step of obtaining the personal behavior feature of the target audience comprises:
step A10, if the current music is in a music playing mode, sending a detection signal through the mobile terminal of the target audience, and detecting the detection signal to obtain the information of the environmental object array;
in this embodiment, it should be noted that the detection signal includes a sound wave signal, an infrasound wave signal, and the like, and the detection signal is sent to the surroundings by using the played audio of the mobile terminal as a detector.
Specifically, when the music playing mode is a music playing mode, the mobile terminal transmits the detection signal to the surrounding environment, the transmission time of the detection signal is recorded, the mobile terminal starts a receiver of the detection signal to receive the detection signal transmitted to the mobile terminal, and records the receiving angle and the receiving time of the detection signal, and then based on the transmission time, the receiving time and the preset propagation speed of the detection signal, the distance between the surrounding object and the mobile terminal is respectively calculated, and further based on the receiving angle and the distance, the object position information of the current environment object is simulated by taking the three-dimensional sphere as a basic model, so that the environment object array information is obtained.
Wherein, the step of sending a detection signal through the mobile terminal of the target audience and detecting the detection signal to obtain the information of the environmental object array comprises the following steps:
step A11, sending a detection signal by the mobile terminal, and recording the emission time of the detection signal and the signal receiving information reflected by the detection signal to the mobile terminal;
in this embodiment, it should be noted that the signal reception information includes a reception time and a reception angle at which the probe signal is reflected to the mobile terminal.
Specifically, the mobile terminal sends a detection signal, and further records the transmission time corresponding to the detection information, and starts a signal receiver of the mobile terminal to receive the detection signal reflected to the mobile terminal, and records the receiving time and the receiving angle of the detection signal.
Step A12, calculating object position information of the environment around the mobile terminal based on the emission time, signal receiving information and preset propagation speed corresponding to the detection signal, and obtaining the array information of the environment objects.
In this embodiment, it should be noted that the detection signals all have corresponding propagation velocities in air propagation, and the environmental object array information is object information of a 360 ° three-dimensional surrounding space calculation range.
Specifically, based on the transmitting time, the receiving time and the preset propagation speed corresponding to the detection signal, calculating the distance between the surrounding environment and the mobile terminal according to a preset calculation mode to obtain the object position information of the surrounding environment, further, according to the object position information and the angle information, the object position information of a 360-degree three-dimensional surrounding space is constructed, thereby obtaining the environmental object list information, for example, the mobile terminal records the emission time of the detection signal as T0, further recording the receiving angle as X degrees, the receiving time as Ti, the preset propagation velocity as V, further calculating the distance between the surrounding environment object and the mobile terminal according to a preset calculation formula m-V (Ti-T0)/2, and simulating the object information of a 360-degree three-dimensional surrounding space according to the receiving angle and the distance, thereby forming the environmental object array information.
Step A20, performing temperature detection on the environment object array information to obtain a temperature detection result;
in this embodiment, it should be noted that the temperatures of the human body and the object are different, and the target audience and other objects can be distinguished through temperature perception.
Specifically, an infrared detector of the mobile terminal emits an infrared detection signal, and temperature detection is performed on an object in the surrounding environment of the mobile terminal, so that a temperature detection result is obtained. In another possible embodiment, the temperature of the object in the environment around the mobile terminal may be detected by a temperature sensor.
Step A30, determining the personal behavior characteristics corresponding to the target audience based on the temperature detection result.
In this embodiment, specifically, according to the temperature detection result, an object in a normal human body temperature range is searched, and objects of other position information are deleted, so that the position information of the target audience is determined, and the position information is used as the personal behavior feature.
The embodiment of the application provides a comment display method in a music playing process, that is, if the current music is in a music playing mode, a detection signal is sent through a mobile terminal of a target audience, the detection signal is detected to obtain environment object array information, the environment object array information is subjected to temperature detection to obtain a temperature detection result, further, based on the temperature detection result, personal behavior characteristics corresponding to the target audience are determined, the situation that when the mobile terminal is in the music playing mode, the environment object array information is simulated by emitting the detection signal to the surrounding environment, the objects in the environment object array information are subjected to temperature detection, and therefore the objects close to the temperature range of a human body are selected, and the personal behavior characteristics of the target audience are determined.
Further, referring to fig. 3, based on the first embodiment in the present application, in another embodiment of the present application, before the step of analyzing the personal behavior characteristics of the target audience, the comment displaying method in the music playing process further includes:
and step B10, if the current music is in the earphone playing mode, detecting the personal behavior characteristics of the target audience through preset sensing equipment.
In this embodiment, it should be noted that the preset sensing device may be disposed on the earphone of the target listener or on the mobile terminal, and preferably, the preset sensing device is disposed on the earphone of the target listener.
Specifically, if the current music is in an earphone playing mode, the characteristics of the heartbeat frequency, the breathing frequency and the like of the target audience are detected through preset sensing equipment corresponding to an earphone worn by the target audience, the personal behavior characteristics are obtained, the song listening state of the target audience is determined based on the personal behavior characteristics, in another implementation scheme, the personal behavior characteristics of the heartbeat frequency, the breathing frequency and the like of the target audience are obtained through detection, geographic position information corresponding to the target user is collected, feature analysis is performed subsequently, and comment information of the music is displayed in a popup window when other listeners play the music in the geographic position information.
Further, referring to fig. 4, based on the first embodiment of the present application, in another embodiment of the present application, the step of analyzing the personal behavior characteristics of the target audience comprises:
step C10, if the current music is in the earphone playing mode, comparing and analyzing the personal behavior characteristics with a preset frequency threshold;
in this embodiment, it should be noted that, before music is played, a piece of normal characteristic values of the heartbeat, the breathing frequency, and the like of a target listener are recorded in advance through a mobile terminal, and the normal characteristic values are set as preset characteristic threshold values.
Specifically, if the current music is in an earphone playing mode, the personal behavior feature is compared and analyzed with a preset frequency threshold, if the personal behavior feature is determined to exceed the preset feature threshold according to a comparison result, it is proved that the lyrics or melody of the music causes resonance of a target listener, and the comment displaying system is started, for example, normal feature values of heartbeat, respiratory frequency and the like are respectively 70 times/minute and 20 times/minute, on the basis, the preset frequency threshold is set to be +/-10, that is, the preset frequency threshold corresponding to the heartbeat is 60-80 times/minute, or the preset frequency threshold corresponding to the respiratory frequency is 10-30 times/minute, if the heartbeat or the respiratory frequency is detected to be out of the range of the preset frequency threshold, it is determined that the comment displaying system can be started, so that the body features of the listener in the process of listening to the music are realized, and the comment display system is automatically triggered by characteristics such as personal operation behaviors and the like.
Further, referring to fig. 5, based on the first embodiment of the present application, in another embodiment of the present application, the step of analyzing the personal behavior characteristics of the target audience comprises:
step D10, if the current music is in a music playing mode, determining the position information corresponding to the target audience based on the personal behavior characteristics;
in this embodiment, it should be noted that, if the current music is in the music play mode, the personal behavior feature includes the location information of the target audience.
Step D20, continuously recording each target state image of the target audience through the mobile terminal of the target audience based on the position information;
in this embodiment, specifically, based on the position information, a video recording function is further turned on to continuously record and update the target state image of the target audience, so as to determine whether the target audience is in the same position based on the target state image.
Step D30, calculating the state similarity of each target state image, and determining the silent time of the target audience according to the state similarity;
in the present embodiment, the state similarity is a similarity between target state images of target listeners.
Specifically, the state similarity of two adjacent front and rear target state images is calculated by a preset similarity calculation method to obtain the state similarity, if the state similarity exceeds a preset similarity threshold, it is proved that the target audience is at the same position, that is, the target audience is in a silent rest state, therefore, only one target state image needs to be retained, and further the state similarity of the target state image and the adjacent target state image is continuously calculated, so that the silent time of the target audience is determined according to the state similarity, if the state similarity does not exceed the preset similarity threshold, it is proved that the target audience is not at the same position, therefore, the adjacent front and rear target state images need to be retained, for example, the two front and rear target state images are respectively cut into 100 × 100 small squares, the method includes the steps of searching squares where states of a target audience are located twice in 10000 squares, marking the squares as S1 (m1, m2, m3, m4... 9.) and S2 (n1, n2, n3, n4... 9.), and then comparing and calculating state similarity of S1 and S2, namely, the state similarity is the same point/total point 100%, wherein the total point takes the number of points in S1 or S2, for example, if S1 is 99 and S2 is 100, then 100 is taken as the total point, then only one target state image is retained if the state similarity is more than 90%, and the two previous and next target state images are retained if the similarity is less than 90%.
And D40, comparing and analyzing the silent time and the preset time length.
In this embodiment, it should be noted that the preset duration is a duration of silence of a listener, that is, a duration of the listener being at the same position, and in this application, the preset duration may be set to be 1 minute to 3 minutes, and preferably, the preset duration is set to be 2 minutes.
Specifically, the silent time and the preset time are compared and analyzed, and if the silent time exceeds the preset time, it is proved that the lyrics or melody of the current music may cause resonance of a target audience, and the comment displaying system is started, so that the comment displaying system is automatically triggered according to the silent time of the audience at the same position in the process of listening to the songs.
Further, referring to fig. 6, according to the first embodiment of the present application, in another embodiment of the present application, if the current music is in the headphone playing mode, before determining the lyric information played by the current music based on the feature analysis result, the method further includes:
step E10, if the personal behavior characteristics in the characteristic analysis result exceed a preset characteristic threshold, starting comment operation;
step E20, according to the first target time point started by the comment operation, inquiring lyric information corresponding to the first target time point, and recording target video information of the target audience through the mobile terminal;
and E30, generating comment information corresponding to the lyric information based on the target video information.
In this embodiment, specifically, if the current music is in the earphone playing mode, the personal behavior feature is analyzed to determine that the feature analysis result exceeds a first target time point corresponding to a preset feature threshold, where for the earphone playing mode, the specific content of the personal behavior feature subjected to the feature analysis may refer to the specific content in steps B10 to B20, which is not repeated here, and further returns to search for specific lyric information of the first target time point according to the first target time point, and starts a video recording function of the mobile terminal of the target listener to record the current environment and the personal facial state of the target listener to obtain the target video information, and further generates comment information of the target listener based on the currently recorded target video information and the lyric information, and further, if the target audience inputs the commenting characters of the music based on the comment bullet box, the commenting characters of the target audience, the currently recorded target video information and the lyric information corresponding to the target time point are packaged and stored to generate the commenting information of the target audience, for example, the target audience plays the music by using a mobile phone, and if in the music playing process, the 1 st: and marking the comment information of the target audience as the position corresponding to the 1:06 second lyric information of the music when the heartbeat, the respiration or the pulse at the time point of 06 seconds exceeds a preset characteristic threshold value.
Further, referring to fig. 7, in another embodiment of the present application, before determining lyric information of a current music playing based on a feature analysis result, based on the first embodiment in the present application, the method further includes:
step F10, if the silence time corresponding to the feature analysis result exceeds a preset duration, starting comment operation;
step F20, according to the second target time point started by the comment operation, inquiring lyric information corresponding to the second target time point, and recording the target video information of the target audience through the mobile terminal;
step F30, based on the target video information, generating comment information corresponding to the lyric information.
In this embodiment, specifically, if the music playing mode is the music playing mode, the position information corresponding to the target audience is determined based on the personal behavior feature, and then a video recording function of the mobile terminal of the target audience is started, so as to continuously update the target state image of the target audience, and further determine whether the target audience is in the silent rest state based on the state similarity of the target state image, and if the silent time of the target audience in the silent rest state exceeds a preset time length, determine whether the silent time of the target audience in the same position information exceeds the preset time length, then start a comment operation, where for the music playing mode, the specific content for performing feature analysis on the personal behavior feature may refer to the specific content in steps C10 to C30, and is not described herein again, and then start the camera device of the mobile terminal, continuously recording the surrounding environment of the target audience according to a preset recording time to obtain the target video information, storing the target video information and the music to generate a personal comment log of the target audience, and pushing the target video information to the target audience after the target audience stops playing the music so that the target audience can check and determine whether comment characters of the music need to be input for publication, thereby realizing automatic triggering of a comment system to comment, for example, the target audience plays the music by using a mobile phone, and in the music playing process, in the step 1: the comment information of the target audience is marked as the position of the 1 st: 06 th second lyric information of the music when the corresponding silence time of the target audience at the time point of 06 seconds exceeds the preset time length, so that the personal behavior characteristics of the target audience in the playing process are detected and analyzed, the fact that the lyrics or melody in the song can cause resonance of the target audience is judged according to the personal behavior characteristics of the target audience in the playing process, whether a comment system is started or not is determined, the audiences can share the experience of listening to the song, namely, the comment behavior is automatically triggered according to the personal behavior characteristics of the target audience, a user does not need to manually click a comment popup window, the comment operation is convenient and fast, and the comment of the music is more targeted.
Referring to fig. 8, fig. 8 is a schematic structural diagram of a comment display device in a music playing process of a hardware operating environment according to an embodiment of the present application.
As shown in fig. 8, the comment displaying apparatus in the music playing process may include: a processor 1001, such as a CPU, a memory 1005, and a communication bus 1002. The communication bus 1002 is used for realizing connection communication between the processor 1001 and the memory 1005. The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a memory device separate from the processor 1001 described above.
Optionally, the comment display device during music playing may further include a rectangular user interface, a network interface, a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module, and the like. The rectangular user interface may comprise a Display screen (Display), an input sub-module such as a Keyboard (Keyboard), and the optional rectangular user interface may also comprise a standard wired interface, a wireless interface. The network interface may optionally include a standard wired interface, a wireless interface (e.g., WIFI interface).
Those skilled in the art will appreciate that the comment display apparatus during music playing shown in fig. 8 does not constitute a limitation of the comment display apparatus during music playing, and may include more or less components than those shown, or combine some components, or a different arrangement of components.
As shown in fig. 8, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, and a comment display program in the course of music playing. The operating system is a program for managing and controlling hardware and software resources of the comment display device in the music playing process, and supports the running of the comment display program in the music playing process and other software and/or programs. The network communication module is used for realizing communication among the components in the memory 1005 and communication with other hardware and software in the comment display device in the music playing process.
In the comment displaying apparatus during music playing shown in fig. 8, the processor 1001 is configured to execute a comment displaying program during music playing stored in the memory 1005, and implement any of the steps of the comment displaying method during music playing described above.
The specific implementation of the comment display device in the music playing process of the application is basically the same as that of each embodiment of the comment display method in the music playing process, and details are not repeated here.
Further, referring to fig. 9, fig. 9 is a schematic functional block diagram of a comment display apparatus in a music playing process of the present application, and the present application further provides a comment display apparatus in a music playing process, where the comment display apparatus in a music playing process includes:
the characteristic analysis module is used for analyzing the personal behavior characteristics of the target audience in the music playing process;
and the determining module is used for determining the lyric information played by the current music based on the characteristic analysis result.
And the comment display module is used for displaying the comment information related to the lyric information based on the target position of the lyric information.
Optionally, the obtaining module is further configured to:
if the current music is in a music playing mode, sending a detection signal through a mobile terminal of the target audience, and detecting the detection signal to obtain the information of the environmental object array;
carrying out temperature detection on the environment object array information to obtain a temperature detection result;
and determining the personal behavior characteristics corresponding to the target audience based on the temperature detection result.
Optionally, the obtaining module is further configured to:
sending a detection signal through the mobile terminal, and recording the emission time of the detection signal and the signal receiving information reflected to the mobile terminal by the detection signal;
and calculating object position information of the surrounding environment of the mobile terminal based on the corresponding transmitting time, signal receiving information and preset propagation speed of the detection signal, and obtaining environment object array information.
Optionally, the obtaining module is further configured to:
and if the current music is in an earphone playing mode, detecting the personal behavior characteristics of the target audience through preset sensing equipment.
Optionally, the feature analysis module is further configured to:
if the current music is in an earphone playing mode, comparing and analyzing the personal behavior characteristics with a preset frequency threshold;
if the current music is in a music playing mode, determining the position information corresponding to the target audience based on the personal behavior characteristics; continuously recording each target state image of the target audience through a mobile terminal of the target audience based on the position information; calculating the state similarity of each target state image, and determining the silent time of the target audience in the position information according to the state similarity; and comparing and analyzing the silence time with a preset time length.
Optionally, the comment displaying device during music playing is further configured to:
if the personal behavior characteristics in the characteristic analysis result exceed a preset characteristic threshold, starting comment operation;
inquiring lyric information corresponding to the first target time point according to the first target time point started by the comment operation, and recording target video information of the target audience through a mobile terminal;
and generating comment information corresponding to the lyric information based on the target video information.
Optionally, the comment displaying device during music playing is further configured to:
if the silence time corresponding to the feature analysis result exceeds a preset time length, starting comment operation;
inquiring lyric information corresponding to a second target time point according to the second target time point started by the comment operation, and recording target video information of the target audience through a mobile terminal;
and generating comment information corresponding to the lyric information based on the target video information.
Optionally, the comment presentation module is further configured to:
if the current music is in an earphone playing mode, determining comment display time points corresponding to the individual behavior characteristics exceeding a preset characteristic threshold value based on the characteristic analysis result;
and if the current music is in a music play-out mode, determining a comment display time point when the silence time corresponding to the target audience exceeds a preset time length based on the feature analysis result.
The specific implementation of the comment display device in the music playing process of the application is basically the same as that of each embodiment of the comment display method in the music playing process, and details are not repeated here.
The embodiment of the present application provides a storage medium, where the storage medium is a computer-readable storage medium, and the computer-readable storage medium stores one or more programs, and the one or more programs are further executable by one or more processors for implementing the steps of the comment display method in the music playing process described in any one of the above.
The specific implementation manner of the computer-readable storage medium of the present application is substantially the same as that of each embodiment of the comment display method in the music playing process, and is not described herein again.
The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings, or which are directly or indirectly applied to other related technical fields, are included in the scope of the present application.
Claims (10)
1. A comment display method in a music playing process is characterized by comprising the following steps:
analyzing the personal behavior characteristics of a target audience in the music playing process;
determining lyric information played by the current music based on the feature analysis result;
and displaying comment information related to the lyric information based on the target position of the lyric information.
2. The comment displaying method during music playing of claim 1, wherein before the step of analyzing the personal behavior characteristics of the target audience, the comment displaying method during music playing further comprises:
if the current music is in a music playing mode, sending a detection signal through a mobile terminal of the target audience, and detecting the detection signal to obtain the information of the environmental object array;
carrying out temperature detection on the environment object array information to obtain a temperature detection result;
and determining the personal behavior characteristics corresponding to the target audience based on the temperature detection result.
3. The method for displaying comments during playing music as claimed in claim 2, wherein the step of obtaining the information of the environmental object array by sending a probe signal through the mobile terminal of the target listener and detecting the probe signal comprises:
sending a detection signal through the mobile terminal, and recording the emission time of the detection signal and the signal receiving information reflected to the mobile terminal by the detection signal;
and calculating object position information of the surrounding environment of the mobile terminal based on the corresponding transmitting time, signal receiving information and preset propagation speed of the detection signal, and obtaining environment object array information.
4. The comment displaying method during music playing of claim 1, wherein before the step of analyzing the personal behavior characteristics of the target audience, the comment displaying method during music playing further comprises:
and if the current music is in an earphone playing mode, detecting the personal behavior characteristics of the target audience through preset sensing equipment.
5. The method of displaying comments during playing of music as claimed in claim 1, wherein the step of analyzing the personal behavior characteristics of the target audience comprises:
if the current music is in an earphone playing mode, comparing and analyzing the personal behavior characteristics with a preset frequency threshold;
if the current music is in a music playing mode, determining the position information corresponding to the target audience based on the personal behavior characteristics; continuously recording each target state image of the target audience through a mobile terminal of the target audience based on the position information; calculating the state similarity of each target state image, and determining the silent time of the target audience in the position information according to the state similarity; and comparing and analyzing the silence time with a preset time length.
6. The method for displaying comments during playing music as claimed in claim 1, further comprising, before determining lyric information of the current music played based on the result of the feature analysis if the current music is in the headphone playing mode:
if the personal behavior characteristics in the characteristic analysis result exceed a preset characteristic threshold, starting comment operation;
inquiring lyric information corresponding to the first target time point according to the first target time point started by the comment operation, and recording target video information of the target audience through a mobile terminal;
and generating comment information corresponding to the lyric information based on the target video information.
7. The method for displaying comments during playing music as claimed in claim 1, further comprising, before determining lyric information of the current music played based on the result of the feature analysis if the current music is in a music play mode:
if the silence time corresponding to the feature analysis result exceeds a preset time length, starting comment operation;
inquiring lyric information corresponding to a second target time point according to the second target time point started by the comment operation, and recording target video information of the target audience through a mobile terminal;
and generating comment information corresponding to the lyric information based on the target video information.
8. The method for displaying comments during playing music as claimed in claim 1, wherein the step of determining lyric information of the current music playing based on the result of the feature analysis comprises:
if the current music is in an earphone playing mode, determining comment display time points corresponding to the individual behavior characteristics exceeding a preset characteristic threshold value based on the characteristic analysis result; inquiring lyric information corresponding to the comment display time point;
if the current music is in a music playing mode, determining a comment display time point when the silence time corresponding to the target audience exceeds a preset time length based on the feature analysis result; and inquiring the lyric information corresponding to the comment display time point.
9. A comment display apparatus in a music playing process, characterized in that the comment display apparatus in the music playing process includes: a memory, a processor and a comment display program stored in the memory during music playing,
the comment displaying program in music playing process is executed by the processor to implement the comment displaying method in music playing process as set forth in any one of claims 1 to 8.
10. A storage medium which is a computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a comment displaying program in a music playing process, the comment displaying program in the music playing process being executed by a processor to implement the steps of the comment displaying method in the music playing process according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111592494.3A CN114385108B (en) | 2021-12-23 | 2021-12-23 | Comment display method, comment display equipment and storage medium in music playing process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111592494.3A CN114385108B (en) | 2021-12-23 | 2021-12-23 | Comment display method, comment display equipment and storage medium in music playing process |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114385108A true CN114385108A (en) | 2022-04-22 |
| CN114385108B CN114385108B (en) | 2024-03-22 |
Family
ID=81197550
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111592494.3A Active CN114385108B (en) | 2021-12-23 | 2021-12-23 | Comment display method, comment display equipment and storage medium in music playing process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114385108B (en) |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070294374A1 (en) * | 2006-06-20 | 2007-12-20 | Sony Corporation | Music reproducing method and music reproducing apparatus |
| JP2012113589A (en) * | 2010-11-26 | 2012-06-14 | Nec Corp | Action motivating device, action motivating method and program |
| US20130094659A1 (en) * | 2010-07-07 | 2013-04-18 | Zte Corporation | Music playing control method and music playing terminal |
| WO2015062337A1 (en) * | 2013-10-29 | 2015-05-07 | Tencent Technology (Shenzhen) Company Limited | Displaying lyrics of a song on a mobile computing device in a lock screen state |
| US20160048589A1 (en) * | 2013-04-11 | 2016-02-18 | Prerna Modi | System to search and play music |
| WO2016123901A1 (en) * | 2015-02-03 | 2016-08-11 | 中兴通讯股份有限公司 | Terminal and method for directionally playing audio signal thereby |
| CN105979312A (en) * | 2016-07-13 | 2016-09-28 | 腾讯科技（深圳）有限公司 | Information sharing method and device |
| CN107944040A (en) * | 2017-12-14 | 2018-04-20 | 维沃移动通信有限公司 | The display methods and mobile terminal of a kind of lyrics |
| CN108429972A (en) * | 2018-05-28 | 2018-08-21 | Oppo广东移动通信有限公司 | Method for playing music, device, terminal, earphone and readable storage medium storing program for executing |
| WO2018223837A1 (en) * | 2017-06-08 | 2018-12-13 | Oppo广东移动通信有限公司 | Music playing method and related product |
| CN109582821A (en) * | 2018-11-27 | 2019-04-05 | 努比亚技术有限公司 | A kind of music object recommendation method, terminal and computer readable storage medium |
| CN109982129A (en) * | 2019-03-26 | 2019-07-05 | 北京达佳互联信息技术有限公司 | Control method for playing back, device and the storage medium of short-sighted frequency |
| CN110324647A (en) * | 2019-07-15 | 2019-10-11 | 北京字节跳动网络技术有限公司 | The determination method, apparatus and electronic equipment of information |
| CN112995654A (en) * | 2021-02-08 | 2021-06-18 | 咪咕音乐有限公司 | Video playing pause detection method and device, server and readable storage medium |
| CN113793578A (en) * | 2021-08-12 | 2021-12-14 | 咪咕音乐有限公司 | Tune generation method, device, equipment and computer readable storage medium |
-
2021
- 2021-12-23 CN CN202111592494.3A patent/CN114385108B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070294374A1 (en) * | 2006-06-20 | 2007-12-20 | Sony Corporation | Music reproducing method and music reproducing apparatus |
| US20130094659A1 (en) * | 2010-07-07 | 2013-04-18 | Zte Corporation | Music playing control method and music playing terminal |
| JP2012113589A (en) * | 2010-11-26 | 2012-06-14 | Nec Corp | Action motivating device, action motivating method and program |
| US20160048589A1 (en) * | 2013-04-11 | 2016-02-18 | Prerna Modi | System to search and play music |
| WO2015062337A1 (en) * | 2013-10-29 | 2015-05-07 | Tencent Technology (Shenzhen) Company Limited | Displaying lyrics of a song on a mobile computing device in a lock screen state |
| WO2016123901A1 (en) * | 2015-02-03 | 2016-08-11 | 中兴通讯股份有限公司 | Terminal and method for directionally playing audio signal thereby |
| CN105979312A (en) * | 2016-07-13 | 2016-09-28 | 腾讯科技（深圳）有限公司 | Information sharing method and device |
| WO2018223837A1 (en) * | 2017-06-08 | 2018-12-13 | Oppo广东移动通信有限公司 | Music playing method and related product |
| CN107944040A (en) * | 2017-12-14 | 2018-04-20 | 维沃移动通信有限公司 | The display methods and mobile terminal of a kind of lyrics |
| CN108429972A (en) * | 2018-05-28 | 2018-08-21 | Oppo广东移动通信有限公司 | Method for playing music, device, terminal, earphone and readable storage medium storing program for executing |
| CN109582821A (en) * | 2018-11-27 | 2019-04-05 | 努比亚技术有限公司 | A kind of music object recommendation method, terminal and computer readable storage medium |
| CN109982129A (en) * | 2019-03-26 | 2019-07-05 | 北京达佳互联信息技术有限公司 | Control method for playing back, device and the storage medium of short-sighted frequency |
| CN110324647A (en) * | 2019-07-15 | 2019-10-11 | 北京字节跳动网络技术有限公司 | The determination method, apparatus and electronic equipment of information |
| CN112995654A (en) * | 2021-02-08 | 2021-06-18 | 咪咕音乐有限公司 | Video playing pause detection method and device, server and readable storage medium |
| CN113793578A (en) * | 2021-08-12 | 2021-12-14 | 咪咕音乐有限公司 | Tune generation method, device, equipment and computer readable storage medium |
Non-Patent Citations (2)
| Title |
|---|
| WENXING HONG: "Weighted-based summarization of music comments", 2013 8TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION, pages 140 - 143 * |
| 柳鹏: "基于移动终端的呼吸频率实时监护研究", 中国优秀硕士学位论文全文数据库电子期刊, pages 1 - 65 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114385108B (en) | 2024-03-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2020098462A1 (en) | Ar virtual character drawing method and apparatus, mobile terminal and storage medium | |
| CN105979312B (en) | Information sharing method and device | |
| CN109256146B (en) | Audio detection method, device and storage medium | |
| CN106210755B (en) | A kind of methods, devices and systems playing live video | |
| CN106303733B (en) | Method and device for playing live special effect information | |
| WO2018223837A1 (en) | Music playing method and related product | |
| WO2017215652A1 (en) | Sound effect parameter adjustment method, and mobile terminal | |
| US8963722B2 (en) | Apparatus and method for playing and/or generating audio content for an audience | |
| TWI574256B (en) | Interactive beat effect system and method for processing interactive beat effect | |
| CN112511850B (en) | Wheat connecting method, live broadcast display device, equipment and storage medium | |
| US20210027800A1 (en) | Method for processing audio, electronic device and storage medium | |
| CN108683927A (en) | Main broadcaster recommends method, apparatus and storage medium | |
| CN109040297A (en) | User's portrait generation method and device | |
| CN109859730A (en) | A kind of audio-frequency processing method and device | |
| CN107680614B (en) | Audio signal processing method, apparatus and storage medium | |
| CN110087149A (en) | A kind of video image sharing method, device and mobile terminal | |
| CN111370018A (en) | Audio data processing method, electronic device and medium | |
| US10704913B2 (en) | Positioning method using music pieces | |
| CN109254752A (en) | 3D sound effect treatment method and Related product | |
| CN107809674A (en) | A kind of customer responsiveness acquisition, processing method, terminal and server based on video | |
| CN112882568A (en) | Audio playing method and device, electronic equipment and storage medium | |
| CN110297543B (en) | Audio playing method and terminal equipment | |
| CN107911777B (en) | Processing method and device for return-to-ear function and mobile terminal | |
| US12035123B2 (en) | Impulse response generation system and method | |
| CN110660403B (en) | Audio data processing method, device, equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |