CN115714873A - Display device and audio acquisition device selection method - Google Patents

Abstract

The application provides a display device and an audio acquisition device selection method. Therefore, the audio acquisition device to be used can be quickly determined for the scene that the display equipment is externally connected with a plurality of audio acquisition devices.

Description

Display device and audio acquisition device selection method

Technical Field

The application relates to the technical field of display equipment, in particular to display equipment and an audio acquisition device selection method.

Background

Currently, a variety of audio service applications are installed in a display device, and accordingly, the display device is configured to be connected with an audio acquisition apparatus (e.g., a microphone MIC) to realize an audio data acquisition function, so as to meet the requirements of the audio service applications.

The audio acquisition devices and the display device are mostly connected by a USB (Universal Serial Bus) transmission protocol, which allows the display device to be connected to a plurality of audio acquisition devices at the same time.

However, when a plurality of available audio capture devices are currently connected to the display device, how to determine a target device to be used at present becomes an urgent problem to be solved.

Disclosure of Invention

The application provides a display device and an audio acquisition device selection method, which are used for solving the problems in the related art.

In a first aspect, the present application provides a display device comprising:

a display configured to display an image screen and a user interface, and a selector in the user interface to indicate that an item is selected in the user interface;

the equipment interface is used for being connected with at least two audio acquisition devices;

a controller interfaced with the display and the device, the controller configured to:

acquiring a configuration mode of an audio acquisition device;

determining a first audio acquisition device based on the configuration mode and the currently available audio acquisition devices;

and acquiring audio information through the first audio acquisition device.

In some embodiments, the controller is further configured to:

presenting a first user interface in the display in response to a user input to launch an audio service application, wherein the first user interface includes a first control to select a configuration mode, the configuration mode including automatic configuration and manual configuration;

and selecting the user input of the configuration mode in the first user interface through the selector to acquire the configuration mode of the audio acquisition device.

In some embodiments, the controller is further configured to:

in response to a user input through the selector that the configuration mode selected in the first user interface is automatically configured, selecting an audio capture device that has recently accessed the display device from the currently available audio capture devices;

and determining that the audio acquisition device which has accessed the display equipment for the last time is the first audio acquisition device.

In some embodiments, the controller is further configured to:

in response to a user input that the configuration mode selected in the first user interface by the selector is a manual configuration, presenting a second user interface in the display, wherein the second user interface comprises a second control that selects a configuration type for an audio service application, the configuration type comprising a unified configuration for all services and an individual configuration for different services;

and selecting the configuration type of the user input in the second user interface through the selector to acquire the configuration type of the audio acquisition device.

In some embodiments, the controller is further configured to:

presenting a third user interface in the display in response to a user input through the selector that the selected configuration type in the second user interface is a unified configuration for all services, wherein the third user interface includes all currently available audio capture devices;

and selecting the user input of the audio acquisition device in the third user interface through the selector, and determining that the selected audio acquisition device is the first audio acquisition device configured for all audio service applications.

In some embodiments, the controller is further configured to:

in response to a user input through the selector that the configuration type selected in the second user interface is configured for different services individually, presenting a fourth user interface in the display, wherein the fourth user interface includes a third control that configures an audio capture device for each audio service application;

and configuring user input of an audio acquisition device for each audio service application in the fourth user interface through the selector, and determining a first audio acquisition device corresponding to each audio service application.

In some embodiments, the controller is further configured to:

responding to the input of a user for switching the audio acquisition devices, and acquiring a second audio acquisition device to be switched;

starting a second sound card corresponding to the second audio acquisition device based on the audio parameters of the first sound card corresponding to the first audio acquisition device;

and after the second sound card is determined to work normally, determining that the audio data corresponding to the second sound card is the data used by the current audio service application.

In some embodiments, the controller is further configured to:

and closing the first sound card corresponding to the first audio acquisition device.

In a second aspect, the present application provides an audio acquisition device selection method, including:

acquiring a configuration mode of an audio acquisition device;

determining a first audio acquisition device which is currently used based on the configuration mode and the currently available audio acquisition devices;

and acquiring audio information through the first audio acquisition device.

In some embodiments, further comprising:

responding to the input of a user for switching the audio acquisition devices, and acquiring a second audio acquisition device to be switched;

starting a second sound card corresponding to the second audio acquisition device based on the audio parameters of the first sound card corresponding to the first audio acquisition device;

and after the second sound card is determined to work normally, determining that the audio data corresponding to the second sound card is the data used by the current audio service application.

According to the display equipment and the audio acquisition device selection method, under the condition that the scene time needing to use the audio acquisition device is determined, the configuration mode of the audio acquisition device is firstly obtained, based on the configuration mode, the first audio acquisition device is determined from the currently available audio acquisition device, and the audio information is acquired through the first audio acquisition device. Therefore, the audio acquisition device to be used can be quickly determined for the scene that the display equipment is externally connected with a plurality of audio acquisition devices.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a schematic view of a usage scenario of a display device according to an embodiment;

fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment;

fig. 3 illustrates a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment;

a software configuration diagram of a display device according to some embodiments is illustrated in fig. 4;

FIG. 5 is a schematic diagram illustrating a scheme for acquiring a USB audio by a service application in an Android system;

FIG. 6 is a schematic diagram of a display device with a plurality of audio acquisition devices connected externally;

FIG. 7 is a schematic diagram of a UI for selection of an audio capture device in an embodiment of the application;

FIG. 8 is a schematic diagram of a UI that prompts a user whether to perform device switching processing in an embodiment of the application;

fig. 9 is a schematic diagram of an audio acquisition device selection method according to an embodiment of the present application.

Specific embodiments of the present disclosure have been shown by way of example in the drawings and will be described in more detail below. These drawings and written description are not intended to limit the scope of the disclosed concepts in any way, but rather to illustrate the concepts of the disclosure to those skilled in the art by reference to specific embodiments.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The terminology used in the embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the embodiments of the present application, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

The words "if", as used herein, may be interpreted as "at \8230; \8230when" or "when 8230; \823030, when" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a good or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such good or system. Without further limitation, an element defined by the phrases "comprising one of 8230; \8230;" 8230; "does not exclude the presence of additional like elements in articles of commerce or systems in which the element is comprised.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display apparatus 200 is also in data communication with a server 400, and a user can operate the display apparatus 200 through the smart device 300 or the control device 100.

In some embodiments, the smart device 300 may include any of a mobile terminal, a tablet, a computer, a laptop, an AR/VR device, and the like.

In some embodiments, the smart device 300 may also be used to control the display device 200.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also be controlled in ways other than controlling the apparatus 100 and the smart device 300.

In some embodiments, the display device 200 is also in data communication with a server 400.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, serving as an interaction intermediary between the user and the display device 200.

In some embodiments, the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key, or an alternative module.

Fig. 3 illustrates a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.

In some embodiments, the display apparatus 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 260 includes a display screen component for displaying pictures, and a driving component for driving image display, and is used for receiving image signals from the controller output, displaying video content, image content, and components of a menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; alternatively, the detector 230 includes an image capturing device, such as a camera, which may be used to capture external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control.

In some embodiments, the controller includes at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphic Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first interface to an nth interface for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents.

In some embodiments, a graphics processor to generate various graphics objects.

In some embodiments, the video processor is configured to receive an external video signal, and perform at least one of video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal displayed or played on the direct display device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image composition module, a frame rate conversion module, a display formatting module, and the like.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in the speaker.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI).

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user.

In some embodiments, user interface 280 is an interface that may be used to receive control inputs (e.g., physical buttons on the body of the display device, or the like).

In some embodiments, the system of the display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system.

Referring to fig. 4, in some embodiments, the system is divided into four layers, which are an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer from top to bottom.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or may be an application developed by a third party developer.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer.

As shown in fig. 4, in the embodiment of the present application, the application framework layer includes Managers (Managers), content providers (Content providers), and the like.

Fig. 5 is a schematic diagram of a scheme for acquiring a USB audio by a service application in an Android system, and as shown in fig. 5, when an application program of the Android system needs to record a sound, an AudioRecord (audio recording) thread is first called to start recording data reading, and AudioPolicy (audio policy) determines a currently used audio acquisition device.

In FIG. 5, the Audio HAL is an Audio Hardware Abstraction Layer (Hardware Abstraction Layer). AudioPolicy: is responsible for switching of audio devices. The AudioRecord is a set of API (Application Programming Interface) for audio acquisition provided by an Android SDK (Software Development Kit), is close to a bottom layer, can be controlled more freely and flexibly, and can obtain original PCM (Pulse Code Modulation) audio data. The PCM audio data refers to a raw stream of uncompressed audio sample data, which is standard digital audio data obtained by sampling, quantizing, and encoding an analog signal.

Currently, in a display device, an Android system supports external connection of a plurality of USB audio acquisition devices through a USB transmission protocol.

Fig. 6 is a schematic diagram of a display device externally connected with a plurality of audio acquisition devices, as shown in fig. 6, when a plurality of audio acquisition devices are available in a system at the same time, there is no effective way for an audio service to ensure that a specific target audio acquisition device is used (selecting a recording device link, facing a plurality of same USB audio acquisition devices, there is no effective scheme for selecting an audio acquisition device, for example, the system may default to use only one of them), and it is often necessary for a user to pull out an audio acquisition device that is not used from the system, which is not beneficial to the flexible selection of the user.

For example, referring to fig. 6, when 3 audio capture devices are available in the system at the same time, the system may default to use one of the audio capture devices, such as the audio capture device 3, according to a preset rule (for example, using the newly-accessed audio capture device), and if the target device that the user wishes to use is the audio capture device 1, the audio capture device 2 and the audio capture device 3 need to be removed, and only the audio capture device 1 is reserved.

The application provides a display device and an audio acquisition device selection method, and aims to solve the technical problems in the related art.

The main conception of the scheme of the application is as follows: adding a UI (User Interface) menu for configuring an audio acquisition device in a system corresponding to display equipment, wherein the menu core selection comprises two modes of automatic configuration and manual configuration; the automatic configuration means that the system automatically determines the target audio acquisition device to be used currently according to a preset rule, and the manual configuration means that the target audio acquisition device to be used currently is determined according to the selection of a user. Therefore, the audio acquisition device to be used can be quickly determined for the scene that the display equipment is externally connected with a plurality of audio acquisition devices.

The following describes the technical solution of the present application and how to solve the above technical problems in detail by specific embodiments. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.

In some embodiments, there is provided a display device including: a display configured to display the image screen and a user interface, and a selector in the user interface to indicate that an item is selected in the user interface; the equipment interface is used for being connected with at least two audio acquisition devices; a controller interfacing with the display and the device.

Wherein the display correspondence may be the display 260 in fig. 3, the device interface correspondence may be the external apparatus interface 240 in fig. 3, and the controller correspondence may be the controller 250 in fig. 3.

In this embodiment, the controller is configured to: the method comprises the following steps that a controller firstly obtains a configuration mode of an audio acquisition device, wherein the configuration mode comprises manual configuration of a user and automatic configuration of a system; after the configuration mode is obtained, the controller determines a first audio acquisition device based on the configuration mode and the currently available audio acquisition devices; and finally, the controller acquires audio information through the first audio acquisition device.

Specifically, the controller may acquire a configuration manner of the audio capture device when determining a scene in which the audio capture device needs to be used, for example, when a user starts an audio service application in the display device. The configuration mode of the audio acquisition device can be specifically divided into automatic configuration and manual configuration.

When the configuration mode of the audio acquisition devices is automatic configuration, the controller selects one audio acquisition device from currently available audio acquisition devices as a first audio acquisition device to be used currently based on a preset selection rule.

When the configuration mode of the audio acquisition devices is manual configuration, a user can select one of all currently available audio acquisition devices, and then the controller takes the audio acquisition device selected by the user as the first audio acquisition device to be currently used.

After the first audio acquisition device is determined, the controller acquires audio information through the first audio acquisition device, so that corresponding business requirements are met.

In this embodiment, when a scene opportunity that the audio acquisition device needs to be used is determined, the controller first obtains a configuration mode of the audio acquisition device, determines a first audio acquisition device from currently available audio acquisition devices based on the configuration mode, and acquires audio information through the first audio acquisition device. Therefore, the audio acquisition device to be used can be quickly determined for the scene that the display equipment is externally connected with a plurality of audio acquisition devices.

In some embodiments, the controller is further configured to: the controller responds to user input for starting the audio service application and shows a first user interface in the display, wherein the first user interface comprises a first control for selecting a configuration mode, the configuration mode comprises automatic configuration and manual configuration, and a user can select a desired configuration mode in the first user interface; the controller selects user input of the configuration mode in the first user interface through the selector to obtain the configuration mode of the audio acquisition device.

Specifically, fig. 7 is a schematic diagram of a UI interface for selecting an audio acquisition device in the embodiment of the present application, and as shown in fig. 7, when a scene opportunity that the audio acquisition device needs to be used is determined, if a user input for starting an audio service application is acquired, a controller displays a first user interface in a display, where the first user interface includes a first control for selecting a configuration mode, the configuration mode includes automatic configuration and manual configuration, and a user may be prompted to "please select the configuration mode" through the first user interface.

On the first user interface, a user can select a configuration mode through the selector, so that the controller selects user input of the configuration mode in the first user interface through the selector, obtains the configuration mode of the audio acquisition device, and further executes subsequent processing according to the configuration mode selected by the user to determine the audio acquisition device to be used.

In some embodiments, the controller is further configured to: the controller responds to the user input that the configuration mode selected in the first user interface through the selector is automatic configuration, namely when the user selects the system to automatically configure the audio acquisition device, the audio acquisition device which has accessed the display equipment for the last time is selected from the currently available audio acquisition devices; then, the controller determines that the audio acquisition device that has accessed the display apparatus the last time is the first audio acquisition device.

When the user selects the automatic configuration in the first user interface, the controller obtains the user input which is automatically configured through the configuration mode selected by the selector in the first user interface, and then determines the audio acquisition device to be used based on a preset selection rule.

In this embodiment, the preset selection rule may be to select the audio capture device that has been accessed last time as the first audio capture device to be used.

Specifically, when a plurality of audio acquisition devices are connected to the display device, the display device may allocate corresponding identifiers to the plurality of audio acquisition devices, and the identifiers may be used to distinguish different audio acquisition devices. Meanwhile, the identity can also reflect the access sequence of different audio acquisition devices.

For example, a timestamp accessed by the audio capturing apparatus may be used as an identifier of the audio capturing apparatus, for example, 20aa.bb.cc. -dd.ee.ff, which indicates that the audio capturing apparatus was accessed to the display device at dd time ee minute ff second of bb month cc in 20aa year, so that the audio capturing apparatus which has been accessed to the display device last time can be determined based on different timestamps.

For another example, a number may be used as the identifier of the audio capturing device, for example, the identifier of the first accessed audio capturing device is 01, the identifier of the second accessed audio capturing device is 02, and so on, so that the audio capturing device accessed to the display device last time may also be determined based on the sorting order of the numbers.

For another example, the letter/character string with a certain sequence may be used as the identification of the audio acquisition device, for example, the identification of the first accessed audio acquisition device is a, the identification of the second accessed audio acquisition device is b, and so on, so that the audio acquisition device accessed to the display device last time may also be determined based on the sequence of the letter/character string.

It is understood that the above solutions may also be used in combination, for example, the timestamp + number accessed by the audio capturing device is used as the identity of the audio capturing device.

In addition, for the condition that the display equipment has the audio acquisition device preset in the factory, under the scene of automatic configuration, the audio acquisition device preset in the factory is selected only under the condition that the display equipment is not externally connected with other equipment.

Referring to fig. 7, in case that the configuration mode is automatic configuration, after the controller determines the currently used audio capturing device, the user may be prompted on the UI interface, for example, "the newly accessed device will be selected for use, and the newly accessed device is XXX", so that the user can know the currently used audio capturing device.

In this embodiment, for a scene in which the configuration mode is automatic configuration, the controller selects an audio acquisition device that has accessed the display device most recently from currently available audio acquisition devices, and determines that the audio acquisition device that has accessed the display device most recently is the first audio acquisition device, so that the audio acquisition device to be used can be determined quickly.

In some embodiments, the controller is further configured to: the controller responds to user input which is manually configured through the configuration mode selected by the selector in the first user interface, and displays a second user interface in the display, wherein the second user interface comprises a second control for selecting a configuration type for the audio service application, and the configuration type comprises unified configuration for all services and independent configuration for different services, namely when the user selects manual configuration of the audio acquisition device, the user needs to further determine the configuration type; the controller obtains the configuration type of the audio capture device by selecting a configuration type of user input in the second user interface via the selector.

Specifically, referring to fig. 7, when the user selects the manual configuration in the first user interface, the controller obtains the user input for the manual configuration through the configuration mode selected by the selector in the first user interface, and presents the second user interface to the user, where the second user interface includes a second control for selecting a configuration type for the audio service application, and the configuration type includes uniform configuration for all services and separate configuration for different services. The second user interface may prompt the user, for example, "please select a configuration type.

On the second user interface, a user can select the configuration type through the selector, so that the controller selects the user input of the configuration type in the second user interface through the selector, the configuration type of the audio acquisition device is obtained, and then subsequent processing is executed according to the configuration type selected by the user to determine the audio acquisition device to be used.

In some embodiments, the controller is further configured to: the controller responds to the user input that the configuration type selected in the second user interface through the selector is 'uniformly configured for all services', and displays a third user interface in the display, wherein the third user interface comprises all currently available audio acquisition devices, and at the moment, the user can select audio selection equipment uniformly configured for all services through the third user interface; the controller determines that the selected audio capture device is the first audio capture device "configured for all audio service applications" by selecting a user input of the audio capture device in the third user interface via the selector.

Specifically, referring to fig. 7, when the user selects the unified configuration for all services in the second user interface, the controller obtains a user input of "unified configuration for all services" type of configuration selected in the second user interface by the selector, and presents the user with a third user interface in which the controller can present all currently available audio capture devices to the user in a list manner. The third user interface may prompt the user, for example, "please select a device that is configured uniformly for all services".

The controller may also display information corresponding to each audio acquisition device, such as a name, a manufacturer, and Sound card information allocated by an ALSA (Advanced Linux Sound Architecture) driver. Thus, the user can select the audio acquisition device to be used according to the information.

On the third user interface, the user may select the audio capture device to be used via the selector, whereby the controller determines that the selected audio capture device is the "configured for all audio service applications" first audio capture device by selecting user input of the audio capture device in the third user interface via the selector.

For example, the audio service application installed in the display device system includes service 1, service 2, and service 3, and if the audio acquisition device selected by the user is audio acquisition device a, the controller determines that the first audio acquisition devices corresponding to service 1, service 2, and service 3 are all audio acquisition devices a.

In some embodiments, the controller is further configured to: in response to a user input that the configuration type selected in the second user interface through the selector is "configure different services individually", presenting a fourth user interface in the display, wherein the fourth user interface includes a third control for configuring an audio acquisition device for each audio service application, and at this time, the user may select to configure audio selection equipment for each service individually through the fourth user interface; the controller determines a first audio acquisition device corresponding to each audio service application by configuring user input of the audio acquisition device for each audio service application in the fourth user interface through the selector.

Specifically, referring to fig. 7, when the user selects different service individual configurations in the second user interface, the controller obtains a user input that the configuration type selected by the selector in the second user interface is "different service individual configurations", and presents the fourth user interface to the user, where the fourth user interface includes a third control that configures the audio acquisition device for each audio service application. The fourth user interface may prompt the user, for example, "please select a device configured for a different service.

On the fourth user interface, the user may individually configure an audio acquisition device for each service through the selector, for example, referring to fig. 7, when the audio acquisition device needs to be individually configured for the service 3, the audio acquisition device selection function may be invoked through a control (an inverted triangle pattern) corresponding to the service 3, and at the same time, the controller presents a fifth user interface to the user in the display, which presents all currently available audio acquisition devices to the user in a list manner, thereby facilitating the user to select.

In order to reduce interference, when the audio acquisition device corresponding to the service 3 is configured separately, the text icons corresponding to other services can be faded/hidden, so that a user can conveniently view the current service type.

In some embodiments, the controller is further configured to: after the first audio acquisition device is determined, the controller judges whether the first audio acquisition device is available at present, namely whether the first audio acquisition device can normally work at present, and if so, the first audio acquisition device acquires audio information.

Specifically, after the first audio acquisition device is determined, the situation that the first audio acquisition device cannot work normally or is temporarily pulled out may occur, and therefore, the controller further determines whether the first audio acquisition device is currently available, and when the first audio acquisition device is determined to be available, the first audio acquisition device acquires audio information.

In addition, if the first audio acquisition device is judged to be unavailable, the user can be prompted to 'the first audio acquisition device is unavailable' through the UI interface, and can be further prompted to 'whether other audio acquisition devices need to be selected', and then a new first audio acquisition device is determined again based on the selection condition of the user.

In some embodiments, the controller is further configured to: the controller responds to the input of a user for switching the audio acquisition devices, and acquires a second audio acquisition device to be switched, wherein the second audio acquisition device can be an audio acquisition device which is confirmed by the user to be switched; based on the audio parameters of the first sound card corresponding to the first audio acquisition device, the controller starts a second sound card corresponding to the second audio acquisition device, and at the moment, after the second sound card is started, the first sound card is still in a working state; and after the second sound card is determined to work normally, determining that the audio data corresponding to the second sound card is the data used by the current audio service application.

In the process of acquiring audio data by the first audio acquisition device determined by the foregoing embodiment, if a newly accessed audio acquisition device is detected, the controller may prompt the user whether to execute a device switching process.

For example, fig. 8 is a schematic diagram of a UI interface for prompting a user whether to execute device switching processing in the embodiment of the present application, and as shown in fig. 8, when a new audio acquisition device is connected to a display device, a controller may prompt the user to "detect a newly connected audio acquisition device M", and simultaneously prompt the user to "please confirm whether to switch to the audio acquisition device M", if the user selects "confirm", the controller executes device switching processing, and if the user selects "cancel", the controller does not execute device switching processing, and at the same time, the controller may add the newly connected audio acquisition device to an available audio acquisition device list.

In this embodiment, for the case that the user selects "confirm", the controller responds to the user input for switching the audio acquisition device, and acquires the second audio acquisition device to be switched, that is, the currently newly accessed audio acquisition device.

Specifically, in the Android system, in the process of acquiring audio data of the audio acquisition device by the audio service, the audio acquisition device to be acquired needs to be selected in the AudioPolicy stage, and the system ALSA system is mainly used for distributing sound card information to the current audio acquisition device. The sound card information is reported to the system in the equipment access stage and is managed by the system.

When the Audio service records, the Audio record initiates a recording request, a target sound card of the recording is decided through the Audio policy, and then the Audio HAL layer starts the recording equipment and collects the Audio based on the sound card information selected by the Audio policy. For example, in the process of the operation of the first audio acquisition device, audioPolicy decides that the target sound card of the current recording is the first sound card corresponding to the first audio acquisition device.

Based on the decided target sound card, the Audio HAL layer opens the target sound card through a standard tinyalsa (reduced version advanced Linux Audio framework running in the Audio HAL layer) command (such as pcm _ open), and after the target sound card is successfully opened, a file handle is generated to identify the identity of the sound card device at this time. And recording the audio data acquired by the recording equipment in a pcm _ read handle mode, and transmitting the audio data to a recording service.

In the existing implementation manner, after the recording process is started, if the audio acquisition device needs to be replaced, the recording needs to be closed, and the previous audio acquisition device needs to be unplugged, so that the recording service is interrupted, and the service discontinuity is caused.

In order to solve the above problem, the present embodiment provides a technical solution for continuously acquiring a service audio, which specifically includes the following steps:

(1) In the service recording process, a first audio acquisition device and a corresponding first sound card are used, and the acquired file handle is f1. And after the user confirms that the execution device switches, transmitting the related information of the second sound card corresponding to the second Audio acquisition device to the Audio HAL layer in the modes of writing attributes, writing files, function transfer and the like.

(2) And after receiving the device switching instruction, the Audio HAL layer pulls up a new thread, the thread takes the second sound card as a target, opens the second sound card by opening the Audio parameters of the first sound card through the pcm _ open interface, and returns a file handle f2 after the second sound card is successfully opened. Such as, among others, audio parameters like sampling rate.

(3) And reading the audio information of the f2 by the thread through the pcm _ read interface, and when the interface can normally return the audio (the pcm _ read interface returns no abnormal condition), indicating that the second sound card can normally work. If it fails, a sleep wait for a fixed time, such as (5 ms), may be made and the data read again determined.

(4) If the read audio data returns to normal, when the recording service reads the f1 data, directly replacing f1 with f2, namely, directly reading the data of a second sound card, thereby completing the hot switching of the audio acquisition device.

Therefore, based on the processing process, the interruption of the recording service can be avoided in the process of switching the audio acquisition device, and the continuity of the service is ensured.

In some embodiments, the controller is further configured to: and closing the first sound card corresponding to the first audio acquisition device.

Specifically, when it is determined that the read audio data returns to normal, the controller may further control to close the first sound card corresponding to the first audio acquisition device, so as to close f1 and release the first sound card, in addition to directly reading the data of the second sound card, so as to reduce unnecessary power consumption.

In some embodiments, an audio capture device selection method is provided, which is applied to the display apparatus of the foregoing embodiments.

Fig. 9 is a schematic diagram of a method for selecting an audio acquisition device according to an embodiment of the present disclosure, where as shown in fig. 9, the method mainly includes the following steps:

s100, acquiring a configuration mode of an audio acquisition device;

s200, determining a first audio acquisition device used currently based on a configuration mode and a currently available audio acquisition device;

s300, collecting audio information through a first audio collecting device.

The embodiment provides an audio acquisition device selection method, wherein when a scene occasion needing to use an audio acquisition device is determined, a controller firstly obtains a configuration mode of the audio acquisition device, determines a first audio acquisition device from currently available audio acquisition devices based on the configuration mode, and acquires audio information through the first audio acquisition device. Therefore, the audio acquisition device to be used can be quickly determined for the scene that the display equipment is externally connected with a plurality of audio acquisition devices.

In some embodiments, further comprising:

s110, responding to user input for starting the audio service application, and displaying a first user interface in a display, wherein the first user interface comprises a first control for selecting a configuration mode, and the configuration mode comprises automatic configuration and manual configuration;

and S120, selecting user input of the configuration mode in the first user interface through the selector, and acquiring the configuration mode of the audio acquisition device.

In some embodiments, further comprising:

s211, responding to the user input that the configuration mode selected in the first user interface through the selector is automatic configuration, and selecting the audio acquisition device which is accessed to the display equipment for the last time from the currently available audio acquisition devices;

s212, determining that the audio acquisition device which is accessed to the display equipment for the last time is the first audio acquisition device.

In some embodiments, further comprising:

s221, responding to user input that a configuration mode selected in the first user interface through the selector is manual configuration, and displaying a second user interface in the display, wherein the second user interface comprises a second control for selecting a configuration type for audio service application, and the configuration type comprises unified configuration for all services and independent configuration for different services;

s222, selecting user input of the configuration type in the second user interface through the selector, and obtaining the configuration type of the audio acquisition device.

In some embodiments, further comprising:

S222A1, in response to the user input that the configuration type selected in the second user interface through the selector is 'uniform configuration for all services', displaying a third user interface in a display, wherein the third user interface comprises all currently available audio acquisition devices;

s222A2, selecting a user input of an audio capture device in the third user interface through the selector, and determining that the selected audio capture device is the first audio capture device configured for all audio service applications.

In some embodiments, further comprising:

S222B1, in response to the user input that the configuration type selected in the second user interface through the selector is 'configured for different services separately', displaying a fourth user interface in the display, wherein the fourth user interface comprises a third control for configuring an audio acquisition device for each audio service application;

S222B2, configuring, by the selector, user input of the audio acquisition device for each audio service application in the fourth user interface, and determining a first audio acquisition device corresponding to each audio service application.

In some embodiments, further comprising:

s410, responding to the user input for switching the audio acquisition devices, and acquiring a second audio acquisition device to be switched;

s420, starting a second sound card corresponding to a second audio acquisition device based on the audio parameters of the first sound card corresponding to the first audio acquisition device;

and S430, after the second sound card is determined to work normally, determining that the audio data corresponding to the second sound card is the data used by the current audio service application.

In some embodiments, further comprising:

s440, closing the first sound card corresponding to the first audio acquisition device.

It should be noted that, the method flow provided in the embodiment of the present invention can implement all the method steps implemented by the embodiment of the display device, and can achieve the same technical effect, and detailed descriptions of the same parts and beneficial effects as those of the embodiment of the display device are omitted here.

It should be understood that, although the respective steps in the flowcharts in the above-described embodiments are sequentially shown as indicated by arrows, the steps are not necessarily performed sequentially as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless otherwise indicated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, in different orders, and may be performed alternately or partially with other steps or at least some of the sub-steps or stages of other steps.

In some embodiments, there is provided a computer device comprising: the computer program product comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the computer program product to realize the steps of the method embodiments of the present application.

In some embodiments, a computer-readable storage medium having stored thereon computer-executable instructions for performing the steps of the method embodiments of the present application when executed by a processor is provided.

In some embodiments, a computer program product is provided, comprising a computer program which, when executed by a processor, performs the steps of the method embodiments of the present application.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware related to instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, the computer program can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), rambus (Rambus) direct RAM (RDRAM), direct Rambus Dynamic RAM (DRDRAM), and Rambus Dynamic RAM (RDRAM), among others.

Other embodiments of the present disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice in the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (10)

1. A display device, comprising:

a display configured to display an image screen and a user interface, and a selector in the user interface to indicate that an item is selected in the user interface;

the equipment interface is used for being connected with at least two audio acquisition devices;

a controller interfaced with the display and the device, the controller configured to:

acquiring a configuration mode of an audio acquisition device;

determining a first audio acquisition device based on the configuration mode and the currently available audio acquisition devices;

and acquiring audio information through the first audio acquisition device.

2. The display device of claim 1, wherein the controller is further configured to:

presenting a first user interface in the display in response to a user input to launch an audio service application, wherein the first user interface includes a first control to select a configuration mode, the configuration mode including automatic configuration and manual configuration;

and selecting the user input of the configuration mode in the first user interface through the selector to acquire the configuration mode of the audio acquisition device.

3. The display device of claim 2, wherein the controller is further configured to:

in response to a user input through the selector that the configuration mode selected in the first user interface is automatically configured, selecting an audio acquisition device that has recently accessed the display device from the currently available audio acquisition devices;

and determining that the audio acquisition device which has accessed the display equipment for the last time is the first audio acquisition device.

4. The display device according to claim 2, wherein the controller is further configured to:

in response to a user input that the configuration mode selected in the first user interface by the selector is a manual configuration, presenting a second user interface in the display, wherein the second user interface comprises a second control that selects a configuration type for an audio service application, the configuration type comprising a unified configuration for all services and an individual configuration for different services;

and selecting the user input of the configuration type in the second user interface through the selector to acquire the configuration type of the audio acquisition device.

5. The display device of claim 4, wherein the controller is further configured to:

presenting a third user interface in the display in response to a user input through the selector that the selected configuration type in the second user interface is a unified configuration for all services, wherein the third user interface includes all currently available audio capture devices;

and selecting the user input of the audio acquisition device in the third user interface through the selector, and determining that the selected audio acquisition device is the first audio acquisition device configured for all audio service applications.

6. The display device of claim 4, wherein the controller is further configured to:

in response to user input through the selector that the configuration type selected in the second user interface is configured for different services individually, presenting a fourth user interface in the display, wherein the fourth user interface includes a third control that configures an audio capture device for each audio service application;

and configuring user input of an audio acquisition device for each audio service application in the fourth user interface through the selector, and determining a first audio acquisition device corresponding to each audio service application.

7. The display device of claim 1, wherein the controller is further configured to:

responding to the input of a user for switching the audio acquisition devices, and acquiring a second audio acquisition device to be switched;

starting a second sound card corresponding to the second audio acquisition device based on the audio parameters of the first sound card corresponding to the first audio acquisition device;

and after the second sound card is determined to work normally, determining that the audio data corresponding to the second sound card is the data used by the current audio service application.

8. The display device according to claim 7, wherein the controller is further configured to:

and closing the first sound card corresponding to the first audio acquisition device.

9. An audio acquisition device selection method, comprising:

acquiring a configuration mode of an audio acquisition device;

determining a first audio acquisition device which is currently used based on the configuration mode and the currently available audio acquisition devices;

and acquiring audio information through the first audio acquisition device.

10. The method of claim 9, further comprising:

responding to the input of a user for switching the audio acquisition devices, and acquiring a second audio acquisition device to be switched;

starting a second sound card corresponding to the second audio acquisition device based on the audio parameters of the first sound card corresponding to the first audio acquisition device;

and after the second sound card is determined to work normally, determining that the audio data corresponding to the second sound card is the data used by the current audio service application.

Images