[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN112073765A - Display device - Google Patents

Display device Download PDF

Info

Publication number
CN112073765A
CN112073765A CN201910877523.7A CN201910877523A CN112073765A CN 112073765 A CN112073765 A CN 112073765A CN 201910877523 A CN201910877523 A CN 201910877523A CN 112073765 A CN112073765 A CN 112073765A
Authority
CN
China
Prior art keywords
image
aspect ratio
user
display
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910877523.7A
Other languages
Chinese (zh)
Inventor
于文钦
杨鲁明
朱铄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Original Assignee
Hisense Visual Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Visual Technology Co Ltd filed Critical Hisense Visual Technology Co Ltd
Priority to PCT/CN2020/079701 priority Critical patent/WO2020248640A1/en
Publication of CN112073765A publication Critical patent/CN112073765A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4438Window management, e.g. event handling following interaction with the user interface
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781Games
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8146Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a display device which is used for shooting and displaying images at a television end according to an aspect ratio set by a user. The image shooting method provided by the embodiment of the application comprises the following steps: receiving a control signal input from a user input interface and indicating to start the camera; responding to user input for starting the camera, presenting a first user interface in a display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting an image of a first aspect ratio acquired by the camera according to a second aspect ratio by the controller, and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio; the method includes receiving a user input indicating that a picture is to be taken by a selector in the first user interface, taking an image of a frame of a second aspect ratio in the preview screen in response to the user input, and displaying the image of the second aspect ratio on a display.

Description

Display device
The present application claims priority of chinese patent application with the title "image capturing method and apparatus, display device" filed by chinese patent office on 10/6/2019 under application number 201910497563.9, the entire contents of which are incorporated herein by reference.
Technical Field
The application relates to the technical field of intelligent televisions, in particular to a display device.
Background
Currently, since a display device can provide a user with a play picture such as audio, video, picture, and the like, it is receiving a wide attention of the user. With the development of big data and artificial intelligence, the functional requirements of users on display devices are increasing day by day. Current display devices, especially household devices, such as smart televisions; the actual shooting area of the camera is not consistent with the display area of the television, and the current technology cannot shoot and display images at the television according to the aspect ratio required by a user.
Disclosure of Invention
The exemplary embodiment of the application provides a display device which is used for shooting and displaying images according to the aspect ratio set by a user at a television end.
According to an aspect of exemplary embodiments, there is provided a display apparatus including:
a camera for acquiring image data using a first aspect ratio;
a display configured to display an image screen and a user interface, and a selector in the user interface to indicate that an item is selected in the user interface;
a controller in communication with the display, the controller configured to:
receiving a control signal input from a user input interface and indicating to start the camera;
responding to user input for starting the camera, presenting a first user interface in a display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting an image of a first aspect ratio acquired by the camera according to a second aspect ratio by the controller, and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio;
receiving a user input indicating to acquire a picture selected in the first user interface through the selector, acquiring an image of a frame of a second aspect ratio in the preview screen in response to the user input, and displaying the image of the second aspect ratio on a display.
Opening a first user interface of the view display area at a television end through a controller according to a user instruction; displaying a preview picture of a shooting scene of a television camera on the first user interface; and when the controller receives a photographing instruction, acquiring a frame of image with a second aspect ratio in the preview picture, and displaying the image with the second aspect ratio on a display, so that a picture is photographed and displayed at the television end according to the instruction of a user.
An exemplary embodiment of the present application provides an image capturing method, including:
receiving a control signal input from a user input interface and indicating to start the camera;
responding to user input for starting the camera, presenting a first user interface in a display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting an image of a first aspect ratio acquired by the camera according to a second aspect ratio by the controller, and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio;
the method includes receiving a user input indicating that a picture is to be taken by a selector in the first user interface, taking an image of a frame of a second aspect ratio in the preview screen in response to the user input, and displaying the image of the second aspect ratio on a display.
According to the method, a first user interface is started at a television end according to a user instruction; displaying a preview picture of a shooting scene of a television camera on the first user interface; and when a photographing instruction is received, acquiring a frame of image with a second aspect ratio in the preview picture, and displaying the image with the second aspect ratio on a display, so that a picture is photographed and displayed at a television end according to the instruction of a user.
In some exemplary embodiments, the preview screen is a screen cut at a preset scale.
According to the method, the preview picture is a picture intercepted according to a preset proportion, so that the preview picture is displayed on a first user interface of a television according to a television visible area.
In some exemplary embodiments, the preview screen has a special effect.
By the method, the preview picture has a special effect, so that the preview picture with the special effect is displayed on the first user interface of the television.
An embodiment of the present application further provides a computing device, including:
a memory for storing program instructions;
and the processor is used for calling the program instructions stored in the memory and executing any one of the methods provided by the embodiment of the application according to the obtained program.
Another embodiment of the present application provides a computer storage medium having stored thereon computer-executable instructions for causing a computer to perform any one of the methods described above.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram illustrating an operation scenario between a display device 200 and a control apparatus according to an embodiment;
fig. 2 is a block diagram schematically illustrating a configuration of a software system in the display device 200 according to the embodiment;
fig. 3 is a schematic diagram illustrating an application included in an application layer of a display device according to an embodiment;
fig. 4 schematically illustrates a user interface in the display device 200 according to an embodiment;
FIGS. 5-7 illustrate schematic diagrams of user interface interaction with a user in a display device 200 according to an exemplary embodiment;
fig. 8 is a diagram schematically illustrating an image capturing method according to an exemplary embodiment;
fig. 9 is a schematic diagram illustrating a comparison of display scales of a camera shooting area and a television display area according to an exemplary embodiment;
FIG. 10 is a flow diagram illustrating capturing television display area images according to an exemplary embodiment;
FIGS. 11-13 illustrate user interface interaction with a user in a display device 200 according to another exemplary embodiment;
fig. 14 is a schematic view schematically illustrating another image capturing method according to an exemplary embodiment;
fig. 15 is a flowchart illustrating capturing a camera display area image according to an exemplary embodiment;
fig. 16 schematically illustrates an image capture device according to an exemplary embodiment;
FIG. 17 is a schematic diagram of another image capture device according to an exemplary embodiment;
fig. 18 also shows an exemplary image recording device according to an exemplary embodiment;
fig. 19 also shows an exemplary illustration of another image recording device according to an exemplary embodiment.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Various embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be noted that the display sequence of the embodiment of the present application only represents the sequence of the embodiment, and does not represent the merits of the technical solutions provided by the embodiments.
The term "module," as used in various embodiments of the present application, may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.
The term "remote control" as used in the embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application) that is capable of wirelessly controlling the electronic device, typically over a short distance. The component can be generally connected with an electronic device by using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and can also comprise a wireless network WiFi, a wireless USB, bluetooth, a motion sensor and other functional modules. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.
The term "gesture" as used in the embodiments of the present application refers to a user behavior used to express an intended idea, action, purpose, or result through a change in hand shape or an action such as hand movement.
Fig. 1 is a schematic diagram illustrating an operation scenario between a display device 200 and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display apparatus 200 through the control device 100.
The control device 100 may be a remote controller 100A, which can communicate with the display device 200 through an infrared protocol communication, a bluetooth protocol communication, a ZigBee (ZigBee) protocol communication, or other short-range communication, and is used to control the display device 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.
The control apparatus 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a notebook computer, etc., which may communicate with the display device 200 through a Local Area Network (LAN), a Wide Area Network (WAN), a Wireless Local Area Network (WLAN), or other networks, and implement control of the display device 200 through an application program corresponding to the display device 200.
For example, the mobile terminal 100B and the display device 200 may each have a software application installed thereon, so that connection communication between the two can be realized through a network communication protocol, and the purpose of one-to-one control operation and data communication can be further realized. Such as: a control instruction protocol can be established between the mobile terminal 100B and the display device 200, a remote control keyboard is synchronized to the mobile terminal 100B, and the function of controlling the display device 200 is realized by controlling a user interface on the mobile terminal 100B; the audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.
As shown in fig. 1, the display apparatus 200 may also perform data communication with the server 300 through various communication means. In various embodiments of the present application, the display device 200 may be allowed to be communicatively coupled to the server 300 via a local area network, a wireless local area network, or other network. The server 300 may provide various contents and interactions to the display apparatus 200.
Illustratively, the display device 200 receives software Program updates, or accesses a remotely stored digital media library by sending and receiving information, and Electronic Program Guide (EPG) interactions. The servers 300 may be a group or groups, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.
The display device 200 may be a liquid crystal display, an Organic Light Emitting Diode (OLED) display, a projection display device, or an intelligent television. The particular display device type, size, aspect ratio, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.
The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function. Examples include a network TV, a smart TV, an Internet Protocol TV (IPTV), and the like.
As shown in fig. 1, the display device may be connected or provided with a camera, and is configured to present a picture taken by the camera on a display interface of the display device or other display devices, so as to implement interactive chat between users. Specifically, the picture shot by the camera can be displayed on the display device in a full screen mode, a half screen mode or any optional area.
As an optional connection mode, the camera is connected with the display rear shell through the connecting plate, is fixedly installed in the middle of the upper side of the display rear shell, and can be fixedly installed at any position of the display rear shell as an installable mode, so that an image acquisition area is ensured not to be shielded by the rear shell, for example, the display orientation of the image acquisition area is the same as that of the display equipment.
As another alternative connection mode, the camera is connected to the display rear shell through a connection board or other conceivable connector, the camera is capable of lifting, the connector is provided with a lifting motor, when a user wants to use the camera or an application program wants to use the camera, the camera is lifted out of the display, and when the camera is not needed, the camera can be embedded in the rear shell to protect the camera from being damaged.
As an embodiment, the camera adopted in the present application may have 1600 ten thousand pixels, so as to achieve the purpose of ultra high definition display. In actual use, cameras higher or lower than 1600 ten thousand pixels may also be used.
After the camera is installed on the display device, the contents displayed by different application scenes of the display device can be fused in various different modes, so that the function which cannot be realized by the traditional display device is achieved.
Illustratively, a user may conduct a video chat with at least one other user while watching a video program. The presentation of the video program may be as a background frame over which a window for video chat is displayed. The function is called 'chat while watching'.
Optionally, in a scene of "chat while watching", at least one video chat is performed across terminals while watching a live video or a network video.
In another example, a user can conduct a video chat with at least one other user while entering the educational application for learning. For example, a student may interact remotely with a teacher while learning content in an educational application. Vividly, this function can be called "chatting while learning".
In another example, a user conducts a video chat with a player entering a card game while playing the game. For example, a player may enable remote interaction with other players when entering a gaming application to participate in a game. Figuratively, this function may be referred to as "watch while playing".
Optionally, the game scene is fused with the video picture, the portrait in the video picture is scratched and displayed in the game picture, and the user experience is improved.
Optionally, in the motion sensing game (such as ball hitting, boxing, running and dancing), the human posture and motion, limb detection and tracking and human skeleton key point data detection are obtained through the camera, and then the human posture and motion, the limb detection and tracking and the human skeleton key point data detection are fused with the animation in the game, so that the game of scenes such as sports and dancing is realized.
In another example, a user may interact with at least one other user in a karaoke application in video and voice. Vividly, this function can be called "sing while watching". Preferably, when at least one user enters the application in a chat scenario, a plurality of users can jointly complete recording of a song.
In another example, a user may turn on a camera locally to take pictures and videos, figurative, which may be referred to as "looking into the mirror". The mirror application is an application newly added in the social television project, and the application supports the functions of camera image preview, face recognition, addition of a beauty filter, photographing, picture sharing and the like; the method of capturing images mentioned in this embodiment is implemented in a mirror application.
In other examples, more or less functionality may be added. The function of the display device is not particularly limited in the present application.
Fig. 2 is a block diagram illustrating a configuration of a software system in the display device 200 according to an exemplary embodiment.
As shown in fig. 2, an operating system 2911, including executing operating software for handling various basic system services and for performing hardware related tasks, acts as an intermediary between application programs and hardware components for performing data processing.
In some embodiments, portions of the operating system kernel may contain a series of software to manage the display device hardware resources and provide services to other programs or software code.
In other embodiments, portions of the operating system kernel may include one or more device drivers, which may be a set of software code in the operating system that assists in operating or controlling the devices or hardware associated with the display device. The drivers may contain code that operates the video, audio, and/or other multimedia components. Examples include a display, a camera, Flash, WiFi, and audio drivers.
The accessibility module 2911-1 is configured to modify or access the application program to achieve accessibility and operability of the application program for displaying content.
A communication module 2911-2 for connection to other peripherals via associated communication interfaces and a communication network.
The user interface module 2911-3 is configured to provide an object for displaying a user interface, so that each application program can access the object, and user operability can be achieved.
Control applications 2911-4 for controlling process management, including runtime applications and the like.
The event transmission system 2914 may be implemented within the operating system 2911 or within the application 2912. In some embodiments, an aspect is implemented within the operating system 2911, while implemented in the application 2912, for listening for various user input events, and will implement one or more sets of predefined operations in response to various events referring to the recognition of various types of events or sub-events.
The event monitoring module 2914-1 is configured to monitor an event or a sub-event input by the user input interface.
The event identification module 2914-1 is configured to input definitions of various types of events for various user input interfaces, identify various events or sub-events, and transmit the same to a process for executing one or more corresponding sets of processes.
The event or sub-event refers to an input detected by one or more sensors in the display device 200 and an input of an external control device (e.g., the control apparatus 100). Such as: the method comprises the following steps of inputting various sub-events through voice, inputting a gesture sub-event through gesture recognition, inputting a remote control key command of a control device and the like. Illustratively, the one or more sub-events in the remote control include a variety of forms including, but not limited to, one or a combination of key presses up/down/left/right/, ok keys, key presses, and the like. And non-physical key operations such as move, hold, release, etc.
The interface layout management module 2913, directly or indirectly receiving the input events or sub-events from the event transmission system 2914, monitors the input events or sub-events, and updates the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size, position, and level of the container, which are related to the layout of the interface.
Fig. 3 is a diagram illustrating an application included in an application layer of a display device including various applications executable in the display device 200 according to an exemplary embodiment.
The application layer 2912 may include, but is not limited to, one or more applications such as: video-on-demand applications, application centers, gaming applications, etc., live television applications, media center applications, etc.
The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.
A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.
The media center application program can provide various applications for playing multimedia contents. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.
The application program center can provide and store various application programs. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on a display device. The application center may obtain these applications from different sources, store them in local storage, and then be operable on the display device 200.
A schematic diagram of a user interface in a display device 200 according to an exemplary embodiment is illustrated in fig. 4. As shown in fig. 4, the user interface includes a view display area 201, wherein, for example, the view display area 201 includes a layout of one or more different items. And a selector in the user interface indicating that the item is selected, the position of the selector being movable by user input to change the selection of a different item.
In some embodiments, the view display area 201 is a scalable view display. "scalable," may mean that the view display area 201 is scalable in size or proportion on the screen, or that the items in the view display 201 are scalable in size or proportion on the screen.
"item" refers to a visual object displayed in a view display area of a user interface in the display device 200 to represent corresponding content, such as icons, thumbnails, video clips, and the like. For example: the items may represent movies, image content or video clips of a television show, audio content of music, applications, or other user access content history information.
Further, the item may represent an interface or a collection of interfaces on which the display device 200 is connected to an external device, or may represent a name of an external device connected to the display device, or the like. Such as: a signal source input Interface set, or a High Definition Multimedia Interface (HDMI), a USB Interface, a PC terminal Interface, and the like.
It should be noted that: the view display area may present Video chat project content or application layer project content (e.g., web page Video, Video On Demand (VOD) presentations, application screens, etc.).
A "selector" is used to indicate where any item has been selected, such as a cursor or a focus object. Positioning the selection information input according to an icon or menu position touched by the user in the display 200 may cause movement of a focus object displayed in the display device 200 to select a control item, one or more of which may be selected or controlled.
The focus object refers to an object that moves between items according to user input. Illustratively, the focus object position is implemented or identified by drawing a thick line through the item edge. In other embodiments, the focus form is not limited to an example, and may be a form such as a cursor that is recognizable by the user, either tangible or intangible, such as in the form of a 3D deformation of the item, or may change the identification of the border lines, size, color, transparency, and outline and/or font of the text or image of the item in focus.
The event transmission system 2914, which may monitor user input for each predefined event or sub-event heard, provides control identifying the event or sub-event directly or indirectly to the interface layout management module 2913.
The interface layout management module 2913 is configured to monitor the state of the user interface (including the position and/or size of the view partition, the item, the focus or the cursor object, the change process, and the like), and according to the event or the sub-event, may perform a modification on the layout of the size and position, the hierarchy, and the like of the view display area, and/or adjust or modify the layout of the size or/and position, the number, the type, the content, and the like of the layout of various items in the view display area. In some embodiments, the layout is modified and adjusted, including displaying or not displaying the view sections or the content of the items in the view sections on the screen.
And a user input interface for transmitting an input signal of a user to the controller or transmitting a signal output from the controller to the user. For example, the control device (e.g., a mobile terminal or a remote controller) may send an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by a user to the user input interface, and then the input signal is forwarded to the controller by the user input interface; alternatively, the control device may receive an output signal such as audio, video, or data output from the user input interface via the controller, and display the received output signal or output the received output signal in audio or vibration form.
In some embodiments, a user may input a user command on a Graphical User Interface (GUI) displayed on the display 200, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
FIGS. 5-7 illustrate schematic diagrams of user interface interaction with a user in the display device 200 according to an exemplary embodiment; for example, as shown in fig. 5 to 7, a plurality of different items are laid out in the view display area 201, for example, a preview screen is displayed on the first user interface 201-1 of the view display area 201, the preview screen is an image video stream captured from a camera according to the aspect ratio of the display, one frame of preview screen of a shooting scene is displayed in fig. 5 (the displayed preview screen has a plurality of frames, where one frame is selected for illustration), and as can be seen from fig. 5, the image mode selected by the user is "storage ratio-full screen" (the pixel ratio of image width and height is 16:9), the user can click "beauty filter" to add or change special effect effects to the preview screen, and the selectable special effect includes beauty, filter, sticker, and the like; the user can click 'view picture' to enter the album center; when the user clicks "take", the user interface changes to that shown in fig. 6 in response to the take instruction.
As shown in fig. 6, a frame of picture in an image data stream acquired when a user sends a "take picture" instruction is displayed on the first user interface 201-1, and at this time, the user may scan a shared picture, or may click "save" or take a picture again; when the user clicks "save", in response to the "save" instruction, the user interface changes to display the picture just saved in the second user interface 201-2 of the view display area 201 as shown in fig. 7. At this time, the user obtains a display scale of the television display area of 16:9 picture.
In some exemplary embodiments, the preview screen is formed by continuously displaying, at a preset frame rate, the first user interface after the controller captures an image acquired by the camera according to a second aspect ratio, where the second aspect ratio is a display aspect ratio. Illustratively, the display aspect ratio is 16:9, respectively.
In some exemplary embodiments, the first aspect ratio is an aspect ratio of an image acquired by the camera.
In some exemplary embodiments, the preview screen has a special effect, and may be implemented by passing the acquired data stream or image through an interface that calls a special effect algorithm.
In some exemplary embodiments, the image storage scale is full screen mode.
Fig. 8 illustrates an image capturing method according to an exemplary embodiment, including:
s101, starting a first user interface at a television end according to a user instruction;
s102, displaying a preview picture of a shooting scene of a television camera on the first user interface;
s103, when a photographing instruction is received, acquiring an image with a second aspect ratio of one frame in the preview picture, and displaying the image with the second aspect ratio on a display.
Illustratively, the first user interface is a preview interface and the second user interface is a photo presentation interface.
In some exemplary embodiments, the preview screen is a screen cut at a preset scale.
Illustratively, the preset ratio is a pixel ratio of 16: 9; after a preview interface of the mirror application is started at the television end according to the instruction of a user, the camera takes the pixel ratio of the width to the height of an image as 4:3 (the camera captures a video stream consisting of a plurality of frames of image data), in order to adapt the aspect ratio of the television to 16:9, the system Hardware Abstraction Layer (HAL) is used for processing an original image shot by a camera according to the pixel ratio of 16: and 9, intercepting the image, performing compression coding on the intercepted image, and transmitting the image to an upper application (for example, a social television mirror application), wherein the upper application analyzes the image, and continuously displays the image on a preview interface at a certain frame rate (the frame rate value is not limited herein), so as to form a camera preview picture.
The mirror application is an application newly added in the social television project, and the application supports the functions of camera image preview, face recognition, special effect effects of adding a beauty filter and the like, photographing, picture sharing and the like.
In some exemplary embodiments, the preview screen has a special effect.
Exemplary special effects include beauty, filters, stickers, and the like. The preview picture can have a special effect or not; if a special effect needs to be added to the preview picture, the camera object is provided by a special effect algorithm; the method for adding the special effect to the video picture specifically comprises the following steps: outputting the video picture to a texture control; illustratively, a special effect algorithm identifies a human face on the texture control TextureView, adds special effect effects such as filter stickers and the like, superimposes the added special effect on the video image texture without any special effect, and synthesizes a new texture; and outputting the synthesized texture to a display control, so that a user can see a video preview picture with special effects on a preview interface.
If no special effect needs to be added to the preview picture, the mirror application does not process the integrated special effect algorithm, and a Camera Camera object is directly created to control and manage the Camera. The Camera object is used for controlling a Camera switch, configuring Camera parameters, managing Camera start/stop preview, photographing and the like. Camera has many interfaces for managing cameras, configuring parameters, starting/stopping previews, etc. the takePicture interface is used to start the photograph.
For example, when a preview interface displays a preview screen of a shooting scene of a television camera, a user can select an image storage ratio to be in a full-screen mode, and can also increase or change a special effect of the preview screen; when a user clicks 'take a picture', a frame of image is acquired when a taking instruction of the user is received, the user interface is switched to a photo display interface from a preview interface, and the image is displayed on the photo display interface.
In some exemplary embodiments, the first aspect ratio is an aspect ratio of 4: 3.
In some exemplary embodiments, the second aspect ratio is an aspect ratio of 16: 9.
For example, when the image storage ratio is full-screen mode, the aspect ratio of the width and height of the image is 16:9, the image resolution presented at the second user interface may be 1920 x 1080, for example.
Fig. 9 is a diagram illustrating a comparison of display scales of a camera shooting area and a television display area according to an exemplary embodiment, and it can be seen that an actual shooting area of a camera angle of view is larger than a television preview screen display area.
Fig. 10 is a flowchart illustrating a process of capturing an image of a display area of a tv in an exemplary embodiment, where, at a tv end, an instruction of a user to open a mirror application at the tv end is received, after entering a preview interface, a special effect algorithm interface is called, a control required for display is initialized, and a camera is started in a special effect algorithm, where the camera has a width-to-height pixel ratio of 4:3, the original image is acquired in order to adapt to the width and height of the television to be 16:9, HAL of the system to the original image in terms of width and height pixel ratio 16: intercepting in a ratio of 9, performing compression coding on the intercepted image, uploading the image to an upper layer application (for example, a mirror application), analyzing the image by the upper layer application, (as a camera acquires a video stream which consists of a plurality of frames of images), forming a video picture without any special effect by the analyzed image at a certain frame rate (the frame rate value is not limited herein), and outputting the video picture to a texture control; illustratively, a special effect algorithm identifies a human face on the texture control TextureView, adds special effect effects such as filter stickers and the like, superimposes the added special effect on the video image texture without any special effect, and synthesizes a new texture; and outputting the synthesized texture to a display control, so that a user can see a video preview picture with special effects on a preview interface. If the storage ratio selected by the user is in a full-screen mode (the aspect ratio of the image is 16:9), and a command of 'taking a picture' of the user is received, acquiring a frame of image of a current video preview picture through a special effect algorithm interface (the frame of image has a special effect), and informing the preview picture, wherein the user can see a Bitmap format image (or pictures in other formats) on the preview interface; when a command that a user clicks 'save' is received, responding to the 'save' command, switching the user interface from the preview interface to a photo display interface, and displaying a photo on the photo display interface; at this point, the user obtains a 16:9 picture of the television display area with special effects, which may be 1920 x 1080 resolution, for example). If no special effect is added to the video preview picture, the step of shooting the image of the television display area specifically comprises the following steps: receiving an instruction of a user for entering a Camera related application (such as opening a mirror application) at a television end, and obtaining a Camera Camera object (the object is used for controlling a Camera switch, configuring Camera parameters, managing start/stop preview of a Camera, taking a picture and the like) after entering a preview interface; the camera is 4 according to the pixel ratio of width and height: 3, the HAL of the system to the original image is 16: and intercepting the image in a ratio of 9, performing compression coding on the intercepted image, and uploading the image to an upper layer application (for example, a mirror application), wherein the upper layer application analyzes the image, (as a video stream is acquired by a camera, the video stream consists of a plurality of frames of images) and continuously displays the analyzed image on a preview interface at a certain frame rate (the frame rate value is not limited herein), so as to form a video preview picture. At this time, the user sees the formed video preview screen on the preview interface.
If the storage ratio selected by the user is in a full-screen mode (the aspect ratio of the image is 16:9), and a command of 'taking a picture' of the user is received, a frame of image of a current video preview picture is obtained (the frame of image does not have a special effect), and the user can see a Bitmap format image (or pictures in other formats) on a preview interface; when a command that a user clicks 'save' is received, responding to the 'save' command, switching the user interface from the preview interface to a photo display interface, and displaying a photo on the photo display interface; at this point, the user obtains a 16:9 aspect ratio photograph of the television display area without special effects, which may be 1920 x 1080 resolution, for example.
In some embodiments, when the user clicks to take a picture, one frame of image in the preview screen is acquired, the first user interface including the preview screen is quitted from being displayed, and the display displays the image with the second aspect ratio.
The following steps exemplarily show taking an image with or without special effect in the visible area of the camera:
another display device is provided in an exemplary embodiment of the present application, including:
a display configured to display a user interface, wherein the user interface comprises a view display area, wherein the view display area comprises a layout of one or more different items, and a selector indicating that the item is selected, wherein the position of the selector in the user interface can be moved by user input to cause the different item to be selected;
a controller in communication with the display, the controller configured to perform presenting the user interface;
the controller displays a first user interface of the view display area on the display according to an instruction of a user for opening the camera;
acquiring an image according to a first aspect ratio through a camera, and forming a preview picture of the image on the first user interface according to a second aspect ratio;
if the image aspect ratio selected by the user is the first aspect ratio, and when the controller receives an instruction for acquiring the image, the preview picture is stopped, and meanwhile, the camera is called to acquire the image according to the first aspect ratio and display the image on the second user interface of the view display area.
In some exemplary embodiments, the method further comprises:
displaying a first user interface of the view display area on a display according to an instruction of a user for opening a camera;
acquiring an image according to a first aspect ratio through a camera in a special effect algorithm, adding a special effect to the image with the first aspect ratio, and forming a preview picture on the first user interface according to a second aspect ratio;
if the image aspect ratio selected by the user is the first aspect ratio, and when an instruction for acquiring the image is received, stopping the preview picture, simultaneously calling the camera to acquire the image according to the first aspect ratio, and adding a special effect to be displayed on a second user interface of the view display area.
11-13 illustrate user interface interaction with a user in the display device 200 according to another exemplary embodiment; for example, as shown in fig. 11 to 13, a plurality of different items are laid out in the view display area 201, for example, a preview image of a shooting scene of a television camera is displayed on the first user interface 201-3 of the view display area 201, one preview image of the shooting scene is displayed in fig. 11 (the displayed preview image has a plurality of frames, where a frame is selected as an example), and as can be seen from fig. 11, the image mode selected by the user is "storage scale-standard" (the pixel ratio of image width and height is 4:3), the user can click "beauty filter", add or change special effect effects to the preview image, and the selectable special effect effects include beauty, filter, sticker, and the like; the user may also click "view pictures"; when the user clicks "take", the user interface changes to that shown in fig. 12 in response to the take instruction.
As shown in fig. 12, a picture of the last frame before the user sends the "take picture" instruction is displayed on the first user interface 201-3, at this time, the user may scan the shared picture, or click "save" or take picture again; when the user clicks "save", in response to the "save" instruction, the user interface changes to display the picture just saved in the second user interface 201-4 of the view display area 201 as shown in fig. 13. At this time, the display scale of the image obtained by the user, which is the display area of the camera, is 4: 3.
In some exemplary embodiments, acquiring an image according to a first aspect ratio through a camera, and forming a preview screen on the first user interface according to a second aspect ratio by using the image specifically includes:
and after the image acquired by the camera is intercepted according to the second width-to-height ratio, continuously displaying the image on the first user interface according to a preset frame rate to form a preview picture.
Illustratively, the predetermined ratio is 16:9, respectively.
In some exemplary embodiments, the preview screen has a special effect.
In some exemplary embodiments, when the controller receives a photographing instruction, the data acquired by the camera is taken as a current image and displayed on the second user interface. Specifically, the method comprises the following steps:
when the controller receives a user photographing instruction, the playing of the preview picture is stopped, namely, the conversion of the aspect ratio of the camera shooting data is stopped. And directly calling the camera to acquire the image data of the first aspect ratio, and displaying the image data on a second user interface after the photographing is finished.
For example, an image of the visible area of the camera is displayed on the second user interface 201-4 (photo presentation interface), and the pixel ratio of the width and height of the image is 4: 3. illustratively, the image resolution is, for example, 4656 x 3496 (which may be set to other values as well).
In some exemplary embodiments, the preset aspect ratio is an aspect ratio corresponding to the image storage ratio selected by the user in the standard mode.
In some exemplary embodiments, after the controller finishes photographing the currently displayed picture of the first user interface, the controller adds a special effect to the obtained image, and displays the image with the added special effect on the second user interface.
Illustratively, the photographed image is returned to the special effect algorithm to add the special effect, and the image with the special effect added is displayed on the second user interface 201-4.
Fig. 14 illustrates another image capturing method according to an exemplary embodiment, including:
s201, receiving a control signal which is input from a user input interface and indicates to start the camera;
s202, responding to user input for starting the camera, and presenting a first user interface in a display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting an image of a first aspect ratio acquired by the camera according to a second aspect ratio by the controller and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio;
s203, receiving user input for selecting and indicating to acquire pictures in the first user interface through a selector, responding to the user input, acquiring an image of a second aspect ratio of one frame in the preview picture, and displaying the image of the second aspect ratio on a display.
Illustratively, the first user interface is a preview interface and the second user interface is a photo presentation interface.
In some exemplary embodiments, the preview screen is a screen cut at a preset scale.
In some exemplary embodiments, the preview screen has a special effect.
Exemplary special effects include beauty, filters, stickers, and the like.
Illustratively, the preset aspect ratio is a pixel width and height of 4: 3-scale (image specific resolution aspect ratio of, for example, 4656 x 3496); and displaying the image in the second user interface as a camera display area image. The image may be an image with or without a special effect.
In some exemplary embodiments, the preset aspect ratio is an aspect ratio corresponding to the image storage ratio selected by the user in the standard mode.
Fig. 15 is a flowchart illustrating a process of capturing an image of a display area of a camera according to an exemplary embodiment, where, at a television, an instruction of a user to open a mirror application at the television is received, the camera is started, a control required for display is initialized, image data acquired by the camera is cut into a size suitable for display on a display, and a preview interface is entered. If the special effect picture needs to be displayed, the intercepted data stream calls a special effect algorithm interface, and a preview picture with a special effect is presented.
Specifically, the camera is a camera with a width and height pixel ratio of 4:3, the original image is acquired in order to adapt to the width and height of the television to be 16:9, HAL of the system to the original image in terms of width and height pixel ratio 16: intercepting in a ratio of 9, performing compression coding on the intercepted image, uploading the image to an upper layer application (for example, a mirror application), analyzing the image by the upper layer application, (as a camera acquires a video stream which consists of a plurality of frames of images), forming a video picture without any special effect by the analyzed image at a certain frame rate (the frame rate value is not limited herein), and outputting the video picture to a texture control; illustratively, a special effect algorithm identifies a human face on the texture control TextureView, adds special effect effects such as filter stickers and the like, superimposes the added special effect on the video image texture without any special effect, and synthesizes a new texture; and outputting the synthesized texture to a display control, so that a user can see a video preview picture with special effects on a preview interface.
If the storage ratio selected by the user is in the standard mode (the image aspect ratio is 4:3), displaying the preview image according to the 1920-1080 preview resolution; and receiving a 'photographing' instruction of a user, stopping the interception and special effect processing of the image data acquired by the camera, and returning to a camera object (the camera is not in the application of a preview algorithm; calling a takePicture interface of the camera to photograph, automatically stopping a preview picture, and at the moment, the user sees one frame of a multi-frame picture when the photographing instruction is executed, wherein the camera object is used for controlling a camera switch, configuring camera parameters, managing the start/stop of the camera for previewing, photographing and the like); then calling a takePicture interface, starting photographing, generating an original photo obtained by a camera, calling a special effect algorithm to add a special effect to the photo, generating a photo with a special effect, and informing a preview interface, so that a user can see a Bitmap format image (or pictures with other formats) on the preview interface; when a command that a user clicks 'save' is received, responding to the 'save' command, switching the user interface from the preview interface to a photo display interface, and displaying a photo on the photo display interface; at this time, the user obtains an aspect ratio with special effect of the visible area of the camera as 4:3, for example, may be 4656 x 3496 resolution.
If no special effect is added to the video preview picture and the image finally obtained by the user does not have the special effect, the step of shooting the image in the display area of the camera specifically comprises the following steps: and at the television end, receiving an instruction of opening a mirror application at the television end by a user, starting a camera, initializing a control required for display, intercepting image data acquired by the camera into a size suitable for display of a display, and entering a preview interface. After entering a preview interface, a Camera object (the object 1 is used for controlling a Camera switch, configuring Camera parameters, managing Camera start/stop previewing, photographing and the like) is obtained.
The user selects the "store scale-standard" mode (4: 3 pixel ratio for image width and height), still displaying the preview image at 1920 x 1080 preview resolution; when a user clicks a 'photographing' instruction, firstly stopping a video preview picture and returning to a camera object (when a takePicture interface of the camera is called for photographing, the preview picture can be automatically stopped, and at the moment, the user sees a frame of picture during photographing, wherein the camera object is used for controlling a camera switch, configuring camera parameters, managing the start/stop of the camera for previewing, photographing and the like); then calling a takePicture interface, starting to take a picture, and after the picture is taken, a user can see a Bitmap-format image (or pictures in other formats) on a preview interface, wherein the image is an actual visible area picture of the camera; when a command that a user clicks 'save' is received, responding to the 'save' command, switching the user interface from the preview interface to a photo display interface, and displaying a photo on the photo display interface; at this time, the user obtains an aspect ratio without special effect of the visible area of the camera as 4:3, for example, may be 4656 x 3496 resolution.
By the method, the television-end camera displays the preview picture at 1920-1080 resolution, and when a user takes a picture, the corresponding image with the aspect ratio is obtained according to the image storage ratio (full screen or standard) selected by the user; specifically, when the image storage ratio selected by the user is full-screen mode, the ratio of the pixel width and height of the television display area is obtained as 16:9, obtaining an image with a resolution of 1920 × 1080, when the image storage ratio selected by the user is in the standard mode, the pixel width and height of the visible area of the camera are 4:3, resolution is for example 4656 x 3496 images. That is, the user can obtain photographs of different aspect ratios and different shooting angles by simply switching.
Accordingly, on the device side, an image capturing device according to an exemplary embodiment is exemplarily shown in fig. 16, including:
the first unit 11 is used for starting a first user interface at the television according to a user instruction;
a second unit 12, configured to display a preview of a shooting scene of a television camera on the first user interface;
and a third unit 13, configured to convert, when a photographing instruction is received, a currently displayed picture of the first user interface into an image, and display the image on the second user interface.
Fig. 17 illustrates another image photographing apparatus according to an exemplary embodiment, including:
a start unit 21 for receiving a control signal indicating to start the camera input from a user input interface;
a preview unit 22, configured to, in response to a user input for starting the camera, present a first user interface in a display, where the first user interface includes a preview picture, and the preview picture is an image of a first aspect ratio acquired by the camera according to a second aspect ratio and is displayed according to the second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;
a display unit 23 configured to receive a user input indicating to acquire a picture selected by a selector in the first user interface, acquire an image of a second aspect ratio of one frame in the preview screen in response to the user input, and display the image of the second aspect ratio on a display.
Fig. 18 also illustrates an image photographing apparatus according to an exemplary embodiment, including:
the processor 600, for reading the program in the memory 610, executes the following processes:
starting a first user interface at the television according to a user instruction;
displaying a preview picture of a shooting scene of a television camera on the first user interface;
and when a photographing instruction is received, converting the current displayed picture of the first user interface into an image and displaying the image on a second user interface.
By the device, a first user interface is started at the television according to a user instruction; displaying a preview picture of a shooting scene of a television camera on the first user interface; when a photographing instruction is received, the current displayed picture of the first user interface is converted into an image and is displayed on the second user interface, and therefore the image is photographed and displayed on the television according to the aspect ratio set by the user.
In some exemplary embodiments, the preview screen is a screen cut at a preset scale.
In some exemplary embodiments, the preview screen has a special effect.
In some exemplary embodiments, when a photographing instruction is received, converting a currently displayed picture of the first user interface into an image, and displaying the image on the second user interface, specifically including:
and when a user photographing instruction is received, converting the currently displayed picture of the first user interface into an image according to the image storage proportion selected by the user, and displaying the image on the second user interface.
In some exemplary embodiments, the image storage scale is full screen mode.
Fig. 19 also illustrates another image photographing apparatus according to an exemplary embodiment, including:
a processor 800 for reading the program in the memory 810 and executing the following processes:
receiving a control signal input from a user input interface and indicating to start the camera;
responding to user input for starting the camera, presenting a first user interface in a display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting an image of a first aspect ratio acquired by the camera according to a second aspect ratio by the controller, and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio;
the method includes receiving a user input indicating that a picture is to be taken by a selector in the first user interface, taking an image of a frame of a second aspect ratio in the preview screen in response to the user input, and displaying the image of the second aspect ratio on a display.
Receiving, by the device, a control signal input from a user input interface indicating to activate the camera; responding to user input for starting the camera, presenting a first user interface in a display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting an image of a first aspect ratio acquired by the camera according to a second aspect ratio by the controller, and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio; receiving user input for selecting and indicating to acquire pictures in the first user interface through a selector, responding to the user input, acquiring a frame of image with a second aspect ratio in the preview picture, and displaying the image with the second aspect ratio on a display, so that the image is shot and displayed according to the aspect ratio set by a user at a television end.
In some exemplary embodiments, after said receiving a user input indicating that a picture is taken is selected in said first user interface by said selector, in response to the user input, further comprising:
and acquiring a frame of image in the preview picture, quitting displaying the first user interface comprising the preview picture, and displaying the image with the second aspect ratio by a display.
In some exemplary embodiments, a first user interface is displayed on the display according to an instruction of a user to turn on the camera;
acquiring an image according to a first aspect ratio through a camera in a special effect algorithm, adding a special effect to the image, and forming a preview picture on the first user interface according to a second aspect ratio;
the method includes receiving an instruction for acquiring an image, acquiring a frame of an image with a special second aspect ratio in the preview screen, and displaying the image with the second aspect ratio on a display.
In some exemplary embodiments, receiving a user input indicating to take a picture in the first user interface selected by the selector, in response to the user input, taking an image of a frame of the preview screen at the second aspect ratio, and displaying the image of the second aspect ratio on a display specifically includes:
when the controller receives a photographing instruction of a user, acquiring an image with a second aspect ratio of one frame in the preview picture according to user input of an image storage ratio selected by the user, and displaying the image with the second aspect ratio on a display.
In some exemplary embodiments, the image storage ratio includes a first width-to-height storage ratio associated with a first width-to-height ratio at which the camera acquires image data and a second width-to-height storage ratio associated with a second width-to-height ratio at which a preview screen is displayed in the display.
In fig. 18 and 19, among other things, the bus architecture may include any number of interconnected buses and bridges, with one or more processors represented by processors 600, 800 and various circuits of memory represented by memories 610, 810 linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface.
The exemplary embodiments of the present application provide a display terminal, which may be specifically a desktop computer, a portable computer, a smart phone, a tablet computer, a Personal Digital Assistant (PDA), and the like. The Display terminal may include a Central Processing Unit (CPU), a memory, an input/output device, etc., the input device may include a keyboard, a mouse, a touch screen, etc., and the output device may include a Display device, such as a Liquid Crystal Display (LCD), a Cathode Ray Tube (CRT), etc.
For different display terminals, in some exemplary embodiments, the user interfaces 620, 820 may be interfaces capable of interfacing externally to desired devices including, but not limited to, keypads, displays, speakers, microphones, joysticks, and the like.
The processor is responsible for managing the bus architecture and general processing, and the memory may store data used by the processor 600 in performing operations.
In some exemplary embodiments, the processor may be a CPU (central processing unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a CPLD (Complex Programmable Logic Device).
The memory may include Read Only Memory (ROM) and Random Access Memory (RAM), and provides the processor with program instructions and data stored in the memory. In the embodiments of the present application, the memory may be used to store a program of any of the methods provided in the exemplary embodiments of the present application.
The processor is configured to execute any of the methods provided in the exemplary embodiments of the present application in accordance with the obtained program instructions by calling the program instructions stored in the memory.
The present application provides, in an exemplary embodiment, a computer storage medium for storing computer program instructions for an apparatus provided in the above-mentioned embodiment of the present application, which includes a program for executing any one of the methods provided in the above-mentioned embodiment of the present application.
The computer storage media may be any available media or data storage device that can be accessed by a computer, including, but not limited to, magnetic memory (e.g., floppy disks, hard disks, magnetic tape, magneto-optical disks (MOs), etc.), optical memory (e.g., CDs, DVDs, BDs, HVDs, etc.), and semiconductor memory (e.g., ROMs, EPROMs, EEPROMs, non-volatile memory (NAND FLASH), Solid State Disks (SSDs)), etc.
In summary, the exemplary embodiments of the present application provide an image capturing method and apparatus, and a display device, so that an image is captured and displayed on a television according to an aspect ratio set by a user. Specifically, when the image mode selected by the user is a full-screen mode (16: 9), shooting an image of a television visible area at the television end and displaying the image; when the image mode selected by the user is the standard mode (4: 3), shooting the image of the visible area of the camera at the television end and displaying the image; therefore, the user can obtain the photos with different aspect ratios and different shooting visual angles through simple switching.
As will be appreciated by one skilled in the art, the present application in exemplary embodiments may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.
It should be understood that the terms "first," "second," "third," and the like in the description and in the claims of the present application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.
Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims (11)

1. A display device, comprising:
a camera for acquiring image data using a first aspect ratio;
a display configured to display an image screen and a user interface, and a selector in the user interface to indicate that an item is selected in the user interface;
a controller in communication with the display, the controller configured to:
receiving a control signal input from a user input interface and indicating to start the camera;
responding to user input for starting the camera, presenting a first user interface in a display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting an image of a first aspect ratio acquired by the camera according to a second aspect ratio by the controller, and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio;
receiving a user input indicating to acquire a picture selected in the first user interface through the selector, acquiring an image of a frame of a second aspect ratio in the preview screen in response to the user input, and displaying the image of the second aspect ratio on a display.
2. The display device according to claim 1, wherein a user input indicating to take a picture is selected in the first user interface by the selector is received, one frame of image in the preview screen is taken in response to the user input, the first user interface including the preview screen is quitted from being displayed, and the display displays the image of the second aspect ratio.
3. The display device according to claim 1, wherein the controller is further configured to perform:
and calling a special effect algorithm interface to carry out special effect processing on the preview picture.
4. The apparatus according to claim 1, wherein receiving a user input indicating to take a picture in the first user interface selected by the selector, and in response to the user input, taking an image of a second aspect ratio of a frame in the preview screen, and displaying the image of the second aspect ratio on the display specifically includes:
when the controller receives a photographing instruction of a user, acquiring an image with a second aspect ratio of one frame in the preview picture according to user input of an image storage ratio selected by the user, and displaying the image with the second aspect ratio on a display.
5. The display device according to claim 4, wherein the image storage ratio includes a first width-to-height storage ratio associated with a first width-to-height ratio at which the camera acquires image data and a second width-to-height storage ratio associated with a second width-to-height ratio at which a preview screen is displayed in the display.
6. An image capturing method, characterized by comprising:
receiving a control signal input from a user input interface and indicating to start the camera;
responding to user input for starting the camera, presenting a first user interface in a display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting an image of a first aspect ratio acquired by the camera according to a second aspect ratio by the controller, and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio;
the method includes receiving a user input indicating that a picture is to be taken by a selector in the first user interface, taking an image of a frame of a second aspect ratio in the preview screen in response to the user input, and displaying the image of the second aspect ratio on a display.
7. The display device of claim 1, further comprising, after said receiving a user input indicating to take a picture in said first user interface selected by said selector in response to the user input:
and acquiring a frame of image in the preview picture, quitting displaying the first user interface comprising the preview picture, and displaying the image with the second aspect ratio by a display.
8. The method of claim 6, further comprising:
displaying a first user interface on a display according to an instruction of a user for opening a camera;
acquiring an image according to a first aspect ratio through a camera in a special effect algorithm, adding a special effect to the image, and forming a preview picture on the first user interface according to a second aspect ratio;
the method includes receiving an instruction for acquiring an image, acquiring a frame of an image with a special second aspect ratio in the preview screen, and displaying the image with the second aspect ratio on a display.
9. The method of claim 6, wherein receiving a user input indicating to take a picture in the first user interface via the selector, in response to which the user input is received, taking a frame of an image of a second aspect ratio in the preview screen, and displaying the image of the second aspect ratio on a display, specifically comprises:
when the controller receives a photographing instruction of a user, acquiring an image with a second aspect ratio of one frame in the preview picture according to user input of an image storage ratio selected by the user, and displaying the image with the second aspect ratio on a display.
10. The method of claim 9, wherein the image storage ratios include a first width-to-height storage ratio and a second width-to-height storage ratio, wherein the first width-to-height storage ratio is associated with a first width-to-height ratio at which the camera acquires image data, and wherein the second width-to-height storage ratio is associated with a second width-to-height ratio at which a preview screen is displayed in the display.
11. A computing device, comprising:
a memory for storing program instructions;
a processor for calling the program instructions stored in the memory and executing the method of any one of claims 6 to 10 according to the obtained program.
CN201910877523.7A 2019-06-10 2019-09-17 Display device Pending CN112073765A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/079701 WO2020248640A1 (en) 2019-06-10 2020-03-17 Display device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2019104975639 2019-06-10
CN201910497563 2019-06-10

Publications (1)

Publication Number Publication Date
CN112073765A true CN112073765A (en) 2020-12-11

Family

ID=68971130

Family Applications (3)

Application Number Title Priority Date Filing Date
CN201910878161.3A Pending CN110636354A (en) 2019-06-10 2019-09-17 Display device
CN201910877525.6A Active CN110636353B (en) 2019-06-10 2019-09-17 Display device
CN201910877523.7A Pending CN112073765A (en) 2019-06-10 2019-09-17 Display device

Family Applications Before (2)

Application Number Title Priority Date Filing Date
CN201910878161.3A Pending CN110636354A (en) 2019-06-10 2019-09-17 Display device
CN201910877525.6A Active CN110636353B (en) 2019-06-10 2019-09-17 Display device

Country Status (2)

Country Link
CN (3) CN110636354A (en)
WO (1) WO2020248640A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114650363A (en) * 2020-12-18 2022-06-21 华为技术有限公司 Image display method and electronic equipment
WO2023036257A1 (en) * 2021-09-13 2023-03-16 北京字跳网络技术有限公司 Image processing method and apparatus

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110636354A (en) * 2019-06-10 2019-12-31 青岛海信电器股份有限公司 Display device
CN111314606B (en) * 2020-02-21 2021-06-18 Oppo广东移动通信有限公司 Photographing method and device, electronic equipment and storage medium
CN113497979A (en) * 2020-03-20 2021-10-12 佛山市云米电器科技有限公司 Interface mode display method, cloud server, television, system and storage medium
CN111917998A (en) * 2020-08-12 2020-11-10 惠州市康冠科技有限公司 GPUImgae-based smart television special-effect camera generation method and device and smart television
CN112261289B (en) * 2020-10-16 2022-08-26 海信视像科技股份有限公司 Display device and AI algorithm result acquisition method
CN114513690B (en) * 2020-10-27 2024-04-05 海信视像科技股份有限公司 Display device and image acquisition method
CN112822556B (en) * 2020-12-31 2022-11-15 上海米哈游天命科技有限公司 Game picture shooting method, device, equipment and storage medium
CN114339358A (en) * 2021-04-16 2022-04-12 海信视像科技股份有限公司 Dynamic processing method of shutdown selection interface and display device
CN113099308B (en) * 2021-03-31 2023-10-27 聚好看科技股份有限公司 Content display method, display equipment and image collector
CN113112407B (en) * 2021-06-11 2021-09-03 上海英立视电子有限公司 Method, system, device and medium for generating field of view of television-based mirror
CN115474073B (en) * 2021-06-11 2023-12-12 上海赛连信息科技有限公司 Method and device for intelligently switching picture layout
CN113938587B (en) * 2021-09-14 2024-03-15 青岛海信移动通信技术有限公司 Double-camera-based shooting method and electronic equipment
CN113971048A (en) * 2021-10-29 2022-01-25 Oppo广东移动通信有限公司 Application program starting method and device, storage medium and electronic equipment
CN113949815B (en) * 2021-11-17 2024-10-25 维沃移动通信有限公司 Shooting preview method and device and electronic equipment

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110231875A1 (en) * 2010-03-17 2011-09-22 Suzin Lee Method and image display device for setting definition
CN102681302A (en) * 2011-03-17 2012-09-19 天津三星光电子有限公司 Method and device for selecting image composition automatically and self-timing shoot and photographic device
CN103414945A (en) * 2013-07-17 2013-11-27 深圳Tcl新技术有限公司 Method and device for automatically clipping and displaying target image
CN106331488A (en) * 2016-08-25 2017-01-11 天脉聚源(北京)传媒科技有限公司 Interface adjusting method and device
CN106339705A (en) * 2016-08-16 2017-01-18 北京小米移动软件有限公司 Image acquisition method and device
CN106506932A (en) * 2015-09-08 2017-03-15 中兴通讯股份有限公司 The acquisition methods and device of image
CN106657761A (en) * 2016-09-29 2017-05-10 乐视控股(北京)有限公司 Picture shooting method and device for intelligent terminal
WO2019071548A1 (en) * 2017-10-13 2019-04-18 深圳传音通讯有限公司 Terminal photograph capturing control method, mobile terminal, and readable storage medium

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8549442B2 (en) * 2005-12-12 2013-10-01 Sony Computer Entertainment Inc. Voice and video control of interactive electronically simulated environment
CN101510970A (en) * 2009-03-27 2009-08-19 四川长虹电器股份有限公司 Method for displaying 4:3 image on a 16:9 television
JP5310837B2 (en) * 2011-12-28 2013-10-09 カシオ計算機株式会社 Image generating apparatus, digital camera, method, and program
KR101917650B1 (en) * 2012-08-03 2019-01-29 삼성전자 주식회사 Method and apparatus for processing a image in camera device
CN102957901B (en) * 2012-11-19 2016-05-18 天津三星电子有限公司 A kind of display system
US10168882B2 (en) * 2013-06-09 2019-01-01 Apple Inc. Device, method, and graphical user interface for switching between camera interfaces
CN103618933A (en) * 2013-11-28 2014-03-05 青岛海信电器股份有限公司 Method and device for displaying application interface images self-adaptively
KR102271853B1 (en) * 2014-03-21 2021-07-01 삼성전자주식회사 Electronic apparatus, image processing method, and computer-readable recording medium
CN104270579B (en) * 2014-09-24 2018-06-05 青岛海信移动通信技术股份有限公司 A kind of terminal applies interface pixel method of adjustment and terminal
CN104333701B (en) * 2014-11-28 2017-04-26 广东欧珀移动通信有限公司 Method and device for displaying camera preview pictures as well as terminal
US10748264B2 (en) * 2015-09-09 2020-08-18 Sony Corporation Image processing apparatus and image processing method
CN205378145U (en) * 2016-02-04 2016-07-06 许阳振 Electronic mirror
US20170302844A1 (en) * 2016-04-13 2017-10-19 Canon Kabushiki Kaisha Image capturing apparatus, control method therefor, and storage medium
CN105915872B (en) * 2016-06-06 2017-12-29 苏州佳世达光电有限公司 The output intent and projection arrangement of image
CN106293589B (en) * 2016-08-31 2019-04-12 宇龙计算机通信科技(深圳)有限公司 A kind of method, apparatus and terminal that preview resolution is set
KR20180051202A (en) * 2016-11-08 2018-05-16 삼성전자주식회사 Display apparatus and control method thereof
CN106896999A (en) * 2017-01-06 2017-06-27 广东小天才科技有限公司 Mirror simulation method and device for mobile terminal
CN106937043A (en) * 2017-02-16 2017-07-07 奇酷互联网络科技(深圳)有限公司 The method and apparatus of mobile terminal and its image procossing
CN107155059A (en) * 2017-04-11 2017-09-12 深圳市金立通信设备有限公司 A kind of image preview method and terminal
KR102289716B1 (en) * 2017-08-01 2021-08-17 삼성디스플레이 주식회사 Display apparatus and method of driving the same
CN108337442A (en) * 2018-05-14 2018-07-27 Oppo广东移动通信有限公司 Shooting preview display methods, device, terminal and storage medium
CN108737732A (en) * 2018-06-04 2018-11-02 成都依能科技股份有限公司 A method of give a definition static high-definition image shooting area in dynamic image preview
CN109302629B (en) * 2018-08-27 2021-07-06 海信视像科技股份有限公司 Method for switching picture frames for pictures and display terminal
CN109120997A (en) * 2018-09-30 2019-01-01 北京微播视界科技有限公司 Method for processing video frequency, device, terminal and medium
CN109460174A (en) * 2018-11-09 2019-03-12 维沃移动通信有限公司 A kind of information processing method and terminal device
CN109547700A (en) * 2018-12-27 2019-03-29 维沃移动通信有限公司 Photographic method and terminal
CN110636354A (en) * 2019-06-10 2019-12-31 青岛海信电器股份有限公司 Display device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110231875A1 (en) * 2010-03-17 2011-09-22 Suzin Lee Method and image display device for setting definition
CN102681302A (en) * 2011-03-17 2012-09-19 天津三星光电子有限公司 Method and device for selecting image composition automatically and self-timing shoot and photographic device
CN103414945A (en) * 2013-07-17 2013-11-27 深圳Tcl新技术有限公司 Method and device for automatically clipping and displaying target image
CN106506932A (en) * 2015-09-08 2017-03-15 中兴通讯股份有限公司 The acquisition methods and device of image
CN106339705A (en) * 2016-08-16 2017-01-18 北京小米移动软件有限公司 Image acquisition method and device
CN106331488A (en) * 2016-08-25 2017-01-11 天脉聚源(北京)传媒科技有限公司 Interface adjusting method and device
CN106657761A (en) * 2016-09-29 2017-05-10 乐视控股(北京)有限公司 Picture shooting method and device for intelligent terminal
WO2019071548A1 (en) * 2017-10-13 2019-04-18 深圳传音通讯有限公司 Terminal photograph capturing control method, mobile terminal, and readable storage medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114650363A (en) * 2020-12-18 2022-06-21 华为技术有限公司 Image display method and electronic equipment
CN114650363B (en) * 2020-12-18 2023-07-21 华为技术有限公司 Image display method and electronic equipment
WO2023036257A1 (en) * 2021-09-13 2023-03-16 北京字跳网络技术有限公司 Image processing method and apparatus

Also Published As

Publication number Publication date
CN110636353A (en) 2019-12-31
WO2020248640A1 (en) 2020-12-17
CN110636354A (en) 2019-12-31
CN110636353B (en) 2022-09-02

Similar Documents

Publication Publication Date Title
CN110636353B (en) Display device
CN110611787B (en) Display and image processing method
CN112073798B (en) Data transmission method and equipment
WO2021031623A1 (en) Display apparatus, file sharing method, and server
CN112073770B (en) Display device and video communication data processing method
CN112399264B (en) Projection hall service management method and application
CN114296949A (en) Virtual reality equipment and high-definition screen capturing method
CN112399263A (en) Interaction method, display device and mobile terminal
CN112399233A (en) Display device and position self-adaptive adjusting method of video chat window
CN112073778A (en) Display device and fault-tolerant method for key transmission
CN112073662A (en) Display device
CN112068987A (en) Method and device for rapidly restoring factory settings
CN112463267B (en) Method for presenting screen saver information on display device screen and display device
CN112788378A (en) Display apparatus and content display method
CN112788423A (en) Display device and display method of menu interface
CN112783380A (en) Display apparatus and method
CN112073663A (en) Audio gain adjusting method, video chatting method and display equipment
CN112073777B (en) Voice interaction method and display device
CN112073812B (en) Application management method on smart television and display device
WO2020248682A1 (en) Display device and virtual scene generation method
CN112073776A (en) Voice control method and display device
CN112770148A (en) Display device, data query method and data storage method
CN112073773A (en) Screen interaction method and device and display equipment
CN112399223B (en) Method for improving moire fringe phenomenon and display device
CN112073779B (en) Display device and fault-tolerant method for key transmission

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20201211

RJ01 Rejection of invention patent application after publication