[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2024147675A1 - Procédé et appareil d'adaptation multimédia en service multimédia - Google Patents

Procédé et appareil d'adaptation multimédia en service multimédia Download PDF

Info

Publication number
WO2024147675A1
WO2024147675A1 PCT/KR2024/000217 KR2024000217W WO2024147675A1 WO 2024147675 A1 WO2024147675 A1 WO 2024147675A1 KR 2024000217 W KR2024000217 W KR 2024000217W WO 2024147675 A1 WO2024147675 A1 WO 2024147675A1
Authority
WO
WIPO (PCT)
Prior art keywords
media
sdp
media stream
stream
streams
Prior art date
Application number
PCT/KR2024/000217
Other languages
English (en)
Inventor
Eric Yip
Jaeyeon Song
Hyunkoo Yang
Original Assignee
Samsung Electronics Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co., Ltd. filed Critical Samsung Electronics Co., Ltd.
Publication of WO2024147675A1 publication Critical patent/WO2024147675A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10—Architectures or entities
    • H04L65/1016—IP multimedia subsystem [IMS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1069—Session establishment or de-establishment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1101—Session protocols
    • H04L65/1104—Session initiation protocol [SIP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
    • H04W88/18—Service support devices; Network management devices

Definitions

  • an aspect of the disclosure is provide a SDP attribute and corresponding parameters to support multiple media streams corresponding to a media presentation.
  • the SDP offer message comprises priority information for each of the plurality of media streams, and the priority information indicates a priority of a corresponding media stream.
  • the SDP offer message comprises dependency information for each of the plurality of media streams, and the dependency information indicates whether a corresponding media stream is an independently decodable media stream or a dependently decodable media stream.
  • FIG. 2 shows a structure of a long term evolution (LTE) network according to an embodiment of the disclosure.
  • LTE long term evolution
  • Figure 4C shows an exemplary architecture of a communication network including the 5G RAN 410c, 5G core network 420c, and the IMS Network 430c according to an embodiment of the disclosure.
  • Figure 7 shows an exemplary media path for media between a transmitting terminal and a receiving terminal according to an embodiment of the disclosure.
  • Figure 9 shows an exemplary operation for a receiving terminal according to an embodiment of the disclosure.
  • Figure 10 is a block diagram of a UE according to an embodiment of the disclosure.
  • Figure 11 is a block diagram of a network entity (function) according to an embodiment of the disclosure.
  • the disclosure may be described and illustrated in terms of blocks which carry out a described function or functions. These blocks, which may be referred to herein as units or modules or the like, are physically implemented by analog and/or digital circuits such as logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, optical components, hardwired circuits and the like, and may optionally be driven by firmware and/or software.
  • the circuits may, for example, be embodied in one or more semiconductor chips, or on substrate supports such as printed circuit boards and the like.
  • the disclosure relates to media adaptation in media service.
  • the disclosure may relate to 5G network system for multimedia, quality of service (QoS), session description protocol (SDP) negotiation for extended reality (XR) real-time communication media services, media codec adaptation for XR media, traffic rate adaptation for XR media, and/or layered codec support for XR media SDP negotiation.
  • QoS quality of service
  • SDP session description protocol
  • XR extended reality
  • 3GPP TS 26.114 defines SDP negotiation and corresponding SDP attributes and parameters for media for real time communication.
  • 3GPP services and system aspects (SA) 2 is commencing study on XR and media services, in particular the support of a protocol/packet data unit (PDU) set concept, allowing for PDU set integrated packet handling and differentiated PDU set handling by a physical layer.
  • PDU protocol/packet data unit
  • the PDU set packet handling is a mechanism for media adaptation.
  • the disclosure may provide several embodiments which allows a media receiver (e.g., UE) or a media sender (e.g., media resource function (MRF) entity) to enable media adaptation (for example, bandwidth adjustments for media) through the SDP negotiation procedure.
  • a media receiver e.g., UE
  • a media sender e.g., media resource function (MRF) entity
  • MRF media resource function
  • media adaptation through PDU set packet dropping by the physical layer may have a following issues:
  • Exposure of media level application means parsing multiple packet layers to identify such information
  • the necessary parameters associated with enablement of a PDU set are very implementation specific, for example knowing the size of the PDU set typically requires encoding of a whole GoP by the encoder, depending on the GoP structure, thus introducing delays in an encapsulation pipeline (e.g. real-time transport protocol (RTP) header) of corresponding PDU set size parameters.
  • RTP real-time transport protocol
  • Certain media line(s) may be independently decodable, and others only dependently decodable (e.g., such as a layered codec).
  • Each of the multiple media lines or layers may also have priority related information associated with it to indicate its priority of selection or importance.
  • the priority related information may be used to identify priority of selection or importance when session bandwidth is insufficient.
  • the priority related information may include at least one of:
  • a priority group attribute (e.g., an XR priority group attribute) which groups multiple media lines associated to a single media presentation (or, single media type presentation) (e.g., 2D video, 3D video, audio etc) when decoded
  • Figure 1 shows a structure of a 3G network according to an embodiment of the disclosure.
  • the 3G network may includes a UE 100, a base station (e.g., NodeB (NB)) 102, a radio network controller (RNC) 104, and a mobile switching center (MSC) 106.
  • NB NodeB
  • RNC radio network controller
  • MSC mobile switching center
  • the 3G network may be connected to another mobile communication network (e.g., a public switched telephone network (PSTN) 108).
  • voice may be compressed and/or restored with an adaptive multi-rate (AMR) codec.
  • the AMR codec may be installed in a terminal (e.g., the UE 100) and the MSC 106 to provide a two-way call service.
  • the MSC 107 may convert the voice compressed in the AMR codec into a pulse-code modulation (PCM) format and transmits the voice of the PCM format to the PSTN 108.
  • the MSC 106 may receive the voice of the PCM format from the PSTN 108, compresses the voice of the PCM format into the AMR codec, and transmits the voice compressed in the AMR codec to the base station 102.
  • PCM pulse-code modulation
  • FIG. 2 shows a structure of a long term evolution (LTE) network according to an embodiment of the disclosure.
  • LTE long term evolution
  • the voice codec may be installed only in the UE 100, and the UE 100 may adjust the voice bit rate of the counterpart terminal using a codec mode request (CMR) message.
  • CMR codec mode request
  • the eNodeB which is a base station, may be divided into a remote radio head (RRH) 202 dedicated to radio frequency (RF) functions and a digital unit (DU) 204 dedicated to modem digital signal processing.
  • RRH remote radio head
  • DU digital unit
  • the eNodeB 202/204 is connected to internet protocol (IP) backbone network 208 through the S-GW and P-GW.
  • IP backbone network 208 is connected to the mobile communication network and/or internet of other service providers.
  • the IP protocol located at the bottom of this structure 302 is connected to packet data convergence protocol (PDCP) located at the top of the protocol structure 302.
  • PDCP packet data convergence protocol
  • the RTP / UDP / IP header is attached to a compressed media frame in the voice and video codec and transmitted to the counterpart terminal through the network (e.g., the LTE network).
  • the counterpart terminal receives a media packet compressed and transmitted from the network (e.g., the LTE network), restores a media, listens to a speaker and a display, and views the media.
  • timestamp information of the RTP protocol header is used to synchronize the two media (e.g., voice and video) to listen and watch.
  • the 5G network includes a UE 100, a base station 402/404 (e.g., 5G NodeB (gNB)) an user plane function (UPF) 406, and data network (DN) 408.
  • the eNB 202/204, S-GW and P-GW of the LTE network are gNB 402/404, the UPF 406, and DN 408 of the 5G network.
  • conversational media including video and audio, may be transmitted using the 5G network.
  • additionally data related to media adaptation may also be transmitted using the 5G network.
  • FIG. 4B shows an exemplary architecture of IP multimedia subsystem (IMS) network according to an embodiment of the disclosure.
  • IMS IP multimedia subsystem
  • the IMS network may include IMS entities from two different operators during a conversational call between two UEs (UE A 410b and UE B 420b).
  • the 5GC functional entities are not shown in Figure 4B.
  • the UE may communicate with other UEs (e.g., UE B 420b) and other IMS entities located in a remote IMS network (e.g., IMS network of operator B 440b) through an IMS entities in an IMS network (e.g., IMS network of operator A 430b).
  • a remote IMS network e.g., IMS network of operator B 440b
  • IMS entities in an IMS network e.g., IMS network of operator A 430b.
  • the IMS entities may include a proxy call session control function (P-CSCF), an interrogating CSCF (I-CSCF), serving CSCF (S-CSCF), an application server (AS), and/or home subscriber server (HSS).
  • P-CSCF proxy call session control function
  • I-CSCF interrogating CSCF
  • S-CSCF serving CSCF
  • AS application server
  • HSS home subscriber server
  • the P-CSCF may perform a first contact point function for the UE 410b/420b to access the IMS network.
  • the I-CSCF may perform a contact point function for a subscriber of a network operator (e.g., the operator A 430b or B 440b) or a roaming user currently located in a service area of the network operator 430b/440b.
  • a network operator e.g., the operator A 430b or B 440b
  • a roaming user currently located in a service area of the network operator 430b/440b.
  • the HSS may serve as a database for storing information about a user.
  • a media path 400b represents an actual flow of media data such as (voice) audio media, video media etc.
  • Figure 4C shows an exemplary architecture of a communication network including the 5G RAN 410c, 5G core network 420c, and the IMS Network 430c according to an embodiment of the disclosure.
  • the communication network includes at least one entity for SDP negotiation, and the at least one entity for the SDP negotiation may include the UE 100 in the 5G RAN 410c and a media resource function (MRF) entity 431c () in the IMS Network 430c.
  • MRF media resource function
  • the MRF 431c may perform various processing tasks related to a media stream.
  • the MRF 431c may be divided into a multimedia resource function controller (MRFC) for control functionality and a multimedia resource function processor (MRFP) for media processing functionality.
  • MRFC multimedia resource function controller
  • MRFP multimedia resource function processor
  • Figure 5 shows an exemplary procedure for a transmitting terminal and a receiving terminal to negotiate a transmission method of a conversational service using the IP multimedia subsystem (IMS) according to an embodiment of the disclosure.
  • IMS IP multimedia subsystem
  • the IMS may be shown in FIG. 4A/4B.
  • Figure 5 may show an exemplary procedure for the transmitting terminal (e.g., UE A 100) and the receiving terminal (e.g., UE B 520) to secure the QoS of a wired and wireless transmission path.
  • the transmitting terminal 100 may transmit a SDP request message (e.g., SDP offer message) 522 to the P-CSCF 504 in the service provider A 502, which has an IMS node/entity allocated to the transmitting terminal 100, in a session initiation protocol (SIP) invite message 524.
  • SDP request message e.g., SDP offer message
  • This message 524 may be transmitted to the IMS connected to the counterpart terminal 520 through nodes such as S-CSCF 506, I-CSCF 514, and P-CSCF 518 in the service provider B 512, and finally to the receiving terminal 520.
  • the receiving terminal 520 may select an acceptable bit rate and a transmission method from among the bit rates proposed by the transmitting terminal 100. For an conversational service, the receiving terminal 520 may also select a desired configuration according to that offered by the transmitting terminal 100, including these information in an SDP answer message in the SIP 183 message 524 in order to transmit the SDP answer message to the transmitting terminal 100. In this case, the transmitting terminal 100 may be an MRF instead of a UE.
  • S-CSCF#1 506 may examine the media parameters. If S-CSCF#1 506 finds media parameters that local policy or the originating user's subscriber profile does not allow to be used within an IMS session, S-CSCF#1 506 may reject the session initiation attempt. This rejection may contain sufficient information for the originating UE (e.g., UE#1 100) to re-attempt session initiation with media parameters that are allowed by the originating user's subscriber profile and by local policy of S-CSCF#1's network. (e.g., according to the procedures specified in IETF RFC 3261). In this flow described in Figure 6 above the S-CSCF#1 506 may allow the initial session initiation attempt to continue.
  • S-CSCF#1 506 may allow the initial session initiation attempt to continue.
  • Figure 8 may shows an XR MTSI session media path for video based XR media between the MRF 810 being media source and the UE 720 being media destination.
  • the MRF 810 sends an SDP offer (SDP offer message) to the UE 810.
  • the SDP offer may include at least one of:
  • a flag value of 0 indicates that the stream is independently decodable without any dependencies, and a flag value of 1 indicates that the stream is not independently decodable, and is only decodable with dependency on another XR media stream(s).
  • - Priority parameter Multiple XR media streams associated to the presentation of one media type may each have a priority assigned such that low priority streams can be omitted when traffic conditions are insufficient (e.g. bandwidth, latency), or when processing on the MTSI client is insufficient (or due to any other factor).
  • the dependency parameter may include a flag which indicates whether a correponding media stream (e.g., a correponding m-line XR media stream) is independently decodable or not.
  • Independently decodable streams may be decoded to output an an media presentation (e.g., XR media presentation) (such as 2D video or 3D video). If a corresponding media stream (e.g., a correponding m-line XR media stream) is indicated to be only dependently decodable, then the corresponding media stream must be decoded together with an independently decodable media stream in order to output an media presentation (e.g., an XR media presentation).
  • a prioriy parameter for a independently decodable media stream may be configured as a value 0.
  • the UE may identify whether the UE support multi-layered coding.
  • Each m-line represents the same media presentation (e.g., the same XR media presentation), each m-line has a different quality
  • Each m-line includes a different combination of multiplexed layer coded media (e.g., multiplexed layer coded XR media), for example:
  • m-line 1 corresponds to 1 media stream having base layer which is independently decodable
  • a new attribute XRpriority_layer under each m-line is defined and used to describe the relationship of the payload formats and the corresponding XR media codec layer) (e.g. base layer, first layer, second layer etc).
  • the XRpriority_layer attribute also contains a priority indication (through e.g. an integer value), which indicates the priority of the m-line in terms of quality priority.
  • a low integer may indicate a low quality priority (e.g. value of 0 indicates lowest quality, but highest priority, since it is the most readily decodable stream, whilst a value of 1 indicates a next higher quality, but lower priority than value 0, since it requires the decoding of a dependent layer).
  • a high integer may also indicate a low quality priority.
  • the selected m-line is included into the SDP answer (together with the attributes and parameters defined in this embodiment), and sent back to the MRF.
  • user plane XR media matching that of the m-line negotiated is delivered to the UE from the MRF.
  • Figure 10 is a block diagram of a UE according to an embodiment of the disclosure.
  • the UE may be a transmitting device (terminal) and/or the receiving device (terminal) as exemplified above.
  • the UE may include a transceiver 1010, a controller 1020, and storage 1030.
  • the controller 1320 may include a circuit, an application-specific integrated circuit (ASIC), or at least one processor.
  • ASIC application-specific integrated circuit
  • the transceiver 1010 may transmit and receive signals to and from another entity.
  • the controller 1020 may control the overall operation of the UE according to the embodiments.
  • the controller 1020 may control the signal flow to perform the operations in Figures 1-9 described above.
  • the controller 1020 may be implemented through at least one processor.
  • the storage 1030 may store at least one of information exchanged through the transceiver and information generated by the controller.
  • a network entity may include a transceiver 1110, a controller 1120, and storage 1130.
  • the controller 1120 may include a circuit, an ASIC, or at least one processor.
  • the transceiver 1110 may transmit and receive signals to and from an UE and other network entity.
  • the controller 1120 may control the overall operation of the network entity (function) according to an embodiment.
  • the controller may control the signal flow to perform the operations in Figures 1-9 described above.
  • the controller 1120 may be implemented through at least one processor.
  • the embodiments disclosed herein can be implemented through at least one software program running on at least one hardware device and performing network management functions to control the elements.
  • the elements disclosed herein include blocks which can be a hardware device, a software module, or a combination of a hardware device and a software module.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

L'invention concerne un système de communication de cinquième génération (5G) ou à un système de communication de sixième génération (6G) permettant de prendre en charge des débits de données supérieurs à ceux d'un système de communication de quatrième génération (4G) tel qu'un système d'évolution à long terme (LTE). L'invention concerne également un procédé d'une entité de transmission. Le procédé comprend la transmission, à une entité de réception, d'un message d'offre de protocole de description de session (SDP), le message d'offre SDP comprenant une information de groupe pour un groupe comprenant une pluralité de flux multimédias, la réception, en provenance de l'entité de réception, d'un message de réponse SDP, en réponse au message d'offre SDP, et la transmission, à l'entité de réception, d'au moins un flux multimédia dans le groupe, négocié sur la base du message d'offre SDP et du message de réponse SDP.
PCT/KR2024/000217 2023-01-05 2024-01-04 Procédé et appareil d'adaptation multimédia en service multimédia WO2024147675A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR20230001784 2023-01-05
KR10-2023-0001784 2023-01-05

Publications (1)

Publication Number Publication Date
WO2024147675A1 true WO2024147675A1 (fr) 2024-07-11

Family

ID=91804003

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2024/000217 WO2024147675A1 (fr) 2023-01-05 2024-01-04 Procédé et appareil d'adaptation multimédia en service multimédia

Country Status (1)

Country Link
WO (1) WO2024147675A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009121403A1 (fr) * 2008-04-01 2009-10-08 Telefonaktiebolaget Lm Ericsson (Publ) Procédé et appareil pour distinguer des flux ip
US20170006078A1 (en) * 2015-06-30 2017-01-05 Qualcomm Incorporated Methods and apparatus for codec negotiation in decentralized multimedia conferences
US20180027027A1 (en) * 2016-07-21 2018-01-25 Qualcomm Incorporated Methods and apparatus for use of compact concurrent codecs in multimedia communications
US20210006611A1 (en) * 2013-03-27 2021-01-07 Ringcentral, Inc. Method and system for negotiation of media between communication devices for multiplexing multiple media types

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009121403A1 (fr) * 2008-04-01 2009-10-08 Telefonaktiebolaget Lm Ericsson (Publ) Procédé et appareil pour distinguer des flux ip
US20210006611A1 (en) * 2013-03-27 2021-01-07 Ringcentral, Inc. Method and system for negotiation of media between communication devices for multiplexing multiple media types
US20170006078A1 (en) * 2015-06-30 2017-01-05 Qualcomm Incorporated Methods and apparatus for codec negotiation in decentralized multimedia conferences
US20180027027A1 (en) * 2016-07-21 2018-01-25 Qualcomm Incorporated Methods and apparatus for use of compact concurrent codecs in multimedia communications

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
HOLMBERG C, ALVESTRAND GOOGLE ERICSSON H, CISCO C JENNINGS: "RFC 8843 Negotiating Media Multiplexing Using the Session Description Protocol (SDP)", INTERNET ENGINEERING TASK FORCE (IETF) - RFC 8843, 1 January 2021 (2021-01-01), pages 1 - 50, XP093189116, Retrieved from the Internet <URL:https://www.rfc-editor.org/rfc/rfc8843.pdf> *

Similar Documents

Publication Publication Date Title
US8560717B2 (en) Method and system for implementing video call service and video interworking gateway device
WO2017003175A1 (fr) Procédé et appareil de fourniture d&#39;un service dans un système de communication sans fil
WO2022035177A1 (fr) Procédé et dispositif de fourniture d&#39;un mbs local dans un système de communication sans fil
WO2016204468A1 (fr) Procédé et appareil pour une distribution multimédia à trajets multiples
GB2359209A (en) Apparatus and methods for video distribution via networks
US6850778B1 (en) Gateway arrangement
WO2021177793A1 (fr) Appareil et procédé de prise en charge d&#39;un service d&#39;exposition d&#39;événement d&#39;une upf dans un système de communication sans fil
WO2021141296A1 (fr) Procédé et dispositif permettant de délivrer des informations de synchronisation de mise en réseau sensible au temps dans un système de communication mobile
EP3314931A1 (fr) Procédé et appareil de fourniture d&#39;un service dans un système de communication sans fil
WO2000067514A1 (fr) Transfert dans un systeme de telecommunications
WO2021141337A1 (fr) Procédé et appareil pour prendre en charge un réseautage sensible au temps entièrement distribué dans un système de communication mobile
US11805156B2 (en) Method and apparatus for processing immersive media
US6985732B1 (en) Handover in a mobile communication system using conference facility
WO2024147675A1 (fr) Procédé et appareil d&#39;adaptation multimédia en service multimédia
WO2016129964A1 (fr) Support d&#39;enregistrement lisible par ordinateur dans lequel est enregistré un programme pour fournir un contenu adaptatif de réseau, et appareil de fourniture de contenu adaptatif de réseau
WO2007041910A1 (fr) Procede et systeme de transmission de donnees
KR100401262B1 (ko) 이동전화망에서의 화상전화 서비스 제공 장치 및 그 방법
WO2008067722A1 (fr) Procédé, système de téléphone et terminal de téléphone pour une session d&#39;appel
JP2003198618A (ja) パケットデータ通信システム及び携帯電話機並びにネットワーク側装置
WO2024080840A1 (fr) Procédé et appareil pour fournir des services multimédias ia/ml
US7061886B1 (en) Packet voting in wireless communications systems
WO2024101720A1 (fr) Procédé et appareil de rapport de qoe pour des services multimédias xr
WO2018164355A1 (fr) Procédé et dispositif de transmission/réception de signal en multidiffusion
WO2018155798A1 (fr) Procédé et dispositif de transmission et de réception de signal multidiffusion
WO2016167592A1 (fr) Procédé et appareil de communication avec un réseau local sans fil dans un système de communication mobile

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24738743

Country of ref document: EP

Kind code of ref document: A1