US20160316009A1

US20160316009A1 - Device and method for receiving scalable content from multiple sources having different content quality

Info

Publication number: US20160316009A1
Application number: US15/198,759
Authority: US
Inventors: Christophe Pavot; Francois-Xavier Ehrhart; Thomas Papin
Original assignee: Google Technology Holdings LLC
Current assignee: Google Technology Holdings LLC
Priority date: 2008-12-31
Filing date: 2016-06-30
Publication date: 2016-10-27
Also published as: US20100169414A1; EP2204965A1; US9386090B2; EP2204965B1

Abstract

A device and a method in a device for receiving scalable content. The method includes receiving a first portion of content to be received with a desired content quality from a first source having a first version of the receivable content. A second portion of content to be received with a desired content quality is received from a second source having a second version of the receivable content, where a value for at least one quality factor of the second version of the receivable content is different than a value for the corresponding quality factor of the first version of the receivable content. At least the first portion of content to be received and the second portion of content to be received is then combined, wherein at least one of the first version and the second version includes non-duplicative data.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 12/646,299 filed Dec. 23, 2009, now U.S. Pat. No. 9,386,090, entitled “Device and Method for Receiving Scalable Content from Multiple Sources Having Different Content Quality”, of which is incorporated herein by reference in its entirety and for all purposes.

BACKGROUND

File sharing refers to the provision for sharing (receiving or distributing) digital files and/or content via a network. In many cases the file sharing involves a peer to peer connection, where content is at least partially received from one or more other end users of the content, which already possess a copy of the desired content. Such a distribution model differs from other instances in which a central server maintains and distributes the content. The peer to peer model benefits from the advantages of a more distributed distribution approach, where a larger number of sources of the content, each having an independent ability to source the content including processing power and distribution band width, are used to supply one or more portions of the content. A particular content recipient can receive different portions of the content from separate sources, which helps to minimize and/or spread the load or impact on any particular source of the content.
Furthermore the presence of multiple sources serves to provide a degree of redundancy, which can be used to accommodate the dynamic nature of networks, such as the Internet, where any particular source's presence on the network may be temporary and/or transient. If a particular source ceases to be available during the download of content, another suitable source is identified and accessed to supply the remaining portions of the content that has yet to be received.
Such a distribution model for content has become very popular for use on personal computers. As such, much of the available content via this distribution model is formatted for use in that environment. Increasingly, users are wanting to access the same or similar content using more portable devices, such as personal digital assistants or cellular telephones. However, much of the available content is formatted for being viewed on the relatively higher fidelity interfaces more commonly associated with personal computers. Additionally, the more limited storage associated with the more mobile devices has diminished the availability of content formatted at a quality level that is suitable for rendering by the more mobile devices.
In some instances the ability to more readily scale content has benefited from the increasing availability of scalable codecs for audio, image or video files, which can sometimes be more readily used to change the quality of the file by adapting the dimensions, the frame rate, and/or other quality factors of the content, without first needing to decompress the information, and subsequently recompress the information after the appropriate quality conversion. At least a couple of scalable techniques include bitplane coding and enhancement layer encoding, which assists in making available a desired portion associated with a particular quality level.
In bitplane coding, scalable coding of the media blocks is generally achieved by coding a block of audio/video transform coefficients bitplane by bitplane, from the most significant bitplane to the least significant bitplane.
In enhancement layer encoding, the media content is compressed into a base layer and one or more enhancement layers, each of which typically occupies a separate channel. A minimum quality media stream is coded in the base layer. With the addition of each successive enhancement layer in addition to the base layer, the quality of the decoded media improves.
However even with the availability of scalable codecs, many peer to peer applications have difficulty managing multiple source files of the same content having differing versions of quality, as the more traditional peer to peer models, are unable to establish a useable relationship between the different versions of the same content. In absence of being able to recognize a useable relationship between the different versions, the different versions are treated by many peer to peer distribution systems as being separate independent and distinct forms of content.
Consequently, the present inventors have recognized that it would be beneficial if the content that is readily available in differing quality levels from multiple peer sources might be identified and adapted to be received and combined at a suitable quality level for use on a more mobile device having greater limitations on data throughput as well as the reproducible quality levels for content that is intended to be rendered by the device.

SUMMARY OF THE INVENTION

The present invention provides a method in a device for receiving scalable content. The method includes receiving a first portion of content to be received with a desired content quality from a first source having a first version of the receivable content. A second portion of content to be received with a desired content quality is received from a second source having a second version of the receivable content, where a value for at least one quality factor of the second version of the receivable content is different than a value for the corresponding quality factor of the first version of the receivable content. At least the first portion of content to be received and the second portion of content to be received is then combined, wherein at least one of the first version and the second version includes non-duplicative data.
In at least one embodiment, at least one of the first version of the receivable content and the second version of the receivable content has a value for at least one quality factor, which is different from the desired value of the corresponding quality factor of the content to be received with the desired content quality.
In at least a further embodiment, the method further includes receiving by the device for receiving scalable content a list of the usable portions of at least one of the first version of the receivable content and the second version of the receivable content in forming the content to be received with the desired content quality.
In at least a still further embodiment, the method further includes receiving by the device for receiving scalable content a list of error checking values for each of one or more different portions of the content to be received with the desired content quality for validating the integrity of the received content after combining.
The present invention further provides a device for receiving scalable content in a system including at least a first source having a first version of the receivable content and a second source having a second version of the receivable content, where a value for at least one quality factor of the second version of the receivable content is different than a value for the corresponding quality factor of the first version of the receivable content. The device includes a receiver for receiving a first portion of content to be received with a desired content quality from the first source, and a second portion of content to be received with a desired content quality from the second source. The device further includes a controller for combining at least the first portion of content to be received and the second portion of content to be received, wherein at least one of the first version and the second version includes non-duplicative data.
These and other features, and advantages of this invention are evident from the following description of one or more preferred embodiments of this invention, with reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of at least a portion of an exemplary network environment in which the distribution of content from multiple sources can occur;

FIG. 2 is a block diagram of a requestor device and multiple peer devices each having different versions of the same content;

FIG. 3 is a block diagram of a mapping of usable blocks of different versions of the same content, including a version having a higher quality and a version having a lower quality;

FIG. 4 is an exemplary command structure for requesting one or more blocks of data from a source of receivable content as part of a single request;

FIG. 5 is a flow diagram of a method in a device for receiving scalable content, in accordance with at least one embodiment of the present invention; and

FIG. 6 is a block diagram of a device for receiving scalable content, in accordance with at least a further embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

While the present invention is susceptible of embodiment in various forms, there is shown in the drawings and will hereinafter be described presently preferred embodiments with the understanding that the present disclosure is to be considered an exemplification of the invention and is not intended to limit the invention to the specific embodiments illustrated.
FIG. 1 illustrates a block diagram 100 of at least a portion of an exemplary network environment in which the distribution of content from multiple sources can occur. In the illustrated embodiment, network 102 represents connectivity that can be present between entities such as servers 104, peer devices 106 and access points 108, which can be used to interface with other devices either directly or indirectly connected to the network 102. Through the access point 108, a device 110 that is requesting content can communicate with other entities communicatively connected to the network 102. It is further possible that the device 110 that is requesting content can communicate directly with other peer devices 112 independent of the network 102.
In at least some instances, the network 102 can include elements associated with one or more types of networks, some of which are intended to interact with the device that is requesting the content or the one or more entities from which the content is sought. In at least some instances, the network 102 may include elements commonly associated with a packet data network, such as the Internet. In the same or other instances, the network 102 may include elements commonly associated with a wireless communication system, such as a wireless LAN or a wireless cellular telephone system. Correspondingly, in at least some instances, the access point 108 might be a wireless router, or a cellular base station, through which other elements coupled to the network can be accessed, including content providers such as servers 104 or peer devices 106. One skilled in the art will readily appreciate, that the network 102 could represent and/or include still further forms of network elements, such as a wireline circuit switched telephone system, and/or other types of networks, without departing from the teachings of the present invention.
FIG. 2 illustrates a block diagram 200 of a requestor device 110 and multiple peer devices each having different versions of the same content. The requestor device 110 is able to access either directly or indirectly one or more peer devices 202, 204 and 206, each including one or more different versions of the desired content 212, 214 and 216. In the illustrated embodiment, a first peer device 202 includes a copy of a first version 212 of requested content. Further, a second peer device 204 includes a copy of both the first version 212 and a second version 214 of the requested content. Lastly, a third peer device 206 includes a copy of a third version 216 of the requested content. Generally each different version differs from the other versions in at least one quality factor, where examples of quality factors can include resolution, color density, frame rate and sampling rate. The particular quality factors associated with a particular file in at least some instances may be dependent upon the type of media file. For example, sampling rate is often associated with an audio file, while frame rate is often associated with a motion picture video file.
In some instances, a particular version of the content might have a higher value for one of the quality factors, but might have a lower value for another one of the quality factors. For example, a particular version of motion picture video content, relative to another version of the same content might have a higher picture resolution, but a lower frame rate. Furthermore, it is possible for some sources to have more than one version of the content, where for example, in the illustrated embodiment, the second peer device 204 has both a copy of the first version 212, and a copy of the second version 214.
Where a particular version has a lower fidelity than the version details associated with the version of the file being requested, a higher fidelity version of the content can be accessed from the same or a different source to supplement the data which is available in the lower fidelity version of the content. Where a particular version has a higher fidelity, then the version details associated with the version of the content being requested, a portion or a subset of the data might be used. In the illustrated embodiment, the second version of the content is being requested.
FIG. 3 illustrates a block diagram 300 of a mapping of usable blocks of different versions of the same content, including a version having a higher quality value and a version having a lower quality value for at least one of the quality factors, such as resolution. Generally, each version of the same content is identified through a searchable identifier contained in the file, such as the header of the file. Each version of the content might additionally include in the file, values for each of quality factors associated with the particular version of the content. For example, such information might similarly be part of a file header, which can be queried by a potential requestor of the content, in order that the requestor can plan the download requests for piecing together a version of the content, which has the desired quality level from the one or more versions having different values for one or more of the quality factors.
While a distribution of blocks are shown relative to each version, the actual distribution for any particular quality level is not necessarily proportional to the amounts illustrated nor is the information associated with each of the different levels of quality necessarily distributed in the file as illustrated. For example, the first version of the content is associated with a version having a picture resolution of 640×480, where the data unique to this version, relative to the two other versions, is shown with a cross hatching. In the particular embodiment illustrated, the amount of additional data is represented as two blocks in addition to the two blocks associated with the other two versions. However, a resolution of 640×480 can represent up to 4× the data relative to the second version of the content, which is identified as having a picture resolution of 320×240, dependent upon the amount of compression. In other words, the coded blocks are intended to identify the presence of additional data, relative to the higher resolution version, which is not present in the lower resolution version.
As shown in FIG. 3, a version of the content corresponding to the second version has been requested. As such, the second version of the content present at one of the peers can generally be used without modification. However, the download can be supplemented with data from each of the lower and higher resolution versions of the content. Generally, most of the data associated with a lower resolution third version of the content can be used, but it needs to by supplemented with additional data from one of the higher resolution versions of the content. Relative to the higher resolution version, a subset of the data can generally be used to produce the desired lower resolution version.
In some instances, a peer containing a higher resolution version might locally create the lower resolution version in support of a particular download. In other instances, it may be possible to receive a mapping of the appropriate data, which would be useful in locally producing the lower resolution version in the target requesting device, and a specific request can then be made to the peer having the higher resolution version, which identifies the specific portions of the higher resolution version, which are desired. An example of an exemplary request structure is illustrated in FIG. 4, which highlights a command structure consistent with the present invention, that enables multiple blocks of data to be identified in a single request, which strings together the descriptors for the multiple blocks in a single command. Each set of four parameters, is generally associated with individual request, which is strung together to form a particular command. The illustrated example, shows N such sets of parameters, each of which identifies the desired data associated with a particular block.
Generally, the exemplary command structure 400 includes parameters identifying the address of the start of the block, labeled first 402, and the address of the end of the block, labeled last 404, as well as the amount of data to grab, labeled size 406, including how often within the defined block to grab the data, labeled step 408, such that a subset of periodically occurring groupings of data can be grabbed from any particular defined data block.
FIG. 5 illustrates a flow diagram of a method 500 in a device for receiving scalable content, in accordance with at least one embodiment of the present invention. The method 500 includes receiving 502 a first portion of content to be received with a desired content quality from a first source having a first version of the receivable content. A second portion of content to be received with a desired content quality is then received 504 from a second source having a second version of the receivable content, where a value for at least one quality factor of the second version of the receivable content is different than a value for the corresponding quality factor of the first version of the receivable content. At least the first portion of content to be received and the second portion of content to be received is then combined 506, wherein at least one of the first version and the second version includes non-duplicative data.
In at least some instances, the method might optionally further include receiving 508 by the device for receiving scalable content a list of the usable portions of at least one of the first version of the receivable content and the second version of the receivable content in forming the content to be received with the desired content quality. Where upon receiving the list of usable portions, a request is sent 510 to the respective source identifying the portions of the particular version stored at the source, that is being requested.
In at least still further instances, the method might further optionally includes receiving 512 by the device for receiving scalable content a list of error checking values for each of one or more different portions of the content to be received with the desired content quality for validating the integrity of the received content after combining. These error checking values could then be used to compare 514 against the locally generated values from the respective portions of the content received. If a mismatch has occurred, the device for receiving scalable content might request that the original source resend the data, or might seek an alternative source for the same section of data. In some instances, the mismatch may be the result of a transmission error. In other instances, the mismatch may be the result of malicious behavior, which has intentionally provided a source of erroneous data.
In at least some embodiments the error checking values are cryptographic hash values, where a cryptographic hash value is derived from taking a predetermined block of data and applying a function that generally returns a fixed size bit string having a determined value. Generally, the function is of a nature such that if there was an accidental or intentional change in the values of any of the data forming the data block from which the cryptographic hash value was determined, a different hash value will be produced. As such, the hash value determined for the received data for the predetermined block of data can be compared against the values determined for the known good copy of the same block of data to help insure that the integrity of the particular block of data has been preserved.
Generally, in order to create the hash values for a file having the desired quality level. A source file having the same quality level needs to supply the values or the values may be derived from a higher quality file, where the data is arranged so as to segregate the data associated with the requested quality level, so that hash values can be determined from the segregated portions. In such an instance it may be beneficial to reorder the data so as to group the data based upon different levels of quality.
FIG. 6 illustrates a block diagram of a device 600 for receiving scalable content, in accordance with at least one embodiment of the present invention. The device 600 includes a controller 602, and a transceiver 604 coupled to the controller 602. The transceiver 604 facilitates one or more communication connections with the network 102 and/or one or more peer devices 106 and 112, which allows for the receipt and/or transmission of information between the device 600 and the other peer devices of the network 106 and 112. In the illustrated embodiment the connection is managed through a wireless communication connection, however in some instances, the connection can be managed through a wired connection.
The transceiver 604 generally radiates and receives electromagnetic energy via an antenna 606, which is coupled to the transceiver 604. The transceiver 206 generally incorporates both a transmitter 608 and a receiver 610 for supporting transmit and receive functions, thereby enabling bi-directional communication.
In at least some embodiments, the device includes a storage element 612, which can be used to store the received scalable content 614. The controller includes a combine module 616, which is adapted to combine the various portions of the received scalable content 614. In some instances, the controller will further include an error checking module 618.
In at least some embodiments, the communication controller 602 can be implemented at least in part using a microprocessor, which might operate to perform some of the functionality associated with one or more of the associated modules in conjunction with the one or more sets of prestored instructions 620 contained in the storage element 612. The storage element 612 can include one or more forms of volatile and/or non-volatile memory including conventional ROM, EPROM, RAM, or EEPROM, as well as other forms of storage including fixed or removable discs.
While at least some of the functionality associated with one or more of the associated modules can be managed under the direction of one or more sets of prestored instructions, one skilled in the art will readily recognize that the modules can include additional and/or alternative forms, such as sequential state machines and operational logic circuitry, which could be implemented in hardware, software and/or both. To the extent that any portion of the functionality is implemented using hardware elements, the same could be constructed using discrete logic elements, gate array or programmable logic array type structures, and/or could be implemented in a VLSI type structure, without departing from the teachings of the present invention.
In at least some instances, the device 600 further includes a user interface 622, which can include one or more elements for interacting with the user including one or more of a display 624, a keypad 626 and/or a speaker 628. Where present, the user interface elements 622 can be used to render the received content.
In some instances, the content might be rendered to the user as part of the receipt of the content. In such instances, the content is said to be streamed to the user. In other instances, the content might be stored for playback by the user at a time in the future to be selected by the user. Under such circumstances, the content is said to be downloaded.
In at least some instances, the device will be a cellular radio telephone. However one skilled in the art will recognize that the device can alternatively take the form of other types of devices without departing from the teachings of the present invention. Further examples in addition to cellular and/or radio telephones without intending to be an exhaustive list include cordless telephones, paging devices, personal digital assistants, portable computers, pen-based or keyboard-based handheld devices, remote control units, audio players (such as an MP3 player), and video game players, which might similarly received scalable content for use by the user.
Furthermore, because many devices for which scaling of the content is desired may have memory constraints, it may be beneficial to receive and process portions of the file at different times, in order to conserve space within the available memory and/or to avoid overflowing the available memory.
While the preferred embodiments of the invention have been illustrated and described, it is to be understood that the invention is not so limited. Numerous modifications, changes, variations, substitutions and equivalents will occur to those skilled in the art without departing from the spirit and scope of the present invention as defined by the appended claims.

Claims

What is claimed is:

1. A method, comprising:

receiving, at an electronic device, a first portion of content to be received with a desired content quality from a first electronic source having a first version of the receivable content;

receiving, at the electronic device, a second portion of content to be received with the desired content quality from a second electronic source having a second version of the receivable content, wherein the first version of the receivable content comprises a lower fidelity than a version of the content capable of being used on the electronic device, and wherein the second version of the receivable content comprises a higher fidelity than the version of the content capable of being used on the electronic device; and

combining, at the electronic device, the first portion of content and the second portion of content, wherein one of the first version and the second version comprises non-duplicative data, wherein when one of the first portion of the content and the second portion of the content comprises a lower fidelity than the desired content quality, the higher fidelity version of the content is accessed to supplement the content available in the lower fidelity version, and when one of the first portion of the content and the second portion of the content comprises a higher fidelity than the desired content quality, a subset of the content is utilized.

2. The method of claim 1, wherein the non-duplicative data comprises one of the first version and the second version including data that is not available from the other one of the first version and the second version.

3. The method of claim 1, comprising receiving a list of error checking values for each of a plurality of different portions of the content to be received with the desired content quality.

4. The method of claim 3, wherein receiving the list of error checking values comprises validating an integrity of the received content.

5. The method of claim 1, comprising receiving the content to be received with the desired content quality as part of a download to the electronic device.

6. The method of claim 1, comprising receiving the content to be received with the desired content quality as part of a streaming to electronic device.

7. The method of claim 6, wherein the streaming comprises rendering the content via a user interface of the electronic device proximate to a time of receipt of the content to be received.

8. The method of claim 1, wherein a value of a quality factor of one of the first version and the second version is different from a desired value of a corresponding quality factor of the content to be received with the desired content quality.

9. The method of claim 8, wherein one of the first version and the second version comprises a value of a quality factor higher than the desired value of the corresponding quality factor of the content to be received with the desired content quality.

10. The method of claim 8, wherein one of the first version and the second version comprises a value of a quality factor lower than the desired value of the corresponding quality factor of the content to be received with the desired content quality.

11. The method of claim 8, wherein the quality factor comprises a sampling rate, a frame rate, a resolution, a color depth, or a combination thereof.

12. A non-transitory computer-readable medium having computer executable code stored thereon, the code comprising instructions to:

cause an electronic device to receive a first portion of content to be received with a desired content quality from a first electronic source having a first version of the receivable content;

cause the electronic device to receive a second portion of content to be received with the desired content quality from a second electronic source having a second version of the receivable content, wherein the first version of the receivable content comprises a lower fidelity than a version of the content capable of being used on the electronic device, and wherein the second version of the receivable content comprises a higher fidelity than the version of the content capable of being used on the electronic device; and

cause the electronic device to combine the first portion of content and the second portion of content, wherein one of the first version and the second version comprises non-duplicative data, wherein when one of the first portion of the content and the second portion of the content comprises a lower fidelity than the desired content quality, the higher fidelity version of the content is accessed to supplement the content available in the lower fidelity version, and when one of the first portion of the content and the second portion of the content comprises a higher fidelity than the desired content quality, a subset of the content is utilized.

13. The non-transitory computer-readable medium of claim 12, wherein the code comprises instructions to cause the electronic device to send a request to the first electronic source or the second electronic source to identify the usable portions requested of the first version and the second version.

14. The non-transitory computer-readable medium of claim 13, wherein the request comprises a list of a plurality of different sections of usable portions of the first version and the second version.

15. The non-transitory computer-readable medium of claim 12, wherein the code comprises instructions to cause the electronic device to combine the first portion and the second portion by receiving a list of usable portions of one of the first version and the second version.

16. The non-transitory computer-readable medium of claim 12, wherein the code comprises instructions to cause the electronic device to receive a first video content as the first portion of content and to receive a second video content as the second portion of content.

17. An electronic device, comprising:

at least one processor configured to:

receive a first portion of content to be received with a desired content quality from a first electronic source having a first version of the receivable content;

receive a second portion of content to be received with the desired content quality from a second electronic source having a second version of the receivable content, wherein the first version of the receivable content comprises a lower fidelity than a version of the content capable of being used on the electronic device, and wherein the second version of the receivable content comprises a higher fidelity than the version of the content capable of being used on the electronic device; and

combine the first portion of content and the second portion of content, wherein one of the first version and the second version comprises non-duplicative data, wherein when one of the first portion of the content and the second portion of the content comprises a lower fidelity than the desired content quality, the higher fidelity version of the content is accessed to supplement the content available in the lower fidelity version, and when one of the first portion of the content and the second portion of the content comprises a higher fidelity than the desired content quality, a subset of the content is utilized.

18. The electronic device of claim 17, wherein the processor comprises a scalable codec.

19. The electronic device of claim 17, wherein the first version and the second version each comprises a value of a quality factor, and wherein the quality factor comprises a sampling rate, a frame rate, a resolution, a color depth, or a combination thereof.

20. The electronic device of claim 17, wherein the first version of the receivable content comprises a resolution of approximately 640×480, and wherein the second version of the receivable content comprises a resolution of approximately 320×240.