Neural Cloud Storage: Innovative Cloud Storage Solution for Cold Video
Authors: 
Jinyeong Lim, Juncheol Ye, Jaehong Kim, Hwijoon Lim, Hyunho Yeo, Dongsu HanAuthors Info & Claims
Pages 1 - 7
Abstract
Cloud storage providers offer different pricing tiers based on the access frequency of stored data. This pricing plan offers cost benefits for videos that are accessed less than once per month. However, the stringent requirement falls short in addressing the large number of "cold" videos stored today. This paper proposes Neural Cloud Storage (NCS), a pioneering approach to address the problem by applying neural enhancement, specifically content-aware super-resolution (SR). According to our preliminary cost-benefit analysis, NCS can further save an annual 14% total cost of ownership (TCO) compared to the cheapest AWS storage service for cold video. By reducing the cost, it expands the cold video coverage (from 25% to 38%) that can benefit from the multi-tiered service. As deep learning and computational resources continue to advance, we believe that neural enhancement will revolutionize the field of cloud storage.
References
[1]
Amazon EC2 G5 instacne. https://aws.amazon.com/ec2/instance-types/g5/.
[2]
Amazon S3. https://aws.amazon.com/s3/.
[3]
Dataset: 3D Animation Youtube video. https://www.youtube.com/watch?v=MSUePe7RH24.
[4]
Dataset: Baseball Youtube video. https://www.youtube.com/watch?v=zM81SW4y_Dg.
[5]
Dataset: Kpop Youtube video. https://www.youtube.com/watch?v=cU0JrSAyy7o.
[6]
Dataset: Minecraft Youtube video. https://www.youtube.com/watch?v=5gff3AGv7o8.
[7]
Dataset: Movie Youtube video. https://www.youtube.com/watch?v=rrGMENN1iaY.
[8]
Dataset: Parkour Youtube video. https://www.youtube.com/watch?v=yv4x0vsfbz8.
[9]
Dataset: Swim Youtube video. https://www.youtube.com/watch?v=IXCq86RbcxU.
[10]
Dataset: Tokyo city view Youtube video. https://www.youtube.com/watch?v=6DQxRQb9dCE.
[11]
Dataset: Wild Youtube video. https://www.youtube.com/watch?v=Pe0Ci3z5xTw.
[12]
Google transparency report. https://transparencyreport.google.com/?hl=en
[13]
Media; google developers. https://developers.google.com/media/vp9/settings/vod?hl=en
[14]
Storage classes | Google Cloud. https://cloud.google.com/storage/docs/storage-classes#descriptions.
[15]
TensorRT Official Website. https://developer.nvidia.com/tensorrt.
[16]
YouTube Data API. https://developers.google.com/youtube/v3.
[17]
YouTube recommended upload encoding settings. https://support.google.com/youtube/answer/1722171?hl=en#zippy=
[18]
Global Cloud Video Storage Market Size [2021--2028] | to Reach USD 20.93 Billion By 2028 and Exhibit a CAGR of 16.1%. https://www.proquest.com/wire-feeds/global-cloud-video-storage-market-size-2021-2028/docview/2646691154/se-2
[19]
Eirikur Agustsson and Radu Timofte. NITRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops.
[20]
Srikar Appalaraju and Vineet Chaoji. Image similarity using Deep CNN and Curriculum Learning. arXiv:cs.CV/1709.08761
[21]
Adam Bielski and Tomasz Trzcinski. Understanding Multimodal Popularity Prediction of Social Media Videos With Self-Attention. IEEE Access 6 (2018), 74277--74287.
[22]
Mathias Bärtl. YouTube channels, uploads and views: A statistical analysis of the past 10 years. Convergence 24, 1 (2018), 16--32. arXiv:https://doi.org/10.1177/1354856517736979
[23]
Jianlong Chang, Lingfeng Wang, Gaofeng Meng, Shiming Xiang, and Chunhong Pan. Deep adaptive image clustering. In Proceedings of the IEEE international conference on computer vision. 5879--5887.
[24]
Bohong Chen, Mingbao Lin, Kekai Sheng, Mengdan Zhang, Peixian Chen, Ke Li, Liujuan Cao, and Rongrong Ji. ARM: Any-Time Super-Resolution Method. arXiv:cs.CV/2203.10812
[25]
Giulia Fontanini, Marco Bertini, and Alberto Del Bimbo. Web Video Popularity Prediction Using Sentiment and Content Visual Features. In Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval (New York, New York, USA) (ICMR '16). Association for Computing Machinery, New York, NY, USA, 289--292.
[26]
Ying-Feng Hsu, Ryo Irie, Shuuichirou Murata, and Morito Matsuoka. A Novel Automated Cloud Storage Tiering System through Hot-Cold Data Classification. In 2018 IEEE 11th International Conference on Cloud Computing (CLOUD). 492--499.
[27]
Jaehong Kim, Youngmok Jung, Hyunho Yeo, Juncheol Ye, and Dongsu Han. Neural-Enhanced Live Streaming: Improving Live Video Ingest via Online Learning (SIGCOMM '20). Association for Computing Machinery, New York, NY, USA, 107--125.
[28]
Yue Li, Dong Liu, Houqiang Li, Li Li, Zhu Li, and Feng Wu. Learning a Convolutional Neural Network for Image Compact-Resolution. IEEE Transactions on Image Processing 28, 3 (2019), 1092--1107.
[29]
Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and Kyoung Mu Lee. Enhanced Deep Residual Networks for Single Image Super-Resolution. CoRR abs/1707.02921 (2017). arXiv:1707.02921 http://arxiv.org/abs/1707.02921
[30]
Subramanian Muralidhar, Wyatt Lloyd, Sabyasachi Roy, Cory Hill, Ernest Lin, Weiwen Liu, Satadru Pan, Shiva Shankar, Viswanath Sivakumar, Linpeng Tang, and Sanjeev Kumar. f4: Facebook's Warm BLOB Storage System. In 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14). USENIX Association, Broomfield, CO, 383--398. https://www.usenix.org/conference/osdi14/technical-sessions/presentation/muralidhar
[31]
Henrique Pinto, Jussara M. Almeida, and Marcos A. Gonçalves. Using Early View Patterns to Predict the Popularity of Youtube Videos. In Proceedings of the Sixth ACM International Conference on Web Search and Data Mining (Rome, Italy) (WSDM '13). Association for Computing Machinery, New York, NY, USA, 365--374.
[32]
Wanjie Sun and Zhenzhong Chen. Learned Image Downscaling for Upscaling Using Content Adaptive Resampler. IEEE Transactions on Image Processing 29 (2020), 4027--4040.
[33]
Linpeng Tang, Qi Huang, Amit Puntambekar, Ymir Vigfusson, Wyatt Lloyd, and Kai Li. Popularity Prediction of Facebook Videos for Higher Quality Streaming. In 2017 USENIX Annual Technical Conference (USENIX ATC 17). USENIX Association, Santa Clara, CA, 111--123. https://www.usenix.org/conference/atc17/technical-sessions/presentation/tang
[34]
Suramya Tomar. Converting video formats with FFmpeg. Linux Journal 2006, 146 (2006), 10.
[35]
Tomasz Trzciński and Przemysław Rokita. Predicting Popularity of Online Videos Using Support Vector Regression. IEEE Transactions on Multimedia 19, 11 (2017), 2561--2570.
[36]
Jiang Wang, Yang song, Thomas Leung, Chuck Rosenberg, Jinbin Wang, James Philbin, Bo Chen, and Ying Wu. Learning Fine-grained Image Similarity with Deep Ranking. arXiv:cs.CV/1404.4661
[37]
Mingqing Xiao, Shuxin Zheng, Chang Liu, Yaolong Wang, Di He, Guolin Ke, Jiang Bian, Zhouchen Lin, and Tie-Yan Liu. Invertible Image Rescaling. arXiv:eess.IV/2005.05650
[38]
Juncheol Ye, Hyunho Yeo, Jinwoo Park, and Dongsu Han. AccelIR: Task-Aware Image Compression for Accelerating Neural Restoration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 18216--18226.
[39]
Hyunho Yeo, Chan Ju Chong, Youngmok Jung, Juncheol Ye, and Dongsu Han. NEMO: Enabling Neural-Enhanced Video Streaming on Commodity Mobile Devices. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking (London, United Kingdom) (MobiCom '20). Association for Computing Machinery, New York, NY, USA, Article 28, 14 pages.
[40]
Hyunho Yeo, Youngmok Jung, Jaehong Kim, Jinwoo Shin, and Dongsu Han. Neural Adaptive Content-Aware Internet Video Delivery. In Proceedings of the 13th USENIX Conference on Operating Systems Design and Implementation (Carlsbad, CA, USA) (OSDI'18). USENIX Association, USA, 645--661.
[41]
Hyunho Yeo, Hwijoon Lim, Jaehong Kim, Youngmok Jung, Juncheol Ye, and Dongsu Han. NeuroScaler: Neural Video Enhancement at Scale. In Proceedings of the ACM SIGCOMM 2022 Conference (Amsterdam, Netherlands) (SIGCOMM '22). Association for Computing Machinery, New York, NY, USA, 795--811.
Index Terms
- Neural Cloud Storage: Innovative Cloud Storage Solution for Cold Video
Recommendations
Cloud Storage as the Infrastructure of Cloud Computing
ICICCI '10: Proceedings of the 2010 International Conference on Intelligent Computing and Cognitive InformaticsAs an emerging technology and business paradigm, Cloud Computing has taken commercial computing by storm. Cloud computing platforms provide easy access to a company’s high-performance computing and storage infrastructure through web services. With cloud ...
Middleware enabled data sharing on cloud storage services
MW4SOC '10: Proceedings of the 5th International Workshop on Middleware for Service Oriented ComputingWith the emergence of public cloud storage platforms like Amazon, Microsoft and Google etc, individual applications and some enterprise storage are being increasingly deployed on Clouds. However, dynamic data sharing in public clouds face problems of ...
Block storage scheduling based on SLA in cloud storage systems
EDB '16: Proceedings of the Sixth International Conference on Emerging Databases: Technologies, Applications, and TheoryAccording to the growth of the utilization of cloud computing, the required storage capacity is also increasing. The cloud computing services can allocate immediately storage volume according to user requirements, and cloud storage should be scalable. ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2023
131 pages
ISBN:9798400702242
DOI:10.1145/3599691
- General Chairs:
- Ali Anwar,
- Ningfang Mi,
- Program Chairs:
- Vasily Tarasov,
- Yiying Zhang
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
- USENIX
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 10 July 2023
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
HotStorage '23
Sponsor:
HotStorage '23: 15th ACM Workshop on Hot Topics in Storage and File Systems
July 9, 2023
MA, Boston, USA
Acceptance Rates
Overall Acceptance Rate 34 of 87 submissions, 39%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 295Total Downloads
- Downloads (Last 12 months)156
- Downloads (Last 6 weeks)13
Reflects downloads up to 12 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in