Watching TV with the Second-Party: A First Look at Automatic Content Recognition Tracking in Smart TVs
Authors: 
Gianluca Anselmi, Yash Vekaria, Alexander D'Souza, Patricia Callejo, 
Anna Maria Mandalari, Zubair ShafiqAuthors Info & Claims
Pages 622 - 634
Abstract
Smart TVs implement a unique tracking approach called Automatic Content Recognition (ACR) to profile viewing activity of their users. ACR is a Shazam-like technology that works by periodically capturing the content displayed on a TV's screen and matching it against a content library to detect what content is being displayed at any given point in time. While prior research has investigated third-party tracking in the smart TV ecosystem, it has not looked into second-party ACR tracking that is directly conducted by the smart TV platform. In this work, we conduct a black-box audit of ACR network traffic between ACR clients on the smart TV and ACR servers. We use our auditing approach to systematically investigate whether (1) ACR tracking is agnostic to how a user watches TV (e.g., linear vs. streaming vs. HDMI), (2) privacy controls offered by smart TVs have an impact on ACR tracking, and (3) there are any differences in ACR tracking between the UK and the US. We perform a series of experiments on two major smart TV platforms: Samsung and LG. Our results show that ACR works even when the smart TV is used as a ''dumb'' external display, opting-out stops network traffic to ACR servers, and there are differences in how ACR works across the UK and the US.
References
[1]
ADB 2023. Android Debug Bridge. https://developer.android.com/tools/adb.
[2]
Hidayet Aksu, Leonardo Babun, Mauro Conti, Gabriele Tolomei, and A Selcuk Uluagac. 2018. Advertising in the IoT era: Vision and challenges. IEEE Communications Magazine 56, 11 (2018), 138--144.
[3]
Alphonso ACR Software Terms of Service 2022. https://alphonso.tv/privacy/ smart-tvs/smart-tv-tos/.
[4]
Natã Miccael Barbosa, Joon S Park, Yaxing Yao, and YangWang. 2019. ''What if?'' Predicting Individual Users' Smart Home Privacy Preferences and Their Changes. Proc. Priv. Enhancing Technol. 2019, 4 (2019), 211--231.
[5]
Johannes K Becker, David Li, and David Starobinski. 2019. Tracking Anonymized Bluetooth Devices. Proc. Priv. Enhancing Technol. 2019, 3 (2019), 50--65.
[6]
Oladayo Bello, Sherali Zeadally, and Mohamad Badra. 2017. Network layer interoperation of Device-to-Device communication technologies in Internet of Things (IoT). Ad Hoc Networks 57 (2017), 52--62.
[7]
Blocada. 2024. 1Hosts (Lite). https://blokada.org/mirror/v5/1hosts/lite/hosts.txt. Accessed: 2024-08--25.
[8]
IAB Canada. 2022. A Samsung Ads guide for advertisers. https://iabcanada.com/wp-content/uploads/2022/09/Samsung-Ads-ACR-Guide-CA.pdf. Accessed: 2024-05--14.
[9]
IAB Canada. 2022. Understanding ACR: A Samsung Ads guide for advertisers. https://iabcanada.com/wp-content/uploads/2022/09/Samsung-Ads-ACRGuide- CA.pdf.
[10]
Samsung DSP Help Center. 2024. https://help.dsp.samsungads.com/docs/audiences. Accessed: 2024-05-08.
[11]
European Commission. 2021. Data protection: Commission adopts adequacy decisions for the UK. https://ec.europa.eu/commission/presscorner/detail/en/ip_ 21_3183. Accessed: 2024-05--14.
[12]
Federal Trade Commission. 2017. Case 2:17-cv-00758 Document 1. https://www. ftc.gov/system/files/documents/cases/170206_vizio_2017.02.06_complaint.pdf. Accessed: 2024-05-07.
[13]
Statista Research Department. 2023. Smart TV streaming device market share worldwide as of 2020, by platform. https://www.statista.com/statistics/1171132/ global-connected-tv-devices-streaming-market-share-by-platform/. Accessed: 2024-05-07.
[14]
Innovation & Technology Department for Science. 2023. Factsheet for United Kingdom Organisations. https://assets.publishing.service.gov.uk/media/ 650c4c7efbd7bc000de54786/factsheet_for_uk_organisations.pdf.
[15]
Virginie Dremeaux. 2021. Across Europe, TV viewing is already a connected experience. https://www.freewheel.com/insights/blog/across-europe-tv-viewingis-already-a-connected-experience. Accessed: 2024-05-07.
[16]
Joseph D'Souza. 2024. Smart TV Statistics By Usage, Demographics and Facts. https://www.coolest-gadgets.com/smart-tv-statistics. Accessed: 2024-08--25.
[17]
Cyrus Farivar. 2018. Vizio, sued for making creepy smart TVs, will notify customers via the TVs. https://arstechnica.com/tech-policy/2018/09/vizio-smart-tvowners-to-learn-of-snooping-settlement-via-their-snoopy-tvs/.
[18]
Kassem Fawaz and Kang G Shin. 2019. Security and privacy in the Internet of Things. Computer 52, 4 (2019), 40--49.
[19]
Chaim Gartenberg. 2018. Vizio nears $17 million settlement for Smart TV data-tracking lawsuit. https://www.theverge.com/2018/10/4/17937052/vizio-17-million-settlement-tv-data-tracking-lawsuit.
[20]
Ben Gilbert. 2019. There's a Simple Reason Your New Smart TVWas so Affordable: It's Collecting and Selling Your Data, and Serving You Ads. Business Insider (2019).
[21]
Michael Gorman. 2013. LG partners with Cognitive Networks to make Smart TVs smarter and more interactive. https://www.engadget.com/2013-08--29-lgparnters-with-cognitive-networks-to-make-smart-tvs-smarter-an.html.
[22]
Danny Yuxing Huang, Noah Apthorpe, Frank Li, Gunes Acar, and Nick Feamster. 2020. Iot inspector: Crowdsourcing labeled network traffic from smart home devices at scale. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 2 (2020), 1--21.
[23]
Tuya Smart Inc. 2024. Tuya Smart App. https://play.google.com/store/apps/details?id=com.tuya.smart.
[24]
Netify Network Intelligence. 2024. Samsungacr.com - Domain Info. https://www.netify.ai/resources/domains/samsungacr.com. Accessed: 2024-08--25.
[25]
IP2Location 2024. https://www.ip2location.com.
[26]
Umar Iqbal, Pouneh Nikkhah Bahrami, Rahmadi Trimananda, Hao Cui, Alexander Gamero-Garrido, Daniel Dubois, David Choffnes, Athina Markopoulou, Franziska Roesner, and Zubair Shafiq. 2022. Your echos are heard: Tracking, profiling, and ad targeting in the amazon smart speaker ecosystem. arXiv preprint arXiv:2204.10920 (2022).
[27]
Haojian Jin, Boyuan Guo, Rituparna Roychoudhury, Yaxing Yao, Swarun Kumar, Yuvraj Agarwal, and Jason I Hong. 2022. Exploring the needs of users for supporting privacy-protective behaviors in smart homes. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1--19.
[28]
Federica Laricchia. 2024. Smart and connected TVs - statistics & facts. https: //www.statista.com/topics/4761/smart-and-connected-tvs/#statisticChapter. Accessed: 2024-05-07.
[29]
Hieu Le. 2021. Characterizing the Fire TV Advertising and Tracking Ecosystem. University of California, Irvine.
[30]
LG. 2022. https://www.lg.com/global/newsroom/news/home-entertainment/lgsmart-tvs-get-a-new-acr-solution-legacy-technology-replaced-by-lg-adssolutions/. Accessed: 2024-05-08.
[31]
Zengrui Liu, Umar Iqbal, and Nitesh Saxena. 2023. Opted Out, Yet Tracked: Are Regulations Enough to Protect Your Privacy? arXiv:2202.00885 [cs.CR]
[32]
Célestin Matte, Nataliia Bielova, and Cristiana Santos. 2020. Do cookie banners respect my choice?: Measuring legal compliance of banners from iab europe's transparency and consent framework. In 2020 IEEE Symposium on Security and Privacy (SP). IEEE, 791--809.
[33]
MaxMind 2024. https://www.maxmind.com/en/home.
[34]
MHammad Mazhar and Zubair Shafiq. 2020. Characterizing smart home iot traffic in the wild. In 2020 IEEE/ACM Fifth International Conference on Internet-of-Things Design and Implementation (IoTDI). IEEE, 203--215.
[35]
Microsoft. 2024. Retrace your steps with Recall. https://support.microsoft.com/enus/ windows/retrace-your-steps-with-recall-aa03f8a0-a78b-4b3e-b0a1- 2eb8ac48701c.
[36]
Hooman Mohajeri Moghaddam. 2022. Tracking and Behavioral Targeting on Connected TV Platforms. Ph.D. Dissertation. Princeton University.
[37]
Hooman Mohajeri Moghaddam, Gunes Acar, Ben Burgess, Arunesh Mathur, Danny Yuxing Huang, Nick Feamster, Edward W Felten, Prateek Mittal, and Arvind Narayanan. 2019. Watching you watch: The tracking ecosystem of overthe- top tv streaming devices. In Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security. 131--147.
[38]
Gabriel Hongsdusit Mohamed Al Elew. 2023. Your Smart TV Knows What You're Watching. https://themarkup.org/privacy/2023/12/12/your-smart-tv-knowswhat- youre-watching. Accessed: 2024-05-07.
[39]
Mon(IoT)r 2019. https://moniotrlab.khoury.northeastern.edu/tools/.
[40]
Arvind Narayanan and Vitaly Shmatikov. 2008. Robust de-anonymization of large sparse datasets. In 2008 IEEE Symposium on Security and Privacy (sp 2008). IEEE, 111--125.
[41]
State of California Department of Justice. 2018. California Consumer Privacy Act of 2018 (CCPA). https://oag.ca.gov/privacy/ccpa. Accessed: 2024-05--14.
[42]
Tim Peterson. 2022. WTF is automatic content recognition (ACR)? https://digiday.com/future-of-tv/wtf-is-automatic-content-recognition/.
[43]
Nick Pino. 2023. Dumb TVs - here's why you can't find them anymore. https://www.tomsguide.com/features/dumb-tvs-heres-why-you-cantfind- them-anymore. Accessed: 2024-05-07.
[44]
Davar Pishva. 2017. Internet of Things: Security and privacy issues and possible solution. In 2017 19th international conference on advanced communication technology (ICACT). IEEE, 797--808.
[45]
Data Privacy Framework Program. 2023. DFP List. https://www.dataprivacyframework.gov/list. Accessed: 2024-05--14.
[46]
Jingjing Ren, Daniel J Dubois, David Choffnes, Anna Maria Mandalari, Roman Kolcun, and Hamed Haddadi. 2019. Information exposure from consumer iot devices: A multidimensional, network-informed measurement approach. In Proceedings of the Internet Measurement Conference. 267--279.
[47]
RIPE. 2024. RIPE IPmap. https://ipmap.ripe.net/. Accessed: 2024-08--25.
[48]
Samsung. 2024. Samsung TV. https://www.samsung.com/us/televisions-hometheater/tvs/tvplus/. Accessed: 2024-05-07.
[49]
Samsung Ads 2024. https://www.samsung.com/uk/business/samsungads/.
[50]
Iskander Sanchez-Rola, Matteo Dell'Amico, Platon Kotzias, Davide Balzarotti, Leyla Bilge, Pierre-Antoine Vervier, and Igor Santos. 2019. Can I opt out yet? GDPR and the global illusion of cookie control. In Proceedings of the 2019 ACM Asia conference on computer and communications security. 340--351.
[51]
Audrey Schomer. 2024. The state of smart TV: a special report. https://variety.com/vip-special-reports/the-state-of-smart-tv-special-report-1235841024/. Accessed: 2024-05-07.
[52]
Catherine Shu. 2014. Content Recognition Tech Company Enswers Receives $2M From Samsung Ventures. https://techcrunch.com/2014/04/25/contentrecognition- tech-company-enswers-receives-2m-from-samsung-ventures/.
[53]
Catherine Shu. 2018. TV ACR -- a brief history, state of play and where it's going. https://www.tvadsync.com/2018/02/22/tv-acr-a-brief-history-state-ofplay-and-where-its-going/.
[54]
Sara Sluis. 2019. The Marketer's Guide To ACR Technology In Smart TVs. https://www.adexchanger.com/ad-exchange-news/the-marketers-guideto-acr-tech-in-smart-tvs/.
[55]
LG Ad Solutions. 2022. How ACR solves major advertiser challenges: Transparency, Cross-Platform Advertising, Measurement, Incrementality. https://lgads.tv/insights/how-acr-solves-major-advertiser-challenges/.
[56]
LG Ad Solutions. 2023. Site Privacy Policy. https://lgads.tv/site-privacy-policy/. Accessed: 2024-05--14.
[57]
FTC Staff in the Office of Technology. 2024. No, hashing still doesn't make your data anonymous. https://www.ftc.gov/policy/advocacy-research/tech-atftc/ 2024/07/no-hashing-still-doesnt-make-your-data-anonymous. Accessed: 2024-08--25.
[58]
Carlotta Tagliaro, Florian Hahn, Riccardo Sepe, Alessio Aceti, and Martina Lindorfer. 2023. I Still Know What You Watched Last Sunday: Privacy of the HbbTV Protocol in the European Smart TV Landscape. In 30th Annual Network and Distributed System Security, NDSS 2023.
[59]
The Copyright Act of 1976, USA 1976. The Copyright Act of 1976, USA. https://www.copyright.gov/reports/guide-to-copyright.pdf.
[60]
U.K. The Information Commissioner's Office (ICO). 2023. The UK GDPR. https://ico.org.uk/for-organisations/data-protection-and-the-eu/dataprotection- and-the-eu-in-detail/the-uk-gdpr/. Accessed: 2024-05--14.
[61]
Oliver Thompson, Anna Maria Mandalari, and Hamed Haddadi. 2021. Rapid IoT Device Identification at the Edge. In Proceedings of the 2nd ACM International Workshop on Distributed Machine Learning. https://doi.org/10.1145/3488659. 3493777
[62]
Marcos Tileria and Jorge Blasco. 2022. Watch over your TV: a security and privacy analysis of the android TV ecosystem. Proceedings on Privacy Enhancing Technologies 3 (2022), 692--710.
[63]
Rahmadi Trimananda, Hieu Le, Hao Cui, Janice Tran Ho, Anastasia Shuba, and Athina Markopoulou. 2022. {OVRseen}: Auditing Network Traffic and Privacy Policies in Oculus {VR}. In 31st USENIX security symposium (USENIX security . 3789--3806.
[64]
TurnOffSmartTVFeatures 2023. How to Turn Off Smart TV Snooping Features. https://www.consumerreports.org/electronics/privacy/how-to-turn-offsmart- tv-snooping-features-a4840102036/.
[65]
Janus Varmarken, Jad Al Aaraj, Rahmadi Trimananda, and Athina Markopoulou. 2022. FingerprinTV: Fingerprinting Smart TV Apps. In Proceedings on Privacy Enhancing Technologies (PoPETs), Vol. 2022. 606--629.
[66]
Janus Varmarken, Hieu Le, Anastasia Shuba, Athina Markopoulou, and Zubair Shafiq. 2020. The tv is smart and full of trackers: Measuring smart tv advertising and tracking. Proceedings on Privacy Enhancing Technologies 2020, 2 (2020).
[67]
Verance. 2020. Verance Develops Solution to Prevent Emerging Issues With Netflix & Other Streaming Services, Avoiding Unforeseen Challenges of ACR Technology. https://www.verance.com/verance-develops-solution-to-preventemerging- issues-with-netflix-other-streaming-services-avoiding-unforeseenchallenges-of-automatic-content-recognition-acr-technology/.
[68]
Tom Warren. 2024. Windows AI feature that screenshots everything labeled a security 'disaster'. https://www.theverge.com/2024/6/3/24170305/microsoftwindows-recall-ai-screenshots-security-privacy-issues.
[69]
BryanWestover. 2022. Stop your snooping smart TV ? how to turn off data collection for every brand. https://www.tomsguide.com/how-to/stop-your-snoopingsmart-tv-how-to-turn-off-data-collection-for-every-brand.
[70]
Alan Wolk. 2023. Why FAST Channels Are Not the Same as Cable Networks. https://www.nexttv.com/news/why-fast-channels-are-not-the-sameas-cable-networks-wolk. Accessed: 2024-05--14.
[71]
Serena Zheng, Noah Apthorpe, Marshini Chetty, and Nick Feamster. 2018. User perceptions of smart home IoT privacy. Proceedings of the ACM on humancomputer interaction 2, CSCW (2018), 1--20.
Index Terms
- Watching TV with the Second-Party: A First Look at Automatic Content Recognition Tracking in Smart TVs
Recommendations
A System Designed to Collect Users' TV-Watching Data Using a Smart TV, Smartphones, and Smart Watches
TVX '16: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online VideoIn this study, we suggest an enhanced smart TV logging system composed of a smart TV, smartphone, and smart watch. It can be used to research the audience's complicated and segmented behaviors while watching TV. We designed a prototype of the system, ...
Determining and validating smart TV UX factors: A multiple-study approach
Highlights- We identified a comprehensive set of smart TV UX factors via think-aloud and diary studies.
AbstractTelevision (TV) remains one of the most important media channels in our daily lives. Smart TVs support highly interactive functions between the TV and users, offer Internet connections, and run various applications. Compared with ...
Zapping delay reduction method for sports live with multi-angle on smart tv
EuroITV '11: Proceedings of the 9th European Conference on Interactive TV and VideoRecently, social TVs and personalize broadcasting services have taken place on interactive television services. While traditional television services do not support multi camera angles or views on sports live, multiple angle of view services have been ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2024
812 pages
ISBN:9798400705922
DOI:10.1145/3646547
- General Chairs:
- Narseo Vallina-Rodríguez,
- Guillermo Suarez-Tángil,
- Program Chairs:
- Dave Levin,
- Cristel Pelsser
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 November 2024
Check for updates
Author Tags
Qualifiers
- Short-paper
Funding Sources
Conference
IMC '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 277 of 1,083 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 483Total Downloads
- Downloads (Last 12 months)483
- Downloads (Last 6 weeks)342
Reflects downloads up to 11 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in