Article

Social Streams Blog Crawler

Authors:

Matthew Hurst,

Alexey MaykovAuthors Info & Claims

ICDE '09: Proceedings of the 2009 IEEE International Conference on Data Engineering

Pages 1615 - 1618

https://doi.org/10.1109/ICDE.2009.146

Published: 29 March 2009 Publication History

Publisher Site

Abstract

Weblogs, and other forms of social media, differ from traditional web content in many ways. One of the most important differences is the highly temporal nature of the content. Applications that leverage social media content must, to be effective, have access to this data with minimal publication/acquisition latency. An effective weblog crawler should satisfy the following requirements: low latency, highly scalable, high data quality and appropriate network politeness. In this paper, we outline the weblog crawler implemented in the social streams project and summarize the challenges faced during development.

Cited By

View all

Li RWang SChang K(2013)Towards social data platformProceedings of the VLDB Endowment10.14778/2556549.25565776:14(1966-1977)Online publication date: 1-Sep-2013
https://dl.acm.org/doi/10.14778/2556549.2556577
Ferreira RFreitas FBrito PMelo JLima RCosta E(2013)RetriBlogExpert Systems with Applications: An International Journal10.1016/j.eswa.2012.08.02040:4(1177-1195)Online publication date: 1-Mar-2013
https://dl.acm.org/doi/10.1016/j.eswa.2012.08.020
Costa EFerreira RBrito PBittencourt IHolanda OMachado AMarinho T(2012)A framework for building web mining applications in the world of blogsExpert Systems with Applications: An International Journal10.1016/j.eswa.2011.09.13539:5(4813-4834)Online publication date: 1-Apr-2012
https://dl.acm.org/doi/10.1016/j.eswa.2011.09.135
Show More Cited By

Social Streams Blog Crawler
1. Information systems

Recommendations

Catching a viral video

The sharing and re-sharing of videos on social sites, blogs e-mail, and other means has given rise to the phenomenon of viral videos--videos that become popular through internet sharing. In this paper we seek to better understand viral videos on YouTube ...
Social media and online political participation

Blog use and SNS use are positively related to online political participation.Like-minded exposure mediates the relationship between blog use and political participation.Cross-cutting exposure mediates the relationship between SNS use and political ...
Bloggers and Readers Blogging Together: Collaborative Co-creation of Political Blogs

A significant amount of research has focused on blogs, bloggers, and blogging. However, relatively little work has examined blog readers, their interactions with bloggers, or their impact on blogging. This paper presents a qualitative study focusing ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICDE '09: Proceedings of the 2009 IEEE International Conference on Data Engineering

March 2009

1772 pages

ISBN:9780769535456

Publisher

IEEE Computer Society

United States

Publication History

Published: 29 March 2009

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Li RWang SChang K(2013)Towards social data platformProceedings of the VLDB Endowment10.14778/2556549.25565776:14(1966-1977)Online publication date: 1-Sep-2013
https://dl.acm.org/doi/10.14778/2556549.2556577
Ferreira RFreitas FBrito PMelo JLima RCosta E(2013)RetriBlogExpert Systems with Applications: An International Journal10.1016/j.eswa.2012.08.02040:4(1177-1195)Online publication date: 1-Mar-2013
https://dl.acm.org/doi/10.1016/j.eswa.2012.08.020
Costa EFerreira RBrito PBittencourt IHolanda OMachado AMarinho T(2012)A framework for building web mining applications in the world of blogsExpert Systems with Applications: An International Journal10.1016/j.eswa.2011.09.13539:5(4813-4834)Online publication date: 1-Apr-2012
https://dl.acm.org/doi/10.1016/j.eswa.2011.09.135
König AGamon MWu QAllan JAslam JSanderson MZhai CZobel J(2009)Click-through prediction for news queriesProceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval10.1145/1571941.1572002(347-354)Online publication date: 19-Jul-2009
https://dl.acm.org/doi/10.1145/1571941.1572002

Abstract

Cited By

Recommendations

Catching a viral video

Social media and online political participation

Bloggers and Readers Blogging Together: Collaborative Co-creation of Political Blogs

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations