[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.5555/1973430.1973452guideproceedingsArticle/Chapter ViewAbstractPublication PagesnsdiConference Proceedingsconference-collections
Article

Network coordinates in the wild

Published: 11 April 2007 Publication History

Abstract

Network coordinates provide a mechanism for selecting and placing servers efficiently in a large distributed system. This approach works well as long as the coordinates continue to accurately reflect network topology. We conducted a long-term study of a subset of a million-plus node coordinate system and found that it exhibited some of the problems for which network coordinates are frequently criticized, for example, inaccuracy and fragility in the presence of violations of the triangle inequality. Fortunately, we show that several simple techniques remedy many of these problems. Using the Azureus BitTorrent network as our testbed, we show that live, large-scale network coordinate systems behave differently than their tame PlanetLab and simulation-based counterparts. We find higher relative errors, more triangle inequality violations, and higher churn. We present and evaluate a number of techniques that, when applied to Azureus, efficiently produce accurate and stable network coordinates.

References

[1]
Azureus BitTorrent Client.
[2]
Y. Bartal, N. Linial, M. Mendel, and A. Naor. On metric ramsey-type phenomena. In STOC, San Diego, CA, 2003.
[3]
R. Bindal et al. Improving Traffic Locality in BitTorrent via Biased Neighbor Selection. In ICDCS, July 2006.
[4]
A. R. Butz. Alternative Algorithm for Hilbert's Space-Filling Curve. IEEE Transactions on Computers, pages 424-426, April 1971.
[5]
Y. Chen, K. H. Lim, R. H. Katz, and C. Overton. On the Stability of Network Distance Estimation. SIGMETRICS Performance Evaluation Review, 30(2), 2002.
[6]
B. Cohen. Incentives Build Robustness in BitTorrent. In Workshop on Economics of P2P Systems, June 2003.
[7]
M. Costa et al. PIC: Practical Internet Coordinates for Distance Estimation. In ICDCS, March 2004.
[8]
F. Dabek et al. Vivaldi: A Decentralized Network Coordinate System. In SIGCOMM, Aug. 2004.
[9]
C. de Launois, S. Uhlig, and O. Bonaventure. A Stable and Distributed Network Coordinate System. Technical report, Universite Catholique de Louvain, December 2004.
[10]
J. Dilley, B. Maggs, J. Parikh, H. Prokop, R. Sitaraman, and B. Weihl. Globally Distributed Content Delivery. IEEE Internet Computing, September/October 2002.
[11]
P. Francis, S. Jamin, C. Jin, Y. Jin, D. Raz, Y. Shavitt, and L. Zhang. IDMaps: a global internet host distance estimation service. IEEE/ACM Trans. Networking, 9(5), 2001.
[12]
M. Freedman, K. Lakshminarayanan, et al. OASIS: Anycast for Any Service. In NSDI, San Jose, CA, May 2006.
[13]
K. P. Gummadi et al. King: Estimating Latency between Arbitrary Internet End Hosts. In IMW, Nov. 2002.
[14]
M. A. Kaafar et al. Virtual Networks under Attack: Disrupting Internet Coordinate Systems. In CoNext, 2006.
[15]
J. Ledlie et al. Network Coordinates in the Wild. Technical Report TR-20-06, Harvard U., Cambridge, MA, Oct. 2006.
[16]
J. Ledlie, P. Pietzuch, et al. Stable and Accurate Network Coordinates. In ICDCS, Lisbon, Portugal, July 2006.
[17]
P. Maymounkov et al. Kademlia: A P2P Information System Based on the XOR Metric. In IPTPS, March 2002.
[18]
A. Nakao et al. A Routing Underlay for Overlay Networks. In SIGCOMM, Karlsruhe, Germany, Aug. 2003.
[19]
E. Ng et al. Predicting Internet Network Distance with Coordinates-Based Approaches. In INFOCOM, June 2002.
[20]
L. Peterson et al. A Blueprint for Introducing Disruptive Technology into the Internet. In HotNets, October 2002.
[21]
M. Pias, J. Crowcroft, S. Wilbur, et al. Lighthouses for Scalable Distributed Location. In IPTPS, February 2003.
[22]
P. Pietzuch et al. Network-Aware Operator Placement for Stream-Processing Systems. In ICDE, April 2006.
[23]
S. Ratnasamy et al. Topology-Aware Overlay Construction and Server Selection. In INFOCOM, June 2002.
[24]
Y. Shavitt et al. Big-Bang Sim. for embedding network distances in Euclidean space. In INFOCOM, June 2003.
[25]
Y. Shavitt and T. Tankel. On the Curvature of the Internet and its usage for Overlay Construction and Distance Estimation. In INFOCOM, June 2004.
[26]
N. Spring, D. Wetherall, et al. Scriptroute: A Public Internet Measurement Facility. In USITS, Mar. 2003.
[27]
I. Stoica et al. Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications. In SIGCOMM, Aug. 2001.
[28]
L. Tang and M. Crovella. Virtual Landmarks for the Internet. In IMC, Oct. 2003.
[29]
B. Wong, A. Slivkins, and E. G. Sirer. Meridian: A Lightweight Network Location Service without Virtual Coordinates. In SIGCOMM, Aug. 2005.
[30]
R. Zhang, Y. C. Hu, et al. A Hierarchical Approach to Internet Distance Prediction. In ICDCS, July 2006.
[31]
H. Zheng, E. K. Lua, M. Pias, et al. Internet Routing Policies and Round-Trip-Times. In PAM, Mar. 2005.

Cited By

View all

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings
NSDI'07: Proceedings of the 4th USENIX conference on Networked systems design & implementation
April 2007
27 pages

Sponsors

  • VMware
  • Google Inc.
  • Microsoft Research: Microsoft Research
  • Intel: Intel
  • CISCO

Publisher

USENIX Association

United States

Publication History

Published: 11 April 2007

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2020)Latency Imbalance Among Internet Load-Balanced PathsProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/33921504:2(1-29)Online publication date: 12-Jun-2020
  • (2017)Edge Provisioning with Flexible Server PlacementIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2016.260480328:4(1031-1045)Online publication date: 1-Apr-2017
  • (2017)MCRIEEE/ACM Transactions on Networking10.1109/TNET.2017.271533125:5(3016-3029)Online publication date: 1-Oct-2017
  • (2017)Network Latency Estimation for Personal DevicesIEEE/ACM Transactions on Networking10.1109/TNET.2016.261269525:2(724-737)Online publication date: 1-Apr-2017
  • (2017)Self-Stabilized Distributed Network Distance PredictionIEEE/ACM Transactions on Networking10.1109/TNET.2016.258159225:1(451-464)Online publication date: 1-Feb-2017
  • (2015)Accurate geolocation using network coordinatesInternational Journal of Security and Networks10.1504/IJSN.2015.07183010:3(170-182)Online publication date: 1-Sep-2015
  • (2015)The nearest replica can be farther than you thinkProceedings of the Sixth ACM Symposium on Cloud Computing10.1145/2806777.2806939(16-29)Online publication date: 27-Aug-2015
  • (2015)GatlingACM Transactions on Information and System Security10.1145/271456517:4(1-34)Online publication date: 24-Apr-2015
  • (2015)A measurement experimentation platform at the internet's edgeIEEE/ACM Transactions on Networking10.1109/TNET.2014.235434823:6(1944-1958)Online publication date: 1-Dec-2015
  • (2015)Multi-operator wireless mesh networks secured by an all-encompassing security architectureInternational Journal of Information Security10.1007/s10207-014-0244-y14:2(169-186)Online publication date: 1-Apr-2015
  • Show More Cited By

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media