[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

タグ

StreamとSQLに関するkimutanskのブックマーク (5)

  • Introducing KSQL: Streaming SQL for Apache Kafka | Confluent

    What does it even mean to query streaming data, and how does this compare to a SQL database? Well, it’s actually quite different to a SQL database. Most databases are used for doing on-demand lookups and modifications to stored data. KSQL doesn’t do lookups (yet), what it does do is continuous transformations— that is, stream processing. For example, imagine that I have a stream of clicks from use

    Introducing KSQL: Streaming SQL for Apache Kafka | Confluent
    kimutansk
    kimutansk 2017/08/29
    Kafkaにどれだけ簡易にStreamSQLをかけるかにもよりますが、これ自体はストリームデータに対して直接クエリをかけるツールとして、ユーザに提供するのに使える・・?
  • Stream Processing for Everyone with SQL and Apache Flink

    May 24, 2016 - The capabilities of open source systems for distributed stream processing have evolved significantly over the last years. Initially, the first systems in the field (notably Apache Storm) provided low latency processing, but were limited to at-least-once guarantees, processing-time semantics, and rather low-level APIs. Since then, several new systems emerged and pushed the state of t

    kimutansk
    kimutansk 2017/07/28
    Calsiteに登録し、DataStream、DataSetの両方にSQLでアクセス可能。実行プランがまだ別である以上、両方の性質に同一DAGから透過的アクセスとはいきませんが、徐々に来ますかね。
  • Streaming SQL

    Streaming is necessary to handle IoT data rates and latency but SQL is unquestionably the lingua franca of data. Apache Samza and Apache Storm have new high-level query interfaces based on standard SQL with streaming extensions, both powered by Apache Calcite. Calcite's relational algebra allows query optimization and federation with data-at-rest in databases, memory, or HDFS. A talk given by Juli

    Streaming SQL
    kimutansk
    kimutansk 2016/07/01
    実際にKafkaとかに流れているデータに対してSQL書くだけで分散クエリ実行できて結果がリアルタイムに取得できれば色々用途は・・構成は見ておきますか。
  • Streaming SQL with Apache Calcite

    With the rise of the Internet of Things (IoT) and low-latency analytics, streaming data becomes ever more important. Surprisingly, one of the most promising approaches for processing streaming data is SQL. In this presentation, Julian Hyde shows how to build streaming SQL analytics that deliver results with low latency, adapt to network changes, and play nicely with BI tools and stored data. He al

    Streaming SQL with Apache Calcite
    kimutansk
    kimutansk 2016/06/12
    実行計画構築用のFRWで、Drill等や、Flink等のストリーム部に実行計画を配分統合できると。メタな存在が出てくるあたり、それだけ成熟した分野ということでしょうか。
  • Radar - O’Reilly

    Now, next, and beyond: Tracking need-to-know trends at the intersection of business and technology AI/ML Few technologies have the potential to change the nature of work and how we live as artificial intelligence (AI) and machine learning (ML). Future of the Firm Everything from new organizational structures and payment schemes to new expectations, skills, and tools will shape the future of the fi

    Radar - O’Reilly
    kimutansk
    kimutansk 2014/08/04
    Samza、「耐障害性を持つローカル状態」を用いて多彩で高速、かつ他に影響を与えない処理を実現していると。耐障害性は変更履歴をストリームとして書きだすことで確保、と。
  • 1