Stream processing fundamentals - CS 591 K1: Data Stream Processing and Analytics Spring 2020A[j]) and updates arrive in increasing order of j, i.e. we observe the entries of A by increasing index. This can model time-series data streams: • a sequence of measurements from a temperature sensor various ways: • as the concatenation of serializations of the relations. • as a list of tuple-index pairs, whereindicates that t ∈ rj • as a serialization of r1 followed by a series of delta EOR (1, 2, 20K), (2, 5, 32K), (2, 3, 28K) EOR (2, 5, 32K), (2, 3, 28K), (1, 2, 28K) EOR • tuple-index pairs <(1, 2, 20K), 1>, <(2, 5, 32K), 2>, <(1, 2, 20K), 2>, <(2, 5, 32K), 1>, <(2, 3, 28K), 3>, <(2 0 码力 | 45 页 | 1.22 MB | 1 年前3
Fault-tolerance demo & reconfiguration - CS 591 K1: Data Stream Processing and Analytics Spring 2020locate and read the matching keys only • Avoids reading irrelevant data • Requires a materialized index for all keys, i.e. a key-to-read-offset mapping, which can potentially grow very large • Large parallel instance • Some kind of hashing is typically used • Maintaining routing tables or an index for all key mappings is usually impractical • Skewed load is challenging to handle with hashing0 码力 | 41 页 | 4.09 MB | 1 年前3
Course introduction - CS 591 K1: Data Stream Processing and Analytics Spring 2020response vehicles • Read more: https://edition.cnn.com/2019/01/15/tech/alibaba-city- brain-hangzhou/index.html 27 Vasiliki Kalavri | Boston University 2020 Why is stream processing challenging? 280 码力 | 34 页 | 2.53 MB | 1 年前3
Streaming in Apache Flinkgetter and setter Tuple2person = new Tuple2<>("Fred", 35); // zero based index! String name = person.f0; Integer age = person.f1; public class Person { public String 0 码力 | 45 页 | 3.00 MB | 1 年前3
Cardinality and frequency estimation - CS 591 K1: Data Stream Processing and Analytics Spring 2020of a near-optimal cardinality estimation algorithm. 2007. https://hal.archives-ouvertes.fr/file/index/docid/406166/ filename/FlFuGaMe07.pdf • Cormode, Graham, and Shan Muthukrishnan. An improved data0 码力 | 69 页 | 630.01 KB | 1 年前3
PyFlink 1.15 Documentationpandoc 3. Build the docs python3 setup.py build_sphinx 4. Open the pyflink-docs/build/sphinx/html/index.html in the Browser 1.1 Getting Started This page summarizes the basic steps required to setup and0 码力 | 36 页 | 266.77 KB | 1 年前3
PyFlink 1.16 Documentationpandoc 3. Build the docs python3 setup.py build_sphinx 4. Open the pyflink-docs/build/sphinx/html/index.html in the Browser 1.1 Getting Started This page summarizes the basic steps required to setup and0 码力 | 36 页 | 266.80 KB | 1 年前3
共 7 条
- 1













