High-availability, recovery semantics, and guarantees - CS 591 K1: Data Stream Processing and Analytics Spring 2020Recovery types • Precise recovery (exactly-once) • It hides the effects of a failure perfectly • Post-failure output is identical to no-failure 8 Vasiliki Kalavri | Boston University 2020 Recovery Recovery types • Precise recovery (exactly-once) • It hides the effects of a failure perfectly • Post-failure output is identical to no-failure • Rollback recovery (at-least-once) • It avoids information Recovery types • Precise recovery (exactly-once) • It hides the effects of a failure perfectly • Post-failure output is identical to no-failure • Rollback recovery (at-least-once) • It avoids information0 码力 | 49 页 | 2.08 MB | 1 年前3
监控Apache Flink应用程序(入门)amount of memory off heap. To understand how much memory RocksDB might use, you can checkout this blog post8 by Stefan Richter. 4.13.1.1 Key Metrics Metric Scope Description Status.JVM.Memory.NonHeap be very helpful in setups without existing host monitoring capabilities. 4.15 Conclusion This post tries to shed some light on Flink’s metrics and monitoring system. You can utilise it as a starting your application, and learn much more about Flink’s internals early on. Last but not least, this post only scratches the surface of the overall metrics and monitoring capabilities of Apache Flink. I0 码力 | 23 页 | 148.62 KB | 1 年前3
Exactly-once fault-tolerance in Apache Flink - CS 591 K1: Data Stream Processing and Analytics Spring 2020• An event is pre-snapshot if it occurs before the local snapshot on a process, otherwise it is post- snapshot • If event A happens causally before B and B is pre-snapshot, then A is also pre-snapshot • An event is pre-snapshot if it occurs before the local snapshot on a process, otherwise it is post- snapshot • If event A happens causally before B and B is pre-snapshot, then A is also pre-snapshot • An event is pre-snapshot if it occurs before the local snapshot on a process, otherwise it is post- snapshot • If event A happens causally before B and B is pre-snapshot, then A is also pre-snapshot0 码力 | 81 页 | 13.18 MB | 1 年前3
Graph streaming algorithms - CS 591 K1: Data Stream Processing and Analytics Spring 2020an underlying graph structure 5 Edge events: A purchase, a movie rating, a like on an online post, a bitcoin transaction, a packet routed from a source to destination Vertex events: A new product0 码力 | 72 页 | 7.77 MB | 1 年前3
Stream processing fundamentals - CS 591 K1: Data Stream Processing and Analytics Spring 2020partitioned by key • State can be cleared based on watermarks or punctuations • window fires, post becomes inactive 41 Vasiliki Kalavri | Boston University 2020 case class Reading(id: String, time:0 码力 | 45 页 | 1.22 MB | 1 年前3
Streaming optimizations - CS 591 K1: Data Stream Processing and Analytics Spring 2020partitioned by key • State can be cleared based on watermarks or punctuations • window fires, post becomes inactive ??? Vasiliki Kalavri | Boston University 2020 Operator selectivity 6 • The number0 码力 | 54 页 | 2.83 MB | 1 年前3
共 6 条
- 1













