Click to edit Master title style 1 可觀測性 (Observability) 在 Kubernetes Day2 Operation的考量與實踐 E . W. K u o @ i T h o m e K u b e r n e t e s S u m m i t 2 0 2 2 Click to edit Master title style Techlearn 個人技術學習與收集 Click to edit Master title style 3 Agenda Day2 Operation Challenge of Kubernetes Day 2 Operation Tame operational complexity Observability Observability Demo 3 Day2 title style 4 Day2 Operation 定 義 與 說 明 4 Click to edit Master title style 5 Day 2 Operation 的定義 • 一旦“某物”投入運營，Day 2 Operation 就是直到該“某物”被移除或 被取代前所需要照料它的時間段。 • Day 2 Operation 是系統為組織生成結 果與價值的地方。

processing. For some operations the flush can be deferred, so it is sent together with a different operation. Versions 11 and higher of the wire protocol explicitly support (or even require) deferring of described together with the operation. Most operation however use one (or more) of the responses described in this section. The meaning and content depend on the operation that initiated the response 2.1. Generic response Int32 Operation code If operation equals op_response: Int32 Object handle Int64 Object ID Buffer Data (meaning depends on the operation). Byte[] Status vector  Information

Some simple examples, intro to senders 3. The lifecycle of an async operation 4. Under the hood of a concurrent operation 5. Implementing a simple algorithm 6. Senders and coroutines Part 2: adaptors Returns a sender that… then(sender, fn) → sender … transforms the result value of the operation with a function. upon_[error|done](sender, fn) → sender … transforms the error and done signals results of input sender into a variant of tuples. bulk(sender, size, fn) → sender … launches a bulk operation. split(sender) → sender … permits multiple receivers to be connected (forks the execution graph)

run sql queries in the beeline console. For instance, > SHOW DATABASES; You will see a wall of operation logs, and a result table in the beeline console. omitted logs +------------+ | namespace | +------------+ an idle async thread of the operation for a new task to arrive before terminating in SQL e kyuubi.backend.engine.exec.pool.shutdown.timeout PT10S Timeout(ms) for the operation execution thread poo applications Number of threads in the operation execution threa applications Key Default Meaning kyuubi.backend.engine.exec.pool.wait.queue.size 100 Size of the wait queue for the operation execution t applications

run sql queries in the beeline console. For instance, > SHOW DATABASES; You will see a wall of operation logs, and a result table in the beeline console. omitted logs +------------+ | namespace | +------------+ an idle async thread of the operation for a new task to arrive before terminating in SQL e kyuubi.backend.engine.exec.pool.shutdown.timeout PT10S Timeout(ms) for the operation execution thread poo applications Number of threads in the operation execution threa applications Key Default Meaning kyuubi.backend.engine.exec.pool.wait.queue.size 100 Size of the wait queue for the operation execution t applications

run sql queries in the beeline console. For instance, > SHOW DATABASES; You will see a wall of operation logs, and a result table in the beeline console. omitted logs +------------+ | namespace | +------------+ 7 by Apache Hive 0: jdbc:hive2://localhost:10009/> show databases; 2020-11-16 23:50:50.388 INFO operation.ExecuteStatement: Spark application name: kyuubi_kentyao_spark_2020-11- 16T15:50:08 HiveMetaStore.audit: ugi=kentyao ip=unknown-ip-addr cmd=get_databases: * 2020-11-16 23:50:50.423 INFO operation.ExecuteStatement: Processing kentyao's query[8453e657-c1c4-4391-8406-ab4747a66c45]: RUNNING_STATE

run sql queries in the beeline console. For instance, > SHOW DATABASES; You will see a wall of operation logs, and a result table in the beeline console. omitted logs +------------+ | namespace | +------------+ 7 by Apache Hive 0: jdbc:hive2://localhost:10009/> show databases; 2020-11-16 23:50:50.388 INFO operation.ExecuteStatement: Spark application name: kyuubi_kentyao_spark_2020-11- 16T15:50:08 HiveMetaStore.audit: ugi=kentyao ip=unknown-ip-addr cmd=get_databases: * 2020-11-16 23:50:50.423 INFO operation.ExecuteStatement: Processing kentyao's query[8453e657-c1c4-4391-8406-ab4747a66c45]: RUNNING_STATE

run sql queries in the beeline console. For instance, > SHOW DATABASES; You will see a wall of operation logs, and a result table in the beeline console. omitted logs +------------+ | namespace | +------------+ 7 by Apache Hive 0: jdbc:hive2://localhost:10009/> show databases; 2020-11-16 23:50:50.388 INFO operation.ExecuteStatement: Spark application name: kyuubi_kentyao_spark_2020-11- 16T15:50:08 HiveMetaStore.audit: ugi=kentyao ip=unknown-ip-addr cmd=get_databases: * 2020-11-16 23:50:50.423 INFO operation.ExecuteStatement: Processing kentyao's query[8453e657-c1c4-4391-8406-ab4747a66c45]: RUNNING_STATE

run sql queries in the beeline console. For instance, > SHOW DATABASES; You will see a wall of operation logs, and a result table in the beeline console. omitted logs +------------+ | namespace | +------------+ 7 by Apache Hive 0: jdbc:hive2://localhost:10009/> show databases; 2020-11-16 23:50:50.388 INFO operation.ExecuteStatement: Spark application name: kyuubi_kentyao_spark_2020-11- 16T15:50:08 HiveMetaStore.audit: ugi=kentyao ip=unknown-ip-addr cmd=get_databases: * 2020-11-16 23:50:50.423 INFO operation.ExecuteStatement: Processing kentyao's query[8453e657-c1c4-4391-8406-ab4747a66c45]: RUNNING_STATE

run sql queries in the beeline console. For instance, > SHOW DATABASES; You will see a wall of operation logs, and a result table in the beeline console. omitted logs +------------+ | namespace | +------------+ 7 by Apache Hive 0: jdbc:hive2://localhost:10009/> show databases; 2020-11-16 23:50:50.388 INFO operation.ExecuteStatement: Spark application name: kyuubi_kentyao_spark_2020-11- 16T15:50:08 HiveMetaStore.audit: ugi=kentyao ip=unknown-ip-addr cmd=get_databases: * 2020-11-16 23:50:50.423 INFO operation.ExecuteStatement: Processing kentyao's query[8453e657-c1c4-4391-8406-ab4747a66c45]: RUNNING_STATE