Observability on Service Mesh 吴 晟 Apache SkyWalking 创始⼈人、PPMC Microsoft MVP ⽐比特⼤大陆 资深技术专家 TetrateObservability CNCF LandscapeMetric, Tracing, LoggingTraditional ObservabilityHow does agent Service MeshProxy and SidecarIstio + Envoy Representative Service Mesh implementorSkyWalking 6.0 Observability Analysis PlatformOAP > APM• Service. Represent a set/group of workloads to provide the same

Observability And Istio Telemetry 吴 晟 Apache SkyWalking Creator Apache ShardingSphere Co-founder Microsoft MVP Tetrate founding Engineer Bitmain tech expert Service Mesh Meetup #4 上海海站 上海海站 2018.11.25Observability CNCF LandscapeMetric, Tracing, LoggingOld game to observeService Mesh is comingProxy and SidecarIstio + Envoy Representative Service Mesh implementorObserve on mesh Metric

themself • User Scaling-up/Scaling-down replicate manually or via Kubernetes Autoscaler Observability - Logging • Based on Uber zap • Auto logging with TraceID、ServiceName、Framework Version… Structured logging for friendly searching • Extract business logger from framework logger Observability - Metrics • Based on Kubernetes/Prometheus/Grafana • Builtin framework and Go runtime collectors，Export Prometheus annotations for service discovery and metrics scraping Observability - Metrics Kubernetes Prometheus Annotations Observability - Metrics Naming • Metric name should be snake_case • User metric

52 Column based shadow algorithm . . . . . . . . . . . . . . . . . . . . . . . . . . 52 8.10 Observability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 8.10.1 Background 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149 9.1.6 Observability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149 Agent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 393 9.2.5 Observability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 408 Agent . . . .

MongoDB ... ● Other Layer-7 Protocols: ... Control Plane (Traffic Management, Security, Observability) #IstioCon What Do We Expect From a Service Mesh? 为了将基础设施的运维管理从应用代码中剥离，我们需要七层的流量管 理能力： ● Routing Injection with application layer error codes ○ HTTP status code ○ Redis Get error ○ ... ● Observability with application layer metrics ○ HTTP status code ○ Thrift request latency ○ ... ● Application layer-3 to layer-6 ● Routing based on headers under layer-7 ○ IP address ○ TCP Port ○ SNI ● Observability - only TCP metrics ○ TCP sent/received bytes ○ TCP opened/closed connections ● Security ○

Network Observability Operator Network Observability Operator 发行版本独立于 OpenShift Container Platform 次版本流的更新。更新 可以通过单一的滚动流提供，该流在所有当前支持的 OpenShift Container Platform 4 版本中被支持。有 关 Network Observability Operator Operator 的新功能、功能增强和程序错误修复的信息，请参阅 Network Observability 发行注记。 1.3.21. 可伸缩性和性能 1.3.21.1. PAO must-gather 镜 镜像添加到默 像添加到默认 认 must-gather 镜 镜像 像 在这个版本中，Performance Addon Operator (PAO) must-gather 镜像不再需要作为 must-gather Degraded=True，并显示不接受证书的原因，以便更轻松地进行故障排除。(OCPBUGS-8404) 在以前的版本中，可观察性仪表板使用大型查询来显示数据，这会导致在有大量节点的集群上频 繁超时。在这个版本中，Observability 仪表板使用预先计算的记录规则，以确保在有大量节点的 集群上的可靠性。(OCPBUGS-3986) 裸机硬件置 裸机硬件置备 在以前的版本中，如果裸机的主机名不是由反向 DNS 或 DHCP

OpenTelemetryCollector apiVersion: opentelemetry.io/v1alpha1 metadata: name: otel spec: mode: deployment observability: metrics: enableMetrics: true 1 config: | connectors: spanmetrics: 2 目启用监控。 流程 流程 1. 要启用 TempoStack 实例的指标，请将 spec.observability.metrics.createServiceMonitors 字 段设置为 true ： 2. 要为 TempoStack 实例启用警报，请将 spec.observability.metrics.createPrometheusRules 字段设置为 true ： serviceAccount: [otlp/dev] apiVersion: tempo.grafana.com/v1alpha1 kind: TempoStack metadata: name: spec: observability: metrics: createServiceMonitors: true apiVersion: tempo.grafana.com/v1alpha1 kind:

control plane that makes it easier to connect, observe, and secure microservices. SkyWalking is an observability power tool that provides distributed tracing, service mesh telemetry analysis, metric aggregation

eBPF = extended Berkeley Packet Filter Dynamically program the kernel for efficient networking, observability, tracing, and security. • 稳定 • 高性能 • 安全（内核verifier机制） • 动态可编程（无需重启） eBPF程序加载和校验 02. eBPF程序加载和校验

• annotation化的数据扩展 • UI自动渲染扩展数据 路线图 管理 分发 扩展性 Interrogation Service++(探针) Observability K8s Operator 1 2 3 来源: https://github.com/goharbor/harbor/blob/master/ROADMAP.md Backup & Restore