ClickHouse在B站海量数据场景的落地实践 胡甫旺 哔哩哔哩OLAP平台 目录 vClickHouse在B站 v内核 v日志 v用户行为数据分析 vFuture Work vQ&A ClickHouse在B站 B站ClickHouse应用概况 v 近400个节点，30个集群 v ⽇均1.5+万亿条数据摄⼊ v ⽇均800+万次Select请求 v 应⽤场景包括（不限于）： ClickHouse存储成本为ES的1/3 日志 v ClickHouse中采⽤分表，统⼀schema的设计 v ⽇志查询采⽤类似ES语法，降低⽤户迁移成本 用户行为数据分析 概述 v 基于ClickHouse构建B站⽤户⾏为数据分析产品：北极星 v 行为数据分析平台主要以下功能模块： 事件分析 v 海量埋点事件数据，⽇增数据千亿级。 v ⽤户⾏为事件的多维度分析场景。 v 事件包含公共属性和私有属性，均可作过滤和聚合维度。

HBASE-21879 Read HFile ’s Block into ByteBuffer directly. 1. Background For reducing the Java GC impact to p99/p999 RPC latency, HBase 2.x has made an offheap read and write path. The KV are allocated but we can’t: ByteBuff can also be referenced by other RPC because it's still in RAMCache and can be accessed by others before it's flushed to IOEngine. Also we cannot free the ByteBuff even if writer If some RPC hit the ByteBuff in RAMCache, then refCount ++; 5. Once RPC finished, then ByteBuff’s refCount --; 6. If its refCount decrease to zero, we MUST deallocate the ByteBuff which means putting

Records ................................................................................. 2353 64. B-Tree Indexes ...................................................................................... ................................ 2355 64.2. Behavior of B-Tree Operator Classes ................................................... 2355 64.3. B-Tree Support Functions ................................ .................................... 2454 B. Date/Time Support ....................................................................................... 2463 B.1. Date/Time Input Interpretation ........

Records ...................................................................................... 2487 64. B-Tree Indexes ...................................................................................... ............................. 2489 64.2. Behavior of B-Tree Operator Classes ......................................................... 2489 64.3. B-Tree Support Functions ............................. ................................. 2592 B. Date/Time Support ............................................................................................. 2601 B.1. Date/Time Input Interpretation .....

.................................... 2164 B. Date/Time Support ....................................................................................... 2173 B.1. Date/Time Input Interpretation ........ .............................................. 2173 B.2. Handling of Invalid or Ambiguous Timestamps ....................................... 2174 B.3. Date/Time Key Words ............................. .......................................... 2175 B.4. Date/Time Configuration Files ............................................................. 2175 B.5. POSIX Time Zone Specifications ..............

Access Methods ........................................................................... 2663 64.1. B-Tree Indexes ...................................................................................... ................................. 2765 B. Date/Time Support ............................................................................................. 2774 B.1. Date/Time Input Interpretation ..... ............................................ 2774 B.2. Handling of Invalid or Ambiguous Timestamps ............................................ 2775 B.3. Date/Time Key Words ..........................

Index Access Methods ...................................................................... 2515 64.1. B-Tree Indexes ................................................................................ 2515 64 .................................... 2612 B. Date/Time Support ....................................................................................... 2621 B.1. Date/Time Input Interpretation ........ .............................................. 2621 B.2. Handling of Invalid or Ambiguous Timestamps ....................................... 2622 B.3. Date/Time Key Words .............................

................................. 2275 B. Date/Time Support ............................................................................................. 2284 B.1. Date/Time Input Interpretation ..... ............................................ 2284 B.2. Handling of Invalid or Ambiguous Timestamps ............................................ 2285 B.3. Date/Time Key Words .......................... ....................................... 2286 B.4. Date/Time Configuration Files ................................................................... 2287 B.5. POSIX Time Zone Specifications ...........

Custom WAL Resource Managers ................................................................. 2453 67. B-Tree Indexes ...................................................................................... ................................ 2455 67.2. Behavior of B-Tree Operator Classes ................................................... 2455 67.3. B-Tree Support Functions ................................ .................................... 2555 B. Date/Time Support ....................................................................................... 2564 B.1. Date/Time Input Interpretation ........

Resource Managers ....................................................................... 2587 67. B-Tree Indexes ...................................................................................... ............................. 2589 67.2. Behavior of B-Tree Operator Classes ......................................................... 2589 67.3. B-Tree Support Functions ............................. 2694 xx PostgreSQL 16.1 Documentation B. Date/Time Support ............................................................................................. 2703 B.1. Date/Time Input Interpretation .....