OID CND Asia Slide: CurveFSand computation ● The call method is the same as that of the standalone database Performance test vs CEPH ● BenchmarkSQL transactions per minute increased by 39% ● In PGBench tests, latency decreased com/openCURVE/CURVE/issues Participated in the communication and discussion of Curve project: wechat group, qr code on the right hand sideYou can take away Challenges faced ● With the development of hardware and0 码力 | 24 页 | 3.47 MB | 6 月前3
Open Flags 调研fuse_file_info structure infor more details. If this request is answered with an error code of ENOSYS and FUSE_CAP_NO_OPEN_SUPPORT is set in fuse_conn_info.capable, this is treated as success org/doc/html/latest/filesystems/fuse-io.html https://stackoverflow.com/questions/27087912/write-back-vs-write-through-caching 0 码力 | 23 页 | 524.47 KB | 6 月前3
Curve for CNCF Main(SSD, three replicas) • csi / storage class for kubernete, nbd for HOST/VMPerformance (vs. Ceph RBD)Performance (vs. Ceph RBD)CurveBS Features • RAFT for data consistency • minor impaction when chunk vertical scaling, auto config tuning, abnormal detection and schedule tuningStorage Engine Comparison (vs. Ceph) DATA CONSISTENT PROTOCOL CURVE (RAFT) CEPH WRITE SUCCESS majority write successful all write INFLUENCE without I/O disruption I/O jitter occasionally CAN SYNC WITH REMOTE DISK SERVER Y NI/O Jitter (vs. Ceph) 3 replicas with 9 nodes cluster each node has 20 x SSD, 2xE5-2660 v4 and 256GB mem FAULTS0 码力 | 21 页 | 4.56 MB | 6 月前3
Curve文件系统元数据持久化方案设计的编码 2、KVStore Q&A 单靠 redis 的 AOF 机制能否保证数据不丢失? redis 的高可用、高可扩方案? redis + muliraft 存在的问题? redis 改造 vs 自己实现? redis 中哈希表实现的优点? 参考 前言 根据之前讨论的结果,元数据节点的架构如下图所示,这里涉及到两部分需要持久化/编码的内容: Raft Log:记录 operator multiraft 可行,因为 leveldb 是可嵌入的,一个 raft 实例中可以绑定一个 leveldb 实例(leveldb 中的 wal 和 SST 文件都可以写到指定的目录) redis 改造 vs 自己实现? 结论:从目前元数据持久化的需要来看,更倾向于自己实现,理由如下: redis 目前不支持单独持久化 redis 中的某个 DB (一个 redis 实例可包含多个 DB) 或数据结构,这对于在要使用0 码力 | 12 页 | 384.47 KB | 6 月前3
Curve核心组件之mds – 网易数帆Mds在分配空间时,轮流在不同的copyset中分配,每次从copyset中分配1个chunk, 这个chunk用copysetId:chunkId来唯一标识。COPYSET Copyset的生成策略:Source code : curve/src/mds/copyset/ bool GenCopyset(const ClusterInfo& cluster, int numCopysets, std::vector* 0 码力 | 23 页 | 1.74 MB | 6 月前3
Curve质量监控与运维 - 网易数帆异常自动化 测试 混沌测试 (每周一次) CI测试(编译、静态检 查、单元测试、集成测 试、覆盖率80%卡点) 邮件通知 Curve所有代码均在github托管。新 代码需要通过CI测试和code review才 能合入master分支,确保新合入代码 的功能、正确性、规范性等都有基本 保障;而每日运行的dailybuild测试在 CI测试基础上增加了异常自动化测试 和混沌测试,确保master分支代码的0 码力 | 33 页 | 2.64 MB | 6 月前3
Curve文件系统元数据管理com/abseil/abseil-cpp/tree/master/absl/c ontainer 实现了btree map和btree set,(Apache)。 google, https://code.google.com/archive/p/cpp-btree/, btree_map , btree_set, btree_multimap, and btree_multiset ,( ) Apache0 码力 | 24 页 | 204.67 KB | 6 月前3
共 7 条
- 1













