 TGT服务器的优化广泛支持的外部设备协议(块,磁带等)Curve云原生存储支持块设备 • 通过NBD,只支持Linux • 通过SDK API,目前只支持Linux • PFS • 扩大使用范围 • 通过iSCSI支持更多系统,例如Windows, 类UNIX系统等,使用两项基础 技术 • TCP/IP • SCSI • 替代SAN • 可靠性、稳定性方面有自己的的特色,使用raft副本一致性和copyset概念可以自动 修复 修复损坏的副本,并且可扩容。无论在可靠性、稳定性还是性价比方面都很有优势, 使用廉价硬件搭建。iSCSI软件 • Client端: iscsi initiator,系统自带 • Linux open-iscsi • Windows iSCSI 发起者 • 服务器端 • 必须是CurveBS原生支持的平台,因为需要curve原生接口,目前是LinuxiSCSI target服务器 • LINUX LILO • 一般用于输出内核本地块设备 logicalunit --op update --tid 1 --lun 1 --params disksize=auto • Initiator 重新发送SCSI READ CAPACITY命令 • Windows 磁盘管理器refresh • Linux open-iscsi, iscsiadm --mode node -RDPO & FUA • DPO是disable page out的缩写,FUA是force0 码力 | 15 页 | 637.11 KB | 6 月前3 TGT服务器的优化广泛支持的外部设备协议(块,磁带等)Curve云原生存储支持块设备 • 通过NBD,只支持Linux • 通过SDK API,目前只支持Linux • PFS • 扩大使用范围 • 通过iSCSI支持更多系统,例如Windows, 类UNIX系统等,使用两项基础 技术 • TCP/IP • SCSI • 替代SAN • 可靠性、稳定性方面有自己的的特色,使用raft副本一致性和copyset概念可以自动 修复 修复损坏的副本,并且可扩容。无论在可靠性、稳定性还是性价比方面都很有优势, 使用廉价硬件搭建。iSCSI软件 • Client端: iscsi initiator,系统自带 • Linux open-iscsi • Windows iSCSI 发起者 • 服务器端 • 必须是CurveBS原生支持的平台,因为需要curve原生接口,目前是LinuxiSCSI target服务器 • LINUX LILO • 一般用于输出内核本地块设备 logicalunit --op update --tid 1 --lun 1 --params disksize=auto • Initiator 重新发送SCSI READ CAPACITY命令 • Windows 磁盘管理器refresh • Linux open-iscsi, iscsiadm --mode node -RDPO & FUA • DPO是disable page out的缩写,FUA是force0 码力 | 15 页 | 637.11 KB | 6 月前3
 CurveFs 用户权限系统调研values are passed to the filesystem with setattr() requests. * However, if the filesystem does not support the full resolution of * the kernel timestamps (nanoseconds), the mtime and ctime values used 权限来成 为最终的默认权限值。 root@pubbeta2-curve5:~# umask 0022 权限为777,文件为666,经过与umask作用,最终权限为755、644 默认目录 Windows Linux umask /etc/login.defs # UMASK is the default umask value for pam_umask and is used by0 码力 | 33 页 | 732.13 KB | 6 月前3 CurveFs 用户权限系统调研values are passed to the filesystem with setattr() requests. * However, if the filesystem does not support the full resolution of * the kernel timestamps (nanoseconds), the mtime and ctime values used 权限来成 为最终的默认权限值。 root@pubbeta2-curve5:~# umask 0022 权限为777,文件为666,经过与umask作用,最终权限为755、644 默认目录 Windows Linux umask /etc/login.defs # UMASK is the default umask value for pam_umask and is used by0 码力 | 33 页 | 732.13 KB | 6 月前3
 Curve Cloud NativeLIFECYCLE Plan to Support app lifecycle, storage lifecycle(backup, failure, recovery) DEEP INSIGHTS Plan to Support metrics, alerts, log processing and workload analysis AUTO PILOT Plan to Support horizontal/vertical metadata backup and recovery • MDS / ChunkServer should respect failure domains of Kubernetes • Support for public cloud environments • Dashboard-driven configuration after minimal Curve installFeature alternative to host path • Support automatically detect new nodes, adding / removing nodes and disk drives • Support dynamic volume resizing • chunkserver on PVC support for different data and metadata(HDD0 码力 | 9 页 | 2.85 MB | 6 月前3 Curve Cloud NativeLIFECYCLE Plan to Support app lifecycle, storage lifecycle(backup, failure, recovery) DEEP INSIGHTS Plan to Support metrics, alerts, log processing and workload analysis AUTO PILOT Plan to Support horizontal/vertical metadata backup and recovery • MDS / ChunkServer should respect failure domains of Kubernetes • Support for public cloud environments • Dashboard-driven configuration after minimal Curve installFeature alternative to host path • Support automatically detect new nodes, adding / removing nodes and disk drives • Support dynamic volume resizing • chunkserver on PVC support for different data and metadata(HDD0 码力 | 9 页 | 2.85 MB | 6 月前3
 Curve Detail Introduction for CNCFmagnification for file new write • Cooperate with Alibaba to support high-performance polardb for postgresql using CurveBS • Cloud-native support for CurveBS • CurveBS clusters and related monitoring services FlowCurveFS Roadmap • CurveFS based on CurveBS • Cache support on CurveFS • NFS support on CurveFS • Cloud tiering support • Cloud-native support for CurveFS • CurveFS clusters and related monitoring0 码力 | 23 页 | 6.53 MB | 6 月前3 Curve Detail Introduction for CNCFmagnification for file new write • Cooperate with Alibaba to support high-performance polardb for postgresql using CurveBS • Cloud-native support for CurveBS • CurveBS clusters and related monitoring services FlowCurveFS Roadmap • CurveFS based on CurveBS • Cache support on CurveFS • NFS support on CurveFS • Cloud tiering support • Cloud-native support for CurveFS • CurveFS clusters and related monitoring0 码力 | 23 页 | 6.53 MB | 6 月前3
 Curve for CNCF Maincontainer service (in Plan) • Config CurveBS by (Cluster and Pool CRDs) in Kubernetes (in Plan) • Support Operator capability level 5 (in Plan) • horizontal / vertical scaling, auto config tuning, abnormal CurveFS by (cluster and storage pools) CRDs in Kubernetes (in Plan) • Support Operator capability level 5 (in Plan) • now support helmCurrent Status • Release 2 major version on CurveBS • v1.2 supporting on CurveBS • POSIX-compatible and mountable • Cache support on CurveFS • CurveFS cloud native support • csi plugin for CurveFS • support operator capability level 2: automated application provisioning0 码力 | 21 页 | 4.56 MB | 6 月前3 Curve for CNCF Maincontainer service (in Plan) • Config CurveBS by (Cluster and Pool CRDs) in Kubernetes (in Plan) • Support Operator capability level 5 (in Plan) • horizontal / vertical scaling, auto config tuning, abnormal CurveFS by (cluster and storage pools) CRDs in Kubernetes (in Plan) • Support Operator capability level 5 (in Plan) • now support helmCurrent Status • Release 2 major version on CurveBS • v1.2 supporting on CurveBS • POSIX-compatible and mountable • Cache support on CurveFS • CurveFS cloud native support • csi plugin for CurveFS • support operator capability level 2: automated application provisioning0 码力 | 21 页 | 4.56 MB | 6 月前3
 OID CND Asia Slide: CurveFSRestore data on a disk within 5 minutes Data availability of 6 nines can be achievedCloud native Support Currently we offer CSI Driver for block storage to provide PV/PVC resources on KubernetesAgenda api Manage multiple types of storage (object storage, HDFS storage, Elastic block storage) Support both on-premise and public cloudsAgenda Why develop storage Design objectives Achievements in Roadmap ● Features ○ Supports RDMA and SPDK ○ Further reduce I/O latency and improve throughput ○ Support data lifecycle management ○ Curve block devices can be used as the underlying storage of Curve file0 码力 | 24 页 | 3.47 MB | 6 月前3 OID CND Asia Slide: CurveFSRestore data on a disk within 5 minutes Data availability of 6 nines can be achievedCloud native Support Currently we offer CSI Driver for block storage to provide PV/PVC resources on KubernetesAgenda api Manage multiple types of storage (object storage, HDFS storage, Elastic block storage) Support both on-premise and public cloudsAgenda Why develop storage Design objectives Achievements in Roadmap ● Features ○ Supports RDMA and SPDK ○ Further reduce I/O latency and improve throughput ○ Support data lifecycle management ○ Curve block devices can be used as the underlying storage of Curve file0 码力 | 24 页 | 3.47 MB | 6 月前3
 CurveBS IO Processing Flowof snapshots l Support asynchronous and incremental snapshot l Support lazy (pre-allocated space) and non-lazy (allocated space on needs) clones from snapshots/mirrors l Support rollback from snapshot scattered all over the storage nodes. ChunkServer provides 4KB random read/write capability to support 4KB aligned read/write on block devices.CurveBS file structure of virtual block device As mentioned0 码力 | 13 页 | 2.03 MB | 6 月前3 CurveBS IO Processing Flowof snapshots l Support asynchronous and incremental snapshot l Support lazy (pre-allocated space) and non-lazy (allocated space on needs) clones from snapshots/mirrors l Support rollback from snapshot scattered all over the storage nodes. ChunkServer provides 4KB random read/write capability to support 4KB aligned read/write on block devices.CurveBS file structure of virtual block device As mentioned0 码力 | 13 页 | 2.03 MB | 6 月前3
 Open Flags 调研for more details. If this request is answered with an error code of ENOSYS and FUSE_CAP_NO_OPEN_SUPPORT is set in fuse_conn_info.capable, this is treated as success and future calls to open and release uint64_t lock_owner; /** Requested poll events. Available in ->poll. Only set on kernels which support it. If unsupported, this field is set to zero. */ uint32_t poll_events; }; // fastcfs typedef0 码力 | 23 页 | 524.47 KB | 6 月前3 Open Flags 调研for more details. If this request is answered with an error code of ENOSYS and FUSE_CAP_NO_OPEN_SUPPORT is set in fuse_conn_info.capable, this is treated as success and future calls to open and release uint64_t lock_owner; /** Requested poll events. Available in ->poll. Only set on kernels which support it. If unsupported, this field is set to zero. */ uint32_t poll_events; }; // fastcfs typedef0 码力 | 23 页 | 524.47 KB | 6 月前3
 Bazelgcc 编译 bazel build –config=gcc7-later … # use '-faligned-new' to enable C++17 over-aligned new support # 使用 clang 编译 CC=clang CXX=clang++ bazel build …2 制作镜像 docker run -v $(pwd):/curve -v /root/0 码力 | 6 页 | 4.69 MB | 6 月前3 Bazelgcc 编译 bazel build –config=gcc7-later … # use '-faligned-new' to enable C++17 over-aligned new support # 使用 clang 编译 CC=clang CXX=clang++ bazel build …2 制作镜像 docker run -v $(pwd):/curve -v /root/0 码力 | 6 页 | 4.69 MB | 6 月前3
共 9 条
- 1













