logo资料库

7种主流分布式文件系统介绍.pdf

第1页 / 共35页
第2页 / 共35页
第3页 / 共35页
第4页 / 共35页
第5页 / 共35页
第6页 / 共35页
第7页 / 共35页
第8页 / 共35页
资料共35页,剩余部分请下载后查看
1 FastDFS...................................................... 5 1.1 1.2 1.3 Fastdfs .......................................... 5 Fastdfs .................................... 5 FastDFS mogileFS ............................. 6 2 MogileFS..................................................... 7 2.1 2.2 Mogilefs ......................................... 7 Mogilefs ..................................... 7 2.2.1 MySQL .............................. 7 2.2.2 ......................................... 8 2.2.3 trackers ................................ 8 2.2.4 ............................................. 8 2.2.5 Client ............................................ 8 2.3 Mogilefs ....................................... 8 2.3.1 —— ..................... 8 2.3.2 ....................................... 9 2.3.3 ................................... 9 2.3.4 RAID ” ................................. 9 2.3.5 ............................. 9 2.3.6 ................................... 9 2.3.7 ................................. 9 2.3.8 RAID ...................................... 10 2.3.9 ................ 10 3 HDFS........................................................ 10 3.1 HDFS ............................................ 10 3.2 ........................................... 10 3.2.1 ........................................ 10 3.2.2 .................................. 10 3.2.3 .................................. 11
3.2.4 ........................................ 11 3.3 ............................................. 11 3.3.1 (block) ................................... 11 3.3.2 (Namenode)(datanode) ........ 11 3.3.2.1 ............................. 11 3.3.2.2 ....................... 12 3.3.2.3 ......... 13 3.3.2.4 ..................... 14 3.3.2.5 ......................... 15 3.4 ............................................. 15 3.4.1 ........................................ 15 3.4.1.1 ............................. 15 3.4.1.2 ............................. 16 3.4.2 ........................................ 16 3.4.2.1 ............................. 16 3.4.2.2 ............................. 17 3.5 HDFS .................................. 18 3.5.1 ...................................... 18 3.5.2 ...................................... 18 3.5.3 .......................... 19 4 TFS......................................................... 19 4.1 4.2 TFS ............................................. 19 TFS ................................... 19 4.3 ............................................. 20 4.4 ............................................. 20 4.5 TFS ..................................... 20 4.5.1 (129.26 KB) 2010-9-29 22:39 ................ 21 4.5.2 ........................ 21 4.6 TFS ....................................... 21
4.6.1 .................................... 21 4.6.2 ...................................... 21 4.6.3 ...................................... 21 4.6.4 ...................................... 22 4.6.5 ...................................... 22 4.6.6 .................................... 22 5 MooseFS MFS ......................................... 22 5.1 5.2 MFS ............................................. 22 MFS ........................................... 22 5.3 )..................................... 23 5.4 MFS ..................................... 23 5.4.1 .................................. 23 5.4.1.1 managing server (master) ........ 23 5.4.1.2 Metalogger serveMetalogger 24 5.4.1.3 data servers (chunkservers) . 24 5.4.1.4 client computers .................... 24 5.4.2 .............................. 24 5.5 MFS ......................................... 25 5.5.1 MFS ....................................... 25 5.5.2 MFS ....................................... 25 6 KFS......................................................... 26 6.1 6.2 KFS ............................................. 26 KFS ........................................... 26 6.2.1 1. ................................... 26 6.2.2 2. ......................................... 27 6.2.3 3. ................................... 27 6.2.4 4. ....................................... 27 6.2.5 5. ....................................... 27
6.2.6 6. ..................................... 27 6.2.7 7. ....................................... 27 6.2.8 8. ........................................... 27 6.2.9 9. FUSE ...................................... 28 6.2.10 C++,Java,Python ................. 28 6.2.11 ........................... 28 6.2.12 ..................... 28 6.3 6.4 KFS ......................................... 28 KFS HDFS .................................... 28 6.4.1 ................................ 28 6.4.2 ...................................... 29 7 Ceph........................................................ 29 7.1 7.2 Ceph .......................................... 29 Ceph ........................................ 30 7.2.1 ............................ 30 7.2.2 Ceph .......................... 30 7.2.2.1 1 ................................. 30 7.2.2.2 2 ................................. 31 7.2.3 Ceph ........................................ 31 7.2.3.1 Ceph ................................ 32 7.2.3.2 Ceph .......................... 33 7.2.3.3 Ceph .............................. 34 7.2.3.4 ............................... 34 7.3 Ceph .................................... 35 7.4 ................................... 35 7.5 ............................................. 35
1 FastDFS 1.1 Fastdfs — mogileFS key-value FUSE, mogileFS — — 1. 2. 3. — RAID; — client api posix — — FastDFS — HTTP 1.2 Fastdfs
1.3 FastDFS mogileFS 1. FastDFS 2. MogileFs FastDFS tracker storageFastDFS 3. tracker storage client trac ker storage 4. FastDFS MogileFS 1 2 FastDFS MogileFS FastDFS 2FastDFS MogileFS
FastDFS C 2 MogileFS perl 3FastDFS socket MogileFS H TTP FastDFS sendfile 5. FastDFS MogileFS 6. FastDFS 7. FastDFS meta data 8. FastDFS V1.14 2 MogileFS 2.1 Mogilefs — Perl — key-value FUSE API web — html 2.2 Mogilefs 2.2.1 MySQL
mogdbsetup Mogilefs Mogilefs HA 2.2.2 mogstored /etc/mogilefs/mogstored.conf mogstored mogadm cluster mogstored 2.2.3 trackers mogilefsd trackers mogilefs wiki trackers Replication Deletion Query Reaper Monitor mogadm,mogtool trackers Client trackers trackers trackers /etc/mogilefs/mogilefsd.conf 2.2.4 mogadmmogtool mogilefs 2.2.5 Client Client Perl pm pm mogilefs 2.3 Mogilefs 2.3.1 ——
分享到:
收藏