1 FastDFS...................................................... 5
1.1
1.2
1.3
Fastdfs .......................................... 5
Fastdfs .................................... 5
FastDFS mogileFS ............................. 6
2 MogileFS..................................................... 7
2.1
2.2
Mogilefs ......................................... 7
Mogilefs ..................................... 7
2.2.1 MySQL .............................. 7
2.2.2 ......................................... 8
2.2.3 trackers ................................ 8
2.2.4 ............................................. 8
2.2.5 Client ............................................ 8
2.3
Mogilefs ....................................... 8
2.3.1 —— ..................... 8
2.3.2 ....................................... 9
2.3.3 ................................... 9
2.3.4 RAID ” ................................. 9
2.3.5 ............................. 9
2.3.6 ................................... 9
2.3.7 ................................. 9
2.3.8 RAID ...................................... 10
2.3.9 ................ 10
3 HDFS........................................................ 10
3.1
HDFS ............................................ 10
3.2 ........................................... 10
3.2.1 ........................................ 10
3.2.2 .................................. 10
3.2.3 .................................. 11
3.2.4 ........................................ 11
3.3 ............................................. 11
3.3.1 (block) ................................... 11
3.3.2 (Namenode)(datanode) ........ 11
3.3.2.1 ............................. 11
3.3.2.2 ....................... 12
3.3.2.3 ......... 13
3.3.2.4 ..................... 14
3.3.2.5 ......................... 15
3.4 ............................................. 15
3.4.1 ........................................ 15
3.4.1.1 ............................. 15
3.4.1.2 ............................. 16
3.4.2 ........................................ 16
3.4.2.1 ............................. 16
3.4.2.2 ............................. 17
3.5
HDFS .................................. 18
3.5.1 ...................................... 18
3.5.2 ...................................... 18
3.5.3 .......................... 19
4 TFS......................................................... 19
4.1
4.2
TFS ............................................. 19
TFS ................................... 19
4.3 ............................................. 20
4.4 ............................................. 20
4.5
TFS ..................................... 20
4.5.1 (129.26 KB) 2010-9-29 22:39 ................ 21
4.5.2 ........................ 21
4.6
TFS ....................................... 21
4.6.1 .................................... 21
4.6.2 ...................................... 21
4.6.3 ...................................... 21
4.6.4 ...................................... 22
4.6.5 ...................................... 22
4.6.6 .................................... 22
5 MooseFS MFS ......................................... 22
5.1
5.2
MFS ............................................. 22
MFS ........................................... 22
5.3 )..................................... 23
5.4
MFS ..................................... 23
5.4.1 .................................. 23
5.4.1.1 managing server (master) ........ 23
5.4.1.2 Metalogger serveMetalogger
24
5.4.1.3 data servers (chunkservers) . 24
5.4.1.4 client computers .................... 24
5.4.2 .............................. 24
5.5
MFS ......................................... 25
5.5.1 MFS ....................................... 25
5.5.2 MFS ....................................... 25
6 KFS......................................................... 26
6.1
6.2
KFS ............................................. 26
KFS ........................................... 26
6.2.1 1. ................................... 26
6.2.2 2. ......................................... 27
6.2.3 3. ................................... 27
6.2.4 4. ....................................... 27
6.2.5 5. ....................................... 27
6.2.6 6. ..................................... 27
6.2.7 7. ....................................... 27
6.2.8 8. ........................................... 27
6.2.9 9. FUSE ...................................... 28
6.2.10 C++,Java,Python ................. 28
6.2.11 ........................... 28
6.2.12 ..................... 28
6.3
6.4
KFS ......................................... 28
KFS HDFS .................................... 28
6.4.1 ................................ 28
6.4.2 ...................................... 29
7 Ceph........................................................ 29
7.1
7.2
Ceph .......................................... 29
Ceph ........................................ 30
7.2.1 ............................ 30
7.2.2 Ceph .......................... 30
7.2.2.1 1 ................................. 30
7.2.2.2 2 ................................. 31
7.2.3 Ceph ........................................ 31
7.2.3.1 Ceph ................................ 32
7.2.3.2 Ceph .......................... 33
7.2.3.3 Ceph .............................. 34
7.2.3.4 ............................... 34
7.3
Ceph .................................... 35
7.4 ................................... 35
7.5 ............................................. 35
1 FastDFS
1.1
Fastdfs
— mogileFS key-value FUSE,
mogileFS
—
— 1. 2. 3.
— RAID;
— client api posix
—
— FastDFS
— HTTP
1.2
Fastdfs
1.3
FastDFS mogileFS
1. FastDFS
2. MogileFs FastDFS
tracker storageFastDFS
3. tracker
storage client trac
ker storage
4. FastDFS MogileFS
1 2 FastDFS MogileFS
FastDFS
2FastDFS MogileFS
FastDFS C 2
MogileFS perl
3FastDFS socket MogileFS H
TTP FastDFS sendfile
5. FastDFS MogileFS
6. FastDFS
7. FastDFS meta data
8. FastDFS V1.14
2 MogileFS
2.1
Mogilefs
—
Perl
— key-value FUSE API
web
—
html
2.2
Mogilefs
2.2.1 MySQL
mogdbsetup Mogilefs
Mogilefs
HA
2.2.2
mogstored
/etc/mogilefs/mogstored.conf mogstored
mogadm cluster
mogstored
2.2.3 trackers
mogilefsd trackers mogilefs wiki trackers
Replication Deletion Query Reaper Monitor
mogadm,mogtool trackers Client
trackers trackers trackers
/etc/mogilefs/mogilefsd.conf
2.2.4
mogadmmogtool
mogilefs
2.2.5 Client
Client Perl pm pm mogilefs
2.3
Mogilefs
2.3.1 ——