pvfs2 debian

Je réécris ce billet (15/07/09) car la mise en page sous dotclear n'est pas des plus fameuses/lisibles.

Doc de référence : http://www.pvfs.org/pvfs2/pvfs2-quickstart.html
 
 
 Cette installation a été réalisée dans des vmware sur 3 machines debian sarge
 avec un noyau IDENTIQUE sur les 3 ainsi que gcc-3.3.
 
 Machines utilisees : bf24ip5 (meta +IO) , pvfsio2 (IO), raid (client)

 Les machines sont declarees dans chacun des fichiers /etc/hosts respectifs :
 192.168.0.41    pvfsio2
 192.168.0.5     bf24ip5
 192.168.0.16    raid

 
 Comme indique sur le site de reference, il est imperatif d'utiliser gcc version >= 3.
 La compil plante avec la version 2.95.
 
 {bf24ip5,raid,pvfsio2}:~# cat /proc/version
 Linux version 2.6.15-1-686 (Debian 2.6.15-6bpo1) (nobse@debian.org)
 (gcc version 3.3.5 (Debian 1:3.3.5-13)) #2 Thu Feb 23 05:41:01 CET 2006
 
 {bf24ip5,raid,pvfsio2}:~# gcc -v
 Reading specs from /usr/lib/gcc-lib/i486-linux/3.3.5/specs
 Thread model: posix
 gcc version 3.3.5 (Debian 1:3.3.5-13)
 
 Il est également nécessaire d'installer le paquet linux-headers correspondant au noyau :
 
 
 {bf24ip5,raid,pvfsio2}:~# dpkg -la linux-headers-2.6.15*
 Desired=Unknown/Install/Remove/Purge/Hold
 | Status=Not/Installed/Config-files/Unpacked/Failed-config/Half-installed
 |/ Err?=(none)/Hold/Reinst-required/X=both-problems (Status,Err: uppercase=bad)
 ||/ Name                        Version                     Description
 +++-===========================-===========================-======================================================================
 ii  linux-headers-2.6.15-1      2.6.15-6bpo1                Common header files for Linux kernel 2.6.15
 ii  linux-headers-2.6.15-1-686  2.6.15-6bpo1                Header files for Linux kernel 2.6.15 on PPro/Celeron/PII/PIII/P4 machi
 
 
 Les paquets suivants sont également requis :
 
 {bf24ip5,raid,pvfsio2}:~# dpkg -la libdb4.2*
 Desired=Unknown/Install/Remove/Purge/Hold
 | Status=Not/Installed/Config-files/Unpacked/Failed-config/Half-installed
 |/ Err?=(none)/Hold/Reinst-required/X=both-problems (Status,Err: uppercase=bad)
 ||/ Name                        Version                     Description
 +++-===========================-===========================-======================================================================
 ii  libdb4.2                    4.2.52-18                   Berkeley v4.2 Database Libraries [runtime]
 ii  libdb4.2-dev                4.2.52-18                   Berkeley v4.2 Database Libraries [development]
 
 
 
 Preparation des repertoires sur les serveurs :
 
 pvfsio2:/#mkdir /pvfs-data

 bf24ip5:/#mkdir /pvfs-data
 
 
 Recup du tarball pvfs2 sur : ftp://ftp.parl.clemson.edu/pub/pvfs2/pvfs2-1.4.0.tar.gz
 
 Puis install sur chacune des 3 machines. Decompression de l'archive puis :
 
 #./configure --with-kernel=/lib/modules/2.6.15-1-686/build/ && make && make kmod && make kmod_install && make install
 
 (NOTE : le module n'est nécessaire que sur la machine cliente)
 
 A la fin de l'install vous devez retrouver ceci :
 
 pvfsio2:/usr/local# ll bin/pvfs*
 -rwxr-xr-x  1 root root  523180 Mar  5 13:51 bin/pvfs2-check-config
 -rwxr-xr-x  1 root root  526069 Mar  5 13:51 bin/pvfs2-chmod
 -rwxr-xr-x  1 root root  526170 Mar  5 13:51 bin/pvfs2-chown
 -rwxr-xr-x  1 root root    1597 Mar  5 13:51 bin/pvfs2-config
 -rwxr-xr-x  1 root root  537291 Mar  5 13:51 bin/pvfs2-cp
 -rwxr-xr-x  1 root root  526094 Mar  5 13:51 bin/pvfs2-event-mon-example
 -rwxr-xr-x  1 root root  531624 Mar  5 13:51 bin/pvfs2-fs-dump
 -rwxr-xr-x  1 root root  536325 Mar  5 13:51 bin/pvfs2-fsck
 -rwxr-xr-x  1 root root   27091 Mar  5 13:51 bin/pvfs2-genconfig
 -rwxr-xr-x  1 root root  526204 Mar  5 13:51 bin/pvfs2-ln
 -rwxr-xr-x  1 root root  535045 Mar  5 13:51 bin/pvfs2-ls
 -rwxr-xr-x  1 root root  527551 Mar  5 13:51 bin/pvfs2-mkdir
 -rwxr-xr-x  1 root root  174667 Mar  5 13:51 bin/pvfs2-mkspace
 -rwxr-xr-x  1 root root  526195 Mar  5 13:51 bin/pvfs2-perf-mon-example
 -rwxr-xr-x  1 root root   21543 Mar  5 13:51 bin/pvfs2-perror
 -rwxr-xr-x  1 root root  530488 Mar  5 13:51 bin/pvfs2-ping
 -rwxr-xr-x  1 root root  526151 Mar  5 13:51 bin/pvfs2-remove-object
 -rwxr-xr-x  1 root root  525979 Mar  5 13:51 bin/pvfs2-rm
 -rwxr-xr-x  1 root root  526219 Mar  5 13:51 bin/pvfs2-set-debugmask
 -rwxr-xr-x  1 root root  526022 Mar  5 13:51 bin/pvfs2-set-eventmask
 -rwxr-xr-x  1 root root  526051 Mar  5 13:51 bin/pvfs2-set-mode
 -rwxr-xr-x  1 root root  526017 Mar  5 13:51 bin/pvfs2-set-sync
 -rwxr-xr-x  1 root root  156169 Mar  5 13:51 bin/pvfs2-showcoll
 -rwxr-xr-x  1 root root  527364 Mar  5 13:51 bin/pvfs2-stat
 -rwxr-xr-x  1 root root  530523 Mar  5 13:51 bin/pvfs2-statfs
 -rwxr-xr-x  1 root root  525982 Mar  5 13:51 bin/pvfs2-touch
 -rwxr-xr-x  1 root root  526489 Mar  5 13:51 bin/pvfs2-viewdist
 
 pvfsio2:/usr/local# ll sbin/pvfs*
 -rwxr-xr-x  1 root root  20165 Mar  5 13:51 sbin/pvfs2-client
 -rwxr-xr-x  1 root root 568018 Mar  5 13:51 sbin/pvfs2-client-core
 -rwxr-xr-x  1 root root 572313 Mar  5 13:51 sbin/pvfs2-server
 
 pvfsio2:/usr/local# ll /lib/modules/2.6.15-1-686/kernel/fs/pvfs2/
 total 116
 drwxr-xr-x   2 root root   4096 Mar  5 13:51 .
 drwxr-xr-x  48 root root   4096 Mar  5 13:51 ..
 -rwxr-xr-x   1 root root 106108 Mar  5 13:51 pvfs2.ko
 
 
 
 
 Chargement du modules pvfs2 sur la machine client par :
 
 insmod /lib/modules/2.6.15-1-686/kernel/fs/pvfs2/pvfs2.ko
 
 raid:/usr/src# lsmod|grep pvfs
 pvfs2                  87440  2
 
 
 
 
 Configuration Serveurs meta et I/O
 
 
 bf24ip5:/usr/local/bin# ./pvfs2-genconfig /etc/pvfs2-fs.conf /etc/pvfs2-server.conf
 **********************************************************************
         Welcome to the PVFS2 Configuration Generator:
 
 This interactive script will generate configuration files suitable
 for use with a new PVFS2 file system.  Please see the PVFS2 quickstart
 guide for details.
 
 **********************************************************************
 
 You must first select the network protocol that your file system will use.
 The only currently supported options are "tcp", "gm", and "ib".
 (For multi-homed configurations, use e.g. "ib,tcp".)
 
 * Enter protocol type \[Default is tcp\]: tcp
 
 Choose a TCP/IP port for the servers to listen on.  Note that this
 script assumes that all servers will use the same port number.
 
 * Enter port number \[Default is 3334\]: 3334
 
 Next you must list the hostnames of the machines that will act as
 I/O servers.  Acceptable syntax is "node1, node2, ..." or "node{#-#,#,#}".
 
 * Enter hostnames \[Default is localhost\]: bf24ip5, pvfsio2
 
 Now list the hostnames of the machines that will act as Metadata
 servers.  This list may or may not overlap with the I/O server list.
 
 * Enter hostnames \[Default is localhost\]: bf24ip5
 
 Configured a total of 2 servers:
 2 of them are I/O servers.
 1 of them are Metadata servers.
 
 * Would you like to verify server list (y/n) \[Default is n\]? y
 
 ****** I/O servers:
 tcp://bf24ip5:3334
 tcp://pvfsio2:3334
 
 ****** Metadata servers:
 tcp://bf24ip5:3334
 
 * Does this look ok (y/n) \[Default is y\]? y
 
 Choose a file for each server to write log messages to.
 
 * Enter log file location \[Default is /tmp/pvfs2-server.log\]:
 
 Choose a directory for each server to store data in.
 
 * Enter directory name: \[Default is /pvfs2-storage-space\]: /pvfs-data
 
 Writing fs config file... Done.
 Writing 2 server config file(s)... Done.
 bf24ip5:/usr/local/bin#
 
 Verif et visualisation des fichiers generes :
 
 bf24ip5:/usr/local/bin# ll /etc/pvfs*
 -rw-r--r--  1 root root 929 Mar  4 18:34 /etc/pvfs2-fs.conf
 -rw-r--r--  1 root root  52 Mar  4 18:34 /etc/pvfs2-server.conf-bf24ip5
 -rw-r--r--  1 root root  52 Mar  4 18:34 /etc/pvfs2-server.conf-pvfsio2
 
 bf24ip5:/usr/local/bin# file /etc/pvfs*
 /etc/pvfs2-fs.conf:             ASCII text
 /etc/pvfs2-server.conf-bf24ip5: ASCII text
 /etc/pvfs2-server.conf-pvfsio2: ASCII text
 
 
 bf24ip5:/usr/local/bin# less /etc/pvfs2-fs.conf
 <Defaults>
         UnexpectedRequests 50
         LogFile /tmp/pvfs2-server.log
         EventLogging none
         LogStamp usec
         BMIModules bmi_tcp
         FlowModules flowproto_multiqueue
         PerfUpdateInterval 1000
         ServerJobBMITimeoutSecs 30
         ServerJobFlowTimeoutSecs 30
         ClientJobBMITimeoutSecs 300
         ClientJobFlowTimeoutSecs 300
         ClientRetryLimit 5
         ClientRetryDelayMilliSecs 2000
 </Defaults>
 
 <Aliases>
         Alias bf24ip5 tcp://bf24ip5:3334
         Alias pvfsio2 tcp://pvfsio2:3334
 </Aliases>
 
 <Filesystem>
         Name pvfs2-fs
         ID 256584223
         RootHandle 1048576
         <MetaHandleRanges>
                 Range bf24ip5 4-1431655767
         </MetaHandleRanges>
         <DataHandleRanges>
                 Range bf24ip5 1431655768-2863311531
                 Range pvfsio2 2863311532-4294967295
         </DataHandleRanges>
         <StorageHints>
                 TroveSyncMeta yes
                 TroveSyncData no
                 AttrCacheKeywords datafile_handles,metafile_dist
                 AttrCacheKeywords dir_ent, symlink_target
                 AttrCacheSize 4093
                 AttrCacheMaxNumElems 32768
         </StorageHints>
 </Filesystem>
 
 
 
 bf24ip5:/usr/local/bin# less /etc/pvfs2-server.conf-bf24ip5
 StorageSpace /pvfs-data
 HostID "tcp://bf24ip5:3334"
 
 bf24ip5:/usr/local/bin# less /etc/pvfs2-server.conf-pvfsio2
 StorageSpace /pvfs-data
 HostID "tcp://pvfsio2:3334"
 
 bf24ip5:/etc# scp pvfs* pvfsio2:/etc
 The authenticity of host 'pvfsio2 (192.168.0.41)' can't be established.
 RSA key fingerprint is 63:b4:3d:1e:0e:b7:68:90:f6:20:07:73:08:d9:e3:44.
 Are you sure you want to continue connecting (yes/no)? yes
 Warning: Permanently added 'pvfsio2' (RSA) to the list of known hosts.
 root@pvfsio2's password:
 pvfs2-fs.conf                                      100%  929     0.9KB/s   00:00    
 pvfs2-server.conf-bf24ip5                          100%   52     0.1KB/s   00:00    
 pvfs2-server.conf-pvfsio2                          100%   52     0.1KB/s   00:00   
 
 bf24ip5:/etc# scp pvfs* raid:/etc
 pvfs2-fs.conf                                      100%  929     0.9KB/s   00:00    
 pvfs2-server.conf-bf24ip5                          100%   52     0.1KB/s   00:00    
 pvfs2-server.conf-pvfsio2                          100%   52     0.1KB/s   00:00  
 
 
 Creation des espaces de stockage sur les serveurs
 

bf24ip5:/usr/local/sbin# ./pvfs2-server /etc/pvfs2-fs.conf /etc/pvfs2-server.conf-bf24ip5 -f
 [D 18:48:04.070128] PVFS2 Server version 1.4.0 starting.


 bf24ip5:/usr/local/sbin# ll /pvfs-data/
 total 28
 drwxr-xr-x   3 root root 4096 Mar  4 18:48 .
 drwxr-xr-x  24 root root 4096 Mar  4 18:29 ..
 drwxr-xr-x   4 root root 4096 Mar  4 18:48 0f4b2a1f
 -rw-r--r--   1 root root 8192 Mar  4 18:48 collections.db
 -rw-r--r--   1 root root 8192 Mar  4 18:48 storage_attributes.db
 
 
 

pvfsio2:/usr/local/sbin# ./pvfs2-server /etc/pvfs2-fs.conf /etc/pvfs2-server.conf-pvfsio2 -f
[D 14:36:40.299111] PVFS2 Server version 1.4.0 starting.


 pvfsio2:/usr/local/sbin# ll /pvfs-data/
 total 28
 drwxr-xr-x   3 root root 4096 Mar  5 14:36 .
 drwxr-xr-x  22 root root 4096 Mar  5 14:16 ..
 drwxr-xr-x   4 root root 4096 Mar  5 14:36 0f4b2a1f
 -rw-r--r--   1 root root 8192 Mar  5 14:36 collections.db
 -rw-r--r--   1 root root 8192 Mar  5 14:36 storage_attributes.db

 
 Demarrage des serveurs
 

bf24ip5:/usr/local/sbin# ./pvfs2-server /etc/pvfs2-fs.conf /etc/pvfs2-server.conf-bf24ip5   
 [D 18:50:33.608719] PVFS2 Server version 1.4.0 starting.


 bf24ip5:/usr/local/sbin# ps ax|grep pvfs
  7330 ?        Ss     0:00 ./pvfs2-server /etc/pvfs2-fs.conf /etc/pvfs2-server.conf-bf24ip5
 
 bf24ip5:/usr/local/sbin# netstat -lnp|grep pvfs
 tcp        0      0 0.0.0.0:3334            0.0.0.0:*               LISTEN     7330/pvfs2-server   
 
 

pvfsio2:/usr/local/sbin# ./pvfs2-server /etc/pvfs2-fs.conf /etc/pvfs2-server.conf-pvfsio2   
[D 14:39:29.148753] PVFS2 Server version 1.4.0 starting.


 pvfsio2:/usr/local/sbin# ps ax|grep pvfs
 31537 ?        S      0:00 ./pvfs2-server /etc/pvfs2-fs.conf /etc/pvfs2-server.conf-pvfsio2
 
 pvfsio2:/usr/local/sbin# netstat -lnp | grep pvfs
 tcp        0      0 0.0.0.0:3334            0.0.0.0:*               LISTEN      31537/pvfs2-server  

 
 
 Configuration du client (machine raid)


 raid:/# mkdir /pvfs
 raid:/# touch /etc/pvfs2tab
 raid:/# chmod a+r /etc/pvfs2tab
 raid:/# ll /etc/pvfs2tab

 -rw-r--r--    1 root     root            0 2006-03-05 14:35 /etc/pvfs2tab

 
Modif de /etc/pvfs2tab. On indique ici le serveur de meta-donnees


 raid:/usr/local/bin# cat /etc/pvfs2tab
 tcp://bf24ip5:3334/pvfs2-fs /pvfs pvfs2 default,noauto 0 0

 
 Verification de la config client
 

 raid:/usr/local/bin# ./pvfs2-ping -m /pvfs
 
 (1) Parsing tab file...
 
 (2) Initializing system interface...
 
 (3) Initializing each file system found in tab file: /etc/pvfs2tab...
 
    /pvfs: Ok
 
 (4) Searching for /pvfs in pvfstab...
 
    PVFS2 servers: tcp://bf24ip5:3334
    Storage name: pvfs2-fs
    Local mount point: /pvfs
 
    meta servers:
    tcp://bf24ip5:3334
 
    data servers:
    tcp://bf24ip5:3334
    tcp://pvfsio2:3334
 
 (5) Verifying that all servers are responding...
 
    meta servers:
    tcp://bf24ip5:3334 Ok
 
    data servers:
    tcp://bf24ip5:3334 Ok
    tcp://pvfsio2:3334 Ok
 
 (6) Verifying that fsid 256584223 is acceptable to all servers...
 
    Ok; all servers understand fs_id 256584223
 
 (7) Verifying that root handle is owned by one server...
 
    Root handle: 1048576
    Ok; root handle is owned by exactly one server.
 
 =============================================================
 
 The PVFS filesystem at /pvfs appears to be correctly configured.
 

 
Demarrage du client
 

 raid:/usr/local/sbin# ll
 total 1145
 drwxr-xr-x    2 root     staff        1024 2006-03-05 13:41 .
 drwxrwsr-x   14 root     staff        1024 2004-03-26 13:20 ..
 -rwxr-xr-x    1 root     root        20165 2006-03-05 13:40 pvfs2-client
 -rwxr-xr-x    1 root     root       567922 2006-03-05 13:40 pvfs2-client-core
 -rwxr-xr-x    1 root     root       572209 2006-03-05 13:41 pvfs2-server
 
 raid:/usr/local/sbin# ./pvfs2-client -f -p ./pvfs2-client-core
 pvfs2-client starting
 Spawning new child process
 Waiting on child with pid 14783
 About to exec ./pvfs2-client-core
 
 
 raid:~# ps ax|grep pvfs
 14782 pts/0    S      0:00 ./pvfs2-client -f -p ./pvfs2-client-core
 14783 pts/0    S      0:00 pvfs2-client-core -a 5 -L /tmp/pvfs2-client.log

 
 On monte le systeme de fichiers pvfs2 :
 

 raid:~# mount -t pvfs2 tcp://bf24ip5:3334/pvfs2-fs /pvfs
 


 Verification
 

 raid:~# mount
 /dev/sda1 on / type ext3 (rw,errors=remount-ro)
 proc on /proc type proc (rw)
 sysfs on /sys type sysfs (rw)
 devpts on /dev/pts type devpts (rw,gid=5,mode=620)
 tmpfs on /dev/shm type tmpfs (rw)
 usbfs on /proc/bus/usb type usbfs (rw)
 /dev/sda3 on /boot type ext3 (rw,errors=remount-ro)
 /dev/sda8 on /usr/local type ext3 (rw)
 /dev/sda10 on /usr/src type ext2 (rw)
 /dev/sda6 on /var type ext3 (rw)
 /dev/sda7 on /home type reiserfs (rw)
 /dev/sda9 on /web type reiserfs (rw)
 /dev/md0 on /opt type ext3 (rw)
 tmpfs on /dev type tmpfs (rw,size=10M,mode=0755)
 tcp://bf24ip5:3334/pvfs2-fs on /pvfs type pvfs2 (rw)
 
 
 
 raid:~# df -hT
 Sys. de fich. Type     Tail. Occ. Disp. %Occ. Monté sur
 /dev/sda1     ext3    1,2G  873M  198M  82% /
 tmpfs        tmpfs     23M     0   23M   0% /dev/shm
 /dev/sda3     ext3     92M   21M   67M  24% /boot
 /dev/sda8     ext3    464M   23M  418M   6% /usr/local
 /dev/sda10    ext2    549M  120M  401M  24% /usr/src
 /dev/sda6     ext3    373M  133M  221M  38% /var
 /dev/sda7 reiserfs    189M   43M  146M  23% /home
 /dev/sda9 reiserfs    142M   33M  110M  23% /web
 /dev/md0      ext3    374M   15M  341M   5% /opt
 tmpfs        tmpfs     23M  552K   22M   3% /dev
 tcp://bf24ip5:3334/pvfs2-fs
              pvfs2    2,1G  1,3G  836M  61% /pvfs
              
              
 raid:~# ll /pvfs
 total 12
 drwxrwxrwt    1 root     root         4096 2006-03-04 18:48 .
 drwxr-xr-x   23 root     root         4096 2006-03-05 14:10 ..
 drwxrwxrwx    1 root     root         4096 2006-03-04 18:48 lost+found
 raid:~#

 
 Sur les serveurs IO l'arborescence suivante a ete creee :
 

 bf24ip5:/# ll pvfs-data/
 total 28
 drwxr-xr-x   3 root root 4096 Mar  4 18:48 .
 drwxr-xr-x  24 root root 4096 Mar  4 18:29 ..
 drwxr-xr-x   4 root root 4096 Mar  4 18:48 0f4b2a1f
 -rw-r--r--   1 root root 8192 Mar  4 18:48 collections.db
 -rw-r--r--   1 root root 8192 Mar  4 18:48 storage_attributes.db
 
 
 bf24ip5:/# ll pvfs-data/0f4b2a1f/
 total 32
 drwxr-xr-x   4 root root 4096 Mar  4 18:48 .
 drwxr-xr-x   3 root root 4096 Mar  4 18:48 ..
 drwxr-xr-x  66 root root 4096 Mar  4 18:48 bstreams
 -rw-r--r--   1 root root 8192 Mar  4 18:48 collection_attributes.db
 -rw-r--r--   1 root root 8192 Mar  4 18:48 dataspace_attributes.db
 drwxr-xr-x  34 root root 4096 Mar  4 18:48 keyvals
 
 bf24ip5:/# ll pvfs-data/0f4b2a1f/bstreams/
 total 264
 drwxr-xr-x  66 root root 4096 Mar  4 18:48 .
 drwxr-xr-x   4 root root 4096 Mar  4 18:48 ..
 drwxr-xr-x   2 root root 4096 Mar  4 18:48 00000000
 drwxr-xr-x   2 root root 4096 Mar  4 18:48 00000001
 drwxr-xr-x   2 root root 4096 Mar  4 18:48 00000002
 drwxr-xr-x   2 root root 4096 Mar  4 18:48 00000003
 drwxr-xr-x   2 root root 4096 Mar  4 18:48 00000004
 drwxr-xr-x   2 root root 4096 Mar  4 18:48 00000005
 drwxr-xr-x   2 root root 4096 Mar  4 18:48 00000006
 drwxr-xr-x   2 root root 4096 Mar  4 18:48 00000007
   etc..... jusqu'à                         00000063

   
 Test de copie de fichier sur le systeme pvfs :


 
 raid:/usr/src# cp pvfs2-1.4.0.tar.gz /pvfs
 
 raid:/usr/src# ll /pvfs
 total 3228
 drwxrwxrwt    1 root     root         4096 2006-03-05 14:51 .
 drwxr-xr-x   23 root     root         4096 2006-03-05 14:10 ..
 drwxrwxrwx    1 root     root         4096 2006-03-04 18:48 lost+found
 -rw-r--r--    1 root     root      3291038 2006-03-05 14:51 pvfs2-1.4.0.tar.gz
 

 
 Sur les serveurs IO ce fichier est ainsi "decompose" :
 

 pvfsio2:/pvfs-data/0f4b2a1f/bstreams# ll 00000044
 total 1612
 drwxr-xr-x   2 root root    4096 Mar  5 14:59 .
 drwxr-xr-x  66 root root    4096 Mar  5 14:36 ..
 -rw-------   1 root root 1638400 Mar  5 14:59 aaaaaaac.bstream
 
 bf24ip5:/pvfs-data/0f4b2a1f/bstreams# ll 00000043
 total 1628
 drwxr-xr-x   2 root root    4096 Mar  4 19:11 .
 drwxr-xr-x  66 root root    4096 Mar  4 18:48 ..
 -rw-------   1 root root 1652638 Mar  4 19:11 aaaaaaab.bstream
 


On verifie : 1638400 + 1652638 = 3291038 : C'est tout bon !!!
 
Les meta-donnees sont stockees sur bf24ip5 dans, me semble-t-il,  /pvfs-data/0f4b2a1f/keyvals/000000x


bf24ip5:/pvfs-data/0f4b2a1f/keyvals/00000001# file  000ffca1.keyval
  000ffca1.keyval: Berkeley DB (Btree, version 9, native byte-order)