X-Git-Url: https://git.whamcloud.com/?p=fs%2Flustre-release.git;a=blobdiff_plain;f=lustre-iokit%2Fstats-collect%2FREADME;h=60270dd89b842a8c6d1b5a05e959281c32094f09;hp=28e4d12d8a965686c617aba24b9eaa1d507a4cb2;hb=51c037f2d7d7c7b713ab21617eb983f231510a33;hpb=2e56e28c5dadfed888e859ebbaff09e504351132 diff --git a/lustre-iokit/stats-collect/README b/lustre-iokit/stats-collect/README index 28e4d12..60270dd 100644 --- a/lustre-iokit/stats-collect/README +++ b/lustre-iokit/stats-collect/README @@ -1,68 +1,63 @@ Overview -------- -These script will be used to collect profile info of lustre client and server. -It will be run on a single(control) node, and collect all the profile info and -create a tarball on the control node. +These scripts will be used to collect application profiling info from +lustre clients and servers. It will be run on a single (control) +node, and collect all the profile info and create a tarball on the +control node. -lstat.sh : The stat script for single node, which will be run on each profile - node. +lstat.sh : script for single node, will be run on each profile node. gather_stats_everywhere.sh : collect stats script. -config.sh : the config for gather_stats_everywhere.sh. +config.sh : customized configuration description Requirements ------- -1) Lustre is installed and setup on your profiling cluster. -2) ssh/scp to these node names works without requiring a password. +1) Lustre is installed and setup on your cluster. +2) ssh/scp to these nodes works without requiring a password. Configuration ------ -Configuration is very simple for this script, all of the profiling config VARs are -in config.sh +Configuration is very simple for this script - all of the profiling +config VARs are in config.sh XXXX_INTERVAL: the profiling interval where value of interval means: 0 - gather stats at start and stop only N - gather stats every N seconds -if some XXX_INTERVAL isn't specified, related stats won't be collected -XXXX can be: VMSTAT, SERVICE, BRW, SDIO, MBALLOC, IO, JBD, CLIENT +if XXX_INTERVAL isn't specified, XXX stats won't be collected +XXX can be: VMSTAT, SERVICE, BRW, SDIO, MBALLOC, IO, JBD, CLIENT -As for ior-collect-stat.sh, you can modify the various IOR and MPI -parameters inside ior-collect-stat.sh Running -------- -1) The gather_stats_everywhere.sh will be run in three mode +The gather_stats_everywhere.sh should be run in three phases: a)sh gather_stats_everywhere.sh config.sh start - It will start collect stats on each node provided in config.sh + It will start stats collection on each node specified in config.sh - b)sh gather_stats_everywhere.sh config.sh stop - It will stop collect stats on each node. If is provided, - it will create a profile tarball /tmp/.tar.gz. + b)sh gather_stats_everywhere.sh config.sh stop + It will stop collect stats on each node. If is provided, + it will create a profile tarball /tmp/ - c)sh gather_stats_everywhere.sh config.sh analyse log_tarball.tar.gz csv + c)sh gather_stats_everywhere.sh config.sh analyse log_tarball.tgz csv It will analyse the log_tarball and create a csv tarball for this profiling tarball. -2) The ior-collect-stat.sh will be run as - sh ior-collect-stat.sh start - It will create a ior result csv file. If is provided, - the detail profile info tarball will be created under /tmp. Example ------- When you want collect your profile info, you should - 1)sh gather_stats_everywhere.sh config.sh start - #start the collect profile daemon on each node. + 1) start the collect profile daemon on each node. + sh gather_stats_everywhere.sh config.sh start - 2)run your test. + 2) run your test. - 3)sh gather_stats_everywhere.sh config.sh stop log_tarball - #stop the collect profile daemon on each node, cleanup - the tmp file and create a profiling tarball. + 3) stop the collect profile daemon on each node, cleanup the tmp + file and create a profiling tarball. + sh gather_stats_everywhere.sh config.sh stop log_tarball.tgz - 4)sh gather_stats_everywhere.sh config.sh analyse log_tarball.tar.gz csv - #create a csv file according to the profile. + 4) create a csv file according to the profile. + sh gather_stats_everywhere.sh config.sh analyse log_tarball.tgz csv + TBD ------