forked from cea-hpc/robinhood
-
Notifications
You must be signed in to change notification settings - Fork 0
/
README.Lustre_HSM
139 lines (102 loc) · 4.01 KB
/
README.Lustre_HSM
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
I - License
II - Compiling
III - Install
IV - Database configuration
V - Enabling Lustre changelogs
VI - RobinHood config file
VII - First run
I - License
===========
Copyright (C) 2004-2013 CEA/DAM
This program is free software; you can redistribute it and/or modify
it under the terms of the CeCILL-C License.
The fact that you are presently reading this means that you have had
knowledge of the CeCILL-C license (http://www.cecill.info) and that you
accept its terms.
II - Compiling
==============
2.1 - From source tarball
-------------------------
It is advised to build RobinHood on your target system, to ensure the best
compatibility with your Lustre and MySQL versions.
Make sure you have the following products installed on your machine:
* bison
* flex
* mysql-devel
* liblustreapi (/usr/include/lustre/lustreapi.h and /usr/lib64/liblustreapi.so)
It is usually provided by client lustre RPM.
Unzip and untar the source distribution:
> tar zxvf robinhood-2.x.x.tar.gz
> cd robinhood-2.x.x
Run the 'configure' script with the following options:
* For Lustre-HSM: --with-purpose=LUSTRE_HSM
* --prefix=<path> to set the prefix of installation path (default is /usr).
* --with-lustre=<lustre_src_tree> if you want to build using a specific Lustre
version (not installed)
E.g.:
> ./configure --with-purpose=LUSTRE_HSM
Then, build the RPM:
> make rpm
A ready-to-install RPM is generated in the 'rpms/RPMS/<arch>' directory.
2.2 - From git repository
-------------------------
# make sure flex, bison, libtool, mysql-devel are installed:
# E.g.
yum install flex
yum install bison
yum install libtool
yum install mysql-devel
# retrieve robinhood sources
git clone git://robinhood.git.sourceforge.net/gitroot/robinhood/robinhood
cd robinhood
git checkout master (or other branch)
sh autogen.sh
Then refer to section 2.1 for next compilation steps.
III - Install
=============
For installing robinhood on your target system, install the following RPM:
> robinhood-adm
configuration helper for DB, changelogs, ...
> robinhood-lhsm
include robinhood commands, config templates, init.d script
IV - Database Configuration
===========================
Robinhood needs a MySQL database for storing information about files.
This database can run on a different node from Robinhood daemon.
* Install MySQL server on the machine (mysql-server and mysql packages).
* Start the DB engine:
service mysqld start
* Run the configuration helper script as root on the database host:
1) check database requirement:
> rbh-config precheck_db
2) create robinhood's database:
> rbh-config create_db
* Write the DB password to a file with read access for root only (600)
e.g. to /etc/robinhood.d/lhsm/.dbpassword
Note: initially, the database schema is empty. Robinhood will create it the first time it is launched.
V - Enabling Lustre changelogs
==============================
For Lustre-HSM purpose, you must register robinhood as a MDT changelog consummer.
* Run the configuration helper script on Lustre MDT:
> rbh-config enable_chglogs
This registers a changelog consummer and activate required changelog records.
Note: by default, the script checks for a 'cl1' consummer.
If you need to register several changelog consummers on your file system,
refer to lustre documentation.
VI - Configuration file
=======================
You can use the '--template' option to generate a documented configuration file template:
> rbh-lhsm --template=<template_file>
Note: by default, "service robinhood-hsm start" looks for configuration files in "/etc/robinhood.d/hsm".
For more details, refer to Robinhood Admin Guide (in the doc/admin_guide directory).
VII - First run
===============
Even if your filesystem is empty, you need to perform an initial scan in order to initialize robinhood database.
This prevents from having entries in filesystem that it wouldn't know about.
rbh-lhsm --scan --once
VIII - Start the daemon
=======================
service robinhood-lhsm start
or run:
rbh-lhsm --detach
This starts reading changelogs + applying policies (archive, release)