1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
|
<?xml version='1.0' encoding='UTF-8'?>
<!-- This document was created with Syntext Serna Free. --><!DOCTYPE chapter PUBLIC "-//OASIS//DTD DocBook XML V4.5//EN" "http://www.oasis-open.org/docbook/xml/4.5/docbookx.dtd" [
<!ENTITY % BOOK_ENTITIES SYSTEM "Administration_Guide.ent">
%BOOK_ENTITIES;
]>
<chapter id="chap-Administration_Guide-Setting_Volumes">
<title>Setting up GlusterFS Server Volumes</title>
<para>A volume is a logical collection of bricks where each brick is an export directory on a server in the trusted storage pool. Most of the gluster management operations are performed on the volume. </para>
<para>To create a new volume in your storage environment, specify the bricks that comprise the volume. After you have created a new volume, you must start it before attempting to mount it. </para>
<itemizedlist>
<listitem>
<para>Volumes of the following types can be created in your storage environment: </para>
<itemizedlist>
<listitem>
<para>Distributed - Distributed volumes distributes files throughout the bricks in the volume. You can use distributed volumes where the requirement is to scale storage and the redundancy is either not important or is provided by other hardware/software layers. For more information, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Distributed"/> .</para>
</listitem>
<listitem>
<para>Replicated – Replicated volumes replicates files across bricks in the volume. You can use replicated volumes in environments where high-availability and high-reliability are critical. For more information, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Replicated"/>.</para>
</listitem>
<listitem>
<para>Striped – Striped volumes stripes data across bricks in the volume. For best results, you should use striped volumes only in high concurrency environments accessing very large files. For more information, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Striped"/>.</para>
</listitem>
<listitem>
<para>Distributed Striped - Distributed striped volumes stripe data across two or more nodes in the cluster. You should use distributed striped volumes where the requirement is to scale storage and in high concurrency environments accessing very large files is critical. For more information, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Distributed_Striped"/>.</para>
</listitem>
<listitem>
<para>Distributed Replicated - Distributed replicated volumes distributes files across replicated bricks in the volume. You can use distributed replicated volumes in environments where the requirement is to scale storage and high-reliability is critical. Distributed replicated volumes also offer improved read performance in most environments. For more information, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Distributed_Replicated"/>. </para>
</listitem>
<listitem>
<para>Distributed Striped Replicated – Distributed striped replicated volumes distributes striped data across replicated bricks in the cluster. For best results, you should use distributed striped replicated volumes in highly concurrent environments where parallel access of very large files and performance is critical. In this release, configuration of this volume type is supported only for Map Reduce workloads. For more information, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Distributed_Striped_Replicated"/>.
</para>
</listitem>
<listitem>
<para>Striped Replicated – Striped replicated volumes stripes data across replicated bricks in the cluster. For best results, you should use striped replicated volumes in highly concurrent environments where there is parallel access of very large files and performance is critical. In this release, configuration of this volume type is supported only for Map Reduce workloads. For more
information, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Striped_Replicated"/>.</para>
</listitem>
</itemizedlist>
</listitem>
</itemizedlist>
<para><emphasis role="bold">To create a new volume </emphasis></para>
<itemizedlist>
<listitem>
<para>Create a new volume :</para>
<para><command># gluster volume create<replaceable> NEW-VOLNAME</replaceable> [stripe <replaceable>COUNT</replaceable> | replica <replaceable>COUNT</replaceable>] [transport tcp | rdma | tcp, rdma] <replaceable>NEW-BRICK1 NEW-BRICK2 NEW-BRICK3...</replaceable></command></para>
<para>For example, to create a volume called test-volume consisting of server3:/exp3 and server4:/exp4:</para>
<para><programlisting># gluster volume create test-volume server3:/exp3 server4:/exp4
Creation of test-volume has been successful
Please start the volume to access data.</programlisting></para>
</listitem>
</itemizedlist>
<section id="sect-Administration_Guide-Setting_Volumes-Distributed">
<title>Creating Distributed Volumes</title>
<para>In a distributed volumes files are spread randomly across the bricks in the volume. Use distributed volumes where you need to scale storage and redundancy is either not important or is provided by other hardware/software layers. </para>
<para><note>
<para>Disk/server failure in distributed volumes can result in a serious loss of data because directory contents are spread randomly across the bricks in the volume. </para>
</note></para>
<figure>
<title>Illustration of a Distributed Volume</title>
<mediaobject>
<imageobject>
<imagedata fileref="images/Distributed_Volume.png"/>
</imageobject>
</mediaobject>
</figure>
<para><emphasis role="bold">To create a distributed volume</emphasis></para>
<orderedlist>
<listitem>
<para>Create a trusted storage pool as described earlier in <xref linkend="sect-Administration_Guide-Storage_Pools-Adding_Servers"/>.</para>
</listitem>
<listitem>
<para>Create the distributed volume:</para>
<para><command># gluster volume create <replaceable>NEW-VOLNAME</replaceable> [transport tcp | rdma | tcp,rdma] <replaceable>NEW-BRICK...</replaceable></command></para>
<para>For example, to create a distributed volume with four storage servers using tcp:</para>
<para><programlisting># gluster volume create test-volume server1:/exp1 server2:/exp2 server3:/exp3 server4:/exp4
Creation of test-volume has been successful
Please start the volume to access data.</programlisting></para>
<para>(Optional) You can display the volume information:</para>
<para><programlisting># gluster volume info
Volume Name: test-volume
Type: Distribute
Status: Created
Number of Bricks: 4
Transport-type: tcp
Bricks:
Brick1: server1:/exp1
Brick2: server2:/exp2
Brick3: server3:/exp3
Brick4: server4:/exp4</programlisting></para>
<para>For example, to create a distributed volume with four storage servers over InfiniBand:</para>
<para><programlisting># gluster volume create test-volume transport rdma server1:/exp1 server2:/exp2 server3:/exp3 server4:/exp4
Creation of test-volume has been successful
Please start the volume to access data.</programlisting></para>
<para>If the transport type is not specified, <emphasis role="italic"> tcp</emphasis> is used as the default. You can also set additional options if required, such as auth.allow or auth.reject. For more information, see <xref linkend="sect-Administration_Guide-Managing_Volumes-Tuning"/></para>
<para><note>
<para>Make sure you start your volumes before you try to mount them or else client operations after the mount will hang, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Starting"/> for details. </para>
</note></para>
</listitem>
</orderedlist>
</section>
<section id="sect-Administration_Guide-Setting_Volumes-Replicated">
<title>Creating Replicated Volumes </title>
<para>Replicated volumes create copies of files across multiple bricks in the volume. You can use replicated volumes in environments where high-availability and high-reliability are critical. </para>
<para><note>
<para>The number of bricks should be equal to of the replica count for a replicated volume.
To protect against server and disk failures, it is recommended that the bricks of the volume are from different servers. </para>
</note></para>
<figure>
<title>Illustration of a Replicated Volume</title>
<mediaobject>
<imageobject>
<imagedata fileref="images/Replicated_Volume.png"/>
</imageobject>
</mediaobject>
</figure>
<para><emphasis role="bold">To create a replicated volume </emphasis></para>
<orderedlist>
<listitem>
<para>Create a trusted storage pool as described earlier in <xref linkend="sect-Administration_Guide-Storage_Pools-Adding_Servers"/>.</para>
</listitem>
<listitem>
<para>Create the replicated volume:</para>
<para><command># gluster volume create <replaceable>NEW-VOLNAME</replaceable> [replica <replaceable>COUNT</replaceable>] [transport tcp | rdma tcp,rdma] <replaceable>NEW-BRICK...</replaceable></command></para>
<para>For example, to create a replicated volume with two storage servers:</para>
<para><programlisting># gluster volume create test-volume replica 2 transport tcp server1:/exp1 server2:/exp2
Creation of test-volume has been successful
Please start the volume to access data.</programlisting></para>
<para>If the transport type is not specified, <emphasis role="italic"> tcp</emphasis> is used as the default. You can also set additional options if required, such as auth.allow or auth.reject. For more information, see <xref linkend="sect-Administration_Guide-Managing_Volumes-Tuning"/></para>
<para><note>
<para>Make sure you start your volumes before you try to mount them or else client operations after the mount will hang, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Starting"/> for details. </para>
</note></para>
</listitem>
</orderedlist>
</section>
<section id="sect-Administration_Guide-Setting_Volumes-Striped">
<title>Creating Striped Volumes</title>
<para>Striped volumes stripes data across bricks in the volume. For best results, you should use striped volumes only in high concurrency environments accessing very large files.</para>
<para><note>
<para>The number of bricks should be a equal to the stripe count for a striped volume. </para>
</note></para>
<figure>
<title>Illustration of a Striped Volume</title>
<mediaobject>
<imageobject>
<imagedata fileref="images/Striped_Volume.png"/>
</imageobject>
</mediaobject>
</figure>
<para><emphasis role="bold">To create a striped volume </emphasis></para>
<orderedlist>
<listitem>
<para>Create a trusted storage pool as described earlier in <xref linkend="sect-Administration_Guide-Storage_Pools-Adding_Servers"/>.</para>
</listitem>
<listitem>
<para>Create the striped volume:</para>
<para><command># gluster volume create <replaceable>NEW-VOLNAME</replaceable> [stripe <replaceable>COUNT</replaceable>] [transport tcp | rdma | tcp,rdma] <replaceable>NEW-BRICK...</replaceable></command></para>
<para>For example, to create a striped volume across two storage servers:</para>
<para><programlisting># gluster volume create test-volume stripe 2 transport tcp server1:/exp1 server2:/exp2
Creation of test-volume has been successful
Please start the volume to access data.</programlisting></para>
<para>If the transport type is not specified, <emphasis role="italic"> tcp</emphasis> is used as the default. You can also set additional options if required, such as auth.allow or auth.reject. For more information, see <xref linkend="sect-Administration_Guide-Managing_Volumes-Tuning"/></para>
<para><note>
<para>Make sure you start your volumes before you try to mount them or else client operations after the mount will hang, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Starting"/> for details. </para>
</note></para>
</listitem>
</orderedlist>
</section>
<section id="sect-Administration_Guide-Setting_Volumes-Distributed_Striped">
<title>Creating Distributed Striped Volumes </title>
<para>Distributed striped volumes stripes files across two or more nodes in the cluster. For best results, you should use distributed striped volumes where the requirement is to scale storage and in high concurrency environments accessing very large files is critical.</para>
<para><note>
<para>The number of bricks should be a multiple of the stripe count for a distributed striped volume. </para>
</note></para>
<figure>
<title>Illustration of a Distributed Striped Volume</title>
<mediaobject>
<imageobject>
<imagedata fileref="images/Distributed_Striped_Volume.png"/>
</imageobject>
</mediaobject>
</figure>
<para><emphasis role="bold">To create a distributed striped volume </emphasis></para>
<orderedlist>
<listitem>
<para>Create a trusted storage pool as described earlier in <xref linkend="sect-Administration_Guide-Storage_Pools-Adding_Servers"/>.</para>
</listitem>
<listitem>
<para>Create the distributed striped volume:</para>
<para><command># gluster volume create <replaceable>NEW-VOLNAME</replaceable> [stripe <replaceable>COUNT</replaceable>] [transport tcp | rdma | tcp,rdma] <replaceable>NEW-BRICK...</replaceable></command></para>
<para>For example, to create a distributed striped volume across eight storage servers:</para>
<para><programlisting># gluster volume create test-volume stripe 4 transport tcp server1:/exp1 server2:/exp2 server3:/exp3 server4:/exp4 server5:/exp5 server6:/exp6 server7:/exp7 server8:/exp8
Creation of test-volume has been successful
Please start the volume to access data.</programlisting></para>
<para>If the transport type is not specified, <emphasis role="italic"> tcp</emphasis> is used as the default. You can also set additional options if required, such as auth.allow or auth.reject. For more information, see <xref linkend="sect-Administration_Guide-Managing_Volumes-Tuning"/></para>
<para><note>
<para>Make sure you start your volumes before you try to mount them or else client operations after the mount will hang, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Starting"/> for details. </para>
</note></para>
</listitem>
</orderedlist>
</section>
<section id="sect-Administration_Guide-Setting_Volumes-Distributed_Replicated">
<title>Creating Distributed Replicated Volumes </title>
<para>Distributes files across replicated bricks in the volume. You can use distributed replicated volumes in environments where the requirement is to scale storage and high-reliability is critical. Distributed replicated volumes also offer improved read performance in most environments.</para>
<para><note>
<para>The number of bricks should be a multiple of the replica count for a distributed replicated volume. Also, the order in which bricks are specified has a great effect on data protection. Each replica_count consecutive bricks in the list you give will form a replica set, with all replica sets combined into a volume-wide distribute set. To make sure that replica-set members are not placed on the same node, list the first brick on every server, then the second brick on every server in the same order, and so on. </para>
</note></para>
<figure>
<title>Illustration of a Distributed Replicated Volume</title>
<mediaobject>
<imageobject>
<imagedata fileref="images/Distributed_Replicated_Volume.png"/>
</imageobject>
</mediaobject>
</figure>
<para><emphasis role="bold">To create a distributed replicated volume </emphasis></para>
<orderedlist>
<listitem>
<para>Create a trusted storage pool as described earlier in <xref linkend="sect-Administration_Guide-Storage_Pools-Adding_Servers"/>.</para>
</listitem>
<listitem>
<para>Create the distributed replicated volume:</para>
<para><command># gluster volume create <replaceable>NEW-VOLNAME</replaceable> [replica <replaceable>COUNT</replaceable>] [transport tcp | rdma | tcp,rdma] <replaceable>NEW-BRICK...</replaceable></command></para>
<para>For example, four node distributed (replicated) volume with a two-way mirror:
</para>
<para><programlisting># gluster volume create test-volume replica 2 transport tcp server1:/exp1 server2:/exp2 server3:/exp3 server4:/exp4
Creation of test-volume has been successful
Please start the volume to access data.</programlisting></para>
<para>For example, to create a six node distributed (replicated) volume with a two-way mirror:</para>
<para><programlisting># gluster volume create test-volume replica 2 transport tcp server1:/exp1 server2:/exp2 server3:/exp3 server4:/exp4 server5:/exp5 server6:/exp6
Creation of test-volume has been successful
Please start the volume to access data.</programlisting></para>
<para>If the transport type is not specified, <emphasis role="italic"> tcp</emphasis> is used as the default. You can also set additional options if required, such as auth.allow or auth.reject. For more information, see <xref linkend="sect-Administration_Guide-Managing_Volumes-Tuning"/></para>
<para><note>
<para>Make sure you start your volumes before you try to mount them or else client operations after the mount will hang, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Starting"/> for details. </para>
</note></para>
</listitem>
</orderedlist>
</section>
<section id="sect-Administration_Guide-Setting_Volumes-Distributed_Striped_Replicated">
<title>Creating Distributed Striped Replicated Volumes </title>
<para>Distributed striped replicated volumes distributes striped data across replicated bricks in the cluster. For best results, you should use distributed striped replicated volumes in highly concurrent environments where parallel access of very large files and performance is critical. In this release, configuration of this volume type is supported only for Map Reduce workloads. </para>
<para><note>
<para>The number of bricks should be a multiples of number of stripe count and replica count for
a distributed striped replicated volume.
</para>
</note></para>
<para><emphasis role="bold">To create a distributed striped replicated volume</emphasis>
</para>
<orderedlist>
<listitem>
<para>Create a trusted storage pool as described earlier in <xref linkend="sect-Administration_Guide-Storage_Pools-Adding_Servers"/>.</para>
</listitem>
<listitem>
<para>Create a distributed striped replicated volume using the following command:</para>
<para><command># gluster volume create <replaceable>NEW-VOLNAME</replaceable> [stripe <replaceable>COUNT</replaceable>] [replica <replaceable>COUNT</replaceable>] [transport tcp | rdma | tcp,rdma] <replaceable>NEW-BRICK...</replaceable></command></para>
<para>For example, to create a distributed replicated striped volume across eight storage servers:
</para>
<para><programlisting># gluster volume create test-volume stripe 2 replica 2 transport tcp server1:/exp1 server2:/exp2 server3:/exp3 server4:/exp4 server5:/exp5 server6:/exp6 server7:/exp7 server8:/exp8
Creation of test-volume has been successful
Please start the volume to access data.</programlisting></para>
<para>If the transport type is not specified, <emphasis role="italic"> tcp</emphasis> is used as the default. You can also set additional options if required, such as auth.allow or auth.reject. For more information, see <xref linkend="sect-Administration_Guide-Managing_Volumes-Tuning"/></para>
<para><note>
<para>Make sure you start your volumes before you try to mount them or else client operations after the mount will hang, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Starting"/> for details. </para>
</note></para>
</listitem>
</orderedlist>
</section>
<section id="sect-Administration_Guide-Setting_Volumes-Striped_Replicated">
<title>Creating Striped Replicated Volumes </title>
<para>Striped replicated volumes stripes data across replicated bricks in the cluster. For best results, you should use striped replicated volumes in highly concurrent environments where there is parallel access of very large files and performance is critical. In this release, configuration of this volume type is supported only for Map Reduce workloads.</para>
<para><note>
<para>The number of bricks should be a multiple of the replicate count and stripe count for a
striped replicated volume.
</para>
</note></para>
<figure>
<title>Illustration of a Striped Replicated Volume</title>
<mediaobject>
<imageobject>
<imagedata fileref="images/Striped_Replicated_Volume.png"/>
</imageobject>
</mediaobject>
</figure>
<para><emphasis role="bold">To create a striped replicated volume</emphasis>
</para>
<orderedlist>
<listitem>
<para>Create a trusted storage pool consisting of the storage servers that will comprise the volume.</para>
<para>For more information, see <xref linkend="sect-Administration_Guide-Storage_Pools-Adding_Servers"/>.</para>
</listitem>
<listitem>
<para>Create a striped replicated volume :</para>
<para><command># gluster volume create <replaceable>NEW-VOLNAME</replaceable> [stripe <replaceable>COUNT</replaceable>] [replica <replaceable>COUNT</replaceable>] [transport tcp | rdma | tcp,rdma] <replaceable>NEW-BRICK...</replaceable></command></para>
<para>For example, to create a striped replicated volume across four storage servers:
</para>
<para><programlisting># gluster volume create test-volume stripe 2 replica 2 transport tcp server1:/exp1 server2:/exp2 server3:/exp3 server4:/exp4
Creation of test-volume has been successful
Please start the volume to access data.</programlisting></para>
<para>To create a striped replicated volume across six storage servers:
</para>
<para><programlisting># gluster volume create test-volume stripe 3 replica 2 transport tcp server1:/exp1 server2:/exp2 server3:/exp3 server4:/exp4 server5:/exp5 server6:/exp6
Creation of test-volume has been successful
Please start the volume to access data.</programlisting></para>
<para>If the transport type is not specified, <emphasis role="italic"> tcp</emphasis> is used as the default. You can also set additional options if required, such as auth.allow or auth.reject. For more information, see <xref linkend="sect-Administration_Guide-Managing_Volumes-Tuning"/></para>
<para><note>
<para>Make sure you start your volumes before you try to mount them or else client operations after the mount will hang, see <xref linkend="sect-Administration_Guide-Setting_Volumes-Starting"/> for details. </para>
</note></para>
</listitem>
</orderedlist>
</section>
<section id="sect-Administration_Guide-Setting_Volumes-Starting">
<title>Starting Volumes </title>
<para>You must start your volumes before you try to mount them. </para>
<para><emphasis role="bold">To start a volume </emphasis></para>
<itemizedlist>
<listitem>
<para>Start a volume:</para>
<para><command># gluster volume start <replaceable>VOLNAME</replaceable></command></para>
<para>For example, to start test-volume:</para>
<para><programlisting># gluster volume start test-volume
Starting test-volume has been successful</programlisting></para>
</listitem>
</itemizedlist>
</section>
</chapter>
|
