glusto-tests.git/tests/functional/snapshot, branch master

[Testfix] Fix I/O logic to use distinct file names

2020-07-31T10:49:07+00:00

Problem:
Testcases test_mount_snap_delete and test_restore_online_vol
were failing in the latest runs with the below traceback
```
Traceback (most recent call last):
  File "/usr/share/glustolibs/io/scripts/file_dir_ops.py", line 1246, in 
    rc = args.func(args)
  File "/usr/share/glustolibs/io/scripts/file_dir_ops.py", line 374, in create_files
    base_file_name, file_types)
  File "/usr/share/glustolibs/io/scripts/file_dir_ops.py", line 341, in _create_files
    ret = pool.map(lambda file_tuple: _create_file(*file_tuple), files)
  File "/usr/lib64/python3.6/multiprocessing/pool.py", line 266, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/usr/lib64/python3.6/multiprocessing/pool.py", line 644, in get
    raise self._value
  File "/usr/lib64/python3.6/multiprocessing/pool.py", line 119, in worker
    result = (True, func(*args, **kwds))
  File "/usr/lib64/python3.6/multiprocessing/pool.py", line 44, in mapstar
    return list(map(*args))
  File "/usr/share/glustolibs/io/scripts/file_dir_ops.py", line 341, in 
    ret = pool.map(lambda file_tuple: _create_file(*file_tuple), files)
  File "/usr/share/glustolibs/io/scripts/file_dir_ops.py", line 270, in _create_file
    with open(file_abs_path, "w+") as new_file:
FileExistsError: [Errno 17] File exists: '/mnt/testvol_distributed_glusterfs/file1.txt'
```
This was because I/O logic was trying to create 2 files with the same
name from 2 clients.

Fix:
Modify logic to use counters to create files with different names.

Change-Id: I2896736d28f6bd17435f941088fd634347e3f4fd
Signed-off-by: kshithijiyer

[Test] Start/Stop of snapd deamon on the cloned volume

2020-06-24T11:54:33+00:00

Test Cases in this module tests the
USS functionality of snapshots snapd
on cloned volume and validated snapshots
are present inside .snaps directory by
terminating snapd on one by one nodes
and validating .snaps directory is still accessible.

Change-Id: I98d48268e7c5c5952a7f0f544960203d8634b7ac
Signed-off-by: Sri Vignesh

[TestFix] Remove hot and cold bricks list on regular volumes

2020-06-24T09:00:20+00:00

For the non-tiered volume types, In few test cases while bringing
bricks offline, collecting both hot_tier_bricks and cold_tier_bricks
and it is not needed to collect hot and cold tier bricks.

Removing the hot and cold tiered bricks and collecting only bricks
of the particular volume as mentioned below.

Removing below section
```
bricks_to_bring_offline_dict = (select_bricks_to_bring_offline(
                self.mnode, self.volname))
bricks_to_bring_offline = list(filter(None, (
bricks_to_bring_offline_dict['hot_tier_bricks'] +
bricks_to_bring_offline_dict['cold_tier_bricks'] +
bricks_to_bring_offline_dict['volume_bricks'])))
```

Modifying as below for bringing bricks offline.
```
bricks_to_bring_offline = bricks_to_bring_offline_dict['volume_bricks']
```

Change-Id: Icb1dc4a79cf311b686d839f2c9390371e42142f7
Signed-off-by: Bala Konda Reddy M

[Testfix] Fix I/O of test_snap_delete_multiple

2020-06-22T14:46:41+00:00

Problem:
test_snap_delete_multiple fails on I/O validation across all automation
runs constantly with the below trace back:
Traceback (most recent call last):
  File "/usr/share/glustolibs/io/scripts/file_dir_ops.py", line 1246, in 
    rc = args.func(args)
  File "/usr/share/glustolibs/io/scripts/file_dir_ops.py", line 374, in create_files
    base_file_name, file_types)
  File "/usr/share/glustolibs/io/scripts/file_dir_ops.py", line 341, in _create_files
    ret = pool.map(lambda file_tuple: _create_file(*file_tuple), files)
  File "/usr/lib64/python2.7/multiprocessing/pool.py", line 250, in map
    return self.map_async(func, iterable, chunksize).get()
  File "/usr/lib64/python2.7/multiprocessing/pool.py", line 554, in get
    raise self._value
IOError: [Errno 17] File exists: '/mnt/testvol_distributed_glusterfs/testfile42.txt'

Fix:
Change the I/O to use --base-file-name parameter when running the I/O
scripts.

Change-Id: Ic5a8222f4fafeac4ac9aadc9c4d23327711ed9f0
Signed-off-by: kshithijiyer

[Test] Validate USS after snapshot restore

2020-05-18T12:22:49+00:00

When a snapshot is restored, that snapshot gets removed.

USS makes use of a '.snaps' directory in the mount point
where all the activated snapshots can be listed.
So the restored snapshot should not be listed under the
'.snaps' directory regardless of it being activated or
deactivated.

Steps:
* Perform I/O on mounts
* Enable USS on volume
* Validate USS is enabled
* Create a snapshot
* Activate the snapshot
* Perform some more I/O
* Create another snapshot
* Activate the second
* Restore volume to the second snapshot
* From mount point validate under .snaps
  - first snapshot should be listed
  - second snapshot should not be listed

Change-Id: I5630d8aad6b4758d49e8d4f53497073c78a00a6b
Co-authored-by: Sunny Kumar 
Signed-off-by: Sunny Kumar 
Signed-off-by: Vinayak Papnoi

[Testfix] Move test from teardown class to teardown

2020-05-15T13:47:51+00:00

Move cases from teardown class to teardown in snapshot

Change-Id: I7b33fa2728665fad000a5ad881f6690d40913f22
Signed-off-by: Sri Vignesh

[testfix] Add sleep in snapshot failures

2020-03-12T10:14:02+00:00

Add sleep in test_snap_delete_original_volume.py
after cloning a volume added sleep and then starting
the volume. Changed io to write in one mount point
otherwise seeing issues with validate io.
removed baseclass cleanup because original volume is
already cleaned up in testcase.

Change-Id: I7bf9686384e238e1afe8491013a3058865343eee
Signed-off-by: Sri Vignesh

[Testfix] Remove python version dependency(Part 5)

2020-03-09T08:19:07+00:00

Please refer to commit message of patch [1].

[1] https://review.gluster.org/#/c/glusto-tests/+/24140/

Change-Id: I5319ce497ca3359e0e7dbd9ece481bada1ee2205
Signed-off-by: kshithijiyer

[testfix] Add steps to stabilize contents in snapshot - part2

2020-02-18T05:47:13+00:00

used library functions to wait for glusterd to start
and wait for peer to connect and made modifications in teardown part
to rectified statements to correct values

Change-Id: I40b4362ae1491acf75681c7623c16c53213bb1b9
Signed-off-by: Sri Vignesh

[testfix] Fix name used for snapshot creation

2020-01-29T12:33:44+00:00

There can be a case where due to a failed tearDown of a previous
test case, the snapshot creation might fail because of redundant
snapshot of the same name present.

This fix includes the changed snapshot names along with tearDown
for deleting the snapshots created in the test case
"test_snap_info_glusterd_restart.py".

Changing the names of the test case function to something
relevant to the test case.
Making use of the method "wait_for_glusterd_to_start" in places
where glusterd is restarted.

Change-Id: I6cb50dc84d306194b6bd363daf7ae0ebd6bb12ee
Signed-off-by: Vinayak Papnoi