From 3e4d13f90710d03e28efbc578c82a465fcd486f8 Mon Sep 17 00:00:00 2001 From: Krutika Dhananjay Date: Mon, 17 Oct 2016 15:13:28 +0530 Subject: compound fops: Fix file corruption issue Backport of: http://review.gluster.org/#/c/15654/ 1. Address of a local variable @args is copied into state->req in server3_3_compound (). But even after the function has gone out of scope, in server_compound_resume () this pointer is accessed and dereferenced. This patch fixes that. 2. Compound fops, by virtue of NOT having a vector sizer (like the one writev has), ends up having both the header and the data (in case one of its member fops is WRITEV) in the same hdr_iobuf. This buffer was not being preserved through the lifetime of the compound fop, causing it to be overwritten by a parallel write fop, even when the writev associated with the currently executing compound fop is yet to hit the desk, thereby corrupting the file's data. This is fixed by associating the hdr_iobuf with the iobref so its memory remains valid through the lifetime of the fop. 3. Also fixed a use-after-free bug in protocol/client in compound fops cbk, missed by Linux but caught by NetBSD. Finally, big thanks to Pranith Kumar K and Raghavendra Gowdappa for their help in debugging this file corruption issue. Change-Id: I58da39ae544ad81192849926399a971c4c01c986 BUG: 1387984 Signed-off-by: Krutika Dhananjay Reviewed-on: http://review.gluster.org/15709 NetBSD-regression: NetBSD Build System Reviewed-by: Raghavendra G Smoke: Gluster Build System CentOS-regression: Gluster Build System --- tests/basic/afr/compounded-write-txns.t | 37 +++++++++++++++++++++++++++++++++ 1 file changed, 37 insertions(+) create mode 100644 tests/basic/afr/compounded-write-txns.t (limited to 'tests') diff --git a/tests/basic/afr/compounded-write-txns.t b/tests/basic/afr/compounded-write-txns.t new file mode 100644 index 00000000000..7cecd87b01b --- /dev/null +++ b/tests/basic/afr/compounded-write-txns.t @@ -0,0 +1,37 @@ +#!/bin/bash +. $(dirname $0)/../../include.rc +. $(dirname $0)/../../volume.rc + +cleanup + +TEST glusterd +TEST pidof glusterd +TEST $CLI volume create $V0 replica 3 $H0:$B0/${V0}{0,1,2} +TEST $CLI volume set $V0 write-behind off +TEST $CLI volume set $V0 client-io-threads off +TEST $CLI volume start $V0 +TEST $GFS --volfile-id=$V0 --volfile-server=$H0 $M0 + +# Create and generate data into a src file + +TEST `printf %1024s |tr " " "1" > /tmp/source` +TEST `printf %1024s |tr " " "2" >> /tmp/source` + +TEST dd if=/tmp/source of=$M0/file bs=1024 count=2 2>/dev/null +md5sum_file=$(md5sum $M0/file | awk '{print $1}') + +TEST $CLI volume set $V0 cluster.use-compound-fops on + +TEST dd if=$M0/file of=$M0/file-copy bs=1024 count=2 2>/dev/null + +EXPECT_WITHIN $UMOUNT_TIMEOUT "Y" force_umount $M0 +TEST $GFS --volfile-id=$V0 --volfile-server=$H0 $M0 + +EXPECT "$md5sum_file" echo `md5sum $M0/file-copy | awk '{print $1}'` + +EXPECT_WITHIN $UMOUNT_TIMEOUT "Y" force_umount $M0 +TEST $CLI volume stop $V0 +TEST $CLI volume delete $V0 + +TEST rm -f /tmp/source +cleanup -- cgit