glusterfs.git/geo-replication/syncdaemon/resource.py, branch v3.5.0beta2

gsyncd / geo-rep: geo-replication fixes

2014-01-27T17:43:19+00:00

-> "threaded" hybrid crawl.
-> Enabling metatadata synchronization.
-> Handling EINVAL/ESTALE gracefully while syncing metadata.
-> Improvments to changelog crawl code.
-> Initial crawl changelog generation format.
-> No gsyncd restart when checkpoint updated.
-> Fix symlink handling in hybrid crawl.
-> Slave's xtime key is 'stime'.
-> tar+ssh as data synchronization.
-> Instead of 'raise', just log in warning level for xtime missing cases.
-> Fix for JSON object load failure
-> Get new config value after config value reset.
-> Skip already processed changelogs.
-> Saving status of each individual worker thread.
-> GFID fetch on slave for purges.
-> Add tar ssh keys and config options.
-> Fix nlink count when using backend.
-> Include "data" operation for hardlink.
-> Use changelog time prefix as slave's time.
-> Process changelogs in parallel.

Change-Id: I09fcbb2e2e418149a6d8435abd2ac6b2f015bb06
BUG: 1036539
Signed-off-by: Ajeet Jha 
Reviewed-on: http://review.gluster.org/6404
Tested-by: Gluster Build System 
Reviewed-by: Anand Avati 
Reviewed-on: http://review.gluster.org/6809
Reviewed-by: Vijay Bellur

geo-replication: treat MKNOD also as regular file create

2013-09-20T18:46:48+00:00

Change-Id: Iec04f642282b554a4d1b5f5c8cdc099fd001b3f4
Original-Author: Venky Shankar 
Signed-off-by: Amar Tumballi 
BUG: 847839
Reviewed-on: http://review.gluster.org/5949
Reviewed-by: Venky Shankar 
Tested-by: Gluster Build System

geo-rep: retry in case of ENOENT errors in entry creations

2013-09-17T10:42:19+00:00

Change-Id: I8961633a7371c941a3feee44c949d5c934eca998
Original-Author: Venky Shankar 
Signed-off-by: Amar Tumballi 
BUG: 847839
Reviewed-on: http://review.gluster.org/5933
Reviewed-by: Venky Shankar 
Tested-by: Venky Shankar

gsyncd / geo-rep: use the correct virtual xattr to collect 'gfid'

2013-09-05T09:33:34+00:00

Change-Id: Ifea32ad1b2695f1668428fae6b263014bf320b70
BUG: 996379
Signed-off-by: Venky Shankar 
Reviewed-on: http://review.gluster.org/5589
Tested-by: Gluster Build System 
Reviewed-by: Amar Tumballi

gsyncd / geo-rep: Fix "regular file" overloading link()

2013-09-05T03:55:33+00:00

... missing entry2pb() call before going ahead with create.

Change-Id: I48de4df3f0ea6c789c9eeb10cd332ab461f3c868
BUG: 1003805
Signed-off-by: Venky Shankar 
Reviewed-by: Amar Tumballi 
Tested-by: Amar Tumballi 
Reviewed-on: http://review.gluster.org/5760
Tested-by: Gluster Build System 
Reviewed-by: Avra Sengupta 
Tested-by: Avra Sengupta 
Reviewed-by: Anand Avati

gsyncd / geo-rep: fix hardlink creation on slave

2013-09-05T03:54:21+00:00

Change-Id: I20fbd518bf519cbf2362b97aeb8be7c3b105087a
BUG: 1003805
Signed-off-by: Venky Shankar 
Reviewed-by: Amar Tumballi 
Tested-by: Amar Tumballi 
Reviewed-on: http://review.gluster.org/5757
Tested-by: Gluster Build System 
Reviewed-by: Avra Sengupta 
Tested-by: Avra Sengupta 
Reviewed-by: Anand Avati

gsyncd / geo-rep: fix "regular file" overloading rename

2013-09-05T03:49:50+00:00

entry operation on the slave was using source parent gfid
and basename when renames are overloaded to use regular file
creation. This patch fixes the issue by using the destination
parent gfid and basename for these cases.

Change-Id: I1a4e8df7f07905224ce44ef5abd6f180234285ab
BUG: 1003800
Tested-by: Amar Tumballi 
Signed-off-by: Venky Shankar 
Reviewed-on: http://review.gluster.org/5754
Tested-by: Gluster Build System 
Reviewed-by: Avra Sengupta 
Tested-by: Avra Sengupta 
Reviewed-by: Anand Avati

gsyncd / geo-rep: Introduce basic crawl instrumentation

2013-09-05T02:50:09+00:00

This patch extends the persistent instrumentation work done by
Aravinda (@avishwa), by introducing a handfull of instrumentation
variables for crawl. These variables are "pulled up" by glusterd
in the event of a geo-replication status cli command and looks
something like below:

"Uptime=00:21:10;FilesSyned=2982;FilesPending=0;BytesPending=0;DeletesPending=0;"

"FilesPending", "BytesPending" and "DeletesPending" are short-lived
variables that are non-zero when a changelog is being processes (ie.
when an active sync in ongoing). After a successfull changelog process
"FilesPending" is summed up into "FilesSynced". The three short-lived
variabled are then reset to zero and the data is persisted

Additionally this patch also reverts some of the changes made for
BZ #986929 (those were not needed).

Change-Id: I948f1a0884ca71bc5e5bcfdc017d16c8c54fc30b
BUG: 990420
Signed-off-by: Venky Shankar 
Reviewed-on: http://review.gluster.org/5441
Tested-by: Gluster Build System 
Reviewed-by: Anand Avati

gsyncd / geo-rep: periodically set slave xtime on slave

2013-09-05T02:48:49+00:00

setting the slave xtime on the slave (after each changelog/xsync)
crawl helps in two things:
  * effective recover of master (failover/failback)
  * cascading setup - instances when the session from intermediate
                      master session is stopped, data is put on
                      the master -> slave sesssion and then the
                      cascading session is started again.

Change-Id: Ifae10a6ac09dc0d17707c3b5a3090bcf1efec8b6
BUG: 990900
Signed-off-by: Venky Shankar 
Reviewed-on: http://review.gluster.org/5451
Tested-by: Gluster Build System 
Reviewed-by: Avra Sengupta 
Tested-by: Avra Sengupta 
Reviewed-by: Anand Avati

glusterd: Saving geo-rep session details in a more specific path

2013-09-05T02:27:19+00:00

Now saving the session details in
/var/lib/glusterd/geo-replication/__
repo to distinguish between two master-slave sessions where the
slavename is same across two different clusters.

Change-Id: I57c93f55cc9bd4fe2bffe579028aaf5e4335b223
BUG: 991501
Signed-off-by: Avra Sengupta 
Signed-off-by: Venky Shankar 
Reviewed-on: http://review.gluster.org/5488
Tested-by: Gluster Build System 
Reviewed-by: Anand Avati