glusterfs.git/events, branch v3.9rc1

events/dht: dht cli events

2016-09-16T01:40:15+00:00

Adding events for add/remove brick and rebalance
from the cli.

> Change-Id: I4e07cb7224e1b63a2926db055f87a02220c5d043
> BUG: 1371874
> Signed-off-by: N Balachandran 
> Reviewed-on: http://review.gluster.org/15500
> NetBSD-regression: NetBSD Build System 
> Smoke: Gluster Build System 
> CentOS-regression: Gluster Build System 
> Reviewed-by: Atin Mukherjee 
(cherry picked from commit 957e40060734f1a0b2d9e3d37c4b0f7961f56b51)

Change-Id: I207af253997adf1b2cbc49fd496fc96913fcdd15
BUG: 1376477
Signed-off-by: N Balachandran 
Reviewed-on: http://review.gluster.org/15512
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Atin Mukherjee

eventsapi: Add conditional import for requests library

2016-09-15T09:29:04+00:00

requests lib is used only during publishing event. gf_event python
imports utils.py, and indirectly imports requests lib even though
it is not required while sending event to eventsd.

Moved "import requests" inside the "plugin_webhook" function.

> Reviewed-on: http://review.gluster.org/15439
> Reviewed-by: Prashanth Pai 
> Smoke: Gluster Build System 
> NetBSD-regression: NetBSD Build System 
> Reviewed-by: Kotresh HR 
> CentOS-regression: Gluster Build System 

BUG: 1375537
Change-Id: Ie3c8088b43d4d7952d01352731999bf8519c73c4
Signed-off-by: Aravinda VK 
(cherry picked from commit aa742fd88e08eeb807dba1cb98402e8813ec6797)
Reviewed-on: http://review.gluster.org/15487
Smoke: Gluster Build System 
CentOS-regression: Gluster Build System 
NetBSD-regression: NetBSD Build System 
Reviewed-by: Atin Mukherjee

storage/posix: Integrate important events with gf_event

2016-09-15T04:18:56+00:00

        Backport of http://review.gluster.org/15342

BUG: 1375914
Change-Id: Icc23b22de02e45d2b0f8c6339ee628b439a4ffa8
Signed-off-by: Pranith Kumar K 
Reviewed-on: http://review.gluster.org/15497
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Ravishankar N

eventsapi: Add Init scripts for different distributions

2016-09-10T08:08:19+00:00

Added init scripts for
- SysvInit(CentOS 6 or Red Hat 6)
- rc.d (FreeBSD)

Most of the latest distributions are using systemd. Support to be
added for other distributions which are not using systemd.

Removed systemctl wrapper functions(start/stop/status) from
gluster-eventsapi CLI(peer_eventsapi.py). Status and Reload
re-implemented using pid file check.

Added pid file support for glustereventsd.

Following dependencies removed
python-flask - Only used for example dashboard. User can install
if required.
python-fasteners - Not available for EPEL 6, added custom code using
fcntl as replacement.

> Reviewed-on: http://review.gluster.org/15367
> Smoke: Gluster Build System 
> CentOS-regression: Gluster Build System 
> Reviewed-by: Niels de Vos 
> NetBSD-regression: NetBSD Build System 
> Reviewed-by: Kaleb KEITHLEY 

BUG: 1374649
Change-Id: I26792eae9b11e93304f70b3997cd7d8d03b067f4
Signed-off-by: Aravinda VK 
(cherry picked from commit 5a1abd235d05809bc7a5c4b94ae7bb51add6fc9c)
Reviewed-on: http://review.gluster.org/15453
NetBSD-regression: NetBSD Build System 
Smoke: Gluster Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Atin Mukherjee

cluster/tier: add tiering events

2016-09-09T05:48:51+00:00

Add events for:
* tier attach and detach
* tier pause and resume
* tier rising and dropping hi and lo watermarks

Update eventskeygen.py with tiering events.
Update cli help with:
* attach: add optional force argument
* detach: make force available as non-optional argument on its own

> Reviewed-on: http://review.gluster.org/15232
> Smoke: Gluster Build System 
> NetBSD-regression: NetBSD Build System 
> CentOS-regression: Gluster Build System 
> Reviewed-by: Dan Lambright 
> Tested-by: Dan Lambright 

(cherry picked from commit cd23242b8953040b231f402c334f16520ac8029f)

Change-Id: I43990d3a8742151a4a7889bafa19cb572fe661bd
BUG: 1374324
Signed-off-by: Milind Changire 
Reviewed-on: http://review.gluster.org/15431
Tested-by: Atin Mukherjee 
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Atin Mukherjee

cluster/ec: Add events for EC translator

2016-09-08T12:21:52+00:00

This patch will generates events in following
cases which will be consumed by new event
framework.

Consider an EC volume with (K+M) configuration
K = Data bricks
M = Redundancy bricks

1- EVENT_EC_MIN_BRICKS_NOT_UP -
   When minimum "K" number of bricks, required
   for any ec fop, are not up.
2- EVENT_EC_MIN_BRICKS_UP
   When minimum "K" number of bricks, required
   for any ec fop, are up.

>Change-Id: I0414b8968c39740a171e5aa14b087afd524d574f
>BUG: 1371470
>Signed-off-by: Ashish Pandey 
>Reviewed-on: http://review.gluster.org/15348
>Tested-by: Pranith Kumar Karampuri 
>NetBSD-regression: NetBSD Build System 
>CentOS-regression: Gluster Build System 
>Smoke: Gluster Build System 
>Reviewed-by: Pranith Kumar Karampuri 

Change-Id: I0414b8968c39740a171e5aa14b087afd524d574f
BUG: 1374167
Signed-off-by: Ashish Pandey 
Reviewed-on: http://review.gluster.org/15425
Smoke: Gluster Build System 
Reviewed-by: Pranith Kumar Karampuri 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System

event: fix gf_event messages for replace/reset brick op

2016-08-31T22:56:31+00:00

Change-Id: I80ebeeaffd2b228d7d0796c8d08bc2a051c4ccac
BUG: 1266876
Signed-off-by: Anuradha Talur 
Reviewed-on: http://review.gluster.org/15370
Smoke: Gluster Build System 
Reviewed-by: Atin Mukherjee 
CentOS-regression: Gluster Build System 
NetBSD-regression: NetBSD Build System 
Reviewed-by: Pranith Kumar Karampuri

eventsapi: declare all the identified events at one go

2016-08-31T11:19:35+00:00

This patch ensures we don't get into merge conflicts
everytime a single eventing patch is merged which
changes eventskeygen.py. I've collected all the identified
events from the patches posted in gerrit for reviews and
consolidated at one place.

Change-Id: I5a5983d5c8db7c4a223fa02b4f99ec41c6fa9c35
BUG: 1334044
Signed-off-by: Atin Mukherjee 
Reviewed-on: http://review.gluster.org/15351
Tested-by: Prasanna Kumar Kalever 
Reviewed-by: Avra Sengupta 
Smoke: Gluster Build System 
Reviewed-by: Aravinda VK 
Reviewed-by: Saravanakumar Arumugam 
CentOS-regression: Gluster Build System 
NetBSD-regression: NetBSD Build System

eventsapi: Add support for Client side Events

2016-08-31T01:34:59+00:00

Client side gf_event uses ctx->cmd_args.volfile_server to push
notifications to the eventsd.

Socket server changed from Unix domain socket to UDP to support
external events.

Following to be addressed in different patch
- Port used for eventsd is 24009. Make it configurable
  Already configurable in Server side. Configurable in gf_event API
  is required.
- Auth Token yet to be added as discussed in
  https://www.gluster.org/pipermail/gluster-devel/2016-August/050324.html

Change-Id: I159acf80b681d10b82d52cfb3ffdf85cb896542d
BUG: 1367774
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/15189
Smoke: Gluster Build System 
Reviewed-by: Prashanth Pai 
Reviewed-by: Atin Mukherjee 
CentOS-regression: Gluster Build System 
NetBSD-regression: NetBSD Build System

glusterd : Introduce reset brick

2016-08-30T02:55:53+00:00

The command basically allows replace brick with src and
dst bricks as same.

Usage:
gluster v reset-brick   start
This command kills the brick to be reset. Once this command is run,
admin can do other manual operations that they need to do,
like configuring some options for the brick. Once this is done,
resetting the brick can be continued with the following options.

gluster v reset-brick    commit {force}

Does the job of resetting the brick. 'force' option should be used
when the brick already contains volinfo id.

Problem: On doing a disk-replacement of a brick in a replicate volume
the following 2 scenarios may occur :

a) there is a chance that reads are served from this replaced-disk brick,
which leads to empty reads. b) potential data loss if next writes succeed
only on replaced brick, and heal is done to other bricks from this one.

Solution: After disk-replacement, make sure that reset-brick command is
run for that brick so that pending markers are set for the brick and it
is not chosen as source for reads and heal. But, as of now replace-brick
for the same brick-path is not allowed. In order to fix the above
mentioned problem, same brick-path replace-brick is needed.
With this patch reset-brick commit {force} will be allowed even when
source and destination  are identical as long as
1) destination brick is not alive
2) source and destination brick have the same brick uuid and path.
Also, the destination brick after replace-brick will use the same port
as the source brick.

Change-Id: I440b9e892ffb781ea4b8563688c3f85c7a7c89de
BUG: 1266876
Signed-off-by: Anuradha Talur 
Reviewed-on: http://review.gluster.org/12250
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Ashish Pandey 
Reviewed-by: Pranith Kumar Karampuri