glusterfs.git/events, branch release-3.9

eventsapi: JSON output and different error codes

2016-12-29T06:27:15+00:00

JSON outputs are added to all commands, use `--json` to
get JSON output.

Following error codes are added to differenciate between errors.
Any other Unknown errors will have return code 1

ERROR_SAME_CONFIG             = 2
ERROR_ALL_NODES_STATUS_NOT_OK = 3
ERROR_PARTIAL_SUCCESS         = 4
ERROR_WEBHOOK_ALREADY_EXISTS  = 5
ERROR_WEBHOOK_NOT_EXISTS      = 6
ERROR_INVALID_CONFIG          = 7
ERROR_WEBHOOK_SYNC_FAILED     = 8
ERROR_CONFIG_SYNC_FAILED      = 9

Also hidden `node-` commands in the help message.

> Reviewed-on: http://review.gluster.org/15867
> Smoke: Gluster Build System 
> Reviewed-by: Prashanth Pai 
> NetBSD-regression: NetBSD Build System 
> CentOS-regression: Gluster Build System 

BUG: 1400845
Change-Id: I962b5435c8a448b4573059da0eae42f3f93cc97e
Signed-off-by: Aravinda VK 
(cherry picked from commit da71bdcf82a8dc71a1170ad3f190702fa49d2838)
Reviewed-on: http://review.gluster.org/16008
Reviewed-by: Prashanth Pai 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Smoke: Gluster Build System

eventsapi: Push Messages to Webhooks in parallel

2016-12-07T12:23:33+00:00

With this patch, glustereventsd will maintain one thread per
webhook. If a webhook is slow, then all the events to that worker
will be delayed but it will not affect the other webhooks.

Note: Webhook in transit may get missed if glustereventsd reloads due to
new Webhook addition or due configuration changes.

>Reviewed-on: http://review.gluster.org/15966
>Smoke: Gluster Build System 
>Reviewed-by: Prashanth Pai 
>NetBSD-regression: NetBSD Build System 
>CentOS-regression: Gluster Build System 

BUG: 1401261
Change-Id: I2d11e01c7ac434355bc356ff75396252f51b339b
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/16021
Tested-by: Atin Mukherjee 
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Prashanth Pai

eventsapi: Auto reload Webhooks data when modified

2016-12-02T08:53:49+00:00

glustereventsd depends on reload signal to reload the
Webhooks configurations. But if reload signal missed, no
events will be sent to newly added Webhook.

Added auto reload based on webhooks file mtime. Before pushing
events to Webhooks, reloads webhooks configurations if previously
recorded mtime is different than current mtime.

> Reviewed-on: http://review.gluster.org/15731
> Reviewed-by: Prashanth Pai 
> Smoke: Gluster Build System 
> NetBSD-regression: NetBSD Build System 
> CentOS-regression: Gluster Build System 

BUG: 1399482
Change-Id: I83a41d6a52d8fa1d70e88294298f4a5c396d4158
Signed-off-by: Aravinda VK 
(cherry picked from commit b7ebffbda9ba784ccfae6d1a90766d5310cdaa15)
Reviewed-on: http://review.gluster.org/15963
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Prashanth Pai

glusterd: fix few events generation

2016-11-23T12:51:06+00:00

This patch does the following:
1. Generate PEER_REJECT event if the peer add request is from an unknown peer
during peer handshaking.
2. EVENT_COMPARE_FRIEND_VOLUME_FAILED should be generated based on status code,
not ret.
3. Add EVENT_BRICKPATH_RESOLVE_FAILED event in case glusterd fails to resolve
bricks, this is mainly at restore path.
4. Remove EVENT_BRICKS_START_FAILED event as we already have
EVENT_BRICK_START_FAILED

>Reviewed-on: http://review.gluster.org/15903
>Smoke: Gluster Build System 
>NetBSD-regression: NetBSD Build System 
>CentOS-regression: Gluster Build System 
>Reviewed-by: Samikshan Bairagya 

Change-Id: I90e5bc4a331166d0bb3554eb2ec9df2526837a1d
BUG: 1397705
Signed-off-by: Atin Mukherjee 
Reviewed-on: http://review.gluster.org/15912
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Samikshan Bairagya

events: add TIER_START and TIER_START_FORCE events

2016-10-26T05:11:54+00:00

Add TIER_START and TIER_START_FORCE events
Conditionally generate DETACH events as per user confirmation.

> Reviewed-on: http://review.gluster.org/15675
> Smoke: Gluster Build System 
> CentOS-regression: Gluster Build System 
> NetBSD-regression: NetBSD Build System 
> Reviewed-by: Dan Lambright 
(cherry picked from commit 8f8e23b0142a21779648802664db5b3d5253e4e0)

Change-Id: I205dc14884d707087edce42e8cf4208bd89d31dc
BUG: 1387981
Signed-off-by: Milind Changire 
Reviewed-on: http://review.gluster.org/15708
NetBSD-regression: NetBSD Build System 
Smoke: Gluster Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Aravinda VK

bitrot/cli: Add ondemand scrub event

2016-10-25T09:10:58+00:00

Following Bitrot Events are added

BITROT_SCRUB_ONDEMAND
{
     "nodeid": NODEID,
     "ts": TIMESTAMP,
     "event": EVENT_TYPE,
     "message": {
        "name": VOLUME_NAME,
     }
}

> Change-Id: I85e668e254e6f29c447ddb4ad2ce2fc04f98bf3c
> BUG: 1387864
> Signed-off-by: Kotresh HR 
> Reviewed-on: http://review.gluster.org/15700
> Smoke: Gluster Build System 
> NetBSD-regression: NetBSD Build System 
> CentOS-regression: Gluster Build System 
> Reviewed-by: Atin Mukherjee 

Change-Id: I85e668e254e6f29c447ddb4ad2ce2fc04f98bf3c
BUG: 1387964
Signed-off-by: Kotresh HR 
(cherry picked from commit 255cc64375abe2925c7da1e13e45018dad4462df)
Reviewed-on: http://review.gluster.org/15705
Smoke: Gluster Build System 
CentOS-regression: Gluster Build System 
NetBSD-regression: NetBSD Build System 
Reviewed-by: Aravinda VK

eventsapi: Auto convert Boolean and Int attributes

2016-10-20T10:22:43+00:00

Before publishing in JSON format, automatically convert the
attribute to "bool" or "int" if configured.

For example, instead of sending force="1", convert to bool and
send as force=True

{
    "event": "VOLUME_START",
    "name" : "gv1",
    "force": "1"
}

Convert to,

{
    "event": "VOLUME_START",
    "name" : "gv1",
    "force": true
}

> Reviewed-on: http://review.gluster.org/15574
> NetBSD-regression: NetBSD Build System 
> CentOS-regression: Gluster Build System 
> Reviewed-by: Prashanth Pai 
> Smoke: Gluster Build System 

BUG: 1387099
Change-Id: Iabc51fd61abc267a7c8dcf0aeac6b3c722d89649
Signed-off-by: Aravinda VK 
(cherry picked from commit a482645865af56b8d34a17430649c3c646f3d450)
Reviewed-on: http://review.gluster.org/15682
Smoke: Gluster Build System 
Reviewed-by: Prashanth Pai 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System

geo-rep/eventsapi: Additional Events

2016-10-20T06:50:24+00:00

Added following events
EVENT_GEOREP_ACTIVE
    {
        "nodeid": NODEID,
        "ts": TIMESTAMP,
        "event": "GEOREP_ACTIVE",
        "message": {
            "master_volume": MASTER_VOLUME_NAME,
            "slave_host": SLAVE_HOST,
            "slave_volume": SLAVE_VOLUME,
            "brick_path": BRICK_PATH
        }
    }

EVENT_GEOREP_PASSIVE
    {
        "nodeid": NODEID,
        "ts": TIMESTAMP,
        "event": "GEOREP_PASSIVE",
        "message": {
            "master_volume": MASTER_VOLUME_NAME,
            "slave_host": SLAVE_HOST,
            "slave_volume": SLAVE_VOLUME,
            "brick_path": BRICK_PATH
        }
    }
EVENT_GEOREP_CHECKPOINT_COMPLETED
    {
        "nodeid": NODEID,
        "ts": TIMESTAMP,
        "event": "GEOREP_ACTIVE",
        "message": {
            "master_volume": MASTER_VOLUME_NAME,
            "slave_host": SLAVE_HOST,
            "slave_volume": SLAVE_VOLUME,
            "brick_path": BRICK_PATH,
            "checkpoint_time": CHECKPOINT_TIME,
            "checkpoint_completion_time": CHECKPOINT_COMPLETION_TIME
        }
    }

> Reviewed-on: http://review.gluster.org/15630
> Smoke: Gluster Build System 
> NetBSD-regression: NetBSD Build System 
> CentOS-regression: Gluster Build System 
> Reviewed-by: Kotresh HR 
> Tested-by: Kotresh HR 

BUG: 1386178
Change-Id: I90716175868c59dd65c8d202e73e0ede90347b6a
Signed-off-by: Aravinda VK 
(cherry picked from commit 3830b48b6a46854d6597a36b6f2089ac1e486eb5)
Reviewed-on: http://review.gluster.org/15672
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Smoke: Gluster Build System 
Reviewed-by: Saravanakumar Arumugam

events/dht: dht cli events

2016-09-16T01:40:15+00:00

Adding events for add/remove brick and rebalance
from the cli.

> Change-Id: I4e07cb7224e1b63a2926db055f87a02220c5d043
> BUG: 1371874
> Signed-off-by: N Balachandran 
> Reviewed-on: http://review.gluster.org/15500
> NetBSD-regression: NetBSD Build System 
> Smoke: Gluster Build System 
> CentOS-regression: Gluster Build System 
> Reviewed-by: Atin Mukherjee 
(cherry picked from commit 957e40060734f1a0b2d9e3d37c4b0f7961f56b51)

Change-Id: I207af253997adf1b2cbc49fd496fc96913fcdd15
BUG: 1376477
Signed-off-by: N Balachandran 
Reviewed-on: http://review.gluster.org/15512
Smoke: Gluster Build System 
NetBSD-regression: NetBSD Build System 
CentOS-regression: Gluster Build System 
Reviewed-by: Atin Mukherjee

eventsapi: Add conditional import for requests library

2016-09-15T09:29:04+00:00

requests lib is used only during publishing event. gf_event python
imports utils.py, and indirectly imports requests lib even though
it is not required while sending event to eventsd.

Moved "import requests" inside the "plugin_webhook" function.

> Reviewed-on: http://review.gluster.org/15439
> Reviewed-by: Prashanth Pai 
> Smoke: Gluster Build System 
> NetBSD-regression: NetBSD Build System 
> Reviewed-by: Kotresh HR 
> CentOS-regression: Gluster Build System 

BUG: 1375537
Change-Id: Ie3c8088b43d4d7952d01352731999bf8519c73c4
Signed-off-by: Aravinda VK 
(cherry picked from commit aa742fd88e08eeb807dba1cb98402e8813ec6797)
Reviewed-on: http://review.gluster.org/15487
Smoke: Gluster Build System 
CentOS-regression: Gluster Build System 
NetBSD-regression: NetBSD Build System 
Reviewed-by: Atin Mukherjee