diff options
author | Susant Palai <spalai@redhat.com> | 2017-11-26 11:49:48 +0530 |
---|---|---|
committer | Niels de Vos <ndevos@redhat.com> | 2018-01-18 08:50:30 +0000 |
commit | ee1c8b52721ce815bc98fd60a6b0e867848c8d79 (patch) | |
tree | d6c4bb262293292e399f5107d9dfa68099584f55 /accepted | |
parent | ee5fab234b0a9d317f7ec7cb7eb05c2d1172e94e (diff) |
cloudArchival: Added feature page and design document
Change-Id: Iff9025dc28ae1b12213b564903b03001251e8aff
Signed-off-by: Susant Palai <spalai@redhat.com>
Reviewed-on: https://review.gluster.org/18854
Reviewed-by: Ashish Pandey <aspandey@redhat.com>
Reviewed-by: Amar Tumballi <amarts@redhat.com>
Tested-by: Amar Tumballi <amarts@redhat.com>
Reviewed-by: Niels de Vos <ndevos@redhat.com>
Diffstat (limited to 'accepted')
-rw-r--r-- | accepted/CloudArchival.md | 84 |
1 files changed, 84 insertions, 0 deletions
diff --git a/accepted/CloudArchival.md b/accepted/CloudArchival.md new file mode 100644 index 0000000..ed25fea --- /dev/null +++ b/accepted/CloudArchival.md @@ -0,0 +1,84 @@ +# CloudArchival + +### Goal + +A new Cloud archival story for Glusterfs. + +### Summary +The feature will archive cold data to cloud storage. Applications where majority +of the data are not accessed/modified frequently can be archived to low-cost +cloud storage. And the local storage system(Glusterfs) space can be used for +files that needs high performance operations + +### Owners + +Aravinda Krishna Murthy <avishwan@redhat.com> + +Susant Kumar Palai <spalai@redhat.com> + +### Current Status Feature under development + +### Detailed Description + +A scanner/uploader tool will run a policy (tunable) based scan and will upload +files to the cloud storage. Post migration of data to cloud, downloader xlator +will truncate the file and store the size information as xattr. Any meta-data +operation will be served locally from glusterfs till the next data modification +request. On a data modification, the request will be stubbed and downloader +will download the file from cloud. Upon success, the stubbed request will be +resumed. + + +### Benefits to GlusterFS +This archival feature will be of immense benifit to users where majority of +their data in the storage system are cold. With this, users can leverage the +in house Glusterfs space for high performance jobs. + +### Scope + +### Nature of proposed change + +- An uploader tool - Role is to scan the file system and upload file to cloud + based on a user-defined policy. + +- Downloader xlator - This xlator will intercept data modification request on a + file which resides in cloud. A download operation will be initiated, post + which the data modification request will be resumed. + +### Implications on manageability +At a high level, command to enable, configure downloader xlator. + +### Implications on presentation layer +N/A + +### Implications on persistence layer +N/A + +### Implications on 'GlusterFS' backend +None + +### Modification to GlusterFS metadata +Post archival, a size xattr will be set on the file to serve meta-data requests +as the file would have been truncated + +### Implications on 'glusterd' +Volgen must be able to configure the downloader xlator and store information +related cloud provider and access. + +### How to Test + +N/A + +### User Experience +Minimal change, mostly related to new options. Some latency will be experienced +while the flie is getting downloaded from cloud during data modification. + +### Dependencies N/A + +### Documentation TBD. + +### Status + +Patches being worked on : + +- https://review.gluster.org/#/c/18532/ (Downloader Xlator) |