glusterfs.git, branch release-3.8-fb scripts: Updated FB branch diff script to note SKIPs 2018-01-11T23:34:00+00:00 ShyamsundarR srangana@redhat.com 2017-12-07T20:09:00+00:00 e6dbc8bae21dd928d7fd5856fd92a7f48763a2b9 Skip table updated, to reflect commits that need not be forward ported to master. Change-Id: Id85fa2a27237a0ef15a7c97591fa3a696d7f836c Signed-off-by: ShyamsundarR <srangana@redhat.com> 
Skip table updated, to reflect commits that need not be
forward ported to master.

Change-Id: Id85fa2a27237a0ef15a7c97591fa3a696d7f836c
Signed-off-by: ShyamsundarR <srangana@redhat.com>
build: many rpm-build fixes 2017-12-20T17:40:19+00:00 Jeff Darcy jdarcy@fb.com 2017-12-05T21:06:02+00:00 21e9d065b779841cc161975ff2b66e8ce27dddbe Summary: Highlights include: * Fixed GF_CONF_OPTS (dev builds) and RPM_BUILD_FLAGS (rpm builds) * Fixed version in configure.ac * Fixed handling of files only present when BUILD_FB_EXTRAS is set * Fixed disable-georeplication (upstream bug) * Fixed disable-tiering (upstream bug) * Removed .service files which should be generated from .in versions * Fixed tirpc (previously fbtirpc) references * Fixed init_enable problems * Removed delay-gen references Test Plan: Use build.sh to build an RPM, and install it. Differential Revision: https://phabricator.intern.facebook.com/D6611299 Change-Id: If61a4964a149f782038ea47362a82b813e6b7738 Signed-off-by: Jeff Darcy <jdarcy@fb.com> 
Summary:
Highlights include:

 * Fixed GF_CONF_OPTS (dev builds) and RPM_BUILD_FLAGS (rpm builds)

 * Fixed version in configure.ac

 * Fixed handling of files only present when BUILD_FB_EXTRAS is set

 * Fixed disable-georeplication (upstream bug)

 * Fixed disable-tiering (upstream bug)

 * Removed .service files which should be generated from .in versions

 * Fixed tirpc (previously fbtirpc) references

 * Fixed init_enable problems

 * Removed delay-gen references

Test Plan: Use build.sh to build an RPM, and install it.

Differential Revision: https://phabricator.intern.facebook.com/D6611299

Change-Id: If61a4964a149f782038ea47362a82b813e6b7738
Signed-off-by: Jeff Darcy <jdarcy@fb.com>
build: merge our 3.6 and upstream 3.8 configure/specfile 2017-11-20T20:35:31+00:00 Jeff Darcy jdarcy@fb.com 2017-11-06T20:54:42+00:00 b8caf1e774a9d8f52a6c630d687313c94aaec3c0 Summary: They have a common ancestor at 3.6, but there were hundreds of lines of changes for each file on each side of the fork. In both cases the easiest method was to take the upstream 3.8 version and re-apply our own changes since we branched. Some changes were dropped (e.g. runit) and a few other files needed new changes (e.g. pkg-version) to keep up. Then there was more hacking to fix stealth geo-rep dependencies, enable tirpc/IPv6, and so on. Also added buildrpm38 and makerelease38. These should probably not go upstream, but not sure what else to do with them. Test Plan: Build RPMs. Install, create volumes, mount, do I/O. Reviewers: sshreyas, #posix_storage Reviewed By: sshreyas Subscribers: jbacik, aquevedo, scientist, sshreyas, calvinowens, jweiner Differential Revision: https://phabricator.intern.facebook.com/D6259797 Tasks: T20348589 Tags: posix-2017h2, gluster, posix_storage Change-Id: I2d43fc6f7f5603293e406c21e4ec85bf19610b77 Signature: 6259797:1510694123:fc5d2975fec134a51d4b70f7f983cd71971e175a 
Summary:
They have a common ancestor at 3.6, but there were hundreds of
lines of changes for each file on each side of the fork. In both
cases the easiest method was to take the upstream 3.8 version and
re-apply our own changes since we branched. Some changes were
dropped (e.g. runit) and a few other files needed new changes
(e.g. pkg-version) to keep up. Then there was more hacking to
fix stealth geo-rep dependencies, enable tirpc/IPv6, and so on.

Also added buildrpm38 and makerelease38.  These should probably
not go upstream, but not sure what else to do with them.

Test Plan: Build RPMs. Install, create volumes, mount, do I/O.

Reviewers: sshreyas, #posix_storage

Reviewed By: sshreyas

Subscribers: jbacik, aquevedo, scientist, sshreyas, calvinowens, jweiner

Differential Revision: https://phabricator.intern.facebook.com/D6259797

Tasks: T20348589

Tags: posix-2017h2, gluster, posix_storage

Change-Id: I2d43fc6f7f5603293e406c21e4ec85bf19610b77
Signature: 6259797:1510694123:fc5d2975fec134a51d4b70f7f983cd71971e175a
fb-remote-test: Put 50 odds tests back into the pool 2017-10-16T18:32:23+00:00 krad krad@fb.com 2017-10-16T05:42:58+00:00 c1a1472168ed626870a90b2ac3c7a408fd2b370e Summary: - Identify 50 odd tests that can pass with higher timeout and 3 attempts - sync fb-remote-test.sh with 3.6. - correspnding fix to .arcconfig Test Plan: Run --all manually Differential Revision: https://phabricator.intern.facebook.com/D6062906 Change-Id: I01157248eb6543d8a4c8dbccfb9961f46de43ebb 
Summary:
- Identify 50 odd tests that can pass with higher timeout and 3 attempts
- sync fb-remote-test.sh with 3.6.
- correspnding fix to .arcconfig

Test Plan: Run --all manually

Differential Revision: https://phabricator.intern.facebook.com/D6062906

Change-Id: I01157248eb6543d8a4c8dbccfb9961f46de43ebb
Added a patch tracker script to the branch 2017-10-03T13:43:07+00:00 ShyamsundarR srangana@redhat.com 2017-10-02T16:39:35+00:00 035a9b742d52d62b6a052399523e64f3ead37d22 The patch tracker script can be run fro within a cloned git workspace as, ./tools/branch-diff.py > output.md The output is in markdown format, and also serves as an easy import to (almost any) spreadsheet application for further processing. Intention is to generate the output from the tracker on a periodic basis and also update a web sheet for the community to pick up patches for porting/review. Change-Id: I10bdab3fd2120170272b0a57f11089eb1e4c30e3 Signed-off-by: ShyamsundarR <srangana@redhat.com> 
The patch tracker script can be run fro within a cloned
git workspace as,
./tools/branch-diff.py > output.md

The output is in markdown format, and also serves as an
easy import to (almost any) spreadsheet application for
further processing.

Intention is to generate the output from the tracker on a
periodic basis and also update a web sheet for the community
to pick up patches for porting/review.

Change-Id: I10bdab3fd2120170272b0a57f11089eb1e4c30e3
Signed-off-by: ShyamsundarR <srangana@redhat.com>
glusterd: fix missing/renamed options 2017-10-02T19:23:14+00:00 Jeff Darcy jdarcy@fb.com 2017-10-02T19:23:14+00:00 8de2ec1b8ddecc9ba01bd918b6b5c208561b22fe Change-Id: I2ca0298ee9d166f58b8730256ea76a04e547ce5d Signed-off-by: Jeff Darcy <jdarcy@fb.com> 
Change-Id: I2ca0298ee9d166f58b8730256ea76a04e547ce5d
Signed-off-by: Jeff Darcy <jdarcy@fb.com>
self-heal: fix automatic split-brain resolution options 2017-09-27T23:03:35+00:00 Jeff Darcy jdarcy@fb.com 2017-09-27T20:18:25+00:00 d9f9be442808ed13135f560698a2f95fe66282a5 Differential Revision: https://phabricator.intern.facebook.com/D5927193 Change-Id: Ife04c8738b9ee721e7be9bc843b2f6d54bbb468e 
Differential Revision: https://phabricator.intern.facebook.com/D5927193

Change-Id: Ife04c8738b9ee721e7be9bc843b2f6d54bbb468e
io-threads: re-port changes since 3.6 on top of FB version 2017-09-18T22:31:16+00:00 Jeff Darcy jdarcy@fb.com 2017-09-15T22:02:06+00:00 e3e7c56323a21467e7e0a0d8f2adc5b05ce40a54 Includes io-threads parts of the following patches: 9e3fea1 performance/io-threads: Exit all threads on PARENT_DOWN 2cfb7bc performance/io-threads: Exit threads in fini() as well Change-Id: Id7cc7720e75414fb8a3ac2db68a5fe63c459ffe2 Signed-off-by: Jeff Darcy <jdarcy@fb.com> 
Includes io-threads parts of the following patches:

  9e3fea1 performance/io-threads: Exit all threads on PARENT_DOWN
  2cfb7bc performance/io-threads: Exit threads in fini() as well

Change-Id: Id7cc7720e75414fb8a3ac2db68a5fe63c459ffe2
Signed-off-by: Jeff Darcy <jdarcy@fb.com>
io-stats: re-port changes since 3.6 on top of FB version 2017-09-15T21:16:04+00:00 Jeff Darcy jdarcy@fb.com 2017-09-15T19:04:16+00:00 6c6b3bc12bee9c3b6ccba292828e316a26216075 Includes io-stats parts of the following patches: 1e421a5 logging: Avoid re-initing log level in io-stats 0facb11 io-stats: Fix overwriting of client profile by the bricks 91004b0 debug/io-stats: Disable fop stats dump by default 62f9659 all: fix various cppcheck warnings e62c0fe build: export minimum symbols from xlators for correct resolution 1d0a0d1 core: use syscall wrappers instead of direct syscalls - tail 0773ca6 all: reduce "inline" usage 8a9328e build: do not #include "config.h" in each file 320455b io-stats: Fixing dereference after null check. 28397ca Avoid conflict between contrib/uuid and system uuid 49d6894 io-stats : null dereference coverity fix. Change-Id: If1bdad6244e5749c6d8c456e6c64b5c5b483e273 Signed-off-by: Jeff Darcy <jdarcy@fb.com> 
Includes io-stats parts of the following patches:

  1e421a5 logging: Avoid re-initing log level in io-stats
  0facb11 io-stats: Fix overwriting of client profile by the bricks
  91004b0 debug/io-stats: Disable fop stats dump by default
  62f9659 all: fix various cppcheck warnings
  e62c0fe build: export minimum symbols from xlators for correct resolution
  1d0a0d1 core: use syscall wrappers instead of direct syscalls - tail
  0773ca6 all: reduce "inline" usage
  8a9328e build: do not #include "config.h" in each file
  320455b io-stats: Fixing dereference after null check.
  28397ca Avoid conflict between contrib/uuid and system uuid
  49d6894 io-stats : null dereference coverity fix.

Change-Id: If1bdad6244e5749c6d8c456e6c64b5c5b483e273
Signed-off-by: Jeff Darcy <jdarcy@fb.com>
Replace namespace/io-stats/io-threads with 3.6-fb versions 2017-09-15T20:47:01+00:00 Jeff Darcy jdarcy@fb.com 2017-09-15T13:59:01+00:00 8dfdecf220d1c9365e1f8d6af9ead5e48c61e2eb This rolls up multiple patches related to namespace identificaton and throttling/QoS. This primarily includes the following, all by Michael Goulet <mgoulet@fb.com>. io-threads: Add weighted round robin queueing by namespace https://phabricator.facebook.com/D5615269 io-threads: Add per-namespaces queue sizes to IO_THREADS_QUEUE_SIZE_KEY https://phabricator.facebook.com/D5683162 io-threads: Implement better slot allocation algorithm https://phabricator.facebook.com/D5683186 io-threads: Only enable weighted queueing on bricks https://phabricator.facebook.com/D5700062 io-threads: Update queue sizes on drain https://phabricator.facebook.com/D5704832 Fix parsing (-1) as default NS weight https://phabricator.facebook.com/D5723383 Parts of the following patches have also been applied to satisfy dependencies. io-throttling: Calculate moving averages and throttle offending hosts https://phabricator.fb.com/D2516161 Shreyas Siravara <sshreyas@fb.com> Hook up ODS logging for FUSE clients. https://phabricator.facebook.com/D3963376 Kevin Vigor <kvigor@fb.com> Add the flag --skip-nfsd-start to skip the NFS daemon stating, even if it is enabled https://phabricator.facebook.com/D4575368 Alex Lorca <alexlorca@fb.com> There are also some "standard" changes: dealing with code that moved, reindenting to comply with Gluster coding standards, gf_uuid_xxx, etc. This patch *does* revert some changes which have occurred upstream since 3.6; these will be re-applied as apppropriate on top of this new base. Change-Id: I69024115da7a60811e5b86beae781d602bdb558d Signed-off-by: Jeff Darcy <jdarcy@fb.com> 
This rolls up multiple patches related to namespace identificaton and
throttling/QoS.  This primarily includes the following, all by Michael
Goulet <mgoulet@fb.com>.

  io-threads: Add weighted round robin queueing by namespace
  https://phabricator.facebook.com/D5615269

  io-threads: Add per-namespaces queue sizes to IO_THREADS_QUEUE_SIZE_KEY
  https://phabricator.facebook.com/D5683162

  io-threads: Implement better slot allocation algorithm
  https://phabricator.facebook.com/D5683186

  io-threads: Only enable weighted queueing on bricks
  https://phabricator.facebook.com/D5700062

  io-threads: Update queue sizes on drain
  https://phabricator.facebook.com/D5704832

  Fix parsing (-1) as default NS weight
  https://phabricator.facebook.com/D5723383

Parts of the following patches have also been applied to satisfy
dependencies.

  io-throttling: Calculate moving averages and throttle offending hosts
  https://phabricator.fb.com/D2516161
  Shreyas Siravara <sshreyas@fb.com>

  Hook up ODS logging for FUSE clients.
  https://phabricator.facebook.com/D3963376
  Kevin Vigor <kvigor@fb.com>

  Add the flag --skip-nfsd-start to skip the NFS daemon stating, even if
  it is enabled
  https://phabricator.facebook.com/D4575368
  Alex Lorca <alexlorca@fb.com>

There are also some "standard" changes: dealing with code that moved,
reindenting to comply with Gluster coding standards, gf_uuid_xxx, etc.

This patch *does* revert some changes which have occurred upstream since
3.6; these will be re-applied as apppropriate on top of this new base.

Change-Id: I69024115da7a60811e5b86beae781d602bdb558d
Signed-off-by: Jeff Darcy <jdarcy@fb.com>