[Checkins] [zopefoundation/ZEO] ec370c: Fixed: the ZEO cache loadBefore method failed to u...

Fri Jun 17 16:24:04 CEST 2016

  Branch: refs/heads/asyncio
  Home:   https://github.com/zopefoundation/ZEO
  Commit: ec370c85daf5e2b63c056ad8b23b54142efb9b3c
      https://github.com/zopefoundation/ZEO/commit/ec370c85daf5e2b63c056ad8b23b54142efb9b3c
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-06 (Mon, 06 Jun 2016)

  Changed paths:
    M src/ZEO/cache.py
    M src/ZEO/tests/test_cache.py

  Log Message:
  -----------
  Fixed: the ZEO cache loadBefore method failed to utilize current data.

  Commit: c5e6574083ee9eb66bc9b547c89e5ec797fe18d0
      https://github.com/zopefoundation/ZEO/commit/c5e6574083ee9eb66bc9b547c89e5ec797fe18d0
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-06 (Mon, 06 Jun 2016)

  Changed paths:
    M CHANGES.rst
    M src/ZEO/ClientStorage.py
    M src/ZEO/zrpc/connection.py

  Log Message:
  -----------
  Changed loadBefore to operate more like load behaved, especially
  with regard to the load lock.  This allowes ZEO to work with the
  upcoming ZODB 5, which used loadbefore rather than load.

  Reimplemented load using loadBefore, this testing loadBefore
  extensively via existing tests.

  Commit: e5141646066895ee726d75c31b30a47aabc07d7d
      https://github.com/zopefoundation/ZEO/commit/e5141646066895ee726d75c31b30a47aabc07d7d
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-06 (Mon, 06 Jun 2016)

  Changed paths:
    M CHANGES.rst

  Log Message:
  -----------
  typo

  Commit: 14adf5ab79624297f72b9fb9604a3c3ec17fcf91
      https://github.com/zopefoundation/ZEO/commit/14adf5ab79624297f72b9fb9604a3c3ec17fcf91
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-06 (Mon, 06 Jun 2016)

  Changed paths:
    M src/ZEO/ClientStorage.py

  Log Message:
  -----------
  Fixed, _load_oid wasn't cleared if loadBefore returned None.

  Commit: 0bde3265f2a1917bf8c6dadd697f6885c208aacd
      https://github.com/zopefoundation/ZEO/commit/0bde3265f2a1917bf8c6dadd697f6885c208aacd
  Author: Jim Fulton <jim at jimfulton.info>
  Date:   2016-06-07 (Tue, 07 Jun 2016)

  Changed paths:
    M CHANGES.rst
    M src/ZEO/ClientStorage.py
    M src/ZEO/cache.py
    M src/ZEO/tests/test_cache.py
    M src/ZEO/zrpc/connection.py

  Log Message:
  -----------
  Merge pull request #23 from zopefoundation/load-uses-loadBefore

Load uses load before

  Commit: c98c1d796f1f2e9763d326501cbb56912b07a92d
      https://github.com/zopefoundation/ZEO/commit/c98c1d796f1f2e9763d326501cbb56912b07a92d
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-07 (Tue, 07 Jun 2016)

  Changed paths:
    M src/ZEO/zrpc/client.py

  Log Message:
  -----------
  Fix #22

  Commit: 8f39958fd800ebbeb7ce041dda7ca822e07563ae
      https://github.com/zopefoundation/ZEO/commit/8f39958fd800ebbeb7ce041dda7ca822e07563ae
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-07 (Tue, 07 Jun 2016)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  traviiiiiiiiis

  Commit: 2e63eb474eaf4e6daf140000e7b1a5e4e9a0b7d1
      https://github.com/zopefoundation/ZEO/commit/2e63eb474eaf4e6daf140000e7b1a5e4e9a0b7d1
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-07 (Tue, 07 Jun 2016)

  Changed paths:
    M src/ZEO/tests/testZEO.py

  Log Message:
  -----------
  Make client_asyncore_thread_has_name less brittle.

  Commit: 6d6537c6282de403545cb61623aec1cb51442478
      https://github.com/zopefoundation/ZEO/commit/6d6537c6282de403545cb61623aec1cb51442478
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-07 (Tue, 07 Jun 2016)

  Changed paths:
    M src/ZEO/tests/ConnectionTests.py

  Log Message:
  -----------
  got rid of an unnecessary wait_until

that was making a test failure hard to interpret.

  Commit: ec718f5a57599b7b8aa33b94804aceecefe6d2f9
      https://github.com/zopefoundation/ZEO/commit/ec718f5a57599b7b8aa33b94804aceecefe6d2f9
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-07 (Tue, 07 Jun 2016)

  Changed paths:
    M src/ZEO/tests/ConnectionTests.py

  Log Message:
  -----------
  Fixed insideous test failure

A test was counting on a cache being written to, but it wasn't because
the storage got an invalidation later than expected (on suitably slow
machines, like travis and an AWS dev machine of mine).

  Commit: 8e715a86c68771d96f3ae4dcbe7b830412de9f67
      https://github.com/zopefoundation/ZEO/commit/8e715a86c68771d96f3ae4dcbe7b830412de9f67
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-08 (Wed, 08 Jun 2016)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  flail at osx travis support

  Commit: f66e1f6c14e333fc9274a0514eeb7de9ff34952f
      https://github.com/zopefoundation/ZEO/commit/f66e1f6c14e333fc9274a0514eeb7de9ff34952f
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-08 (Wed, 08 Jun 2016)

  Changed paths:
    M src/ZEO/tests/ConnectionTests.py

  Log Message:
  -----------
  Merge branch 'fix22' of github.com:zopefoundation/ZEO into fix22

  Commit: 283f6f54240a81f6853f196f53aa42a1cc835078
      https://github.com/zopefoundation/ZEO/commit/283f6f54240a81f6853f196f53aa42a1cc835078
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-08 (Wed, 08 Jun 2016)

  Changed paths:
    M src/ZEO/zrpc/server.py

  Log Message:
  -----------
  If bind fails, presumably because address already in use, retry

traviiiiiiiiis

  Commit: 2e176d80aab74947cbf869a95b7fbc8ca822a44a
      https://github.com/zopefoundation/ZEO/commit/2e176d80aab74947cbf869a95b7fbc8ca822a44a
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-08 (Wed, 08 Jun 2016)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  revert osx support

  Commit: 17c463255544e8fc6f94cbe41ceb76851ba28b5c
      https://github.com/zopefoundation/ZEO/commit/17c463255544e8fc6f94cbe41ceb76851ba28b5c
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-08 (Wed, 08 Jun 2016)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  reverting addition of osx didn't help

Adding osx back.

Also adding back -j99, in hopes of getting quicker runs and making
travis nor hate us so much.  But then, we'll probably get more
failures. Maybe the best option will be to just make test pass even
when starved. :(

  Commit: dfc334a059151cc99a4beeec24ccb918a9e4e4a3
      https://github.com/zopefoundation/ZEO/commit/dfc334a059151cc99a4beeec24ccb918a9e4e4a3
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-08 (Wed, 08 Jun 2016)

  Changed paths:
    M src/ZEO/zrpc/server.py

  Log Message:
  -----------
  fixed copy-paste error I should have tested locally before giving to travis

  Commit: 01294186b8c4778083b9b8317dd7a4a9bfa56da7
      https://github.com/zopefoundation/ZEO/commit/01294186b8c4778083b9b8317dd7a4a9bfa56da7
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-08 (Wed, 08 Jun 2016)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  pypy3 is a no-no for ZEO until Python 3.3

  Commit: 9ad706320a11e6b884650c161441e0c03ad4cc26
      https://github.com/zopefoundation/ZEO/commit/9ad706320a11e6b884650c161441e0c03ad4cc26
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-08 (Wed, 08 Jun 2016)

  Changed paths:
    M src/ZEO/tests/forker.py

  Log Message:
  -----------
  wait much longer for servers to start cuz address already in use

  Commit: 6d05cc16d55840b3230db5fe3d6de9d124084f89
      https://github.com/zopefoundation/ZEO/commit/6d05cc16d55840b3230db5fe3d6de9d124084f89
  Author: Jim Fulton <jim at jimfulton.info>
  Date:   2016-06-09 (Thu, 09 Jun 2016)

  Changed paths:
    M .travis.yml
    M src/ZEO/tests/ConnectionTests.py
    M src/ZEO/tests/forker.py
    M src/ZEO/tests/testZEO.py
    M src/ZEO/zrpc/client.py
    M src/ZEO/zrpc/server.py

  Log Message:
  -----------
  Merge pull request #24 from zopefoundation/fix22

Fix #22

  Commit: e63c72758b643fc921724507a70b710a82b23212
      https://github.com/zopefoundation/ZEO/commit/e63c72758b643fc921724507a70b710a82b23212
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-09 (Thu, 09 Jun 2016)

  Changed paths:
    M src/ZEO/ClientStorage.py

  Log Message:
  -----------
  Fixed: cache lastTid wasn't set when doing full verification

  Commit: d957ff3e02e8f74b761ff1139bbac31f3b220061
      https://github.com/zopefoundation/ZEO/commit/d957ff3e02e8f74b761ff1139bbac31f3b220061
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-09 (Thu, 09 Jun 2016)

  Changed paths:
    M src/ZEO/tests/testZEO.py

  Log Message:
  -----------
  added a connection close

To avoid an error on tearDown.

  Commit: 20f81caa953a81c8e3a90d9b77a54a99d9113463
      https://github.com/zopefoundation/ZEO/commit/20f81caa953a81c8e3a90d9b77a54a99d9113463
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-09 (Thu, 09 Jun 2016)

  Changed paths:
    M src/ZEO/ClientStorage.py

  Log Message:
  -----------
  require the storage lock in lastTransaction.

This is required (or maybe strongly implied) by the IStorage interface.

Also, rearrange the order of operations in _process_invalidations.

Each of these changes avoid a potential race when a connection starts
a transaction while invalidateTransaction is being called. Basically,
we don't want a connection to get a lastTransaction corresponding to
invalidations it hasn't processed.

This neither fixes nor provokes any test failures. :) The need for
this change was discovered via code inspection. It's hard to see how
to test the race without getting being insanely whitebox.

  Commit: b793437a4f63aaf634d685539a3ac32895e7c728
      https://github.com/zopefoundation/ZEO/commit/b793437a4f63aaf634d685539a3ac32895e7c728
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-15 (Wed, 15 Jun 2016)

  Changed paths:
    M src/ZEO/ClientStorage.py

  Log Message:
  -----------
  remove a race when checking whether we need to update the cache tid after verification.

  Commit: 2952501bda3dffe98043bc7b4bda82a717312658
      https://github.com/zopefoundation/ZEO/commit/2952501bda3dffe98043bc7b4bda82a717312658
  Author: Jim Fulton <jim at jimfulton.info>
  Date:   2016-06-15 (Wed, 15 Jun 2016)

  Changed paths:
    M src/ZEO/ClientStorage.py
    M src/ZEO/tests/testZEO.py

  Log Message:
  -----------
  Merge pull request #25 from zopefoundation/zodb5

Zodb5

  Commit: 11b3091394e92fa769967c107446caf14ee385bf
      https://github.com/zopefoundation/ZEO/commit/11b3091394e92fa769967c107446caf14ee385bf
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-15 (Wed, 15 Jun 2016)

  Changed paths:
    M src/ZEO/tests/IterationTests.py
    M src/ZEO/tests/testZEO.py

  Log Message:
  -----------
  Changed tests to not depend on ZODB underware

  Commit: e6b136a4ad64cae0d7af5a826279c6ecb2d450d2
      https://github.com/zopefoundation/ZEO/commit/e6b136a4ad64cae0d7af5a826279c6ecb2d450d2
  Author: Jim Fulton <jim at jimfulton.info>
  Date:   2016-06-15 (Wed, 15 Jun 2016)

  Changed paths:
    M src/ZEO/tests/IterationTests.py
    M src/ZEO/tests/testZEO.py

  Log Message:
  -----------
  Merge pull request #26 from zopefoundation/zodb5

Changed tests to not depend on ZODB underware

  Commit: 7a1a3804f103550be7050e46f45e797836fd2439
      https://github.com/zopefoundation/ZEO/commit/7a1a3804f103550be7050e46f45e797836fd2439
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-15 (Wed, 15 Jun 2016)

  Changed paths:
    M CHANGES.rst
    M setup.py

  Log Message:
  -----------
  4.2.0

  Commit: 2f6919671e1299aab9edda7ae54573b728c58d5c
      https://github.com/zopefoundation/ZEO/commit/2f6919671e1299aab9edda7ae54573b728c58d5c
  Author: Tres Seaver <tseaver at palladion.com>
  Date:   2016-06-16 (Thu, 16 Jun 2016)

  Changed paths:
    M src/ZEO/ClientStorage.py

  Log Message:
  -----------
  Close opened-file leak in blob cache size check.

Closes #27.

  Commit: a7a5fab75ac6f8ef09d4948961176ee71669a676
      https://github.com/zopefoundation/ZEO/commit/a7a5fab75ac6f8ef09d4948961176ee71669a676
  Author: Jim Fulton <jim at jimfulton.info>
  Date:   2016-06-16 (Thu, 16 Jun 2016)

  Changed paths:
    M src/ZEO/ClientStorage.py

  Log Message:
  -----------
  Merge pull request #28 from zopefoundation/27-fix_file_leak

Close opened-file leak in blob cache size check.

  Commit: dcbeab41af6d8f3486b8c8aa56634133a3fe27ae
      https://github.com/zopefoundation/ZEO/commit/dcbeab41af6d8f3486b8c8aa56634133a3fe27ae
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-17 (Fri, 17 Jun 2016)

  Changed paths:
    M .travis.yml
    M CHANGES.rst
    M setup.py
    M src/ZEO/ClientStorage.py
    M src/ZEO/cache.py
    M src/ZEO/tests/ConnectionTests.py
    M src/ZEO/tests/IterationTests.py
    M src/ZEO/tests/forker.py
    M src/ZEO/tests/testZEO.py
    M src/ZEO/tests/test_cache.py
    M src/ZEO/zrpc/connection.py
    M src/ZEO/zrpc/server.py

  Log Message:
  -----------
  Merge remote-tracking branch 'origin/master' into asyncio

Conflicts:
	.travis.yml
	setup.py
	src/ZEO/ClientStorage.py
	src/ZEO/cache.py
	src/ZEO/tests/testZEO.py
	src/ZEO/zrpc/client.py
	src/ZEO/zrpc/server.py

Also, removed load from the asyncion client implementation, since it
isn't used anymore.

Compare: https://github.com/zopefoundation/ZEO/compare/da4d4ce1e2e6...dcbeab41af6d