[Checkins] [zopefoundation/ZEO] 838769: Major update, featuring SSL suppprt

Thu Jul 7 15:17:31 CEST 2016

  Branch: refs/heads/asyncio
  Home:   https://github.com/zopefoundation/ZEO
  Commit: 838769661a79db31e10847e705676e05cd5cdb00
      https://github.com/zopefoundation/ZEO/commit/838769661a79db31e10847e705676e05cd5cdb00
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-22 (Wed, 22 Jun 2016)

  Changed paths:
    A doc/README.rst

  Log Message:
  -----------
  Major update, featuring SSL suppprt

  Commit: bfcd269590aa4bbce1a933565a9d006b400d9fce
      https://github.com/zopefoundation/ZEO/commit/bfcd269590aa4bbce1a933565a9d006b400d9fce
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-22 (Wed, 22 Jun 2016)

  Changed paths:
    M doc/README.rst

  Log Message:
  -----------
  It's soo hard to not put =s in zconfigs

  Commit: 7b41e01a382f2deb89c05c7a33f0e4fbba92d1d3
      https://github.com/zopefoundation/ZEO/commit/7b41e01a382f2deb89c05c7a33f0e4fbba92d1d3
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-22 (Wed, 22 Jun 2016)

  Changed paths:
    M doc/README.rst

  Log Message:
  -----------
  rst fix

  Commit: dc00be9003401427f7d5536c9a77bc6ffa5e07b3
      https://github.com/zopefoundation/ZEO/commit/dc00be9003401427f7d5536c9a77bc6ffa5e07b3
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-22 (Wed, 22 Jun 2016)

  Changed paths:
    M doc/README.rst

  Log Message:
  -----------
  emphasize need or import

  Commit: e22f0af67ffca3bcbe9abc1f70450f1041e3d622
      https://github.com/zopefoundation/ZEO/commit/e22f0af67ffca3bcbe9abc1f70450f1041e3d622
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-22 (Wed, 22 Jun 2016)

  Changed paths:
    A src/ZEO/zconfig.py

  Log Message:
  -----------
  First cut at code for setting up ssl contexts

  Commit: 2fdc0283a79bccc488cf19d5ac219f4bb9931256
      https://github.com/zopefoundation/ZEO/commit/2fdc0283a79bccc488cf19d5ac219f4bb9931256
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-23 (Thu, 23 Jun 2016)

  Changed paths:
    M doc/README.rst
    R doc/zeo.txt
    M setup.py
    M src/ZEO/ClientStorage.py
    M src/ZEO/StorageServer.py
    M src/ZEO/acceptor.py
    M src/ZEO/asyncio/client.py
    M src/ZEO/component.xml
    M src/ZEO/runzeo.py
    M src/ZEO/schema.xml
    A src/ZEO/server.xml
    A src/ZEO/tests/client.pem
    A src/ZEO/tests/client_key.pem
    M src/ZEO/tests/forker.py
    A src/ZEO/tests/server.pem
    A src/ZEO/tests/server_key.pem
    A src/ZEO/tests/serverpw.pem
    A src/ZEO/tests/serverpw_key.pem
    M src/ZEO/tests/testConfig.py
    M src/ZEO/zconfig.py

  Log Message:
  -----------
  initial ssl implementation (more tests coming)

  Commit: 9f97ea8d2c0f18f3e1c792f3488ee108df90e148
      https://github.com/zopefoundation/ZEO/commit/9f97ea8d2c0f18f3e1c792f3488ee108df90e148
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-24 (Fri, 24 Jun 2016)

  Changed paths:
    M src/ZEO/asyncio/client.py
    M src/ZEO/asyncio/testing.py
    M src/ZEO/tests/CommitLockTests.py
    M src/ZEO/tests/ConnectionTests.py
    M src/ZEO/tests/forker.py
    M src/ZEO/tests/testConfig.py
    M src/ZEO/tests/testConnection.py
    M src/ZEO/tests/testZEO.py
    A src/ZEO/tests/testssl.py

  Log Message:
  -----------
  Finished SSL tests

  Commit: d5f44000e09000d5b14ddcacb055fd8d61659a5e
      https://github.com/zopefoundation/ZEO/commit/d5f44000e09000d5b14ddcacb055fd8d61659a5e
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-24 (Fri, 24 Jun 2016)

  Changed paths:
    M doc/README.rst

  Log Message:
  -----------
  doc fixes

  Commit: fdfc92456e5f00e327dd0b91b6d3f96323576122
      https://github.com/zopefoundation/ZEO/commit/fdfc92456e5f00e327dd0b91b6d3f96323576122
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-24 (Fri, 24 Jun 2016)

  Changed paths:
    M src/ZEO/component.xml
    M src/ZEO/tests/testssl.py
    M src/ZEO/zconfig.py

  Log Message:
  -----------
  client check-hostname by default

  Commit: 5727c7a2e03f05c4ff82533f9e8a67b1ec78e93a
      https://github.com/zopefoundation/ZEO/commit/5727c7a2e03f05c4ff82533f9e8a67b1ec78e93a
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-24 (Fri, 24 Jun 2016)

  Changed paths:
    M src/ZEO/zconfig.py

  Log Message:
  -----------
  Added some verification flags suggested by Julien Muchembled

  Commit: da2e22814d94d458e797fbf8f3ab97e2dd37d8e6
      https://github.com/zopefoundation/ZEO/commit/da2e22814d94d458e797fbf8f3ab97e2dd37d8e6
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-26 (Sun, 26 Jun 2016)

  Changed paths:
    M src/ZEO/StorageServer.py
    R src/ZEO/acceptor.py
    A src/ZEO/asyncio/mtacceptor.py
    M src/ZEO/asyncio/server.py
    M src/ZEO/asyncio/testing.py
    M src/ZEO/tests/testZEO.py
    M src/ZEO/tests/testssl.py

  Log Message:
  -----------
  Refactord the server to be single-threaded to make SSL work on Linux

SSL didn't work on Linux because of an incompatibility between
non-blocking sockerts and SSL (which wasn't an issue on Mac OS X for
some reason).

I decided to try switching the server to use a single thread.  This
led to a performance improvement for zodbshootout and a lower-level
networking test.  I refactored the server listening logic and kept (at
least for now) both the multi-threaded and the single-threaded
version. (The multi-threaded logic can be used by changing a single
import. Tests pass with both.).

I'm a bit worried about the asyncio server. See

  http://bugs.python.org/issue27386

Tests appear to be less stable using asyncio.server on my Mac. :(

  Commit: daca97cb4292ad9a316a1924960a5fbf54d3622b
      https://github.com/zopefoundation/ZEO/commit/daca97cb4292ad9a316a1924960a5fbf54d3622b
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-26 (Sun, 26 Jun 2016)

  Changed paths:
    M src/ZEO/StorageServer.py
    M src/ZEO/asyncio/mtacceptor.py
    M src/ZEO/tests/testZEO.py

  Log Message:
  -----------
  Awful hack to run the server multi-threaded

Because running it single-threaded was unstable, at least in the tests.

See http://bugs.python.org/issue27392

  Commit: fddb6f8527d71e2a2a8ec09293541e4344c3b345
      https://github.com/zopefoundation/ZEO/commit/fddb6f8527d71e2a2a8ec09293541e4344c3b345
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-27 (Mon, 27 Jun 2016)

  Changed paths:
    M src/ZEO/ClientStorage.py

  Log Message:
  -----------
  Fix a race

Where we check for a disconnect, get disconnected and vote

  Commit: 31d41127d7828c0e1938c5de155f742931cc71a1
      https://github.com/zopefoundation/ZEO/commit/31d41127d7828c0e1938c5de155f742931cc71a1
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-27 (Mon, 27 Jun 2016)

  Changed paths:
    M src/ZEO/asyncio/server.py
    M src/ZEO/tests/forker.py

  Log Message:
  -----------
  Refactored the asyncio.Server-based server to be more careful about closing down

It appeared that some tests were failing because servers weren't
closing down.  Modified the test forker module and the server to be
more paranoid about closing the server.

This seems to have helped test stability. (Or maybe I accidentally
fixed something while flailing :)).

  Commit: 7cb6e87c9a5845bbe7a19ba532c340314826b171
      https://github.com/zopefoundation/ZEO/commit/7cb6e87c9a5845bbe7a19ba532c340314826b171
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-27 (Mon, 27 Jun 2016)

  Changed paths:
    M src/ZEO/tests/ConnectionTests.py

  Log Message:
  -----------
  Bind to port 0 some of the time to avoid get_port

And maybe avoid spurious test failures due to port contention.

  Commit: 5fcd383eceb45e410d4267c4997a82f42891512f
      https://github.com/zopefoundation/ZEO/commit/5fcd383eceb45e410d4267c4997a82f42891512f
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-27 (Mon, 27 Jun 2016)

  Changed paths:
    M src/ZEO/tests/testZEO.py

  Log Message:
  -----------
  Split up the misc ZEO test layer

- To make tests run faster with j99, and

- To isolate some tests that often seem to fail spuriously but pass
  when run by themselves.

  Commit: 8d59cba0beb639d7d5d780252c7442e9edd0ea56
      https://github.com/zopefoundation/ZEO/commit/8d59cba0beb639d7d5d780252c7442e9edd0ea56
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-27 (Mon, 27 Jun 2016)

  Changed paths:
    M src/ZEO/StorageServer.py
    M src/ZEO/asyncio/mtacceptor.py
    M src/ZEO/tests/testZEO.py

  Log Message:
  -----------
  Merge branch 'ssl' of github.com:zopefoundation/ZEO into ssl

  Commit: f6d06ae5998f1a7e21a332eff48dafa7c86b1abb
      https://github.com/zopefoundation/ZEO/commit/f6d06ae5998f1a7e21a332eff48dafa7c86b1abb
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-27 (Mon, 27 Jun 2016)

  Changed paths:
    M src/ZEO/StorageServer.py

  Log Message:
  -----------
  Switch back to using asyncio.Server to listen and run in 1 thread

  Commit: f15668b682dbcd935b8d8604583b41b58862951c
      https://github.com/zopefoundation/ZEO/commit/f15668b682dbcd935b8d8604583b41b58862951c
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-28 (Tue, 28 Jun 2016)

  Changed paths:
    M src/ZEO/__init__.py

  Log Message:
  -----------
  Make running server in thread vs process optional

  Commit: 04e491e943c559feb2f5214e627baaf03f2f6461
      https://github.com/zopefoundation/ZEO/commit/04e491e943c559feb2f5214e627baaf03f2f6461
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-28 (Tue, 28 Jun 2016)

  Changed paths:
    M src/ZEO/tests/new_addr.test

  Log Message:
  -----------
  Made new_addr.test more robust

  Commit: 0e06dc4481de1b9aaee8b3dfc99e4dc5fb7c4c98
      https://github.com/zopefoundation/ZEO/commit/0e06dc4481de1b9aaee8b3dfc99e4dc5fb7c4c98
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-28 (Tue, 28 Jun 2016)

  Changed paths:
    M src/ZEO/__init__.py

  Log Message:
  -----------
  doctring fix

  Commit: c429775884afffbea030b4f37370a169624125e8
      https://github.com/zopefoundation/ZEO/commit/c429775884afffbea030b4f37370a169624125e8
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-28 (Tue, 28 Jun 2016)

  Changed paths:
    M src/ZEO/tests/dynamic_server_ports.test

  Log Message:
  -----------
  Made dynamic_server_ports.test more robust

  Commit: f9c5c35e6ba5bdd1bbc343015d1febd9409faa6c
      https://github.com/zopefoundation/ZEO/commit/f9c5c35e6ba5bdd1bbc343015d1febd9409faa6c
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-28 (Tue, 28 Jun 2016)

  Changed paths:
    M src/ZEO/tests/forker.py

  Log Message:
  -----------
  removed some debugging code that shouldn't have been checked in.

  Commit: 11fdfd1e6840a0d8f88522388123629aea154a8a
      https://github.com/zopefoundation/ZEO/commit/11fdfd1e6840a0d8f88522388123629aea154a8a
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-28 (Tue, 28 Jun 2016)

  Changed paths:
    M src/ZEO/tests/ConnectionTests.py

  Log Message:
  -----------
  fixed a test race condition, I hope

  Commit: daed384f6e0f08d231974fbe78d3bba213488fab
      https://github.com/zopefoundation/ZEO/commit/daed384f6e0f08d231974fbe78d3bba213488fab
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-29 (Wed, 29 Jun 2016)

  Changed paths:
    A src/ZEO/asyncio/README.rst
    M src/ZEO/asyncio/mtacceptor.py

  Log Message:
  -----------
  docs

  Commit: 2afe16de552684d89603108c4948287abd54d561
      https://github.com/zopefoundation/ZEO/commit/2afe16de552684d89603108c4948287abd54d561
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-06-29 (Wed, 29 Jun 2016)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  travis mac jobs have been queued for more than 3 hours.

I develop on a mac (for better or worse) so I know that mac tests are being run.

  Commit: 48defe9f6bd43b6165988df7c5d36bab6ed4b85f
      https://github.com/zopefoundation/ZEO/commit/48defe9f6bd43b6165988df7c5d36bab6ed4b85f
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-07-01 (Fri, 01 Jul 2016)

  Changed paths:
    M tox.ini

  Log Message:
  -----------
  Added the mock test dependency

It's a shame that Tox is unable (or unwilling) to get test
dependencies from package meta data. :(

  Commit: 2f0021335aabb9501a57b69e1c7ac5266de05624
      https://github.com/zopefoundation/ZEO/commit/2f0021335aabb9501a57b69e1c7ac5266de05624
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-07-06 (Wed, 06 Jul 2016)

  Changed paths:
    M setup.py
    M src/ZEO/ClientStorage.py
    M src/ZEO/StorageServer.py
    M src/ZEO/TransactionBuffer.py
    M src/ZEO/asyncio/server.py
    M src/ZEO/asyncio/tests.py
    M src/ZEO/cache.py
    M src/ZEO/interfaces.py
    M src/ZEO/tests/ConnectionTests.py
    M src/ZEO/tests/forker.py
    M src/ZEO/tests/protocols.test
    M src/ZEO/tests/testZEO.py
    M src/ZEO/tests/testZEO2.py

  Log Message:
  -----------
  Merge remote-tracking branch 'origin/asyncio' into ssl

Conflicts:
	src/ZEO/ClientStorage.py

  Commit: 22615fb463cd57979a411cc636f30a7965886be4
      https://github.com/zopefoundation/ZEO/commit/22615fb463cd57979a411cc636f30a7965886be4
  Author: Jim Fulton <jim at zope.com>
  Date:   2016-07-06 (Wed, 06 Jul 2016)

  Changed paths:
    M src/ZEO/StorageServer.py

  Log Message:
  -----------
  removed some unused code

  Commit: 1eb086dae13b17304f5d4b0614872be3bb4aa447
      https://github.com/zopefoundation/ZEO/commit/1eb086dae13b17304f5d4b0614872be3bb4aa447
  Author: Jim Fulton <jim at jimfulton.info>
  Date:   2016-07-07 (Thu, 07 Jul 2016)

  Changed paths:
    M .travis.yml
    A doc/README.rst
    R doc/zeo.txt
    M setup.py
    M src/ZEO/ClientStorage.py
    M src/ZEO/StorageServer.py
    M src/ZEO/__init__.py
    R src/ZEO/acceptor.py
    A src/ZEO/asyncio/README.rst
    M src/ZEO/asyncio/client.py
    A src/ZEO/asyncio/mtacceptor.py
    M src/ZEO/asyncio/server.py
    M src/ZEO/asyncio/testing.py
    M src/ZEO/component.xml
    M src/ZEO/runzeo.py
    M src/ZEO/schema.xml
    A src/ZEO/server.xml
    M src/ZEO/tests/CommitLockTests.py
    M src/ZEO/tests/ConnectionTests.py
    A src/ZEO/tests/client.pem
    A src/ZEO/tests/client_key.pem
    M src/ZEO/tests/dynamic_server_ports.test
    M src/ZEO/tests/forker.py
    M src/ZEO/tests/new_addr.test
    A src/ZEO/tests/server.pem
    A src/ZEO/tests/server_key.pem
    A src/ZEO/tests/serverpw.pem
    A src/ZEO/tests/serverpw_key.pem
    M src/ZEO/tests/testConfig.py
    M src/ZEO/tests/testConnection.py
    M src/ZEO/tests/testZEO.py
    A src/ZEO/tests/testssl.py
    A src/ZEO/zconfig.py
    M tox.ini

  Log Message:
  -----------
  Merge pull request #32 from zopefoundation/ssl

Add SSL support +

It's sad no reviewer, but I suppose it can be reviewed even after a merge.

Compare: https://github.com/zopefoundation/ZEO/compare/b87118389120...1eb086dae13b