[Zope] Backing up Data.fs

Peter Sabaini sabaini@inode.at
Mon, 02 Jun 2003 15:33:22 +0200


This is a cryptographically signed message in MIME format.

--------------ms070604000501050801050208
Content-Type: text/plain; charset=us-ascii; format=flowed
Content-Transfer-Encoding: 7bit


Toby Dickenson wrote:
> On Monday 02 June 2003 12:48, Peter Sabaini wrote:
> 
>>Toby Dickenson wrote:
>>
>>>On Monday 02 June 2003 10:18, Peter Sabaini wrote:
> 
> 
>>>Think
>>>of backup as a database operation  -  this script has no ACID.
>>
>>please explain -- why would i need transactions and concurrency with a
>>backup script?
> 
> 
> Suppose this morning (Monday) the machine locks up (or power failure, or 
> network loss if this is on a network mount, etc) immediately after this 
> backup script has terminated. Some, but not all of the changes to 
> /archive/monday/data.fs will have been written to disk, and some will have 
> been lost. There is every chance that todays backup has been mashed together 
> with the backup from last weeks monday in some arbitrarily confusing way. 
> There is no new backup, and the old backup has been destroyed.
> 
> Sure, if this happens only once then this script leaves you with six other 
> good daily copies. But during a disaster recovery is the worst possible time 
> to have to be thinking about which "backup" directory contains a data.fs that 
> has recently been destroyed by a non-transactional backup script. Sean Upton 
> talks about disaster-prepardness here:
> http://zope.nipltd.com/public/lists/zope-archive.nsf/AGByKey/6036CE8DFC2D3484
> 
> This "bug" can be fixed for FileStorage backup scripts, check out the link I 
> posted earlier. The cost is in performance.

i see. i guess it mainly depends on how write-heavy your zope 
application is.  but if this is okay for you i'd like to put up the 
script you linked to as a comment as soon as the book is online.


[snip]


  - peter.



--------------ms070604000501050801050208
Content-Type: application/x-pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature

MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIJcjCC
AxcwggKAoAMCAQICAwlZhTANBgkqhkiG9w0BAQQFADCBkjELMAkGA1UEBhMCWkExFTATBgNV
BAgTDFdlc3Rlcm4gQ2FwZTESMBAGA1UEBxMJQ2FwZSBUb3duMQ8wDQYDVQQKEwZUaGF3dGUx
HTAbBgNVBAsTFENlcnRpZmljYXRlIFNlcnZpY2VzMSgwJgYDVQQDEx9QZXJzb25hbCBGcmVl
bWFpbCBSU0EgMjAwMC44LjMwMB4XDTAzMDIyMTEzMTY0NloXDTA0MDIyMTEzMTY0NlowWzEQ
MA4GA1UEBBMHU2FiYWluaTEOMAwGA1UEKhMFUGV0ZXIxFjAUBgNVBAMTDVBldGVyIFNhYmFp
bmkxHzAdBgkqhkiG9w0BCQEWEHNhYmFpbmlAaW5vZGUuYXQwggEiMA0GCSqGSIb3DQEBAQUA
A4IBDwAwggEKAoIBAQC1XhEfxugiGePyj2dxvgshFABfJw+Zcfar1FrGEdmCiMdEQO8kOpfZ
6NgSFe3nxMi4wsDR6LlnW1gEKYe0FVOf8T41naNlgAoz507xmm9X0QFo+lUiz00lZyiETHLS
pniVk2Ds9NnZeOwbkYLekXj1QXy2MChGfzavpXzI+Zl+XYojMtnEJEDYUiL/gwEDxMSE/KnA
yMx3R0vVeXCNKA3dM3il50QjNyE0XAVrCd1yayJ5Nto2wNb7HHS6lXMo75Mse9pblm2kkLUO
E+G3o1fuLJ6jWKAUcCwy7yfQTAGFT5Rt8f7/Qn3fBAFUAY8ScA7OXuHupkC0QqCxohLTuewD
AgMBAAGjLTArMBsGA1UdEQQUMBKBEHNhYmFpbmlAaW5vZGUuYXQwDAYDVR0TAQH/BAIwADAN
BgkqhkiG9w0BAQQFAAOBgQCOSrsA13Mj2nKj8xDp+gVRnz2wGPlXwgSUCDib6rk/gSL/go1C
Xq0X2+H1TSzg5cd6Iad39PzNxUQqBxD3k4X5tqgnikwcNOjaufFO6gxG42kEiEentqFCm8yw
8k6BFa+WFaGSRgAyJ/HXn0SvIEb5lf850aScgo/GsmDMPvPuBjCCAxcwggKAoAMCAQICAwlZ
hTANBgkqhkiG9w0BAQQFADCBkjELMAkGA1UEBhMCWkExFTATBgNVBAgTDFdlc3Rlcm4gQ2Fw
ZTESMBAGA1UEBxMJQ2FwZSBUb3duMQ8wDQYDVQQKEwZUaGF3dGUxHTAbBgNVBAsTFENlcnRp
ZmljYXRlIFNlcnZpY2VzMSgwJgYDVQQDEx9QZXJzb25hbCBGcmVlbWFpbCBSU0EgMjAwMC44
LjMwMB4XDTAzMDIyMTEzMTY0NloXDTA0MDIyMTEzMTY0NlowWzEQMA4GA1UEBBMHU2FiYWlu
aTEOMAwGA1UEKhMFUGV0ZXIxFjAUBgNVBAMTDVBldGVyIFNhYmFpbmkxHzAdBgkqhkiG9w0B
CQEWEHNhYmFpbmlAaW5vZGUuYXQwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC1
XhEfxugiGePyj2dxvgshFABfJw+Zcfar1FrGEdmCiMdEQO8kOpfZ6NgSFe3nxMi4wsDR6Lln
W1gEKYe0FVOf8T41naNlgAoz507xmm9X0QFo+lUiz00lZyiETHLSpniVk2Ds9NnZeOwbkYLe
kXj1QXy2MChGfzavpXzI+Zl+XYojMtnEJEDYUiL/gwEDxMSE/KnAyMx3R0vVeXCNKA3dM3il
50QjNyE0XAVrCd1yayJ5Nto2wNb7HHS6lXMo75Mse9pblm2kkLUOE+G3o1fuLJ6jWKAUcCwy
7yfQTAGFT5Rt8f7/Qn3fBAFUAY8ScA7OXuHupkC0QqCxohLTuewDAgMBAAGjLTArMBsGA1Ud
EQQUMBKBEHNhYmFpbmlAaW5vZGUuYXQwDAYDVR0TAQH/BAIwADANBgkqhkiG9w0BAQQFAAOB
gQCOSrsA13Mj2nKj8xDp+gVRnz2wGPlXwgSUCDib6rk/gSL/go1CXq0X2+H1TSzg5cd6Iad3
9PzNxUQqBxD3k4X5tqgnikwcNOjaufFO6gxG42kEiEentqFCm8yw8k6BFa+WFaGSRgAyJ/HX
n0SvIEb5lf850aScgo/GsmDMPvPuBjCCAzgwggKhoAMCAQICEGZFcrfMdPXPY3ZFhNAukQEw
DQYJKoZIhvcNAQEEBQAwgdExCzAJBgNVBAYTAlpBMRUwEwYDVQQIEwxXZXN0ZXJuIENhcGUx
EjAQBgNVBAcTCUNhcGUgVG93bjEaMBgGA1UEChMRVGhhd3RlIENvbnN1bHRpbmcxKDAmBgNV
BAsTH0NlcnRpZmljYXRpb24gU2VydmljZXMgRGl2aXNpb24xJDAiBgNVBAMTG1RoYXd0ZSBQ
ZXJzb25hbCBGcmVlbWFpbCBDQTErMCkGCSqGSIb3DQEJARYccGVyc29uYWwtZnJlZW1haWxA
dGhhd3RlLmNvbTAeFw0wMDA4MzAwMDAwMDBaFw0wNDA4MjcyMzU5NTlaMIGSMQswCQYDVQQG
EwJaQTEVMBMGA1UECBMMV2VzdGVybiBDYXBlMRIwEAYDVQQHEwlDYXBlIFRvd24xDzANBgNV
BAoTBlRoYXd0ZTEdMBsGA1UECxMUQ2VydGlmaWNhdGUgU2VydmljZXMxKDAmBgNVBAMTH1Bl
cnNvbmFsIEZyZWVtYWlsIFJTQSAyMDAwLjguMzAwgZ8wDQYJKoZIhvcNAQEBBQADgY0AMIGJ
AoGBAN4zMqZjxwklRT7SbngnZ4HF2ogZgpcO40QpimM1Km1wPPrcrvfudG8wvDOQf/k0caCj
bZjxw0+iZdsN+kvx1t1hpfmFzVWaNRqdknWoJ67Ycvm6AvbXsJHeHOmr4BgDqHxDQlBRh4M8
8Dm0m1SKE4f/s5udSWYALQmJ7JRr6aFpAgMBAAGjTjBMMCkGA1UdEQQiMCCkHjAcMRowGAYD
VQQDExFQcml2YXRlTGFiZWwxLTI5NzASBgNVHRMBAf8ECDAGAQH/AgEAMAsGA1UdDwQEAwIB
BjANBgkqhkiG9w0BAQQFAAOBgQAxsUtHXfkBceX1U2xdedY9mMAmE2KBIqcS+CKV6BtJtyd7
BDm6/ObyJOuR+r3sDSo491BVqGz3Da1MG7wD9LXrokefbKIMWI0xQgkRbLAaadErErJAXWr5
edDqLiXdiuT82w0fnQLzWtvKPPZE6iZph39Ins6ln+eE2MliYq0FxjGCA9UwggPRAgEBMIGa
MIGSMQswCQYDVQQGEwJaQTEVMBMGA1UECBMMV2VzdGVybiBDYXBlMRIwEAYDVQQHEwlDYXBl
IFRvd24xDzANBgNVBAoTBlRoYXd0ZTEdMBsGA1UECxMUQ2VydGlmaWNhdGUgU2VydmljZXMx
KDAmBgNVBAMTH1BlcnNvbmFsIEZyZWVtYWlsIFJTQSAyMDAwLjguMzACAwlZhTAJBgUrDgMC
GgUAoIICDzAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0wMzA2
MDIxMzMzMjJaMCMGCSqGSIb3DQEJBDEWBBSrUJBMAfxNhexj8necOVi+mwowxTBSBgkqhkiG
9w0BCQ8xRTBDMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIBQDAH
BgUrDgMCBzANBggqhkiG9w0DAgIBKDCBqwYJKwYBBAGCNxAEMYGdMIGaMIGSMQswCQYDVQQG
EwJaQTEVMBMGA1UECBMMV2VzdGVybiBDYXBlMRIwEAYDVQQHEwlDYXBlIFRvd24xDzANBgNV
BAoTBlRoYXd0ZTEdMBsGA1UECxMUQ2VydGlmaWNhdGUgU2VydmljZXMxKDAmBgNVBAMTH1Bl
cnNvbmFsIEZyZWVtYWlsIFJTQSAyMDAwLjguMzACAwlZhTCBrQYLKoZIhvcNAQkQAgsxgZ2g
gZowgZIxCzAJBgNVBAYTAlpBMRUwEwYDVQQIEwxXZXN0ZXJuIENhcGUxEjAQBgNVBAcTCUNh
cGUgVG93bjEPMA0GA1UEChMGVGhhd3RlMR0wGwYDVQQLExRDZXJ0aWZpY2F0ZSBTZXJ2aWNl
czEoMCYGA1UEAxMfUGVyc29uYWwgRnJlZW1haWwgUlNBIDIwMDAuOC4zMAIDCVmFMA0GCSqG
SIb3DQEBAQUABIIBAAeK/9g85hxo5OOl0cLhTvD6PRJJop1wz2kMALAWqixwtobKLJO/xfYw
WE965ww/TSnpdT/GElPStSiaF64gGclhW8N+TWRDC+J3Bfgj2/HRQlYLcg3N7OEb8yjyA1DU
d8TJFu/83XJWPq+jSwCz8JamIDv3/SEk7MeqIhONn3HWUAIQSV2bh31SlF8oNoDJnuew8X4q
8rKW+I3KHc2vu4EcHofugO3Nlrg3pUzntPPju2Dv1ePvbNU1fF8NpvqBKHZZjFr7B0DCoCnw
n0x5qnWwC+4bMJQ2+Y8UI7Tahmx5Msh/uvv1zyclpG2ifizFA1BrgFz4LIEDG5UlNr+SYhoA
AAAAAAA=
--------------ms070604000501050801050208--