[Zope-Dev] Zope 2.1.6 Memory issue

[Jason Spisak]

Shane Hathaway writes:

> Jason Spisak wrote:
> > 
> > Shane Hathaway writes:
> > 
> > > Jason Spisak wrote:
> > > > > You must have a large site.
> > > >
> > > > 300,000 + objects
> > >
> > > Whoa...  ;-)
> > >
> > > Tell me, what are you doing with 300K objects?
> > >
> > > Shane
> > 
> > Technical recruiting.
> > I am the ultimate test case for ZDOB scalability. ;)
> > 
> > I just recently started having problems thoug, so I am going back and
> > disabling the small fixes I have made recently in my code.
> > 
> > I just restarted Zope again.
> > 
> > Most of the objects just sit around.
> > 
> > Wow.  There it goes again.  It's got to be DateTime.DateTime.DateTime.  It
> > just shot to 118003.
> 
> That's actually a natural thing to happen.  DateTime objects get
> attached to many kinds of objects.  The real problem is that so many
> objects are being loaded into memory.
> 
> I just did some research and it looks as though garbage collection is
> not fully implemented in Python.  I was not aware of this; do you know
> whether it has been corrected?

No, I had no idea.

> 
> After minimizing your in-memory cache, look at the manage_debug screen
> again.  Are the refcounts still high?  I bet they are...
> 

No.  The ref counts drop to hundreds.

Also, is see reference to 161 Products.GadflyDA.gadfly.kjparser.ParseRule,
and I'm not even useing Gadfly!

What the heck is that about?  Anyone?

Thing's seem to be a bit nicer now that I took out an External Method that
returns a DateTime object the Catalog for Indexing.  However, there's only
about 14,000 of objects with that property in existsnce in my DB, and they
don't change often.

Here's the code:

def calendar_day(self)
    return int(self.calendar_date)/1000000

Used to return the unique integer day.


All my best,

Jason Spisak
CIO
HireTechs.com
6151 West Century Boulevard
Suite 900
Los Angeles, CA 90045
P. 310.665.3444
F. 310.665.3544

Under US Code Title 47, Sec.227(b)(1)(C), Sec.227(a)(2)(B) This email
address may not be added to any commercial mail list with out my
permission.  Violation of my privacy with advertising or SPAM will
result in a suit for a MINIMUM of $500 damages/incident, $1500 for
repeats.