[muscle] Re: zlib encoding and muscled
- From: Wilson Yeung <wilson@xxxxxxxxx>
- To: muscle@xxxxxxxxxxxxx
- Date: Sun, 6 Jun 2004 23:00:43 -0700
That's excellent. Thanks Jeremy.
I'm a little curious about memory usage too.
I stood up the muscled server, and ran three clients. I had one of the
clients publish 100,000 set data messages as quickly as possible, again
and again, and I had two other clients subscribe to the data.
I'm able to sustain about 20,000 messages per second between a dual
processor PIII 600 and a 12" Powerbook.
The receiving clients don't do anything with the incoming messages.
They just take the incoming message off the queue and throw it away
(well, it's a MessageRef object, so I expect that not doing anything
means eventual release/deallocation). Yet I see the memory usage on
the receiving processes grow from ~20MB to ~125MB over time. I don't
think memory fragmentation should be an issue as you're using
object/memory pools, and I'm not doing any heap allocation, so I'm a
little surprised that memory usage grows much at all. Does it have
something to do with the incoming message queue being jammed with data?
Are the object pools being resized? If that's the case, is there a
recommended method to restrict the size of the object pools?
I'll probably have a better idea of what to do as I become more
familiar with the source, but I'm wondering if this is a normal thing
I'm seeing.
I'm planning to include the muscle system in a pretty mixed
environment, including possibly some C# clients, so I'm thinking of
writing a C# client API modeled after the Java client API. Is there
interest by anyone else in such a thing?
Wilson
Other related posts:
