Memory allocation / GC issues???

Luc Pattyn

Hi, there are good reasons why the gc is lazy, and should not be called explicitly: 1. it is an expensive operation, since it needs to check all the data in your app, figuring out which objects still have references to them (are "alive") and which don't. There can be a lot of data involved, it does not fit in the cache, and it trashes the cache (i.e. whatever was rightfully in there now is gone). 2. while doing its job, the gc suspends all your threads, to make sure the stacks and objects don't change while it is examining them; so your app is temporarily dead. :)

Luc Pattyn [Forum Guidelines] [My Articles]

this weeks tips: - make Visual display line numbers: Tools/Options/TextEditor/... - show exceptions with ToString() to see all information - before you ask a question here, search CodeProject, then Google

Luc Pattyn

You may want to display (and periodically update) the value of Environment.WorkingSet inside your app; that allows you to see memory usage by your process.

Luc Pattyn [Forum Guidelines] [My Articles]

this weeks tips: - make Visual display line numbers: Tools/Options/TextEditor/... - show exceptions with ToString() to see all information - before you ask a question here, search CodeProject, then Google

realJSOP

A side note - don't allocate more than about 85k of memory to any single object unless you're prepare to handle cleanup manually. Anything bigger than that gets shoved onto the "large object heap", and the GC doesn't clean that up for you.

"Why don't you tie a kerosene-soaked rag around your ankles so the ants won't climb up and eat your candy ass..." - Dale Earnhardt, 1997
-----
"...the staggering layers of obscenity in your statement make it a work of art on so many levels." - Jason Jystad, 10/26/2001

Xpnctoc

Got that covered. All of my core logic I'm writing in unmanaged code. I found early on that I didn't like the overhead of some of the System.Collections.Generic classes -- especially the bulky disk usage in serialization compared to doing a straight binary write of unmanaged data structures. So I chose to write the app in C++/CLI, using .NET for the ease of creating Windows forms and controls while keeping my core logic and processing in native C++. So I'm fully prepared to do my unmanaged allocation and cleanup. Like I said, the behavior I'm calling into question occurs with things I have little or no control over, such as Menu controls and dialogs.

Xpnctoc

Thanks for the tip. I wasn't aware of that one. I'm sure that will help.

Luc Pattyn

Hi John, I don't fully agree, AFAIK objects on the large object heap are managed like all other managed objects, with a single difference: the LOH does not get reshuffled, hence there is a risk of fragmentation. Example: allocate 1MB, then 100MB, repeat this N times until memory is almost full, then throw away the references to all 100MB objects and try to get one really big object of 300MB. IMO the threshold (85KB?) is not documented, is not available through some API, may vary over time, and may depend on your system's memory situation. I feel the Framework should be more specific about this, it should guarantee a reasonable minimum value for the threshold, so one can make sure fragmentation will not become an issue by keeping objects smaller than that. :)

Luc Pattyn [Forum Guidelines] [My Articles]

this weeks tips: - make Visual display line numbers: Tools/Options/TextEditor/... - show exceptions with ToString() to see all information - before you ask a question here, search CodeProject, then Google

Lutoslaw

Hey, I though that a code

openFileDialog.ShowDialog();
openFileDialog.Dispose();
openFileDialog.ShowDialog();

throws "object disposed" excpt or sth like that, doesn't it? So if I use this dialog all the time...

Greetings - Gajatko

Luc Pattyn

of course you only dispose of things you don't need any longer.

Luc Pattyn [Forum Guidelines] [My Articles]

this weeks tips: - make Visual display line numbers: Tools/Options/TextEditor/... - show exceptions with ToString() to see all information - before you ask a question here, search CodeProject, then Google

Scott Dorman

Luc Pattyn wrote:

the threshold (85KB?) is not documented, is not available through some API, may vary over time, and may depend on your system's memory situation.

In general this is true, the 85KB limit isn't publicly documented. I did find it in Rotor[^] (SSCLI) in the gc.h header file for the garbage collector's native code:

/* misc defines */
#define LARGE_OBJECT_SIZE 85000

.

Scott.

—In just two days, tomorrow will be yesterday. [Forum Guidelines] [Articles] [Blog]

Dave Kreskowiak

gajatko wrote:

So if I use this dialog all the time...

You create a new instance of it...

A guide to posting questions on CodeProject[^]
Dave Kreskowiak Microsoft MVP Visual Developer - Visual Basic
2006, 2007

Vaibhav Sharma

Hi, I am amazed that after reading all the replies and posts on this article no one mentions of the Using...End Using code block. I am sure you must be knowing it but just a little bit of detailing on the using statements: 'VB Version, C# no different, just lang. changes Using dlgOpen As New OpenFileDialog() dlgOpen.Filter="*.*" 'Any other properties dlg.ShowDialog() End Using Now what the above code fragment does is that the CLR will create the dlgOpen object and will be responsible for its disposal, not YOU. This has serious benefits in terms of Performance & Memory Utilization since as soon as the code execution reaches End Using the dlgOpen will be Disposed off without requiring you to do any thing at all. :::One Catch Though While using the Using statements::: the dlgOpen will not be accessible outside the Using block since its scope is limited is to the Using...End Using block. So i strongly recommend you to go ahead and use the Using...End Using blocks for all the DialogBoxes since most of them times they return only one value which can easily be stored on a local/global variable. Awaiting reply eagerly.

Regards, Vaibhav Sharma

Xpnctoc

I appreciate the tip. I am aware of the "using" syntax, but in my case that won't work. As I mentioned in my response to John Simmons's post above, my application is written in C++/CLI, which has no such construct. There were multiple reasons for that language choice, some of which I mentioned and others that are irrelevant to this conversation. And even if I was in C#/VB, I'd still have the same problem with the Menu control. Can't use "using" for something like a menu that has to be present for the duration of execution. Regardless, I think it was one of Luc Pattyn's responses that directed me to try examining memory usage through the Environment.WorkingSet (thank's again, Luc). This provides memory use much closer to what I would expect based on my interaction with the application. I still find it alarming that the .NET virtual machine continues to eat up additional memory when it's not needed, but there I just have to trust that the GC will do its job when push comes to shove.