You can use the Registry key "HKEY_LOCAL_MACHINE\SOFTWARE\Clients\Mail". Its default value should be the system's default mail client.

Why not just have the app check if the folder exists upon startup and create it if it does not exist? That way, users can delete the folders, and the application will not break.

...and I thought you were going to start talking about how you had been infected by Blaster...