Process large file in asp.net
-
Hi all, I need yours openions in following scenario I have a web application where we allow to import data from xml file and the xml file could be larger like 10 to 20 MB containng more than 100000 record. For this thing we have increased the maxrequestlength upto 20MB as well as executiontimeout upto 1 hr. Can anybody confirm it is good to allow such processing via web application? if no then plese suggest me some alternative way to handle such case. Thanks Rohit
-
Hi all, I need yours openions in following scenario I have a web application where we allow to import data from xml file and the xml file could be larger like 10 to 20 MB containng more than 100000 record. For this thing we have increased the maxrequestlength upto 20MB as well as executiontimeout upto 1 hr. Can anybody confirm it is good to allow such processing via web application? if no then plese suggest me some alternative way to handle such case. Thanks Rohit
You could allow your clients to FTP the files to you and then process them with a dedicated application rather than through the web application?
-
You could allow your clients to FTP the files to you and then process them with a dedicated application rather than through the web application?
-
Hi all, I need yours openions in following scenario I have a web application where we allow to import data from xml file and the xml file could be larger like 10 to 20 MB containng more than 100000 record. For this thing we have increased the maxrequestlength upto 20MB as well as executiontimeout upto 1 hr. Can anybody confirm it is good to allow such processing via web application? if no then plese suggest me some alternative way to handle such case. Thanks Rohit
-
Probably this may help you.
Success is the good fortune that comes from aspiration, desperation, perspiration and inspiration.
-
Hi all, I need yours openions in following scenario I have a web application where we allow to import data from xml file and the xml file could be larger like 10 to 20 MB containng more than 100000 record. For this thing we have increased the maxrequestlength upto 20MB as well as executiontimeout upto 1 hr. Can anybody confirm it is good to allow such processing via web application? if no then plese suggest me some alternative way to handle such case. Thanks Rohit
I think you have understood that it will take a long time to process. The problem if I am correct is how to make the user wait for the result? My suggestion would be to decouple the processing and the status reporting. So, the once the file is submitted by the user, 1. Save the file to disk, save the location to a queue table and tell the user that the application is processing his file. 2. On the server, write a service to read that queue table periodically and process the file. You could use fire and forget threads here. 3. The service would write some progress update to a progress table. 4. The status page shown to the user can read this progress table with the file id as the filter. You could also expose a web service to check on status of a file Shreekar