Low process speed Large scale storage question...
-
Hi, I'm implementing mass information procedures that is stored in a SQL Database. What methods and actions i need to take in order for the process to be faster in a case like this (its more then 1000000 rows). I'm trying also to improve the memory usage since i use the DataTable in C# and I'm looking for a better way to process the retrieved data. is there a better class or method thats improving the speed and preventing any memory leaks ? please advise.... Thanks for any help, Lior S ;)
-
Hi, I'm implementing mass information procedures that is stored in a SQL Database. What methods and actions i need to take in order for the process to be faster in a case like this (its more then 1000000 rows). I'm trying also to improve the memory usage since i use the DataTable in C# and I'm looking for a better way to process the retrieved data. is there a better class or method thats improving the speed and preventing any memory leaks ? please advise.... Thanks for any help, Lior S ;)
There are a few recommendations: 1) Do not use ad hoc queries instead use Stored Procedures even to retrive data. 2) Do not use Typed Datasets. They are not efficient and take more memory. 3) Try to use Microsoft Enterprise Library Data Access Layer for better reliability and maturity to access DB. 4) If your target usersTry to use connection pooling. 5) Do not try to put dataset with 100000 rows on session or viewstate. Hope it helps.
Regards Khalid
-
Hi, I'm implementing mass information procedures that is stored in a SQL Database. What methods and actions i need to take in order for the process to be faster in a case like this (its more then 1000000 rows). I'm trying also to improve the memory usage since i use the DataTable in C# and I'm looking for a better way to process the retrieved data. is there a better class or method thats improving the speed and preventing any memory leaks ? please advise.... Thanks for any help, Lior S ;)