Strange network speed question
-
To start my internal net is 100mbit. I need to read a lot of data ( couple of Gigs ) over the net very frequently. So I need a program that copies the data and I want to go as fast as possible. If I copy the files over FTP I get over 10MB/s in transfer speed and task manager shows network usage at 98-99% witch is really great. But I don’t want to use FTP. I want to read the file from a network share. And if I do, I only get like 6.5MB/sec so I made my test program to read/write threaded. Triple buffers and read/write at the same time and stuff. And now I get like 7-7.5 MB (not much of a performance gain) Anyway network usage only gets up to about 56-59% if I read from network share. I tried reading with different chunk sizes but did not make any difference. If I copy the file with windows drag'n'drop I get also low speed but a little better, network usage of 62% I understand that doing a lot of readfile(...) and stuff will generate more io request then receiving data over FTP. But should it really drop so much. Anyone have any idea of why I can’t get close to 100% network usage when reading from a network share? /Mathias
-
To start my internal net is 100mbit. I need to read a lot of data ( couple of Gigs ) over the net very frequently. So I need a program that copies the data and I want to go as fast as possible. If I copy the files over FTP I get over 10MB/s in transfer speed and task manager shows network usage at 98-99% witch is really great. But I don’t want to use FTP. I want to read the file from a network share. And if I do, I only get like 6.5MB/sec so I made my test program to read/write threaded. Triple buffers and read/write at the same time and stuff. And now I get like 7-7.5 MB (not much of a performance gain) Anyway network usage only gets up to about 56-59% if I read from network share. I tried reading with different chunk sizes but did not make any difference. If I copy the file with windows drag'n'drop I get also low speed but a little better, network usage of 62% I understand that doing a lot of readfile(...) and stuff will generate more io request then receiving data over FTP. But should it really drop so much. Anyone have any idea of why I can’t get close to 100% network usage when reading from a network share? /Mathias