Slow netwok transfer

[Skywatch]

Hi all,

I am trying to transfer files to a USB 2.0 powered HDD connected to the pi (iva powered hub) and I get less than 100Kb speed.

I am connecting via a gigabit switch and 100Mb router and feel that it should be a lot more than this.

I have tried from a windows 7 laptop via 'drag n drop' and winscp32 and both have the same issue. Plugging the HDD into the laptop and all is fast, so that's not the issue.

I had a search on here and can't see any other problems like this..... Anyone have any bright ideas that would help?

Skywatch.

[f1vefour]

(15th Apr, 2013 06:52 AM)Skywatch Wrote:  Hi all,

I am trying to transfer files to a USB 2.0 powered HDD connected to the pi (iva powered hub) and I get less than 100Kb speed.

I am connecting via a gigabit switch and 100Mb router and feel that it should be a lot more than this.

I have tried from a windows 7 laptop via 'drag n drop' and winscp32 and both have the same issue. Plugging the HDD into the laptop and all is fast, so that's not the issue.

I had a search on here and can't see any other problems like this..... Anyone have any bright ideas that would help?

Skywatch.

Fastest transfer over network will be with FTP, SMB has quite a bit of overhead.

That being said I get about 1.25 Megabytes per second over SMB on my pi, you definitely have an issue.

Try FTP and see if that improves you throughput, if not it is a network issue. Then you can proceed with diagnosis of the network.

[mk01]

do not forget, that winscp is scp (ssh) so each packet is encrypted. this takes significat power from rpi.

I have standard transfers of 12MB/s via NFS

[f1vefour]

(15th Apr, 2013 12:42 PM)mk01 Wrote:  do not forget, that winscp is scp (ssh) so each packet is encrypted. this takes significat power from rpi.

I have standard transfers of 12MB/s via NFS

This would be impossible over a 100mbps line.

[Koenkk]

100mbps / 8 = 12,5 mb/s theoretical max speed so yes it is definitely possible over a 100 mbps line.

[mk01]

(15th Apr, 2013 05:04 PM)f1vefour Wrote:  

(15th Apr, 2013 12:42 PM)mk01 Wrote:  do not forget, that winscp is scp (ssh) so each packet is encrypted. this takes significat power from rpi.

I have standard transfers of 12MB/s via NFS

This would be impossible over a 100mbps line.

root@xbian ~ # dd if=/dev/zero of=/mnt/Public/image.test bs=32k count=2048
2048+0 records in
2048+0 records out
67108864 bytes (67 MB) copied, 6.8632 s, 9.8 MB/s

[f1vefour]

(15th Apr, 2013 05:36 PM)mk01 Wrote:  

(15th Apr, 2013 05:04 PM)f1vefour Wrote:  

(15th Apr, 2013 12:42 PM)mk01 Wrote:  do not forget, that winscp is scp (ssh) so each packet is encrypted. this takes significat power from rpi.

I have standard transfers of 12MB/s via NFS

This would be impossible over a 100mbps line.

root@xbian ~ # dd if=/dev/zero of=/mnt/Public/image.test bs=32k count=2048
2048+0 records in
2048+0 records out
67108864 bytes (67 MB) copied, 6.8632 s, 9.8 MB/s

12 MB/s would be 96 megabit thus impossible, 9.8 MB/s is 78 megabit which leaves the necessary %20+- upload overhead.

That speed is quite good.

---

(15th Apr, 2013 05:15 PM)Koenkk Wrote:  100mbps / 8 = 12,5 mb/s theoretical max speed so yes it is definitely possible over a 100 mbps line.

Not even theoretical, you must have upload bandwidth or the transfer will choke.

[mk01]

(15th Apr, 2013 05:50 PM)f1vefour Wrote:  12 MB/s would be 96 megabit thus imposdible, 9.8 MB/s is 78 megabit which leaves the necessary %20+- upload overhead.

That speed is quite good.

but as you see no fs overhead, pure zeroes via nfs. of course as soon as you involves local disk, is less. but still is ok, yes.

anyone was successful with Jumbo frames? as soon )few minutes) as I turn it on, network stops - timeouts.

I have three other servers on the net with 9000 working, so there is it not.

[zilexa]

Is FTP even faster then NFS?

[Isabel]

This slow network speed really irritates me, i think it's the most annoying thing while using internet you just get stuck with this, now a days even our 3g network are so fast so internet should be very fast.

[mk01]

(18th Jun, 2013 04:22 AM)Isabel Wrote:  This slow network speed really irritates me, i think it's the most annoying thing while using internet you just get stuck with this, now a days even our 3g network are so fast so internet should be very fast.

Isabel, I was writing this as reaction in more threads, it's not the network speed, it's the usb storage automount process using "sync" as mount option.

check /etc/usbmount/usbmount.conf ... remove the "sync" option and retest.

(but be aware, that without sync you have to "umount" disk before taking out from usb port)

---

(15th Apr, 2013 10:16 PM)zilexa Wrote:  Is FTP even faster then NFS?

both have very minimal overhead, you will not notice the difference at the speed of RPI.

with nfs you can work as with mounted drive, with ftp not. so i would definitely prefer nfs.

[Skywatch]

I tried removing the 'sync' option as above and the pi disappeared from the samba shares on the network. At this point the usbmount.conf file became read only and I could not change it back via ssh. Rebooting only got as far as the end of the bar graph and then hung when it should say starting xbmc.

I powered off and on again with the same results. Finally I accessed the pi directly and managed to change it back and all is well again.

Can anyone explain that one? ;-)

Skywatch (still with less then 100Kb network transfer to the pi)... :-(

[mk01]

you can test the sync option without actually modifying the usbmount.conf...

go to ssh, check mountpoint of the mounted partition. the do:

mount -o remount,async /mounpoint/xyz

[Skywatch]

I have tried to do this but there is no mountpoint for the USB HDD in fstab. Where would I find this info please?

Thanks

Skywatch

[Skywatch]

OK, now tried it with mount -o remount,async /dev/sda5 and no error messages but the speed actually got worse!.....

I think I will just have to unplug the HDD and attach direct to the laptop whenever I need to move files, unless there's more I can try?

Cheers

Skywatch