Transfer Speed

apastor
Posts: 175
Joined: Fri Jan 14, 2011 6:58 am

Re: Transfer Speed

Postby apastor » Mon Jul 18, 2011 1:44 pm

Thanks for the reply, but this may not be new to you, but for someone else who is new may not know.

Odd? What is odd about this. I did some research and applied my findings to my network and it worked. I do not see anything odd with it.
A CPU boost from 1.6Ghz to 2.3Ghz quad-core might give a "slightly" and I mean VERY slight change in data transfer speeds... We're talking mere 0.5MB/s speed difference.
Have you tested this out yourself? Sounds like you never have, and your just guessing. I have applied it, and saw the difference. Hence why I posted my experience here. Otherwise I would not have said anything.
I already have cat5e and cat6 allover my network. That's a no-brainer.
For you and me yes, but for someone else who is new it may not. Thats why I posted all these possibilities to rule these out.


As for your issue, first thing that came to my mind is a driver issue. Apparently you have all the hardware, great, but maybe its a driver issue on amahi. Maybe the Fedora driver needs to be updated.
Proxmox Server: Currently Not Running Amahi
CPU: AMD FX 6100 Six Core
RAM: 8GB DDR3
HDD: 4x1TB RAID10 (Adaptec)

jonathankonrad
Posts: 136
Joined: Sat Jul 25, 2009 1:42 pm

Re: Transfer Speed

Postby jonathankonrad » Mon Jul 18, 2011 3:02 pm

Just like to encourage the previous person. While much of the information may seem obvious, it is really excellent when writers take the time to write full posts with lots of information. Many users will not be as technically savvy as others, and it's so helpful when posts are written out in full.

Also, I'd like to say that even veterans make mistakes. I've been in the technology game a long time, but somehow on my own home network I constantly have errors that I miss. For example, this thread reminded me to check all my cables. Sure enough, one of my many runs was actually on some old copper. Just plain CAT 5 I must have cut years back. I had missed this in my earlier trouble shooting and it was a good reminder to not over look the obvious.

Thanks. :)

rjwaldren
Posts: 71
Joined: Mon Jan 17, 2011 7:15 pm

Re: Transfer Speed

Postby rjwaldren » Tue Jul 19, 2011 3:19 pm

Out of interest what kind of throughput have you seen since solving your cable issue.

It's important to note that those are limits based on the specifications, and do not represent real world scenarios which include overhead and interaction of all devices involved. Aside from hardware and drivers Samba itself is a notoriously low performer. I garantee you'll never go faster than that but your also unlikely to ever reach it. In practice a really good disc to disc throughput over gig will likely fall into the 77-80MB/s range, that would require fast drives/SSD/raid especially on the writing end. In practice I'd expect consistent results in the 40-50 MB/s range.

SgtFoo, have you checked the partition alignment on those WD greens? Assuming they are 4K advanced format drives, I've seen a 30-40% performance hit on misaligned partitions.
Amahi 6.1 x86_64 ExpressCD - Intel D510MO, 2GB, Promise TX300
1x 500GB 2.5" WD Black (OS and LZ). Pool: 1x 1.5TB Samsung F2, 1x 1.5TB Samsung F3, 1x 2TB Samsung F4EG
Apps: uShare, uTorrent, Amahi Energy Saver

User avatar
sgtfoo
Posts: 419
Joined: Sun Jul 18, 2010 8:27 pm

Re: Transfer Speed

Postby sgtfoo » Wed Jul 20, 2011 5:26 am

Out of interest what kind of throughput have you seen since solving your cable issue.

It's important to note that those are limits based on the specifications, and do not represent real world scenarios which include overhead and interaction of all devices involved. Aside from hardware and drivers Samba itself is a notoriously low performer. I garantee you'll never go faster than that but your also unlikely to ever reach it. In practice a really good disc to disc throughput over gig will likely fall into the 77-80MB/s range, that would require fast drives/SSD/raid especially on the writing end. In practice I'd expect consistent results in the 40-50 MB/s range.

SgtFoo, have you checked the partition alignment on those WD greens? Assuming they are 4K advanced format drives, I've seen a 30-40% performance hit on misaligned partitions.
Will check the partitions. My LZ is a drive on its own, so I would have assumed everything be ideal.

has anyone tried this?..
Dropt these lines into your smb.conf file to speed up Samba access. Find the Global area section and paste them underneath:

Code: Select all

read size = 65536 read prediction = true socket options = TCP_NODELAY SO_RCVBUF=8192 SO_SNDBUF=8192
Depending on your network card and configuration, this should speed up your LAN transfers at least tenfold.
source: http://tips4linux.com/speed-up-samba-network-access/

and there's this too...(similar)... http://www.randombugs.com/linux/speed-u ... linux.html
SgtFoo
HDA: VM inside oVirt FX-8300 95w (2 cores for HDA), 32GB RAM (2GB for HDA)
My PC: FX-8300, 16GB RAM, 3x 1TB HDDs, Radeon HD6970 2GB video; Win10 Pro x64
Other: PC, Asus 1215n (LXLE), Debian openZFS server (3x(2x2tb) mirrors)
Modem&Network: Thomson DCM475; Asus RT-AC66U; HP 1800-24G switch

apastor
Posts: 175
Joined: Fri Jan 14, 2011 6:58 am

Re: Transfer Speed

Postby apastor » Wed Jul 20, 2011 6:29 am

read size = 65536
read prediction = true
socket options = TCP_NODELAY SO_RCVBUF=8192 SO_SNDBUF=8192
Thanks for the tip.

I will try this as well and let you guys now if I see a difference.

I will do a few tests before and afterwards.
Proxmox Server: Currently Not Running Amahi
CPU: AMD FX 6100 Six Core
RAM: 8GB DDR3
HDD: 4x1TB RAID10 (Adaptec)

apastor
Posts: 175
Joined: Fri Jan 14, 2011 6:58 am

Re: Transfer Speed

Postby apastor » Wed Jul 20, 2011 10:35 pm

OK guys

I tried adding this to my smb.conf...

read size = 65536
read prediction = true
socket options = TCP_NODELAY SO_RCVBUF=8192 SO_SNDBUF=8192

And my speeds dropped

Before I applied those lines I did a quick file transfer of a 4GB file, and it transfered at about 88MB/sec

I applied those lines above and it dropped down to 24MB/sec.
Proxmox Server: Currently Not Running Amahi
CPU: AMD FX 6100 Six Core
RAM: 8GB DDR3
HDD: 4x1TB RAID10 (Adaptec)

User avatar
bigfoot65
Project Manager
Posts: 11924
Joined: Mon May 25, 2009 4:31 pm

Re: Transfer Speed

Postby bigfoot65 » Thu Jul 21, 2011 4:52 am

Same for me. It did not improve anything, only worse. Does not seem like a good solution.
ßîgƒσστ65
Applications Manager

My HDA: Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz on MSI board, 16GB RAM, 1TBx1+2TBx2+4TBx2

User avatar
sgtfoo
Posts: 419
Joined: Sun Jul 18, 2010 8:27 pm

Re: Transfer Speed

Postby sgtfoo » Thu Jul 21, 2011 4:27 pm

same for me... after those added lines, I fell to the KB/s speeds. UGLY!!!

gonna pull those and see what else..

ANY other ideas??
SgtFoo
HDA: VM inside oVirt FX-8300 95w (2 cores for HDA), 32GB RAM (2GB for HDA)
My PC: FX-8300, 16GB RAM, 3x 1TB HDDs, Radeon HD6970 2GB video; Win10 Pro x64
Other: PC, Asus 1215n (LXLE), Debian openZFS server (3x(2x2tb) mirrors)
Modem&Network: Thomson DCM475; Asus RT-AC66U; HP 1800-24G switch

jonathankonrad
Posts: 136
Joined: Sat Jul 25, 2009 1:42 pm

Re: Transfer Speed

Postby jonathankonrad » Tue Sep 20, 2011 2:42 pm

Out of interest what kind of throughput have you seen since solving your cable issue.
Sorry I did not reply earlier. When I pulled out the old cable and plugged in CAT 6 my transfer speeds are now between 40 - 60 MB/s. Earlier they stayed around 10 - 12 MB/s. It looks to me like the cable finally allowed the NIC and Switch to negotiate closer to gigabit speeds instead of 100Mbit.

Sometimes it will spike to 80 MB/s or so, but only when copying single files. When I have multiple files moving it slows right down. Is that a result of my HDs on the other end? I'm using Greyhole and just eSata. No RAID, not SSD. Just plain drives.

Thanks.

User avatar
radioz
Posts: 406
Joined: Tue Nov 24, 2009 1:07 pm

Re: Transfer Speed

Postby radioz » Tue Sep 20, 2011 3:30 pm

At 80 MB/s I think you are approaching average disk transfer rates. Once you start adding in all the overheads of buffering, network traffic, OS latencies, and head seek times, I don't think you should expect it much faster than that.

Who is online

Users browsing this forum: No registered users and 7 guests