[Samba] Tunning samba for better read performance

[Jagan Teki]

Hi,

I'm running samba server on board and client is windows 7.

I did below steps for performance tests.
+ format /dev/sda1 with ext4
+ mount the drive in server as mentioned in [media] path of /etc/samba/smb.conf
+ created a root password
$ smbpasswd -a root
+ 1Gb ethernet interface from board.
+ map the driver in windows
+ did a 4gb robocopy
+ read got 13MBps and write got 105MBps

Could any one suggest me any inputs why read got too slow, do I need to look
at any config options in /etc/samba/smb.conf

thanks!
--
Jagan.
--
To unsubscribe from this list go to the following URL and read the
instructions: https://lists.samba.org/mailman/options/samba

[Volker Lendecke]

On Wed, Nov 19, 2014 at 12:49:06PM +0530, Jagan Teki wrote:
> Hi,
>
> I'm running samba server on board and client is windows 7.
>
> I did below steps for performance tests.
> + format /dev/sda1 with ext4
> + mount the drive in server as mentioned in [media] path of /etc/samba/smb.conf
> + created a root password
> $ smbpasswd -a root
> + 1Gb ethernet interface from board.
> + map the driver in windows
> + did a 4gb robocopy
> + read got 13MBps and write got 105MBps
>
> Could any one suggest me any inputs why read got too slow, do I need to look
> at any config options in /etc/samba/smb.conf

Can you post your smb.conf?

Thanks,

Volker

--
SerNet GmbH, Bahnhofsallee 1b, 37081 Göttingen
phone: +49-551-370000-0, fax: +49-551-370000-9
AG Göttingen, HRB 2816, GF: Dr. Johannes Loxen
http://www.sernet.de, mailto:kon...@sernet.de

[Jagan Teki]

On 19 November 2014 13:59, Volker Lendecke <Volker....@sernet.de> wrote:
> On Wed, Nov 19, 2014 at 12:49:06PM +0530, Jagan Teki wrote:
>> Hi,
>>
>> I'm running samba server on board and client is windows 7.
>>
>> I did below steps for performance tests.
>> + format /dev/sda1 with ext4
>> + mount the drive in server as mentioned in [media] path of /etc/samba/smb.conf
>> + created a root password
>> $ smbpasswd -a root
>> + 1Gb ethernet interface from board.
>> + map the driver in windows
>> + did a 4gb robocopy
>> + read got 13MBps and write got 105MBps
>>
>> Could any one suggest me any inputs why read got too slow, do I need to look
>> at any config options in /etc/samba/smb.conf
>
> Can you post your smb.conf?

[global]
netbios name = %h
server string = Samba %v on (%h)
domain master = no
local master = no
preferred master = no
host msdfs = no
os level = 0
passdb backend = smbpasswd
load printers = no
printcap name = /dev/null
use sendfile = yes
client signing = no
server signing = no
display charset = UTF8
unix charset = UTF8
min receivefile size = 128k
max connections = 50
max log size = 1000
log file = /var/log/samba/log.smbd
# If using samba 3.6, uncomment below to enable SMB2
max protocol = SMB2

[media]
comment = Public share
path = /media/mydisk
readonly = no
writeable = yes
guest ok = yes

[homes]
comment = User Home Directories
browseable = no
valid users = %S
writable = yes
readonly = no

thanks!
--
Jagan.

[L.P.H. van Belle]

What mainboard is this? aka a bit more info on the hardware.
It is a nas mainboard or something like that.

Im getting 115Mb/s read and write from a windows 7.
( asrock E350 AMD board )

1Gb interface does not mean it can reach the max speed, cpu is also important in this,
so for that we need more hardware info.

I did a few of these :
http://www.sysprobs.com/windows-7-network-slow
1 is the most important.
2 stops auto update, so dont do that.
3) possible, what you want.
4) not really needed.
5) what you want.
6) This can be a point to check, make sure you have the latest NIC drivers.

and no changes at samba side for me. ( only the defaults from install )

I get these speeds with : ( tested, and what is see in windows )
samba 3.6.6 ( Debian samba ) stand server 115MB/s
samba 4.1.6 ( Ubuntu samba ) stand server 108MB/s
samba 4.1.13 ( Ubuntu sernet samba ) AD DC server 112MB/s


Louis


>-----Oorspronkelijk bericht-----
>Van: jaganna...@gmail.com
>[mailto:samba-...@lists.samba.org] Namens Jagan Teki
>Verzonden: woensdag 19 november 2014 8:19
>Aan: sa...@lists.samba.org
>Onderwerp: [Samba] Tunning samba for better read performance

[Jagan Teki]

On 19 November 2014 14:39, L.P.H. van Belle <be...@bazuin.nl> wrote:
>
>
> What mainboard is this? aka a bit more info on the hardware.
> It is a nas mainboard or something like that.

Server: Target is ARM development board where 1GB RAM with dual core
armv7 processor and
Client: Windows 7, Intel Xeon with 8GB RAM.

>
> Im getting 115Mb/s read and write from a windows 7.
> ( asrock E350 AMD board )

I think this is a valid behavior, but I have very less speed in read.
Could you share your /etc/samba/smb.conf may be I will tune accordingly.

>
> 1Gb interface does not mean it can reach the max speed, cpu is also important in this,
> so for that we need more hardware info.

I'm not much concern about speed here, I need to be a read > write
which is of identical
and good performance.

[L.P.H. van Belle]

well, Im betting its not samba's problem but can try.

I suggest first you try the win 7 speed changes, and change the UTP Cable first and put the device on an other swich port.
My guest, its the cable..

and here is my smb.conf. pretty basic.

# Global parameters
[global]
workgroup = INTERNAL
realm = INTERNAL.DOMAIN.TLD
netbios name = DC1
server role = active directory domain controller
server services = s3fs, rpc, nbt, wrepl, ldap, cldap, kdc, drepl, winbin d, ntp_signd, kcc, dnsupdate

interfaces = 127.0.0.1 192.168.1.1/24
bind interfaces only = yes
time server = yes
wins support = yes

##---- disable printing completely
load printers = no
printing = bsd
printcap name = /dev/null
disable spoolss = yes

[netlogon]
path = /home/samba/sysvol/internal.domain.tld/scripts
read only = No
acl_xattr:ignore system acl = yes

[sysvol]
path = /home/samba/sysvol
read only = No
acl_xattr:ignore system acl = yes

[media]
path = /media
read only = No
acl_xattr:ignore system acl = yes

>-----Oorspronkelijk bericht-----
>Van: Jagan Teki [mailto:jaganna...@gmail.com]
>Verzonden: woensdag 19 november 2014 10:16
>Aan: L.P.H. van Belle
>CC: sa...@lists.samba.org
>Onderwerp: Re: [Samba] Tunning samba for better read performance

[Daniel Carrasco Marín]

Hi,

Of course CPU speed and Drive speed are bottleneck but the download
speed is very slow even for a low end PC, maybe you have the same
problem i had.

What version of samba do you have? and, do you have any "audit" addon in
samba conf? (full_audit:...).

I got similar problem in a server with samba 3.5.6, upload speed was OK
but download speed was very slow, and the problem was audit addon. LAN,
HDD, and CPU usage was near to 5% but download speed was very slow.

Greetings!!

El 19/11/14 a las 10:09, L.P.H. van Belle escribió:

------------------------------------------------------------
Daniel Carrasco Marín

Técnicas Territoriales y Urbanas, S.L.
C/ Zurbano 92, 2º, 28003 Madrid
Tfno.: +34 91 571 93 46 (ext. 148) # Fax: +34 91 571 58 72
------------------------------------------------------------

[Jagan Teki]

On 19 November 2014 14:51, Daniel Carrasco Marín <d.car...@ttu.es> wrote:
> Hi,
>
> Of course CPU speed and Drive speed are bottleneck but the download speed is
> very slow even for a low end PC, maybe you have the same problem i had.
>
> What version of samba do you have? and, do you have any "audit" addon in
> samba conf? (full_audit:...).

Samba version - 3.6.22
I couldn't see any audit addon on my smb.conf

This is my smb.conf

>

[Daniel Carrasco Marín]

Oh, sorry, i thought that you only sent the "share" part :-[ .

My smb.conf have this:

### Optimizaciones
socket options = TCP_NODELAY IPTOS_LOWDELAY SO_RCVBUF=65536 SO_SNDBUF=65536
strict sync = no
sync always = no

#Logs
log level = 1
syslog = 0
log file = /var/log/samba/%m
max log size = 50

Maybe it help, it have some optimizations and avoid syslog. I'm using a
lot of W7 PCs connected without problem with that options in a Samba 3.6.6.

El 19/11/14 a las 10:28, Jagan Teki escribió:

--

------------------------------------------------------------
Daniel Carrasco Marín

Técnicas Territoriales y Urbanas, S.L.
C/ Zurbano 92, 2º, 28003 Madrid
Tfno.: +34 91 571 93 46 (ext. 148) # Fax: +34 91 571 58 72
------------------------------------------------------------

--

[Jagan Teki]

On 19 November 2014 15:06, L.P.H. van Belle <be...@bazuin.nl> wrote:
> and as extra to mention.
>
> on samba 3.6.23 on ubuntu 14.04 i got the max speed 120Mb/s
> on a software raid 1, 2 x 5400rpm drives.
> same hardware as i mentions first.
> so i really suppect hardware problems.

Ohh, So you meant to say - to dig on win 7 setup, what sort of could you please
elaborate.

>
> ( and im not often wrong ) sorry.. ;-)
>
> Greetz,
>
> Louis
>
>
>>-----Oorspronkelijk bericht-----
>>Van: be...@bazuin.nl [mailto:samba-...@lists.samba.org]
>>Namens L.P.H. van Belle
>>Verzonden: woensdag 19 november 2014 10:29
>>Aan: Jagan Teki

[Jagan Teki]

On 19 November 2014 15:07, Daniel Carrasco Marín <d.car...@ttu.es> wrote:
> Oh, sorry, i thought that you only sent the "share" part :-[ .
>
> My smb.conf have this:
>
> ### Optimizaciones
> socket options = TCP_NODELAY IPTOS_LOWDELAY SO_RCVBUF=65536 SO_SNDBUF=65536
> strict sync = no
> sync always = no
>
> #Logs
> log level = 1
> syslog = 0
> log file = /var/log/samba/%m
> max log size = 50
>
> Maybe it help, it have some optimizations and avoid syslog. I'm using a lot
> of W7 PCs connected without problem with that options in a Samba 3.6.6.
>

These setting will decrease the write speed from 103 to 78 MBps but no
change in read.

[L.P.H. van Belle]

Hai,

I dont think its you windows pc.
i dont think its samba.

I think its the device or cable or switch port.

A simple test with windows 7 is ( run as administrator CMD )
netsh interface tcp set global autotuning=disabled
and reverse with
netsh interface tcp set global autotuning=normal

disabled it sets a fixed TCP receive windows. ( 64Kb)
so set it, reboot the pc, disable any antivirus and do the copy again.

if you get the same speed, them im sure its something in you device/cables
there for i suggest you replace the cable.

and you cant tell me more about the arm device? mainboard model ( even its development )

What i must say also, the speeds i mentions are on a "tuned" partions.
aka.
My movies are on a separated partion with 4MB block size.
My music are on a separated partion with 1MB block size.

and speed differences are there yes.
movies, i always get the max speed, read and write.
music, read about 80-100MB/s
The 1K blocks partition, well depends on the size of the file. about 50-100MB/s

also, install iotop and start it before the copy test.
and see if you device can handle the speed.


Greetz,

Louis



>-----Oorspronkelijk bericht-----

>Van: Jagan Teki [mailto:jaganna...@gmail.com]

>Verzonden: woensdag 19 november 2014 11:08
>Aan: L.P.H. van Belle; sa...@lists.samba.org

[Jagan Teki]

Thanks for your data.

On 19 November 2014 16:13, L.P.H. van Belle <be...@bazuin.nl> wrote:
> Hai,
>
> I dont think its you windows pc.
> i dont think its samba.
>
> I think its the device or cable or switch port.
>
> A simple test with windows 7 is ( run as administrator CMD )
> netsh interface tcp set global autotuning=disabled
> and reverse with
> netsh interface tcp set global autotuning=normal
>
> disabled it sets a fixed TCP receive windows. ( 64Kb)
> so set it, reboot the pc, disable any antivirus and do the copy again.
>
> if you get the same speed, them im sure its something in you device/cables
> there for i suggest you replace the cable.

I just disabled autotuning and restarted the client and did the test again, but
same perf numbers.

What it means with respect to TCP window size 64Kb on disable and what exactly
the size at normal is it 1024?

and how you conclude with change in window size will have some change in perf
numbers.?

[L.P.H. van Belle]

Bigger RWIN size means lesser acknowledgement packages.

if you read :
http://en.wikipedia.org/wiki/TCP_tuning

it wil be clear to you.

But did you try with an other cable also.
really please try it.

Greetz,

Louis



>-----Oorspronkelijk bericht-----
>Van: Jagan Teki [mailto:jaganna...@gmail.com]

>Verzonden: woensdag 19 november 2014 12:23

[Jagan Teki]

On 19 November 2014 17:33, L.P.H. van Belle <be...@bazuin.nl> wrote:
> Bigger RWIN size means lesser acknowledgement packages.
>
> if you read :
> http://en.wikipedia.org/wiki/TCP_tuning
>
> it wil be clear to you.
>
> But did you try with an other cable also.

Another cable mean the eth cable connected from Server(board) to switch
or from Client(Win 7) to switch?

[Andrew Walker]

Try disabling the "use sendfile" parameter. Either comment it out or set it
to "false".

[Jeremy Allison]

On Wed, Nov 19, 2014 at 02:58:38PM +0530, Jagan Teki wrote:
> On 19 November 2014 14:51, Daniel Carrasco Marín <d.car...@ttu.es> wrote:
> > Hi,
> >
> > Of course CPU speed and Drive speed are bottleneck but the download speed is
> > very slow even for a low end PC, maybe you have the same problem i had.
> >
> > What version of samba do you have? and, do you have any "audit" addon in
> > samba conf? (full_audit:...).
>
> Samba version - 3.6.22

For SMB2 you need to upgrade to 4.1.latest.

Lots of speed improvements in the SMB2
implementation.

[Jeremy Allison]

On Wed, Nov 19, 2014 at 02:39:11PM +0530, Jagan Teki wrote:
> > Can you post your smb.conf?
>
> [global]
> netbios name = %h
> server string = Samba %v on (%h)
> domain master = no
> local master = no
> preferred master = no
> host msdfs = no
> os level = 0
> passdb backend = smbpasswd

^^^^
Remove - use a tdb passdb backend.

> load printers = no
> printcap name = /dev/null
> use sendfile = yes
> client signing = no
> server signing = no
> display charset = UTF8
> unix charset = UTF8
> min receivefile size = 128k

^^^^
Don't use the above. Doesn't do you
any good.

> max connections = 50
> max log size = 1000
> log file = /var/log/samba/log.smbd
> # If using samba 3.6, uncomment below to enable SMB2
> max protocol = SMB2

All the rest look fine. What version
of Samba are you using (that's the
first and most basic question you
should always include on a Samba
question :-) ?

[Jeremy Allison]

On Wed, Nov 19, 2014 at 03:47:35PM +0530, Jagan Teki wrote:
> On 19 November 2014 15:07, Daniel Carrasco Marín <d.car...@ttu.es> wrote:
> > Oh, sorry, i thought that you only sent the "share" part :-[ .
> >
> > My smb.conf have this:
> >
> > ### Optimizaciones
> > socket options = TCP_NODELAY IPTOS_LOWDELAY SO_RCVBUF=65536 SO_SNDBUF=65536
> > strict sync = no
> > sync always = no
> >
> > #Logs
> > log level = 1
> > syslog = 0
> > log file = /var/log/samba/%m
> > max log size = 50
> >
> > Maybe it help, it have some optimizations and avoid syslog. I'm using a lot
> > of W7 PCs connected without problem with that options in a Samba 3.6.6.
> >
>
> These setting will decrease the write speed from 103 to 78 MBps but no
> change in read.

Indeed - modern Linux TCP implementations only
go slower when you add the voodoo "socket options="
line.

Wish we could remove that parameter :-).

[Andrey Repin]

Greetings, Jagan Teki!

>> Bigger RWIN size means lesser acknowledgement packages.
>>
>> if you read :
>> http://en.wikipedia.org/wiki/TCP_tuning
>>
>> it wil be clear to you.
>>
>> But did you try with an other cable also.

> Another cable mean the eth cable connected from Server(board) to switch
> or from Client(Win 7) to switch?

I would say, ditch the switch, connect them directly.

>> really please try it.


--
WBR,
Andrey Repin (anrd...@yandex.ru) 19.11.2014, <20:55>

Sorry for my terrible english...

[Jones]

Hello Jagan,

Perhaps change the NIC driver parameters on windows 7,
Goto Control Panel -> Network and Share Center
-> Ethernet (1Gb ethernet interface on board)
-> Properties -> Configure -> Advanced,
and try followings:
1. Flow control: Disabled
2. Interrupt moderation: Disabled. Or other options.

BTW, could you post the on-board Ethernet information,
for example Intel I217-LM or Realtek Family GbE, etc,
thanks.

--
Regards,
Jones

[Jagan Teki]

Hi Jones,

On 20 November 2014 13:40, Jones <jones...@gmail.com> wrote:
> Hello Jagan,
>
> Perhaps change the NIC driver parameters on windows 7,
> Goto Control Panel -> Network and Share Center
> -> Ethernet (1Gb ethernet interface on board)
> -> Properties -> Configure -> Advanced,
> and try followings:
> 1. Flow control: Disabled
> 2. Interrupt moderation: Disabled. Or other options.

Still, I couldn't see the increasing read.

>
> BTW, could you post the on-board Ethernet information,
> for example Intel I217-LM or Realtek Family GbE, etc,

Win7 Intel 82579LM Gigabit network

[L.P.H. van Belle]

Hai,

I just read this :
http://linuxengineering.wordpress.com/2014/08/03/performance-tuning-with-pogoplug-v4/
which says, .. By default, Arch Linux ARM had an incorrectly tuned network stack.
We will correct this and optimize it for Gigabit Ethernet on a local area network.

Looks like your problem.

There are good tips in there, linux tuning, disk tuning and... samba tuning.
Go read it and try it and... be nice report your experiance back.

Greetz,

Louis


>-----Oorspronkelijk bericht-----

>Van: jaganna...@gmail.com
>[mailto:samba-...@lists.samba.org] Namens Jagan Teki

>Verzonden: donderdag 20 november 2014 12:03
>Aan: Jones
>CC: samba-t...@lists.samba.org

>Onderwerp: Re: [Samba] Tunning samba for better read performance
>

[Jagan Teki]

On 20 November 2014 16:50, L.P.H. van Belle <be...@bazuin.nl> wrote:
> Hai,
>
> I just read this :
> http://linuxengineering.wordpress.com/2014/08/03/performance-tuning-with-pogoplug-v4/
> which says, .. By default, Arch Linux ARM had an incorrectly tuned network stack.
> We will correct this and optimize it for Gigabit Ethernet on a local area network.
>
> Looks like your problem.
>
> There are good tips in there, linux tuning, disk tuning and... samba tuning.
> Go read it and try it and... be nice report your experiance back.

Yes - Indeed link has good info, with samba conf items check for
better performance,
but this couldn't help me, I tried to connect the eth interface
back-to-back as well.

[Jagan Teki]

On 19 November 2014 23:26, Andrey Repin <anrd...@yandex.ru> wrote:
> Greetings, Jagan Teki!
>
>>> Bigger RWIN size means lesser acknowledgement packages.
>>>
>>> if you read :
>>> http://en.wikipedia.org/wiki/TCP_tuning
>>>
>>> it wil be clear to you.
>>>
>>> But did you try with an other cable also.
>
>> Another cable mean the eth cable connected from Server(board) to switch
>> or from Client(Win 7) to switch?
>
> I would say, ditch the switch, connect them directly.

Yes - I connected back-to-back Arm target with Win7 - no luck still
the same numbers.

>
>>> really please try it.
>
>
> --
> WBR,
> Andrey Repin (anrd...@yandex.ru) 19.11.2014, <20:55>
>
> Sorry for my terrible english...
>



--

Jagan.

[Jagan Teki]

Hi All,

Any tool or script that finds out which packets over internet(samba)
got delayed in
case of read, any options to do on wireshark?

Any help?

[Daniel Carrasco Marín]

Hi,

Is there any way to encrypt a file to avoid it usage outside of a domain?.
I've a Samba domain, with some Windows computers connected to that
domain and i want to know if something like that exist.

Greetings!!

--
------------------------------------------------------------
Daniel Carrasco Marín

Técnicas Territoriales y Urbanas, S.L.
C/ Zurbano 92, 2º, 28003 Madrid
Tfno.: +34 91 571 93 46 (ext. 148) # Fax: +34 91 571 58 72
------------------------------------------------------------

[David Bear]

this would be an interesting 'feature' -- the question is what would the
encryption key be -- who who hold it, and how would you prevent a drag'n
dropping of the file out of the file server to the users desktop ?

On Fri, Nov 21, 2014 at 5:48 AM, Daniel Carrasco Marín <d.car...@ttu.es>
wrote:

> Hi,

--
David Bear
mobile: (602) 903-6476

[Nico Kadel-Garcia]

On Sat, Nov 22, 2014 at 2:05 PM, David Bear <dwbe...@gmail.com> wrote:
> this would be an interesting 'feature' -- the question is what would the
> encryption key be -- who who hold it, and how would you prevent a drag'n
> dropping of the file out of the file server to the users desktop ?

> On Fri, Nov 21, 2014 at 5:48 AM, Daniel Carrasco Marín <d.car...@ttu.es>
> wrote:
>
>> Hi,
>>
>> Is there any way to encrypt a file to avoid it usage outside of a domain?.
>> I've a Samba domain, with some Windows computers connected to that domain
>> and i want to know if something like that exist.
>>
>> Greetings!!

I don't see anything like that right now. It sounds like a *lot* of
pain to integrate with a stable, mission critical toolkit that's woven
into system operating systems and is exceptionally unlikely to ever be
excepted into the Windows kernels to work well with Samba.

You can achieve *most* of this by using a Kerberos sensitive file
sharing system, such as NFSv4 on Linux/UNIX hosts and CIFS group
enabled access on the Windows clients. It takes work to integrate
those, but it can certainly work with NetApp based servers.

And there is no defense in this approach to drag'n-drop, David is
quite right. But it's a reasonable place to work from.

[d.car...@ttu.es]

Hi, that's truth ;)

I forgot to say that is only curiosity ;)

I was talking about something like windows option (right click
properties -> Advanced -> encrypt content...), but i'm not really sure
if that really works :P
Something like: if a user copy a file from server allow it usage in
every PC where he's logged (or anyone with permissions in that file),
but disallow to user reasd that file without be logged (in home for
exampled). Really it's a lot of work implement something like that and
sure that you need to install 3rd party software on clients to allow
windows to read permissions from file in AD, and get decryption key.

Thanks all!!

[John Lewis]

On 11/23/2014 03:13 AM, d.car...@ttu.es wrote:
>
> Hi, that's truth ;)
>
> I forgot to say that is only curiosity ;)
>
> I was talking about something like windows option (right click
> properties -> Advanced -> encrypt content...), but i'm not really sure
> if that really works :P
> Something like: if a user copy a file from server allow it usage in
> every PC where he's logged (or anyone with permissions in that file),
> but disallow to user reasd that file without be logged (in home for
> exampled). Really it's a lot of work implement something like that and
> sure that you need to install 3rd party software on clients to allow
> windows to read permissions from file in AD, and get decryption key.
>
> Thanks all!!

That effect isn't from Window's implementation of SMB at all. It is from
EFS http://technet.microsoft.com/en-us/library/cc700811.aspx.

If you are running Samba on Linux you could try similar file systems
such as encfs https://wiki.archlinux.org/index.php/EncFS.