Replies module not working

[Dima Saveliev]

Hi, can somebody please confirm that replies module working in Rspamd 1.5.2?
My config is pretty straightforward, but I see no symbols inserted in incoming replies and no rr keys in redis db

rspamadm configdump replies
*** Section replies ***
expire = 86400;
key_prefix = "rr";
message = "Message is reply to one we originated";
symbol = "REPLY";
servers = "localhost";
action = "no action";

*** End of section replies ***

cat /etc/rmilter.conf.local
# /etc/rmilter.conf.local

spamd {
    # use rspamd action for greylisting
    spamd_greylist = yes;

    # use rspamd action for messages
    spamd_soft_fail = yes;

    # add extended headers for messages
    extended_spam_headers = yes;
};

limits {
    enable = false;
};

greylisting {
    enable = false;
};

dkim {
    rspamd_sign = yes;
};

strict_auth = true;

I've tried to debug the issue by placing simple unconditional logging at the very beginning of replies_set and replies_check functions in replies.lua and found that incoming mail hits both functions, however outgoing mail hits replies_check only.
Any ideas?

[Andrew Lewis]

Hi Dima,

> I've tried to debug the issue by placing simple unconditional logging at
> the very beginning of replies_set and replies_check functions in
> replies.lua and found that incoming mail hits both functions, however
> outgoing mail hits replies_check only.
> Any ideas?

Do you disable one of these with `settings` module? Guessing not- does
your outbound mail come from an authenticated user or a reserved IP
range? (replies module is looking for one of these things). If the
mail /does/ from a reserved IP range or authenticated user, is
`milter_mail_macros` or equivalent set correctly?
https://rspamd.com/rmilter/#postfix-settings

Best,
-AL.

[Alex JOST]

Am 14.03.2017 um 04:55 schrieb Dima Saveliev:
> Hi, can somebody please confirm that replies module working in Rspamd 1.5.2?
> My config is pretty straightforward, but I see no symbols inserted in
> incoming replies and no rr keys in redis db

It is working for us with 1.5.2.

> rspamadm configdump replies
> *** Section replies ***
> expire = 86400;
> key_prefix = "rr";
> message = "Message is reply to one we originated";
> symbol = "REPLY";
> servers = "localhost";
> action = "no action";
>
> *** End of section replies ***

The configdump looks a bit different for us as we redefined the
parameters in '/etc/rspamd/rspamd.conf.local' but it's basically the same.

root# rspamadm configdump replies

*** Section replies ***
expire = 86400;
key_prefix = "rr";
message = "Message is reply to one we originated";
symbol = "REPLY";

*** End of section replies ***

*** Section replies ***
servers = "10.0.0.1";
password = "password";
dbname = "1";
key_prefix = "reply.";
expire = 432000;

message = "Message is reply to one we originated";

symbol = "REPLY-ORIGIN";

*** End of section replies ***

--
Alex JOST

[Dima Saveliev]

Thanks for confirmation!

вторник, 14 марта 2017 г., 18:41:27 UTC+8 пользователь Alex JOST написал:

[Dima Saveliev]

Do you disable one of these with `settings` module? Guessing not- does  
your outbound mail come from an authenticated user or a reserved IP  
range? (replies module is looking for one of these things). If the  
mail /does/ from a reserved IP range or authenticated user, is  
`milter_mail_macros` or equivalent set correctly?  
https://rspamd.com/rmilter/#postfix-settings

I believe all the settings you mentioned are correct in my case. I did not touch settings module, outbound mail come from an authenticated user, my postfix config looks as follows:

smtpd_milters = unix:/rmilter/rmilter.sock (chroot)
milter_mail_macros = i {mail_addr} {client_addr} {client_name} {auth_authen}
milter_protocol = 6

I even removed all the changes I made to default Rspamd config except of logging and replies module but it did not help

Here is outbound mail:

#5851(normal) <77fc6a>; task; accept_socket: accepted connection from 127.0.0.1 port 56210, task ptr: 00007F5A61BA4000
#5851(normal) <77fc6a>; task; rspamd_mime_text_to_utf8: converted from windows-1251 to UTF-8 inlen: 102, outlen: 124
#5851(normal) <77fc6a>; task; rspamd_message_parse: loaded message; id: <845768799.20...@domain.local>; queue-id: <55C372061A>; size: 669; checksum: <4bb93233cb2877090846d9b0b2bf5e3e>
#5851(normal) <77fc6a>; lua; replies.lua:43: >>>>> replies_check call
#5851(normal) <77fc6a>; task; dkim_symbol_callback: skip DKIM checks for local networks and authorized users
#5851(normal) <77fc6a>; task; rspamd_stat_classifiers_process: skip statistics as SPAM class is missing
#5851(normal) <77fc6a>; task; rspamd_task_write_log: id: <845768799.20...@domain.local>, qid: <55C372061A>, ip: 192.168.0.30, user: te...@domain.local, from: <te...@domain.local>, (default: F (no action): [0.00/15.00] []), len: 669, time: 0.000ms real, 1.827ms virtual, dns req: 0, digest: <4bb93233cb2877090846d9b0b2bf5e3e>, rcpts: <te...@domain.com>, mime_rcpt: <te...@domain.com>
#5851(normal) <77fc6a>; task; rspamd_protocol_http_reply: regexp statistics: 0 pcre regexps scanned, 0 regexps matched, 272 regexps total, 0 regexps cached, 0B bytes scanned using pcre, 0B bytes scanned total

and here is inbound reply:

#5852(normal) <54cfff>; task; accept_socket: accepted connection from 127.0.0.1 port 56218, task ptr: 00007F5A61B9C010
#5852(normal) <54cfff>; task; rspamd_mime_text_to_utf8: converted from windows-1251 to UTF-8 inlen: 181, outlen: 229
#5852(normal) <54cfff>; task; rspamd_message_parse: loaded message; id: <16729853.20...@domain.com>; queue-id: <1FB742061A>; size: 1533; checksum: <c96767b06d12b2784b99f09737cf02d6>
#5852(normal) <54cfff>; lua; replies.lua:43: >>>>> replies_check call
#5852(normal) <54cfff>; task; bayes_classify: skip classification as ham class has not enough learns: 0, 200 required
#5852(normal) <54cfff>; lua; replies.lua:85: >>>>> replies_set call
#5852(normal) <54cfff>; task; rspamd_task_write_log: id: <16729853.20...@domain.com>, qid: <1FB742061A>, ip: 195.206.48.xxx, from: <te...@domain.com>, (default: F (no action): [-0.30/15.00] [R_SPF_ALLOW(-0.20){+mx;},MIME_GOOD(-0.10){text/plain;},ASN(0.00){asn:8345, ipnet:195.206.32.0/19, country:RU;},DMARC_NA(0.00){domain.com;},FROM_EQ_ENVFROM(0.00){},FROM_HAS_DN(0.00){},HAS_X_PRIO_3(0.00){},MID_RHS_MATCH_FROM(0.00){},PREVIOUSLY_DELIVERED(0.00){te...@domain.local;},RCPT_COUNT_1(0.00){},RCVD_COUNT_4(0.00){},R_DKIM_NA(0.00){},TO_DN_ALL(0.00){},TO_MATCH_ENVRCPT_ALL(0.00){}]), len: 1533, time: 963.981ms real, 12.310ms virtual, dns req: 23, digest: <c96767b06d12b2784b99f09737cf02d6>, rcpts: <te...@domain.local>, mime_rcpt: <te...@domain.local>
#5852(normal) <54cfff>; task; rspamd_protocol_http_reply: regexp statistics: 0 pcre regexps scanned, 2 regexps matched, 272 regexps total, 95 regexps cached, 0B bytes scanned using pcre, 1.93k bytes scanned total

Please note that '>>>>> replies_check call' and '>>>>> replies_set call' are diagnostic lines produced by additional debug logging I put in replies.lua:

local function replies_check(task)
  rspamd_logger.infox(task, ">>>>> replies_check call");
...

local function replies_set(task)
  rspamd_logger.infox(task, ">>>>> replies_set call");
...

As I can see for some reason outbound message does not call replies_set at all
Thanks!

[Vsevolod Stakhov]

I don't see `user` in the log line. Do you have the correct settings for
milter in your MTA, namely you should pass `auth_authen` macro. Here is
the example for Postfix:

milter_default_action = accept


milter_protocol = 6

[Andrew Lewis]

Hi Dima,

> Here is outbound mail:

Did it have a Message-ID header?

> and here is inbound reply:

Message seems to have come from a host listed in `local_addrs` - that
won't work well - I would suggest to avoid tampering with this setting
if you can (at least hosts delivering inbound mail should not be here).

Best,
-AL.

[Dima Saveliev]

Did it have a Message-ID header?

#5851(normal) <77fc6a>; task; rspamd_message_parse: loaded message; id: <845768799.20170315102442@

domain.local>

domain.local is a testing ground with Rspamd, domain.com - production server

 

Message seems to have come from a host listed in `local_addrs`

Do you mean:
 #5852(normal) <54cfff>; task; accept_socket: accepted connection from 127.0.0.1 port 56218, task ptr: 00007F5A61B9C010 ?
I think 127.0.0.1 comes from rmilter, real IP of domain.com listed lower in the log: 195.206.48.xxx
 Thanks

[Andrew Lewis]

Hi Dima,

>> Did it have a Message-ID header?
> #5851(normal) <77fc6a>; task; rspamd_message_parse: loaded message; id:
> <845768799.20170315102442@
> domain.local>

Right, there it is.

> Do you mean:
> #5852(normal) <54cfff>; task; accept_socket: accepted connection from
> 127.0.0.1 port 56218, task ptr: 00007F5A61B9C010 ?
> I think 127.0.0.1 comes from rmilter, real IP of domain.com listed lower in
> the log: 195.206.48.xxx

I meant 195.206.48.xxx but I may have made a bad assumption about
quite where you put your logging.

Do you somehow disable checks/force no action for outbound mail? I
notice it doesn't seem to yield any symbols.

Best,
-AL.

[Dima Saveliev]

Всеволод, извиняюсь, что по-русски, мой английский уже спит в это время. user вроде как есть в логе:

>#5851(normal) <77fc6a>; task; rspamd_task_write_log: id: <845768799.20170315102442@

domain.local>, qid: <55C372061A>, ip: 192.168.0.30, user: te...@domain.local

да и dkim, например, его прекрасно видит:

>#5851(normal) <77fc6a>; task; dkim_symbol_callback: skip DKIM checks for local networks and authorized users

Rmilter в postfix настроен как рекомендовано в документации, в частности есть и  {auth_authen}. Нет, разве что 'milter_default_action = accept', проверю с ним завтра, но не думаю, что повлияет.
Я добавил в replies.lua безусловное логирование вызовов replies_set и replis_check в самом начале этих функций, т. е. еще до проверки аутентификации пользователя и локальных сетей внутри функций:

local function replies_check(task)
  rspamd_logger.infox(task, ">>>>> replies_check call");
...
local function replies_set(task)
  rspamd_logger.infox(task, ">>>>> replies_set call");
...

и, судя по логу, replies_set не вызывается при исходящем сообщении вообще

Как такое может быть?
Спасибо!

среда, 15 марта 2017 г., 18:06:23 UTC+8 пользователь vsevolod написал:

On 15/03/17 09:32, Dima Saveliev wrote:
>
>     Do you disable one of these with `settings` module? Guessing not-
>     does  
>     your outbound mail come from an authenticated user or a reserved IP  
>     range? (replies module is looking for one of these things). If the  
>     mail /does/ from a reserved IP range or authenticated user, is  
>     `milter_mail_macros` or equivalent set correctly?  
>     https://rspamd.com/rmilter/#postfix-settings
>     <https://rspamd.com/rmilter/#postfix-settings>
>
>
> I believe all the settings you mentioned are correct in my case. I did
> not touch settings module, outbound mail come from an authenticated
> user, my postfix config looks as follows:
>
> smtpd_milters = unix:/rmilter/rmilter.sock (chroot)
> milter_mail_macros = i {mail_addr} {client_addr} {client_name} {auth_authen}
> milter_protocol = 6
>
> I even removed all the changes I made to default Rspamd config except of
> logging and replies module but it did not help
>
> Here is outbound mail:
>
> #5851(normal) <77fc6a>; task; accept_socket: accepted connection from
> 127.0.0.1 port 56210, task ptr: 00007F5A61BA4000
> #5851(normal) <77fc6a>; task; rspamd_mime_text_to_utf8: converted from
> windows-1251 to UTF-8 inlen: 102, outlen: 124
> #5851(normal) <77fc6a>; task; rspamd_message_parse: loaded message; id:

> <845768799.20170315102442@domain.local>; queue-id: <55C372061A>; size:

> 669; checksum: <4bb93233cb2877090846d9b0b2bf5e3e>
> #5851(normal) <77fc6a>; lua; replies.lua:43: >>>>> replies_check call
> #5851(normal) <77fc6a>; task; dkim_symbol_callback: skip DKIM checks for
> local networks and authorized users
> #5851(normal) <77fc6a>; task; rspamd_stat_classifiers_process: skip
> statistics as SPAM class is missing
> #5851(normal) <77fc6a>; task; rspamd_task_write_log: id:

> <845768799.20170315102442@domain.local>, qid: <55C372061A>, ip:

> country:RU;},DMARC_NA(0.00){domain.com;},FROM_EQ_ENVFROM(0.00){},FROM_HAS_DN(0.00){},HAS_X_PRIO_3(0.00){},MID_RHS_MATCH_FROM(0.00){},PREVIOUSLY_DELIVERED(0.00){test@domain.local;},RCPT_COUNT_1(0.00){},RCVD_COUNT_4(0.00){},R_DKIM_NA(0.00){},TO_DN_ALL(0.00){},TO_MATCH_ENVRCPT_ALL(0.00){}]),

[Vsevolod Stakhov]

Could you please enable full debug for the task and symcache:

debug_modules = ["task", "symcache"];

in local.d/logging.inc and show me the scan results for outbound message
(it might be a large piece of log). If there is something confidential
then you can send that log to me directly encrypting it using my gpg key.

On 15/03/17 14:23, Dima Saveliev wrote:
> Всеволод, извиняюсь, что по-русски, мой английский уже спит в это время.
> user вроде как есть в логе:
>
>>#5851(normal) <77fc6a>; task; rspamd_task_write_log: id:
> <845768799.20170315102442@
> domain.local>, qid: <55C372061A>, ip: 192.168.0.30, user: te...@domain.local
>
> да и dkim, например, его прекрасно видит:
>
>>#5851(normal) <77fc6a>; task; dkim_symbol_callback: skip DKIM checks
> for local networks and authorized users
>
> Rmilter в postfix настроен как рекомендовано в документации, в частности
> есть и {auth_authen}. Нет, разве что 'milter_default_action = accept',
> проверю с ним завтра, но не думаю, что повлияет.

> Я добавил в replies.lua /безусловное/ логирование вызовов replies_set и

> > <845768799.20...@domain.local>; queue-id: <55C372061A>;

> size:
> > 669; checksum: <4bb93233cb2877090846d9b0b2bf5e3e>
> > #5851(normal) <77fc6a>; lua; replies.lua:43: >>>>> replies_check call
> > #5851(normal) <77fc6a>; task; dkim_symbol_callback: skip DKIM
> checks for
> > local networks and authorized users
> > #5851(normal) <77fc6a>; task; rspamd_stat_classifiers_process: skip
> > statistics as SPAM class is missing
> > #5851(normal) <77fc6a>; task; rspamd_task_write_log: id:

> > <845768799.20...@domain.local>, qid: <55C372061A>, ip:

> > 192.168.0.30, user: te...@domain.local, from: <te...@domain.local>,
> > (default: F (no action): [0.00/15.00] []), len: 669, time: 0.000ms
> real,
> > 1.827ms virtual, dns req: 0, digest:
> <4bb93233cb2877090846d9b0b2bf5e3e>,

> > rcpts: <te...@domain.com <javascript:>>, mime_rcpt:
> <te...@domain.com <javascript:>>

> > #5851(normal) <77fc6a>; task; rspamd_protocol_http_reply: regexp
> > statistics: 0 pcre regexps scanned, 0 regexps matched, 272 regexps
> > total, 0 regexps cached, 0B bytes scanned using pcre, 0B bytes
> scanned total
> >
> > and here is inbound reply:
> >
> > #5852(normal) <54cfff>; task; accept_socket: accepted connection from
> > 127.0.0.1 port 56218, task ptr: 00007F5A61B9C010
> > #5852(normal) <54cfff>; task; rspamd_mime_text_to_utf8: converted
> from
> > windows-1251 to UTF-8 inlen: 181, outlen: 229
> > #5852(normal) <54cfff>; task; rspamd_message_parse: loaded
> message; id:

> > <16729853.20...@domain.com <javascript:>>; queue-id: <1FB742061A>;

> size:
> > 1533; checksum: <c96767b06d12b2784b99f09737cf02d6>
> > #5852(normal) <54cfff>; lua; replies.lua:43: >>>>> replies_check call
> > #5852(normal) <54cfff>; task; bayes_classify: skip classification
> as ham
> > class has not enough learns: 0, 200 required
> > #5852(normal) <54cfff>; lua; replies.lua:85: >>>>> replies_set call
> > #5852(normal) <54cfff>; task; rspamd_task_write_log: id:

> > <16729853.20...@domain.com <javascript:>>, qid: <1FB742061A>, ip:
> > 195.206.48.xxx, from: <te...@domain.com <javascript:>>, (default:

> F (no action):
> > [-0.30/15.00]
> >
> [R_SPF_ALLOW(-0.20){+mx;},MIME_GOOD(-0.10){text/plain;},ASN(0.00){asn:8345,
>

> > ipnet:195.206.32.0/19 <http://195.206.32.0/19>,
> > country:RU;},DMARC_NA(0.00){domain.com
> <http://domain.com>;},FROM_EQ_ENVFROM(0.00){},FROM_HAS_DN(0.00){},HAS_X_PRIO_3(0.00){},MID_RHS_MATCH_FROM(0.00){},PREVIOUSLY_DELIVERED(0.00){te...@domain.local;},RCPT_COUNT_1(0.00){},RCVD_COUNT_4(0.00){},R_DKIM_NA(0.00){},TO_DN_ALL(0.00){},TO_MATCH_ENVRCPT_ALL(0.00){}]),

> --
> You received this message because you are subscribed to the Google
> Groups "rspamd" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to rspamd+un...@googlegroups.com
> <mailto:rspamd+un...@googlegroups.com>.
> Visit this group at https://groups.google.com/group/rspamd.

[Dima Saveliev]

here is outbound mail debug log:

(normal) <2bf23b>; task; accept_socket: accepted connection from 127.0.0.1 port 44728, task ptr: 00007FC30AB9C010
(normal) <2bf23b>; task; rspamd_protocol_handle_headers: read rcpt header, value: <di...@domain.com>
(normal) <2bf23b>; task; rspamd_protocol_handle_headers: read helo header, value: ws030va.domain.local
(normal) <2bf23b>; task; rspamd_protocol_handle_headers: read hostname header, value: [192.168.0.30]
(normal) <2bf23b>; task; rspamd_protocol_handle_headers: read IP header, value: 192.168.0.30
(normal) <2bf23b>; task; rspamd_protocol_handle_headers: read queue_id header, value: 58435205E7
(normal) <2bf23b>; task; rspamd_protocol_handle_headers: read MTA-Tag header, value: mail.domain.local
(normal) <2bf23b>; task; rspamd_protocol_handle_headers: unknown header: Content-Type
(normal) <2bf23b>; task; rspamd_protocol_handle_headers: unknown header: Content-Length
(normal) <2bf23b>; task; rspamd_task_load_message: got input of length 0
(normal) <2bf23b>; task; rspamd_task_process: completed stage 1
(normal) <2bf23b>; task; rspamd_task_process: completed stage 2
(normal) <2bf23b>; task; rspamd_message_parse: construct mime parser from string length 610
(normal) <2bf23b>; task; rspamd_mime_headers_process: start processing headers
(normal) <2bf23b>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <2bf23b>; task; rspamd_mime_header_add: add new raw header Received: from ws030va.domain.local ([192.168.0.30] [192.168.0.30]) by localhost (Postfix) with ESMTP id 366e9f28ae;
(normal) <2bf23b>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <2bf23b>; task; rspamd_mime_header_add: add new raw header Date: Thu, 16 Mar 2017 11:40:55 +0800
(normal) <2bf23b>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <2bf23b>; task; rspamd_mime_header_add: add new raw header From: te...@domain.local
(normal) <2bf23b>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <2bf23b>; task; rspamd_mime_header_add: add new raw header X-Priority: 3 (Normal)
(normal) <2bf23b>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <2bf23b>; task; rspamd_mime_header_add: add new raw header Message-ID: <1610585238.2...@domain.local>
(normal) <2bf23b>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <2bf23b>; task; rspamd_mime_header_add: add new raw header To: di...@domain.com
(normal) <2bf23b>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <2bf23b>; task; rspamd_mime_header_add: add new raw header Subject: 1
(normal) <2bf23b>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <2bf23b>; task; rspamd_mime_header_add: add new raw header MIME-Version: 1.0
(normal) <2bf23b>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <2bf23b>; task; rspamd_mime_header_add: add new raw header Content-Type: text/plain; charset=windows-1251
(normal) <2bf23b>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <2bf23b>; task; rspamd_mime_header_add: add new raw header Content-Transfer-Encoding: quoted-printable
(normal) <2bf23b>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <2bf23b>; task; rspamd_mime_header_add: add new raw header Return-Path: <te...@domain.local>
(normal) <2bf23b>; task; rspamd_mime_header_add: add new raw header X-Rcpt-To: <di...@domain.com>
(normal) <2bf23b>; task; rspamd_message_parse: found 1 parts in message
(normal) <2bf23b>; task; rspamd_mime_text_to_utf8: converted from windows-1251 to UTF-8 inlen: 100, outlen: 122
(normal) <2bf23b>; task; rspamd_url_trie_generic_callback_common: extract of url 'mailto:te...@domain.local' failed: TLD part is not detected
(normal) <2bf23b>; task; rspamd_message_parse: the first received seems to be not ours, replace it with fake one
(normal) <2bf23b>; task; rspamd_message_parse: loaded message; id: <1610585238.2...@domain.local>; queue-id: <58435205E7>; size: 610; checksum: <eef77378eadae5379ec091278c26df06>
(normal) <2bf23b>; task; rspamd_task_process: completed stage 4
(normal) <2bf23b>; task; rspamd_symbols_cache_process_symbols: symbols processing stage at pass: 0
(normal) <2bf23b>; task; rspamd_symbols_cache_check_symbol: execute EMAIL_PLUS_ALIASES, 81
(normal) <2bf23b>; task; rspamd_symbols_cache_check_symbol: execute REPLIES_CHECK, 414
(normal) <2bf23b>; lua; replies.lua:43: >>>>> replies_check call
(normal) <2bf23b>; task; rspamd_symbols_cache_check_symbol: execute SETTINGS_CHECK, 416
(normal) <2bf23b>; task; rspamd_symbols_cache_enable_symbol_checkpoint: enable execution of R_DKIM_REJECT
(normal) <2bf23b>; task; rspamd_symbols_cache_enable_symbol_checkpoint: enable execution of R_DKIM_ALLOW
(normal) <2bf23b>; task; rspamd_symbols_cache_enable_symbol_checkpoint: enable execution of R_DKIM_TEMPFAIL
(normal) <2bf23b>; task; rspamd_task_process: completed stage 8
(normal) <2bf23b>; task; rspamd_symbols_cache_process_symbols: symbols processing stage at pass: 2
(normal) <2bf23b>; task; rspamd_symbols_cache_process_symbols: symbols processing stage at pass: 3
(normal) <2bf23b>; task; rspamd_symbols_cache_check_symbol: execute R_DKIM_REJECT, 96
(normal) <2bf23b>; task; dkim_symbol_callback: skip DKIM checks for local networks and authorized users
(normal) <2bf23b>; task; rspamd_task_process: completed stage 16
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: added stat tokens for part language 'russian'
(normal) <2bf23b>; task; rspamd_stat_tokenize_header: added stat tokens for header 'Content-Type'
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.25
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) logger; file_log_function: Last message repeated 4 times
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.50
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 1.00
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 1.00
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 1.00
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 1.00
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <2bf23b>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <2bf23b>; task; rspamd_stat_preprocess: symbol BAYES_SPAM is disabled, skip classification
(normal) <2bf23b>; task; rspamd_stat_preprocess: symbol BAYES_HAM is disabled, skip classification
(normal) <2bf23b>; task; rspamd_task_process: completed stage 32
(normal) <2bf23b>; task; rspamd_task_process: completed stage 64
(normal) <2bf23b>; task; rspamd_stat_classifiers_process: skip statistics as SPAM class is missing
(normal) <2bf23b>; task; rspamd_task_process: completed stage 128
(normal) <2bf23b>; task; rspamd_task_process: completed stage 256
(normal) <2bf23b>; task; rspamd_symbols_cache_process_symbols: symbols processing stage at pass: 5
(normal) <2bf23b>; task; rspamd_task_process: completed stage 512
(normal) <2bf23b>; task; rspamd_task_process: completed stage 1024
(normal) <2bf23b>; task; rspamd_task_process: completed stage 2048
(normal) <2bf23b>; task; rspamd_task_process: completed stage 4096
(normal) <2bf23b>; task; rspamd_task_process: task is processed
(normal) <2bf23b>; task; rspamd_protocol_write_reply: writing reply to client
(normal) <2bf23b>; task; rspamd_task_write_log: id: <1610585238.2...@domain.local>, qid: <58435205E7>, ip: 192.168.0.30, user: te...@domain.local, from: <te...@domain.local>, (default: F (no action): [0.00/15.00] []), len: 610, time: 0.000ms real, 2.098ms virtual, dns req: 0, digest: <eef77378eadae5379ec091278c26df06>, rcpts: <di...@domain.com>, mime_rcpt: <di...@domain.com>
(normal) <2bf23b>; task; rspamd_protocol_http_reply: regexp statistics: 0 pcre regexps scanned, 0 regexps matched, 272 regexps total, 0 regexps cached, 0B bytes scanned using pcre, 0B bytes scanned total
(normal) <2bf23b>; task; rspamd_worker_finish_handler: normally closing connection from: 127.0.0.1
(normal) <2bf23b>; task; rspamd_task_free: free pointer 00007FC30AB9C010

I changed actual domain name to just 'domain'. Please note that mail.domain.com is production mail server, mail.domain.local - test mail server with Rspamd

Just in case it needed, my milter section in main.cf is:

smtpd_milters = unix:/rmilter/rmilter.sock

milter_mail_macros = i {mail_addr} {client_addr} {client_name} {auth_authen}

milter_default_action = accept
milter_protocol = 6

rspamadm configdump logging
/* skipping long output */
...
((NULL)) <gn6bpf>; symcache; rspamd_symbols_cache_add_symbol: used items: 414, added symbol: REPLIES_SET, 413
((NULL)) <gn6bpf>; symcache; rspamd_symbols_cache_add_symbol: used items: 415, added symbol: REPLIES_CHECK, 414
((NULL)) <gn6bpf>; symcache; rspamd_symbols_cache_add_symbol: used items: 416, added symbol: REPLY, 415
...
*** Section logging ***
type = "file";
systemd = true;
level = "info";
log_format = <<EOD
id: <$mid>,$if_qid{ qid: <$>,}$if_ip{ ip: $,}$if_user{ user: $,}$if_smtp_from{ from: <$>,}
(default: $is_spam ($action): [$scores] [$symbols_scores_params]),
len: $len, time: $time_real real, $time_virtual virtual, dns req: $dns_req,
digest: <$digest>$if_smtp_rcpts{, rcpts: <$>}$if_mime_rcpt{, mime_rcpt: <$>}
EOD;
log_re_cache = true;
color = false;
debug_modules [
    "task",
    "symcache",
]
filename = "/var/log/rspamd/rspamd.log";

*** End of section logging ***

rspamadm configdump replies
/* skipping long output */

*** Section replies ***
expire = 86400;
key_prefix = "rr";
message = "Message is reply to one we originated";
symbol = "REPLY";
servers = "localhost";

*** End of section replies ***

Thanks!

четверг, 16 марта 2017 г., 2:19:55 UTC+8 пользователь vsevolod написал:

>     > <845768799.20170315102442@domain.local>; queue-id: <55C372061A>;

>     size:
>     > 669; checksum: <4bb93233cb2877090846d9b0b2bf5e3e>
>     > #5851(normal) <77fc6a>; lua; replies.lua:43: >>>>> replies_check call
>     > #5851(normal) <77fc6a>; task; dkim_symbol_callback: skip DKIM
>     checks for
>     > local networks and authorized users
>     > #5851(normal) <77fc6a>; task; rspamd_stat_classifiers_process: skip
>     > statistics as SPAM class is missing
>     > #5851(normal) <77fc6a>; task; rspamd_task_write_log: id:

>     > <845768799.20170315102442@domain.local>, qid: <55C372061A>, ip:

[Vsevolod Stakhov]

On 16/03/17 04:14, Dima Saveliev wrote:
> here is outbound mail debug log:
>

It seems that your settings disable all symbols with the exception of
'dkim'. That's why no checks are done.

[Dima Saveliev]

It seems that with my settings Rspamd does not process symbols on outbound mail, though I strictly followed 'Scanning outbound mail' document

Here is inbound mail debug log for comparison (please note that unlike outbound mail both REPLIES_CHECK and REPLIES_SET executed):

(normal) <fd9321>; task; accept_socket: accepted connection from 127.0.0.1 port 37552, task ptr: 00007F83DCF84010
(normal) <fd9321>; task; rspamd_protocol_handle_headers: read rcpt header, value: <te...@domain.local>
(normal) <fd9321>; task; rspamd_protocol_handle_headers: read helo header, value: mail.domain.com
(normal) <fd9321>; task; rspamd_protocol_handle_headers: read hostname header, value: mail.domain.com
(normal) <fd9321>; task; rspamd_protocol_handle_headers: read IP header, value: 195.206.48.xxx
(normal) <fd9321>; task; rspamd_protocol_handle_headers: read queue_id header, value: BEE522061C
(normal) <fd9321>; task; rspamd_protocol_handle_headers: read MTA-Tag header, value: mail.domain.local
(normal) <fd9321>; task; rspamd_protocol_handle_headers: unknown header: Content-Type
(normal) <fd9321>; task; rspamd_protocol_handle_headers: unknown header: Content-Length
(normal) <fd9321>; task; rspamd_task_load_message: got input of length 0
(normal) <fd9321>; task; rspamd_task_process: completed stage 1
(normal) <fd9321>; task; rspamd_task_process: completed stage 2
(normal) <fd9321>; task; rspamd_message_parse: construct mime parser from string length 1637
(normal) <fd9321>; task; rspamd_mime_headers_process: start processing headers
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header Received: from mail.domain.com (mail.domain.com [195.206.48.xxx]) by localhost (Postfix) with ESMTP id 6f43ff2480;
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->3
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->3
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: append raw header Received: from localhost (localhost [127.0.0.1]) by mail.domain.com (Postfix) with ESMTP id 2735220A7C for <te...@domain.local>; Fri, 17 Mar 2017 15:29:49 +0800 (IRKT)
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header X-Virus-Scanned: by amavisd-new-2.6.4 (20090625) (Debian) at domain.com
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->3
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->3
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->3
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: append raw header Received: from mail.domain.com ([127.0.0.1]) by localhost (mail.domain.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id DyTZS9XT+9tu for <te...@domain.local>; Fri, 17 Mar 2017 15:29:49 +0800 (IRKT)
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->3
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->3
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: append raw header Received: from ws030va.domain.local (unknown [192.168.0.30]) by mail.domain.com (Postfix) with ESMTPSA id F2DDB206FE for <te...@domain.local>; Fri, 17 Mar 2017 15:29:48 +0800 (IRKT)
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header Date: Fri, 17 Mar 2017 15:29:49 +0800
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header From: di...@domain.com
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header X-Priority: 3 (Normal)
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header Message-ID: <183712261.20...@domain.com>
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header To: te...@domain.local
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header Subject: Re: 15
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header In-Reply-To: <924635526.20...@domain.local>
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header References: <924635526.20...@domain.local>
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header MIME-Version: 1.0
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header Content-Type: text/plain; charset=windows-1251
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header Content-Transfer-Encoding: quoted-printable
(normal) <fd9321>; task; rspamd_mime_headers_process: go to state: 99->4
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header Return-Path: <dima+prvs=02499...@domain.com>
(normal) <fd9321>; task; rspamd_mime_header_add: add new raw header X-Rcpt-To: <te...@domain.local>
(normal) <fd9321>; task; rspamd_message_parse: found 1 parts in message
(normal) <fd9321>; task; rspamd_mime_text_to_utf8: converted from windows-1251 to UTF-8 inlen: 174, outlen: 230
(normal) <fd9321>; task; rspamd_message_parse: loaded message; id: <183712261.20...@domain.com>; queue-id: <BEE522061C>; size: 1637; checksum: <6d142e0ba4a1ccfd2d6a74c6c57ea150>
(normal) <fd9321>; task; rspamd_task_process: completed stage 4
(normal) <fd9321>; task; rspamd_symbols_cache_process_symbols: symbols processing stage at pass: 0
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute EMAIL_PLUS_ALIASES, 81
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute REPLIES_CHECK, 423
(normal) <fd9321>; task; rspamd_task_process: need more work on stage 8
(normal) <fd9321>; task; rspamd_symbols_cache_watcher_cb: finished watcher, 0 symbols waiting
(normal) <fd9321>; task; rspamd_symbols_cache_process_symbols: symbols processing stage at pass: 1
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SETTINGS_CHECK, 425
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute GREYLIST_CHECK, 288
(normal) <fd9321>; task; rspamd_task_process: need more work on stage 8
(normal) <fd9321>; task; rspamd_symbols_cache_watcher_cb: finished watcher, 0 symbols waiting
(normal) <fd9321>; task; rspamd_symbols_cache_process_symbols: symbols processing stage at pass: 1
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute ASN_CHECK, 273
(normal) <fd9321>; task; rspamd_task_process: need more work on stage 8
(normal) <fd9321>; task; rspamd_symbols_cache_watcher_cb: finished watcher, 0 symbols waiting
(normal) <fd9321>; task; rspamd_symbols_cache_process_symbols: symbols processing stage at pass: 1
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute RATELIMIT_CHECK, 351
(normal) <fd9321>; task; rspamd_task_process: need more work on stage 8
(normal) <fd9321>; task; rspamd_symbols_cache_watcher_cb: finished watcher, 0 symbols waiting
(normal) <fd9321>; task; rspamd_symbols_cache_process_symbols: symbols processing stage at pass: 2
(normal) <fd9321>; task; rspamd_task_process: completed stage 8
(normal) <fd9321>; task; rspamd_symbols_cache_process_symbols: symbols processing stage at pass: 3
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FUZZY_CALLBACK, 268
(normal) <fd9321>; task; fuzzy_cmd_from_text_part: loading shingles of type mum with key ef43ae80cc8dc34c6f1bd6181bae8774
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute (NULL), 353
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute (NULL), 322
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_DKIM_REJECT, 96
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MAILLIST, 316
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute PREVIOUSLY_DELIVERED, 78
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute BROKEN_HEADERS, 30
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MICROSOFT_SPAM, 197
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_SAJDING, 175
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_LOTTO, 241
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_MIXED_CHARSET_URL, 95
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute PHISHING, 346
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_WHITE_ON_WHITE, 21
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FAKE_REPLY_C, 221
(normal) <fd9321>; task; rspamd_header_exists: try to get header References
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_SUSPICIOUS_IMAGES, 20
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_SUSPICIOUS_URL, 29
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MULTIPLE_UNIQUE_HEADERS, 34
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute OMOGRAPH_URL, 80
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_MIXED_CHARSET, 94
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_OUTLOOK_HTML, 165
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUSPICIOUS_BOUNDARY, 170
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HTML_META_REFRESH_URL, 174
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute AOL_SPAM, 185
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SPAM_FLAG, 194
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HFILTER, 289
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DATE_IN_FUTURE, 27
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUSPICIOUS_BOUNDARY4, 178
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute X_PHP_EVAL, 179
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute RCVD_ILLEGAL_CHARS, 190
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MUA_THEBAT_MSGID, 198
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUSPICIOUS_OPERA_10W_MSGID, 238
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FAKE_RECEIVED_smtp_yandex_ru, 239
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FAKE_RECEIVED_mail_ru, 240
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MUA_THUNDERBIRD_MSGID, 242
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUSPICIOUS_BOUNDARY2, 246
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MUA_OPERA_MSGID, 250
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MUA_SEAMONKEY_MSGID, 256
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MUA_MOZILLA_MAIL_MSGID, 259
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute X_PHP_FORGED_0X, 261
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute ONCE_RECEIVED, 343
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute TRACKER_ID, 150
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_GENERIC_RECEIVED4, 151
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_GENERIC_RECEIVED, 159
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_GENERIC_RECEIVED2, 204
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_GENERIC_RECEIVED3, 237
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SORTED_RECIPS, 192
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute ADVANCE_FEE_2, 217
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUBJ_ALL_CAPS, 23
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute LONG_SUBJ, 24
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute RCVD_HELO_USER, 39
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MUA_KMAIL_MSGID, 152
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MUA_THEBAT_MSGID_UNKNOWN, 154
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_UNDISC_RCPT, 202
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute X_PHPOS_FAKE, 215
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MUA_OUTLOOK, 229
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_RCVD_SPAMBOTS, 230
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute INVALID_POSTFIX_RECEIVED, 236
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUSPICIOUS_BOUNDARY3, 244
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MUA_THUNDERBIRD_MSGID_UNKNOWN, 180
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MUA_MOZILLA_MAIL_MSGID_UNKNOWN, 186
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MISSING_MID, 208
(normal) <fd9321>; task; rspamd_header_exists: try to get header Message-Id
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute GOOGLE_FORWARDING_MID_MISSING, 213
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MUA_SEAMONKEY_MSGID_UNKNOWN, 223
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_MISSING_CHARSET, 226
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MUA_KMAIL_MSGID_UNKNOWN, 266
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute ADVANCE_FEE_3, 219
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_OUTLOOK_TAGS, 158
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MISSING_SUBJECT, 12
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HTML_SHORT_LINK_IMG_1, 16
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_EMPTY_IMAGE, 19
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HEADER_RCONFIRM_MISMATCH, 32
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HEADER_FORGED_MDN, 33
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MISSING_FROM, 38
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute CHECK_TO_CC, 54
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute CHECK_MIME, 74
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute CHECK_MID, 87
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MUA_THEBAT_BOUN, 153
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORGED_MSGID_YAHOO, 157
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute RCVD_DOUBLE_IP_SPAM, 162
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HIDDEN_SOURCE_OBJ, 163
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MIME_HEADER_CTYPE_ONLY, 167
(normal) <fd9321>; task; rspamd_header_exists: try to get header Content-Disposition
(normal) <fd9321>; task; rspamd_header_exists: try to get header Content-Transfer-Encoding
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute RATWARE_MS_HASH, 184
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MISSING_MIMEOLE, 189
(normal) <fd9321>; task; rspamd_header_exists: try to get header X-MSMail-Priority
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DRUGS_MUSCLE, 193
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute REPTO_QUOTE_YAHOO, 200
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DATA_URI_OBFU, 201
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DRUGS_MANYKINDS, 203
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DRUGS_DIET, 211
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DRUGS_ANXIETY, 212
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_BAD_CTE_7BIT, 214
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MISSING_TO, 220
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DRUGS_ANXIETY_EREC, 248
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FM_FAKE_HELO_VERIZON, 255
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DRUGS_ERECTILE, 260
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute (NULL), 284
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute GOOGLE_FORWARDING_MID_BROKEN, 234
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute INVALID_MSGID, 252
(normal) <fd9321>; task; rspamd_header_exists: try to get header Message-Id
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute BROKEN_CONTENT_TYPE, 31
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FROM_EXCESS_BASE64, 156
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUBJ_EXCESS_BASE64, 160
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUSPICIOUS_RECIPS, 161
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute REPLYTO_EXCESS_BASE64, 218
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute TO_EXCESS_BASE64, 247
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute CC_EXCESS_BASE64, 254
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute REPLYTO_EXCESS_QP, 210
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute TO_EXCESS_QP, 216
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FROM_EXCESS_QP, 224
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute CC_EXCESS_QP, 225
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUBJ_EXCESS_QP, 228
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FROM_SERVICE_ACCT, 15
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HTML_SHORT_LINK_IMG_2, 17
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute EXT_CSS, 22
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_PARTS_DIFFER, 25
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MISSING_DATE, 26
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DATE_IN_PAST, 28
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute URI_COUNT_ODD, 40
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FAKE_REPLY, 43
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute CHECK_FROM, 44
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute URI_HIDDEN_PATH, 169
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute ENVFROM_SERVICE_ACCT, 171
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute XAW_SERVICE_ACCT, 172
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_NO_SPACE_IN_FROM, 177
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HEADER_REPLYTO_DELIMITER_TAB, 181
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HEADER_TO_EMPTY_DELIMITER, 182
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute PHP_SCRIPT_ROOT, 188
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HEADER_FROM_DELIMITER_TAB, 196
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute CT_EXTRA_SEMI, 205
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUBJECT_ENDS_QUESTION, 231
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HAS_INTERSPIRE_SIG, 233
(normal) <fd9321>; task; rspamd_header_exists: try to get header X-Mailer-LID
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HEADER_DATE_DELIMITER_TAB, 243
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HEADER_TO_DELIMITER_TAB, 245
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUBJECT_NEEDS_ENCODING, 249
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUBJECT_HAS_CURRENCY, 251
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HEADER_REPLYTO_EMPTY_DELIMITER, 257
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute STOX_REPLY_TYPE, 258
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HEADER_FROM_EMPTY_DELIMITER, 263
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HEADER_CC_DELIMITER_TAB, 264
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HEADER_DATE_EMPTY_DELIMITER, 265
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HEADER_CC_EMPTY_DELIMITER, 267
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HTML_SHORT_LINK_IMG_3, 18
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MV_CASE, 42
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute WWW_DOT_DOMAIN, 166
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MID_RHS_WWW, 168
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUBJECT_ENDS_SPACES, 222
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute CTE_CASE, 232
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MIME_HTML_ONLY, 164
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HAS_X_AS, 13
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HAS_X_GMSV, 14
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute ENVFROM_PRVS, 35
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute ENVFROM_VERP, 36
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute RCVD_TLS_ALL, 37
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HAS_ATTACHMENT, 41
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute CHECK_RECEIVED, 63
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HAS_X_PRIO, 64
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 44 for symbol 65 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute CHECK_REPLYTO, 65
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FWD_GOOGLE, 82
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FWD_YANDEX, 83
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FWD_MAILRU, 84
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FWD_SRS, 85
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FORWARDED, 86
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 96 for symbol 101 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DKIM_SIGN, 101
(normal) <fd9321>; task; dkim_sign_callback: skip signing as dkim condition callback returned false
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute R_SPF_FAIL, 102
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SURBL_REDIRECTOR_CALLBACK, 109
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 109 for symbol 110 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SURBL_CALLBACK, 110
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 109 for symbol 112 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SURBL_CALLBACK, 112
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 109 for symbol 114 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SURBL_CALLBACK, 114
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 109 for symbol 116 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SURBL_CALLBACK, 116
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 109 for symbol 118 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SURBL_CALLBACK, 118
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 109 for symbol 120 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SURBL_CALLBACK, 120
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 109 for symbol 122 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SURBL_CALLBACK, 122
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 109 for symbol 124 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SURBL_CALLBACK, 124
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HAS_X_SOURCE, 149
(normal) <fd9321>; task; rspamd_header_exists: try to get header X-Source
(normal) <fd9321>; task; rspamd_header_exists: try to get header X-Source-Args
(normal) <fd9321>; task; rspamd_header_exists: try to get header X-Source-Dir
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute PHP_XPS_PATTERN, 155
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HAS_XAW, 173
(normal) <fd9321>; task; rspamd_header_exists: try to get header X-Authentication-Warning
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HAS_WP_URI, 176
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUBJECT_ENDS_EXCLAIM, 183
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HAS_X_POS, 187
(normal) <fd9321>; task; rspamd_header_exists: try to get header X-PHP-Originating-Script
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUBJECT_HAS_EXCLAIM, 191
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HAS_X_ANTIABUSE, 195
(normal) <fd9321>; task; rspamd_header_exists: try to get header X-AntiAbuse
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute PRECEDENCE_BULK, 199
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HAS_DATA_URI, 206
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute WP_COMPROMISED, 207
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HAS_PHPMAILER_SIG, 209
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute SUBJECT_HAS_QUESTION, 227
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute HAS_X_PHP_SCRIPT, 253
(normal) <fd9321>; task; rspamd_header_exists: try to get header X-PHP-Script
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute MAIL_RU_MAILER, 262
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute IP_SCORE, 315
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 96 for symbol 317 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute KNOWN_MID_CALLBACK, 317
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FREEMAIL_ENVFROM, 331
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FREEMAIL_TO, 332
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DISPOSABLE_REPLYTO, 333
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DISPOSABLE_CC, 334
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DISPOSABLE_TO, 335
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DISPOSABLE_FROM, 336
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FREEMAIL_REPLYTO, 337
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FREEMAIL_ENVRCPT, 338
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FREEMAIL_FROM, 339
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DISPOSABLE_ENVFROM, 340
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FREEMAIL_CC, 341
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DISPOSABLE_ENVRCPT, 342
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 96 for symbol 275 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: delayed dependency 275 for symbol 426
(normal) <fd9321>; task; rspamd_symbols_cache_process_symbols: blocked execution of 426 unless deps are resolved
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 96 for symbol 428 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute WHITELIST_DKIM, 428
(normal) <fd9321>; task; rspamd_symbols_cache_process_symbols: blocked execution of 429 unless deps are resolved
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 337 for symbol 79 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 339 for symbol 79 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FREEMAIL_REPLYTO_NEQ_FROM_DOM, 79
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 96 for symbol 275 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_process_symbols: blocked execution of 275 unless deps are resolved
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 96 for symbol 427 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_process_symbols: blocked execution of 427 unless deps are resolved
(normal) <fd9321>; task; rspamd_task_process: need more work on stage 16
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 96 for symbol 275 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: delayed dependency 275 for symbol 426
(normal) <fd9321>; task; rspamd_symbols_cache_watcher_cb: finished watcher, 1 symbols waiting
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 96 for symbol 275 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: delayed dependency 275 for symbol 426
(normal) <fd9321>; task; rspamd_symbols_cache_watcher_cb: finished watcher, 1 symbols waiting
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 96 for symbol 275 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: delayed dependency 275 for symbol 426
(normal) <fd9321>; task; rspamd_symbols_cache_watcher_cb: finished watcher, 1 symbols waiting
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 102 for symbol 275 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 96 for symbol 275 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute DMARC_CALLBACK, 275
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: started check of 275 symbol as dep for 426
(normal) <fd9321>; task; rspamd_symbols_cache_watcher_cb: finished watcher, 1 symbols waiting
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 275 for symbol 426 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute WHITELIST_DMARC, 426
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 102 for symbol 429 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute WHITELIST_SPF, 429
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 102 for symbol 427 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_deps: dependency 96 for symbol 427 is already checked
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute WHITELIST_SPF_DKIM, 427
(normal) <fd9321>; task; rspamd_symbols_cache_watcher_cb: finished watcher, 0 symbols waiting
(normal) <fd9321>; task; rspamd_symbols_cache_watcher_cb: finished watcher, 0 symbols waiting
(normal) <fd9321>; task; rspamd_symbols_cache_process_symbols: symbols processing stage at pass: 4
(normal) <fd9321>; task; rspamd_task_process: completed stage 16
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: added stat tokens for part language 'russian'
(normal) <fd9321>; task; rspamd_stat_tokenize_header: added stat tokens for header 'Content-Type'
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.31
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00

(normal) logger; file_log_function: Last message repeated 4 times

(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.50
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 1.00
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 1.00
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 1.00
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.25
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 1.00
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.25
(normal) <fd9321>; task; rspamd_stat_tokenize_parts_metadata: got metatoken number: 0.00
(normal) <fd9321>; task; rspamd_task_process: completed stage 32
(normal) <fd9321>; task; rspamd_task_process: need more work on stage 64
(normal) <fd9321>; task; rspamd_redis_connected: connected to redis server, tokens learned for BAYES_SPAM: 0
(normal) <fd9321>; task; rspamd_redis_processed: received tokens for BAYES_SPAM: 73 processed, 0 found
(normal) <fd9321>; task; rspamd_redis_connected: connected to redis server, tokens learned for BAYES_HAM: 4
(normal) <fd9321>; task; rspamd_redis_processed: received tokens for BAYES_HAM: 73 processed, 73 found
(normal) <fd9321>; task; bayes_classify: skip classification as ham class has not enough learns: 4, 200 required
(normal) <fd9321>; task; rspamd_task_process: completed stage 128
(normal) <fd9321>; task; rspamd_task_process: completed stage 256
(normal) <fd9321>; task; rspamd_symbols_cache_process_symbols: symbols processing stage at pass: 5
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute FANNR_SPAM, 282
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute IPSCORE_SAVE, 314
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute RATELIMIT_SET, 352
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute REPLIES_SET, 422
(normal) <fd9321>; task; rspamd_stat_check_autolearn: <183712261.20...@domain.com>: autolearn ham for classifier 'bayes' as message's score is negative: -0.30
(normal) <fd9321>; task; rspamd_task_process: need more work on stage 512
(normal) <fd9321>; task; rspamd_symbols_cache_watcher_cb: finished watcher, 0 symbols waiting
(normal) <fd9321>; task; rspamd_symbols_cache_watcher_cb: finished watcher, 0 symbols waiting
(normal) <fd9321>; task; rspamd_symbols_cache_process_symbols: symbols processing stage at pass: 5
(normal) <fd9321>; task; rspamd_symbols_cache_check_symbol: execute GREYLIST_SAVE, 287
(normal) <fd9321>; task; rspamd_task_process: completed stage 512
(normal) <fd9321>; task; rspamd_task_process: need more work on stage 1024
(normal) <fd9321>; task; rspamd_task_process: need more work on stage 2048
(normal) <fd9321>; task; rspamd_task_process: need more work on stage 4096
(normal) <fd9321>; task; rspamd_task_process: task is processed
(normal) <fd9321>; task; rspamd_protocol_write_reply: writing reply to client
(normal) <fd9321>; task; rspamd_task_write_log: id: <183712261.20...@domain.com>, qid: <BEE522061C>, ip: 195.206.48.xxx, from: <di...@domain.com>, (default: F (no action): [-0.30/15.00] [R_SPF_ALLOW(-0.20){+mx;},MIME_GOOD(-0.10){text/plain;},ASN(0.00){asn:8345, ipnet:195.206.32.0/19, country:RU;},DMARC_NA(0.00){domain.com;},FROM_EQ_ENVFROM(0.00){},FROM_HAS_DN(0.00){},HAS_ORG_HEADER(0.00){},HAS_X_PRIO_3(0.00){},IP_SCORE(0.00){ip: (-9.31), ipnet: 195.206.32.0/19(-7.44), asn: 8345(-4.65), country: RU(-0.93);},MID_RHS_MATCH_FROM(0.00){},PREVIOUSLY_DELIVERED(0.00){te...@domain.local;},RCPT_COUNT_1(0.00){},RCVD_COUNT_4(0.00){},R_DKIM_NA(0.00){},TO_DN_ALL(0.00){},TO_MATCH_ENVRCPT_ALL(0.00){}]), len: 1637, time: 1111.979ms real, 32.226ms virtual, dns req: 24, digest: <6d142e0ba4a1ccfd2d6a74c6c57ea150>, rcpts: <te...@domain.local>, mime_rcpt: <te...@domain.local>
(normal) <fd9321>; task; rspamd_protocol_http_reply: regexp statistics: 0 pcre regexps scanned, 4 regexps matched, 272 regexps total, 96 regexps cached, 0B bytes scanned using pcre, 1.97k bytes scanned total
(normal) <fd9321>; task; rspamd_protocol_write_log_pipe: calling for fann_redis
(normal) <fd9321>; task; rspamd_worker_finish_handler: normally closing connection from: 127.0.0.1
(normal) <fd9321>; task; rspamd_task_free: free pointer 00007F83DCF84010

пятница, 17 марта 2017 г., 1:03:09 UTC+8 пользователь vsevolod написал:

[Dima Saveliev]

Vsevolod, you were right
I've built Rspamd from source, did some debugging and found that all symbols were disabled by rspamd_symbols_cache_process_settings() in symbols_cache.c:

enabled = ucl_object_lookup (task->settings, "groups_enabled");
def = g_hash_table_lookup (task->cfg->metrics, DEFAULT_METRIC);

if (def && enabled) {
    ...
    rspamd_symbols_cache_disable_all_symbols (task, cache);

then the following code does not enable anything except of DKIM:

while (g_hash_table_iter_next (&gr_it, &k, &v)) {
    rspamd_symbols_cache_enable_symbol_checkpoint (task, cache, k);
}

It's not obvious to novice what should I do. I have no settings.conf. Should I explicitly enable REPLIES_SET in that file?

пятница, 17 марта 2017 г., 1:03:09 UTC+8 пользователь vsevolod написал:

On 16/03/17 04:14, Dima Saveliev wrote:

[Dima Saveliev]

Disabling 'explicit_modules = ["settings"];' in options.inc solved the problem
Thank you!

пятница, 17 марта 2017 г., 1:03:09 UTC+8 пользователь vsevolod написал:

On 16/03/17 04:14, Dima Saveliev wrote: