Local Fuzzy Storage Has Stopped Eating

[Rob Gunther]

About 10 days ago with the help of Alexander Moisseev I setup local fuzzy storage in our lab.

Then I set up local fuzzy in production, it worked for a while but then stopped eating the spam we are feeding it, as the fuzzy_stored value no longer increases.

Checkinng on the status ( rspamadm control fuzzystat ) we get this:

Statistics for storage 37ee21a22cfc0e4c1f5

invalid_requests: 0

fuzzy_expired: 0

fuzzy_found: (v0.6: 0), (v0.8: 0), (v0.9: 0), (v1.0+: 2.26M)

fuzzy_stored: 48.37k

fuzzy_shingles: (v0.6: 0), (v0.8: 0), (v0.9: 0), (v1.0+: 2.94M)

fuzzy_checked: (v0.6: 0), (v0.8: 0), (v0.9: 0), (v1.0+: 3.28M)

The problem is the fuzzy_stored value stopped increasing.

Every few minutes we feed the system with a folder full of fresh spam, using this command.

rspamc -S LOCAL_FUZZY_DENIED -w 10 fuzzy_add /tmp/feedrspamd/learn

It appears to eat up the spam, spitting out results to the screen like this:

Results for file: /tmp/feedrspamd/learn/1769242628.eml (0.004 seconds)

success = true;

hashes [

    "6aa7fcd214301d2f73126c7e87eaa36368bc93f9feafa3478dab8392173b71cbbcd3354ebe7a339625e6b124ad1e711c2ead00$

    "3e8e8e0b844d7e401e2890ef1c04cc83705f91c5fe8174882c409942fafe817cc109d05c8183d899ccce3bda799acd45aca4c3$

]

The rspamd logs also show positive results with the fuzzy_controller_io_callback reporting that is adding the fuzzy hash.  No obvious errors.

With everything appearing to be operating without error why has the  fuzzy_stored count stopped increasing?  The fuzzy_shingles values continue to increase.

Rob