SonarQube stops unexpectedly,

3,071 views
Skip to first unread message

fabien...@gmail.com

unread,
Nov 30, 2015, 12:31:27 PM11/30/15
to SonarQube
Hello to you all, 

Since a few weeks, I have sonarQube which stops randomly after a few minute without any visible error. 

Here is an example of a typical log file I obtain: 

2015.11.30 14:52:57 INFO  app[o.s.p.m.Monitor] Process[web] is up
2015.11.30 14:53:08 WARN   es[o.e.monitor.jvm]  [sonar-1448891439205] [gc][young][133][3] duration [1.2s], collections [1]/[1.8s], total [1.2s]/[1.7s], memory [157.9mb]->[35.6mb]/[1007.3mb]
, all_pools {[young] [130.7mb]->[947.2kb]/[133.1mb]}{[survivor] [12.6mb]->[15.6mb]/[16.6mb]}{[old] [14.5mb]->[19mb]/[857.6mb]}
2015.11.30 14:53:30 INFO  web[o.s.s.c.t.CeWorkerRunnableImpl] Execute task | project=Marine:QNX | id=AVFYq26-2Ksz7hjliQuo
2015.11.30 14:53:36 INFO  web[o.s.s.c.t.CeWorkerRunnableImpl] Executed task | project=Marine:QNX | id=AVFYq26-2Ksz7hjliQuo | time=6562ms
2015.11.30 14:55:58 INFO  web[o.s.s.c.t.CeWorkerRunnableImpl] Execute task | project=Marine:QNX | id=AVFYra8R2Ksz7hjliQus
2015.11.30 14:56:12 INFO  web[o.s.s.c.t.CeWorkerRunnableImpl] Executed task | project=Marine:QNX | id=AVFYra8R2Ksz7hjliQus | time=14041ms
2015.11.30 14:57:44 INFO  web[o.s.s.c.t.CeWorkerRunnableImpl] Execute task | project=Marine:QNX | id=AVFYr1IZ2Ksz7hjliQuw
2015.11.30 14:57:58 INFO  web[o.s.s.c.t.CeWorkerRunnableImpl] Executed task | project=Marine:QNX | id=AVFYr1IZ2Ksz7hjliQuw | time=14559ms
2015.11.30 15:12:42 INFO  app[o.s.p.m.TerminatorThread] Process[search] is stopping
2015.11.30 15:12:43 INFO   es[o.s.p.StopWatcher]  Stopping process
2015.11.30 15:12:43 INFO   es[o.elasticsearch.node]  [sonar-1448891439205] stopping ...
2015.11.30 15:12:45 INFO   es[o.elasticsearch.node]  [sonar-1448891439205] stopped
2015.11.30 15:12:45 INFO   es[o.elasticsearch.node]  [sonar-1448891439205] closing ...
2015.11.30 15:12:45 INFO   es[o.elasticsearch.node]  [sonar-1448891439205] closed
2015.11.30 15:12:45 INFO  app[o.s.p.m.TerminatorThread] Process[search] is stopped

I start at 14:52 then do some analyses that are successful and then out of nowhere, sonarqube unexpectedly stops. 
At the end of my access.log, I have nothing that happens at 15:12

127.0.0.1 - - [30/nov./2015:14:57:26 +0100] "GET /api/rules/search.protobuf?f=repo,name,severity,lang,internalKey,templateKey,params,actives&activation=true&qprofile=c++-wandercraft
-35733&p=1&ps=500 HTTP/1.0" 200 11 "-" "SonarQube SonarQubeRunner/2.4"
127.0.0.1 - - [30/nov./2015:14:57:29 +0100] "GET /api/rules/search.protobuf?f=repo,name,severity,lang,internalKey,templateKey,params,actives&activation=true&qprofile=java-sonar-way-
25548&p=1&ps=500 HTTP/1.0" 200 23479 "-" "SonarQube SonarQubeRunner/2.4"
127.0.0.1 - - [30/nov./2015:14:57:42 +0100] "GET /api/rules/list.protobuf HTTP/1.0" 200 375426 "-" "SonarQube SonarQubeRunner/2.4"
127.0.0.1 - - [30/nov./2015:14:57:43 +0100] "POST /api/ce/submit?projectKey=Marine:QNX&projectName=Marine&projectBranch= HTTP/1.0" 200 84 "-" "SonarQube 5.2"


I have sonar 5.2 but the problem was already there under 5.1 (whereas it worked for a long time with 5.1 before). I tried moving the elastic search to another hard drive with more space. I tried also to remove all the plugins to see if it was coming from the plugins but nothing helped. 
 I really have no idea what has gone wrong.

I would be grateful for any idea. 

Simon Brandhof

unread,
Dec 2, 2015, 4:34:32 PM12/2/15
to fabien...@gmail.com, SonarQube
Hi Fabien,

Can you send the full server logs ? I'd like to know if the web server stopped just after.
Anyway the Elasticsearch configuration seems to be undersized compared to the volume of data/requests. Could you also please send the export of system info ? (Administration > System Info > Download)

Thanks


Simon BRANDHOF | SonarSource
Tech Lead & Co-Founder
http://twitter.com/SimonBrandhof

--
You received this message because you are subscribed to the Google Groups "SonarQube" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sonarqube+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/sonarqube/048d5ef6-ec69-48bd-a617-6a2c8547cef0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

fabien...@gmail.com

unread,
Dec 3, 2015, 9:59:40 AM12/3/15
to SonarQube, fabien...@gmail.com
Hello Simon, 

Thank you for your answer. 

So i did the experience again to get the corresponding long: 

Here is the sonar.log file 

--> Wrapper Started as Daemon
Launching a JVM...
Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
  Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.

2015.12.03 12:46:51 INFO  app[o.s.p.m.JavaProcessLauncher] Launch process[search]: /usr/lib/jvm/java-7-openjdk-amd64/jre/bin/java -Djava.awt.headless=true -Xmx1G -Xms256m -Xss256k -Djava.ne
t.preferIPv4Stack=true -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+HeapDumpOnOutOfMemoryError -Djava.io.tmpdir=/me
dia/backup/sonar/temp -cp ./lib/common/*:./lib/search/* org.sonar.search.SearchServer /tmp/sq-process7111338419556835000properties
2015.12.03 12:46:52 INFO   es[o.s.p.ProcessEntryPoint]  Starting search
2015.12.03 12:46:52 INFO   es[o.s.s.SearchSettings]  Elasticsearch listening on 127.0.0.1:9001
2015.12.03 12:46:53 INFO   es[o.elasticsearch.node]  [sonar-1449143210801] version[1.7.2], pid[3305], build[e43676b/2015-09-14T09:49:53Z]
2015.12.03 12:46:53 INFO   es[o.elasticsearch.node]  [sonar-1449143210801] initializing ...
2015.12.03 12:46:53 INFO   es[o.e.plugins]  [sonar-1449143210801] loaded [], sites []
2015.12.03 12:46:53 INFO   es[o.elasticsearch.env]  [sonar-1449143210801] using [1] data paths, mounts [[/media/backup (/dev/sdb)]], net usable_space [459.8gb], net total_space [916.7gb], t
ypes [ext3]
2015.12.03 12:46:56 WARN   es[o.e.bootstrap]  JNA not found. native methods will be disabled.
2015.12.03 12:46:58 INFO   es[o.elasticsearch.node]  [sonar-1449143210801] initialized
2015.12.03 12:46:58 INFO   es[o.elasticsearch.node]  [sonar-1449143210801] starting ...
2015.12.03 12:46:58 INFO   es[o.e.transport]  [sonar-1449143210801] bound_address {inet[/127.0.0.1:9001]}, publish_address {inet[/127.0.0.1:9001]}
2015.12.03 12:46:58 INFO   es[o.e.discovery]  [sonar-1449143210801] sonarqube/dZEQKU_UT4eAauh4skwGsw
2015.12.03 12:47:02 INFO   es[o.e.cluster.service]  [sonar-1449143210801] new_master [sonar-1449143210801][dZEQKU_UT4eAauh4skwGsw][gaia][inet[/127.0.0.1:9001]]{rack_id=sonar-1449143210801},
 reason: zen-disco-join (elected_as_master)
2015.12.03 12:47:02 INFO   es[o.elasticsearch.node]  [sonar-1449143210801] started
2015.12.03 12:47:02 INFO   es[o.e.gateway]  [sonar-1449143210801] recovered [6] indices into cluster_state
2015.12.03 12:47:11 INFO  app[o.s.p.m.Monitor] Process[search] is up
2015.12.03 12:47:11 INFO  app[o.s.p.m.JavaProcessLauncher] Launch process[web]: /usr/lib/jvm/java-7-openjdk-amd64/jre/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djruby.managem
ent.enabled=false -Djruby.compile.invokedynamic=false -Xmx768m -Xms256m -XX:MaxPermSize=160m -XX:+HeapDumpOnOutOfMemoryError -Djava.net.preferIPv4Stack=true -Djava.io.tmpdir=/media/backup/s
onar/temp -cp ./lib/common/*:./lib/server/*:/opt/sonar52/lib/jdbc/mysql/mysql-connector-java-5.1.35.jar org.sonar.server.app.WebServer /tmp/sq-process550289150773913405properties
2015.12.03 12:47:12 INFO  web[o.s.p.ProcessEntryPoint] Starting web
2015.12.03 12:47:12 INFO  web[o.s.s.app.Webapp] Webapp directory: /opt/sonar52/web
2015.12.03 12:47:13 INFO  web[o.a.c.h.Http11NioProtocol] Initializing ProtocolHandler ["http-nio-0.0.0.0-8999"]
2015.12.03 12:47:14 INFO  web[o.a.t.u.n.NioSelectorPool] Using a shared selector for servlet write/read
2015.12.03 12:47:16 INFO  web[o.e.plugins] [sonar-1449143210801] loaded [], sites []
2015.12.03 12:47:18 INFO  web[o.s.s.p.ServerImpl] SonarQube Server / 5.2 / f045be98be3ba032b6b19d71574038eeeb91803b
2015.12.03 12:47:18 INFO  web[o.sonar.db.Database] Create JDBC data source for jdbc:mysql://localhost:3306/sonar2?useUnicode=true&characterEncoding=utf8&rewriteBatchedStatements=true&useCon
figs=maxPerformance
2015.12.03 12:47:22 INFO  web[o.s.s.p.DefaultServerFileSystem] SonarQube home: /opt/sonar52
2015.12.03 12:47:22 INFO  web[o.s.s.p.ServerPluginRepository] Deploy plugin C++ (Community) / 0.9.4 / 0
2015.12.03 12:47:22 INFO  web[o.s.s.p.ServerPluginRepository] Deploy plugin Findbugs / 2.4 / a334be36ba4374bb779255272c53fb08675ac2c2
2015.12.03 12:47:22 INFO  web[o.s.s.p.ServerPluginRepository] Deploy plugin Generic Coverage / 1.1 / eec17f58515c33546a4b872b64044182828aeea8
2015.12.03 12:47:22 INFO  web[o.s.s.p.ServerPluginRepository] Deploy plugin Git / 1.0 / 9ce9d330c313c296fab051317cc5ad4b26319e07
2015.12.03 12:47:22 INFO  web[o.s.s.p.ServerPluginRepository] Deploy plugin Java / 2.4 / 7e7e6335211bb9c0ff9727065f43e7010cc3df91
2015.12.03 12:47:22 INFO  web[o.s.s.p.ServerPluginRepository] Deploy plugin Motion Chart / 1.7 / e9c4a5c95c75564b3c3b5a887b63ef50fc59a156
2015.12.03 12:47:22 INFO  web[o.s.s.p.ServerPluginRepository] Deploy plugin SVN / 1.0 / 213fc8a8b582ff530b12dd4a59a6512be1071234
2015.12.03 12:47:22 INFO  web[o.s.s.p.ServerPluginRepository] Deploy plugin Scm Stats / 0.3.1 / fd4f129d8cc73da085723c50b94936d74b1dc975
2015.12.03 12:47:22 INFO  web[o.s.s.p.ServerPluginRepository] Deploy plugin Tab Metrics / 1.4.1 / f575baba797d28be52a4fed5ee23159dd2e4a83a
2015.12.03 12:47:22 INFO  web[o.s.s.p.ServerPluginRepository] Deploy plugin Timeline / 1.5 / a9cae1328fd455a128b5d7d603381f47398c6e2a
2015.12.03 12:47:22 INFO  web[o.s.s.p.ServerPluginRepository] Deploy plugin Useless Code Tracker / 1.0 / a3ddd97c48de2a4ec5c716484c320b371f4f38f1
2015.12.03 12:47:22 INFO  web[o.s.s.p.ServerPluginRepository] Deploy plugin Widget Lab / 1.7 / 199762d2ed62a215601f3422a4973682c16618c0
2015.12.03 12:47:23 INFO  web[o.s.s.p.RailsAppsDeployer] Deploying Ruby on Rails applications
2015.12.03 12:47:23 INFO  web[o.s.s.p.RailsAppsDeployer] Deploying app: motionchart
2015.12.03 12:47:25 INFO  web[o.s.s.p.UpdateCenterClient] Update center: http://update.sonarsource.org/update-center.properties (no proxy)
2015.12.03 12:47:27 INFO  web[o.s.s.n.NotificationService] Notification service started (delay 60 sec.)
2015.12.03 12:47:28 INFO  web[o.s.s.s.IndexSynchronizer] Index rules
2015.12.03 12:47:30 INFO  web[o.s.s.s.IndexSynchronizer] Index activeRules
2015.12.03 12:47:30 INFO  web[o.s.s.s.RegisterMetrics] Register metrics
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Display doc [display_doc]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric New unreviewed violations [new_unreviewed_violations]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Active reviews [active_reviews]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric LCOM4 [lcom4]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric File edges weight [file_edges_weight]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Number of Children [noc]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Package dependencies to cut [package_feedback_edges]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Unplanned reviews [unplanned_reviews]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Documentation url [documentation_url]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Instability [instability]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Directory cycles [package_cycles]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Directory edges weight [package_edges_weight]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric File tangles [file_tangles]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Doxygen Url [doxygen_url]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Revisions by line [revisions_by_line]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric RFC [rfc]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Distance [distance]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Rules compliance [violations_density]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric duplication_lines_data [duplication_lines_data]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Weighted issues [weighted_violations]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Class distribution /RFC [rfc_distribution]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric File cycles [file_cycles]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Unreviewed violations [unreviewed_violations]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Afferent couplings [ca]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric False-positive reviews [false_positive_reviews]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Suspect file dependencies [file_feedback_edges]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric LCOM4 blocks [lcom4_blocks]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Error Message [error_message]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Authors by line [authors_by_line]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Unassigned reviews [unassigned_reviews]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Class distribution /LCOM4 [lcom4_distribution]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Suspect LCOM4 density [suspect_lcom4_density]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Efferent couplings [ce]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric File tangle index [file_tangle_index]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Warning Message [warning_message]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric File dependencies to cut [package_tangles]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Abstractness [abstractness]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Blank comments [comment_blank_lines]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Depth in Tree [dit]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Last commit dates by line [last_commit_datetimes_by_line]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Directory tangle index [package_tangle_index]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterMetrics] Disable metric Dependency Matrix [dsm]
2015.12.03 12:47:31 INFO  web[o.s.s.s.RegisterDebtModel] Register technical debt model
2015.12.03 12:47:31 INFO  web[o.s.s.r.RegisterRules] Register rules
2015.12.03 12:47:47 INFO  web[o.s.s.q.RegisterQualityProfiles] Register quality profiles
2015.12.03 12:47:54 INFO  web[o.s.s.s.RegisterNewMeasureFilters] Register measure filters
2015.12.03 12:47:54 INFO  web[o.s.s.s.RegisterDashboards] Register dashboards
2015.12.03 12:47:54 INFO  web[o.s.s.s.RegisterPermissionTemplates] Register permission templates
2015.12.03 12:47:54 INFO  web[o.s.s.s.RenameDeprecatedPropertyKeys] Rename deprecated property keys
2015.12.03 12:47:54 INFO  web[o.s.s.s.IndexSynchronizer] Index activities
2015.12.03 12:47:55 INFO  web[o.s.s.s.IndexSynchronizer] Index issues
2015.12.03 12:47:56 INFO  web[o.s.s.s.IndexSynchronizer] Index tests
2015.12.03 12:47:56 INFO  web[o.s.s.s.IndexSynchronizer] Index users
2015.12.03 12:47:56 INFO  web[o.s.s.s.IndexSynchronizer] Index views
2015.12.03 12:47:56 INFO  web[o.s.s.c.q.PurgeCeActivities] Delete the Compute Engine tasks created before Sat Jun 06 12:47:56 CEST 2015
2015.12.03 12:47:57 INFO  web[jruby.rack] jruby 1.7.9 (ruby-1.8.7p370) 2013-12-06 87b108a on OpenJDK 64-Bit Server VM 1.7.0_91-b02 [linux-amd64]
2015.12.03 12:47:57 INFO  web[jruby.rack] using a shared (threadsafe!) runtime
2015.12.03 12:48:40 INFO  web[jruby.rack] keeping custom (config.logger) Rails logger instance
2015.12.03 12:48:40 INFO  web[o.a.c.h.Http11NioProtocol] Starting ProtocolHandler ["http-nio-0.0.0.0-8999"]
2015.12.03 12:48:40 INFO  web[o.s.s.a.TomcatAccessLog] Web server is started
2015.12.03 12:48:40 INFO  web[o.s.s.a.EmbeddedTomcat] HTTPS connector enabled on port 8999 | ciphers=JVM defaults
2015.12.03 12:48:40 INFO  app[o.s.p.m.Monitor] Process[web] is up
2015.12.03 13:12:02 INFO   es[o.e.monitor.jvm]  [sonar-1449143210801] [gc][young][1503][3] duration [797ms], collections [1]/[1s], total [797ms]/[1s], memory [162.2mb]->[33mb]/[1007.3mb], a
ll_pools {[young] [132.3mb]->[3.7mb]/[133.1mb]}{[survivor] [16.5mb]->[9.9mb]/[16.6mb]}{[old] [13.4mb]->[19.4mb]/[857.6mb]}
2015.12.03 15:12:14 INFO  app[o.s.p.m.TerminatorThread] Process[search] is stopping
2015.12.03 15:12:15 INFO   es[o.s.p.StopWatcher]  Stopping process
2015.12.03 15:12:15 INFO   es[o.elasticsearch.node]  [sonar-1449143210801] stopping ...
2015.12.03 15:12:16 INFO   es[o.elasticsearch.node]  [sonar-1449143210801] stopped
2015.12.03 15:12:16 INFO   es[o.elasticsearch.node]  [sonar-1449143210801] closing ...
2015.12.03 15:12:16 INFO   es[o.elasticsearch.node]  [sonar-1449143210801] closed
2015.12.03 15:12:17 INFO  app[o.s.p.m.TerminatorThread] Process[search] is stopped
<-- Wrapper Stopped

SonarQube stopped at 15:12. 

Here is what I have in the syslog between 15h10 and 15h20: 

Dec  3 15:10:00 gaia postfix/qmgr[2129]: C44785802D5: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: C16785802EF: from=<ro...@wandercraft.eu>, size=5857, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 751EB580398: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 79F64580080: from=<ro...@wandercraft.eu>, size=759, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 7FFAC58035E: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: ABD2C58038B: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 00648580BB5: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 0BA5D580308: from=<>, size=6444, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 01A2758090F: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 0433D5803D2: from=<cla...@wandercraft.eu>, size=4538, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 03C31580355: from=<ro...@wandercraft.eu>, size=7952, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 08AE65802C7: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 00D7B580388: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 907AE5802E9: from=<>, size=6444, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 9FD9D58033B: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: ED9E658023F: from=<>, size=19674, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: E41625803D1: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 117DE5803F8: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 103C8580390: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 4EFAF580360: from=<>, size=6444, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: BFC84580BFC: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 2F6B55803DD: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 8E1F958022F: from=<>, size=6375, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 839AF5802F3: from=<cla...@wandercraft.eu>, size=4538, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 308D0580336: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 39D0A580344: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/error[21378]: C44785802D5: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=231382, delays=231381/0.05/0/0.07, dsn=4.4.1, status=deferred (delive
ry temporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21379]: C16785802EF: to=<ro...@wandercraft.eu>, orig_to=<root>, relay=none, delay=29752, delays=29752/0.08/0/0.05, dsn=4.4.1, status=deferred (delivery tem
porarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21378]: 751EB580398: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=29687, delays=29687/0.09/0/0.06, dsn=4.4.1, status=deferred (delivery
 temporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21379]: 7FFAC58035E: to=<cla...@wandercraft.eu>, relay=none, delay=115339, delays=115339/0.12/0/0.03, dsn=4.4.1, status=deferred (delivery temporarily sus
pended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21381]: 79F64580080: to=<ro...@wandercraft.eu>, orig_to=<root>, relay=none, delay=375747, delays=375747/0.09/0/0.06, dsn=4.4.1, status=deferred (delivery t
emporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21385]: ABD2C58038B: to=<cla...@wandercraft.eu>, relay=none, delay=39739, delays=39739/0.13/0/0.03, dsn=4.4.1, status=deferred (delivery temporarily suspe
nded: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21379]: 01A2758090F: to=<cla...@wandercraft.eu>, relay=none, delay=165738, delays=165738/0.14/0/0.02, dsn=4.4.1, status=deferred (delivery temporarily sus
pended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21381]: 0433D5803D2: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=292393, delays=292393/0.14/0/0.02, dsn=4.4.1, status=deferred (delive
ry temporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21378]: 00648580BB5: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=80071, delays=80071/0.14/0/0.03, dsn=4.4.1, status=deferred (delivery
 temporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21387]: 0BA5D580308: to=<cla...@wandercraft.eu>, relay=none, delay=90138, delays=90138/0.15/0/0.04, dsn=4.4.1, status=deferred (delivery temporarily suspe
nded: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21381]: 08AE65802C7: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=432977, delays=432977/0.16/0/0.03, dsn=4.4.1, status=deferred (delive
ry temporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21385]: 03C31580355: to=<ro...@wandercraft.eu>, orig_to=<root>, relay=none, delay=117884, delays=117884/0.15/0/0.04, dsn=4.4.1, status=deferred (delivery t
emporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 08AE65802C7: from=<cla...@wandercraft.eu>, status=expired, returned to sender
Dec  3 15:10:00 gaia postfix/error[21379]: 00D7B580388: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=55040, delays=55039/0.16/0/0.03, dsn=4.4.1, status=deferred (delivery
 temporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21387]: ED9E658023F: to=<ro...@wandercraft.eu>, relay=none, delay=375739, delays=375738/0.18/0/0.03, dsn=4.4.1, status=deferred (delivery temporarily suspe
nded: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21385]: E41625803D1: to=<cla...@wandercraft.eu>, relay=none, delay=367339, delays=367338/0.18/0/0.02, dsn=4.4.1, status=deferred (delivery temporarily sus
pended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21389]: 9FD9D58033B: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=155842, delays=155842/0.17/0/0.06, dsn=4.4.1, status=deferred (delive
ry temporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21378]: 907AE5802E9: to=<cla...@wandercraft.eu>, relay=none, delay=392539, delays=392539/0.16/0/0.07, dsn=4.4.1, status=deferred (delivery temporarily sus
pended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21381]: 117DE5803F8: to=<cla...@wandercraft.eu>, relay=none, delay=300138, delays=300138/0.18/0/0.05, dsn=4.4.1, status=deferred (delivery temporarily sus
pended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21379]: 103C8580390: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=1134, delays=1133/0.18/0/0.06, dsn=4.4.1, status=deferred (delivery t
emporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21385]: BFC84580BFC: to=<cla...@wandercraft.eu>, relay=none, delay=14539, delays=14539/0.2/0/0.03, dsn=4.4.1, status=deferred (delivery temporarily suspen
ded: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21387]: 4EFAF580360: to=<cla...@wandercraft.eu>, relay=none, delay=1800, delays=1800/0.2/0/0.04, dsn=4.4.1, status=deferred (delivery temporarily suspende
d: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21389]: 2F6B55803DD: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=357283, delays=357283/0.21/0/0.04, dsn=4.4.1, status=deferred (delive
ry temporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21391]: 308D0580336: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=130460, delays=130460/0.21/0/0.04, dsn=4.4.1, status=deferred (delive
ry temporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21381]: 839AF5802F3: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=206223, delays=206223/0.21/0/0.05, dsn=4.4.1, status=deferred (delive
ry temporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21378]: 8E1F958022F: to=<cla...@wandercraft.eu>, relay=none, delay=190939, delays=190939/0.21/0/0.06, dsn=4.4.1, status=deferred (delivery temporarily sus
pended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/error[21379]: 39D0A580344: to=<cla...@wandercraft.eu>, relay=none, delay=241339, delays=241339/0.21/0/0.05, dsn=4.4.1, status=deferred (delivery temporarily sus
pended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:00 gaia postfix/cleanup[21393]: 97FC65803A6: message-id=<20151203141000.97FC65803A6@serverZT>
Dec  3 15:10:00 gaia postfix/bounce[21382]: 08AE65802C7: sender non-delivery notification: 97FC65803A6
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 97FC65803A6: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:10:00 gaia postfix/qmgr[2129]: 08AE65802C7: removed
Dec  3 15:10:00 gaia postfix/error[21385]: 97FC65803A6: to=<cla...@wandercraft.eu>, relay=none, delay=0.18, delays=0.15/0/0/0.02, dsn=4.4.1, status=deferred (delivery temporarily suspended:
 connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:10:13 gaia kernel: [ 8762.995332] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:10:13 gaia kernel: [ 8762.995347] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:10:43 gaia kernel: [ 8793.194351] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:10:43 gaia kernel: [ 8793.194367] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:10:53 gaia named[1308]:   validating @0x7f52a076c160: mozilla.com SOA: no valid signature found
Dec  3 15:10:53 gaia named[1308]: validating @0x7f52a899d130: aus5.external.zlb.scl3.mozilla.com A: no valid signature found
Dec  3 15:10:53 gaia named[1308]:   validating @0x7f52a89e2c00: ib938n8jqkkciu0i70pkujsds5lhulno.mozilla.com NSEC3: no valid signature found
Dec  3 15:11:13 gaia kernel: [ 8823.389691] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:11:13 gaia kernel: [ 8823.389707] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:11:44 gaia kernel: [ 8853.593661] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:11:44 gaia kernel: [ 8853.593677] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:12:13 gaia kernel: [ 8882.657278] redis-server invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
Dec  3 15:12:13 gaia kernel: [ 8882.657287] redis-server cpuset=/ mems_allowed=0
Dec  3 15:12:13 gaia kernel: [ 8882.657293] CPU: 0 PID: 1185 Comm: redis-server Not tainted 3.13.0-71-generic #114-Ubuntu
Dec  3 15:12:13 gaia kernel: [ 8882.657296] Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./C847N, BIOS F2 11/09/2012
Dec  3 15:12:13 gaia kernel: [ 8882.657299]  0000000000000000 ffff8800753a1980 ffffffff81724860 ffff88007583e000
Dec  3 15:12:13 gaia kernel: [ 8882.657306]  ffff8800753a1a08 ffffffff8171ee67 ffffffff81067a76 ffff8800753a19e0
Dec  3 15:12:13 gaia kernel: [ 8882.657311]  ffffffff810c7a2c 0000000000000000 ffff8801005f9e38 0000000000000000
Dec  3 15:12:13 gaia kernel: [ 8882.657317] Call Trace:
Dec  3 15:12:13 gaia kernel: [ 8882.657328]  [<ffffffff81724860>] dump_stack+0x45/0x56
Dec  3 15:12:13 gaia kernel: [ 8882.657335]  [<ffffffff8171ee67>] dump_header+0x7f/0x1f1
Dec  3 15:12:13 gaia kernel: [ 8882.657342]  [<ffffffff81067a76>] ? put_online_cpus+0x56/0x80
Dec  3 15:12:13 gaia kernel: [ 8882.657347]  [<ffffffff810c7a2c>] ? rcu_oom_notify+0xcc/0xf0
Dec  3 15:12:13 gaia kernel: [ 8882.657354]  [<ffffffff81152fee>] oom_kill_process+0x1ce/0x330
Dec  3 15:12:13 gaia kernel: [ 8882.657361]  [<ffffffff812d8505>] ? security_capable_noaudit+0x15/0x20
Dec  3 15:12:13 gaia kernel: [ 8882.657366]  [<ffffffff81153724>] out_of_memory+0x414/0x450
Dec  3 15:12:13 gaia kernel: [ 8882.657372]  [<ffffffff81159a60>] __alloc_pages_nodemask+0xa60/0xb80
Dec  3 15:12:13 gaia kernel: [ 8882.657380]  [<ffffffff81197fd3>] alloc_pages_current+0xa3/0x160
Dec  3 15:12:13 gaia kernel: [ 8882.657387]  [<ffffffff8114fba7>] __page_cache_alloc+0x97/0xc0
Dec  3 15:12:13 gaia kernel: [ 8882.657391]  [<ffffffff811515b5>] filemap_fault+0x185/0x410
Dec  3 15:12:13 gaia kernel: [ 8882.657397]  [<ffffffff8117648f>] __do_fault+0x6f/0x530
Dec  3 15:12:13 gaia kernel: [ 8882.657403]  [<ffffffff8117a312>] handle_mm_fault+0x482/0xf10
Dec  3 15:12:13 gaia kernel: [ 8882.657410]  [<ffffffff8108e8f8>] ? hrtimer_try_to_cancel+0x48/0xe0
Dec  3 15:12:13 gaia kernel: [ 8882.657415]  [<ffffffff8172824e>] ? schedule_hrtimeout_range_clock+0xce/0x170
Dec  3 15:12:13 gaia kernel: [ 8882.657423]  [<ffffffff817309b4>] __do_page_fault+0x184/0x570
Dec  3 15:12:13 gaia kernel: [ 8882.657429]  [<ffffffff81206e7f>] ? ep_poll+0x30f/0x340
Dec  3 15:12:13 gaia kernel: [ 8882.657436]  [<ffffffff8109ace0>] ? wake_up_state+0x20/0x20
Dec  3 15:12:13 gaia kernel: [ 8882.657442]  [<ffffffff81730dba>] do_page_fault+0x1a/0x70
Dec  3 15:12:13 gaia kernel: [ 8882.657447]  [<ffffffff81207fec>] ? SyS_epoll_wait+0xac/0x100
Dec  3 15:12:13 gaia kernel: [ 8882.657452]  [<ffffffff8172d0e8>] page_fault+0x28/0x30
Dec  3 15:12:13 gaia kernel: [ 8882.657455] Mem-Info:
Dec  3 15:12:13 gaia kernel: [ 8882.657458] Node 0 DMA per-cpu:
Dec  3 15:12:13 gaia kernel: [ 8882.657462] CPU    0: hi:    0, btch:   1 usd:   0
Dec  3 15:12:13 gaia kernel: [ 8882.657465] CPU    1: hi:    0, btch:   1 usd:   0
Dec  3 15:12:13 gaia kernel: [ 8882.657467] Node 0 DMA32 per-cpu:
Dec  3 15:12:13 gaia kernel: [ 8882.657471] CPU    0: hi:  186, btch:  31 usd:  30
Dec  3 15:12:13 gaia kernel: [ 8882.657474] CPU    1: hi:  186, btch:  31 usd: 109
Dec  3 15:12:13 gaia kernel: [ 8882.657477] Node 0 Normal per-cpu:
Dec  3 15:12:13 gaia kernel: [ 8882.657480] CPU    0: hi:    0, btch:   1 usd:   0
Dec  3 15:12:13 gaia kernel: [ 8882.657483] CPU    1: hi:    0, btch:   1 usd:   0
Dec  3 15:12:13 gaia kernel: [ 8882.657491] active_anon:298395 inactive_anon:117932 isolated_anon:32
Dec  3 15:12:13 gaia kernel: [ 8882.657491]  active_file:165 inactive_file:305 isolated_file:0
Dec  3 15:12:13 gaia kernel: [ 8882.657491]  unevictable:0 dirty:0 writeback:0 unstable:0
Dec  3 15:12:13 gaia kernel: [ 8882.657491]  free:18644 slab_reclaimable:8136 slab_unreclaimable:6865
Dec  3 15:12:13 gaia kernel: [ 8882.657491]  mapped:2903 shmem:3543 pagetables:6578 bounce:0
Dec  3 15:12:13 gaia kernel: [ 8882.657491]  free_cma:0
Dec  3 15:12:13 gaia kernel: [ 8882.657497] Node 0 DMA free:7740kB min:556kB low:692kB high:832kB active_anon:3264kB inactive_anon:3672kB active_file:0kB inactive_file:4kB unevictable:0kB i
solated(anon):0kB isolated(file):0kB present:15992kB managed:15368kB mlocked:0kB dirty:0kB writeback:0kB mapped:76kB shmem:76kB slab_reclaimable:248kB slab_unreclaimable:236kB kernel_stack:
8kB pagetables:196kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:21 all_unreclaimable? yes
Dec  3 15:12:13 gaia kernel: [ 8882.657507] lowmem_reserve[]: 0 1799 1804 1804
Dec  3 15:12:13 gaia kernel: [ 8882.657513] Node 0 DMA32 free:66836kB min:66836kB low:83544kB high:100252kB active_anon:1190316kB inactive_anon:468056kB active_file:660kB inactive_file:1216
kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:1959460kB managed:1845620kB mlocked:0kB dirty:0kB writeback:0kB mapped:11536kB shmem:14096kB slab_reclaimable:32288kB slab
_unreclaimable:27044kB kernel_stack:4056kB pagetables:26116kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:2820 all_unreclaimable? yes
Dec  3 15:12:13 gaia kernel: [ 8882.657523] lowmem_reserve[]: 0 0 5 5
Dec  3 15:12:13 gaia kernel: [ 8882.657528] Node 0 Normal free:0kB min:184kB low:228kB high:276kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolate
d(anon):0kB isolated(file):0kB present:6144kB managed:5160kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:8kB slab_unreclaimable:180kB kernel_stack:0kB pagetabl
es:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Dec  3 15:12:13 gaia kernel: [ 8882.657537] lowmem_reserve[]: 0 0 0 0
Dec  3 15:12:13 gaia kernel: [ 8882.657542] Node 0 DMA: 19*4kB (UEM) 8*8kB (UE) 11*16kB (UE) 4*32kB (UE) 4*64kB (EM) 3*128kB (UEM) 2*256kB (UE) 0*512kB 2*1024kB (EM) 2*2048kB (ER) 0*4096kB
= 7740kB
Dec  3 15:12:13 gaia kernel: [ 8882.657565] Node 0 DMA32: 358*4kB (UE) 440*8kB (UEM) 469*16kB (UE) 335*32kB (UE) 157*64kB (UEM) 68*128kB (UE) 25*256kB (UEM) 4*512kB (E) 2*1024kB (UM) 3*2048
kB (UMR) 2*4096kB (M) = 66760kB
Dec  3 15:12:13 gaia kernel: [ 8882.657588] Node 0 Normal: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 0kB
Dec  3 15:12:13 gaia kernel: [ 8882.657604] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Dec  3 15:12:13 gaia kernel: [ 8882.657606] 72418 total pagecache pages
Dec  3 15:12:13 gaia kernel: [ 8882.657609] 68367 pages in swap cache
Dec  3 15:12:13 gaia kernel: [ 8882.657612] Swap cache stats: add 4778459, delete 4710092, find 3605650/4068967
Dec  3 15:12:13 gaia kernel: [ 8882.657614] Free swap  = 0kB
Dec  3 15:12:13 gaia kernel: [ 8882.657616] Total swap = 1982460kB
Dec  3 15:12:13 gaia kernel: [ 8882.657618] 495399 pages RAM
Dec  3 15:12:13 gaia kernel: [ 8882.657620] 0 pages HighMem/MovableOnly
Dec  3 15:12:13 gaia kernel: [ 8882.657622] 246 pages reserved
Dec  3 15:12:13 gaia kernel: [ 8882.657624] [ pid ]   uid  tgid total_vm      rss nr_ptes swapents oom_score_adj name
Dec  3 15:12:13 gaia kernel: [ 8882.657635] [  435]     0   435     4900        2      13       79             0 upstart-udev-br
Dec  3 15:12:13 gaia kernel: [ 8882.657640] [  440]     0   440    12924       37      28      186         -1000 systemd-udevd
Dec  3 15:12:13 gaia kernel: [ 8882.657645] [  742]     0   742     3814        6      13       46             0 upstart-socket-
Dec  3 15:12:13 gaia kernel: [ 8882.657650] [  884]     0   884    68169       48     131      420             0 smbd
Dec  3 15:12:13 gaia kernel: [ 8882.657655] [  913]   102   913     9841        2      23      132             0 dbus-daemon
Dec  3 15:12:13 gaia kernel: [ 8882.657658] [  969]     0   969    68171       41     125      427             0 smbd
Dec  3 15:12:13 gaia kernel: [ 8882.657663] [  979]     0   979   187226     3062      66     1626             0 docker
Dec  3 15:12:13 gaia kernel: [ 8882.657667] [  981]     0   981    99710     1455      31      300             0 gitlab-ci-multi
Dec  3 15:12:13 gaia kernel: [ 8882.657670] [  985]     0   985    47861       35      91      291             0 nmbd
Dec  3 15:12:13 gaia kernel: [ 8882.657674] [ 1016]     0  1016    10862        2      26       90             0 systemd-logind
Dec  3 15:12:13 gaia kernel: [ 8882.657678] [ 1037]   101  1037    63960       86      28      208             0 rsyslogd
Dec  3 15:12:13 gaia kernel: [ 8882.657683] [ 1071]     0  1071     3818        6      12       50             0 upstart-file-br
Dec  3 15:12:13 gaia kernel: [ 8882.657686] [ 1159]     0  1159     1090        6       8       19             0 runsvdir
Dec  3 15:12:13 gaia kernel: [ 8882.657691] [ 1161]     0  1161     4654        1      13       40             0 getty
Dec  3 15:12:13 gaia kernel: [ 8882.657694] [ 1165]     0  1165     4654        1      13       39             0 getty
Dec  3 15:12:13 gaia kernel: [ 8882.657698] [ 1167]     0  1167     1052        0       7       25             0 runsv
Dec  3 15:12:13 gaia kernel: [ 8882.657701] [ 1168]     0  1168     1052        0       7       29             0 runsv
Dec  3 15:12:13 gaia kernel: [ 8882.657705] [ 1169]     0  1169     1052        0       7       28             0 runsv
Dec  3 15:12:13 gaia kernel: [ 8882.657709] [ 1170]     0  1170     1052        0       7       22             0 runsv
Dec  3 15:12:13 gaia kernel: [ 8882.657712] [ 1171]     0  1171     1052        0       7       29             0 runsv
Dec  3 15:12:13 gaia kernel: [ 8882.657716] [ 1172]     0  1172     1052        0       6       29             0 runsv
Dec  3 15:12:13 gaia kernel: [ 8882.657720] [ 1173]     0  1173     1052        0       6       29             0 runsv
Dec  3 15:12:13 gaia kernel: [ 8882.657724] [ 1176]     0  1176     1088        0       8       37             0 svlogd
Dec  3 15:12:13 gaia kernel: [ 8882.657727] [ 1177]     0  1177     1088        0       8       27             0 svlogd
Dec  3 15:12:13 gaia kernel: [ 8882.657731] [ 1178]     0  1178     1088        0       7       27             0 svlogd
Dec  3 15:12:13 gaia kernel: [ 8882.657735] [ 1179]     0  1179     1088        0       8       35             0 svlogd
Dec  3 15:12:13 gaia kernel: [ 8882.657738] [ 1181]     0  1181     1088        0       8       30             0 svlogd
Dec  3 15:12:13 gaia kernel: [ 8882.657742] [ 1182]  1001  1182   373218    50180     341    31639             0 ruby
Dec  3 15:12:13 gaia kernel: [ 8882.657746] [ 1183]     0  1183     1088        0       7       30             0 svlogd
Dec  3 15:12:13 gaia kernel: [ 8882.657749] [ 1184]     0  1184     1088        0       8       26             0 svlogd
Dec  3 15:12:13 gaia kernel: [ 8882.657753] [ 1185]   998  1185    10846      318      17     2830             0 redis-server
Dec  3 15:12:13 gaia kernel: [ 8882.657757] [ 1187]  1001  1187    49911      598      21      340             0 gitlab-workhors
Dec  3 15:12:13 gaia kernel: [ 8882.657761] [ 1188]   997  1188   132212       80      35      119             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657766] [ 1189]  1001  1189     4507       39      14       42             0 gitlab-unicorn-
Dec  3 15:12:13 gaia kernel: [ 8882.657770] [ 1191]     0  1191     4654        1      13       41             0 getty
Dec  3 15:12:13 gaia kernel: [ 8882.657773] [ 1192]     0  1192     4654        1      12       41             0 getty
Dec  3 15:12:13 gaia kernel: [ 8882.657777] [ 1198]     0  1198     4654        2      13       39             0 getty
Dec  3 15:12:13 gaia kernel: [ 8882.657781] [ 1233]     0  1233     1091        0       8       36             0 acpid
Dec  3 15:12:13 gaia kernel: [ 8882.657784] [ 1235]     0  1235     5913       22      17       41             0 cron
Dec  3 15:12:13 gaia kernel: [ 8882.657788] [ 1242]     0  1242    15342       15      35      155         -1000 sshd
Dec  3 15:12:13 gaia kernel: [ 8882.657792] [ 1252]     0  1252     4784        0      12       51             0 atd
Dec  3 15:12:13 gaia kernel: [ 8882.657796] [ 1266]     0  1266    15940        0      37      119             0 cron
Dec  3 15:12:13 gaia kernel: [ 8882.657799] [ 1288]   103  1288   107069       77      74      265             0 whoopsie
Dec  3 15:12:13 gaia kernel: [ 8882.657804] [ 1297]     0  1297     1110        1       7       26             0 sh
Dec  3 15:12:13 gaia kernel: [ 8882.657808] [ 1298]     0  1298     3800        0      12       53             0 clamav_scan.sh
Dec  3 15:12:13 gaia kernel: [ 8882.657811] [ 1299]     0  1299     1808       46      10      169             0 inotifywait
Dec  3 15:12:13 gaia kernel: [ 8882.657815] [ 1300]     0  1300     4163       14      13       25             0 sed
Dec  3 15:12:13 gaia kernel: [ 8882.657819] [ 1301]     0  1301     3901      128      11       26             0 clamav_scan.sh
Dec  3 15:12:13 gaia kernel: [ 8882.657823] [ 1304]     0  1304     4797       27      15       31             0 irqbalance
Dec  3 15:12:13 gaia kernel: [ 8882.657827] [ 1308]   112  1308    73192    10384      79     9191             0 named
Dec  3 15:12:13 gaia kernel: [ 8882.657831] [ 1378]   997  1378   132269     1088      34      106             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657835] [ 1379]   997  1379   132269       18      21      129             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657839] [ 1380]   997  1380   132269       15      18      132             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657843] [ 1381]   997  1381   132506      126      24      221             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657847] [ 1382]   997  1382     6879       62      15      122             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657851] [ 1393]   107  1393   203254     3068      92    19046             0 mysqld
Dec  3 15:12:13 gaia kernel: [ 8882.657855] [ 1588]   996  1588    49700     2553      31      794             0 mattermost
Dec  3 15:12:13 gaia kernel: [ 8882.657858] [ 1607]   997  1607   135141      444      43      549             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657862] [ 1614]   997  1614   134439      543      42      311             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657866] [ 1865]  1001  1865   121498     2588     204    53513             0 ruby
Dec  3 15:12:13 gaia kernel: [ 8882.657870] [ 1878]   997  1878   134366       66      31      562             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657874] [ 1880]   113  1880   187260    14820     232    80460             0 clamd
Dec  3 15:12:13 gaia kernel: [ 8882.657878] [ 1998]   113  1998    13657        1      30      346             0 freshclam
Dec  3 15:12:13 gaia kernel: [ 8882.657882] [ 2019]     0  2019    24243       65      42      286             0 nginx
Dec  3 15:12:13 gaia kernel: [ 8882.657886] [ 2020]    33  2020    24553      193      44      560             0 nginx
Dec  3 15:12:13 gaia kernel: [ 8882.657889] [ 2021]    33  2021    24717      350      45      562             0 nginx
Dec  3 15:12:13 gaia kernel: [ 8882.657893] [ 2022]    33  2022    24787      451      45      553             0 nginx
Dec  3 15:12:13 gaia kernel: [ 8882.657915] [ 2023]    33  2023    24816      395      45      612             0 nginx
Dec  3 15:12:13 gaia kernel: [ 8882.657920] [ 2117]   997  2117   134977      460      41      336             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657923] [ 2118]   997  2118   134979      436      41      367             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657927] [ 2122]     0  2122     6335       27      16       51             0 master
Dec  3 15:12:13 gaia kernel: [ 8882.657931] [ 2129]   110  2129     6900       57      16       61             0 qmgr
Dec  3 15:12:13 gaia kernel: [ 8882.657935] [ 2168]   105  2168    16690       22      34      134             0 svnserve
Dec  3 15:12:13 gaia kernel: [ 8882.657939] [ 2192]     0  2192   263513        0      47      327             0 console-kit-dae
Dec  3 15:12:13 gaia kernel: [ 8882.657943] [ 2257]     0  2257    69939        0      40      191             0 polkitd
Dec  3 15:12:13 gaia kernel: [ 8882.657947] [ 2368]   997  2368   134977      424      41      335             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657951] [ 2369]   997  2369   134979      459      41      336             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657954] [ 2370]   997  2370   134978      455      41      335             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657958] [ 2511]     0  2511    26924        0      56      257             0 sshd
Dec  3 15:12:13 gaia kernel: [ 8882.657962] [ 2634]  1002  2634    26957        0      54      286             0 sshd
Dec  3 15:12:13 gaia kernel: [ 8882.657966] [ 2635]  1002  2635     6758        1      18      883             0 bash
Dec  3 15:12:13 gaia kernel: [ 8882.657970] [ 2950]     0  2950    86875      624      34     1174             0 fail2ban-server
Dec  3 15:12:13 gaia kernel: [ 8882.657973] [ 3012]     0  3012     4654        1      13       40             0 getty
Dec  3 15:12:13 gaia kernel: [ 8882.657977] [ 3278]     0  3278     4467       14       8       28             0 wrapper
Dec  3 15:12:13 gaia kernel: [ 8882.657981] [ 3281]     0  3281   339958      502      89     7484             0 java
Dec  3 15:12:13 gaia kernel: [ 8882.657985] [ 3305]     0  3305   610261     4475     216    67400             0 java
Dec  3 15:12:13 gaia kernel: [ 8882.657989] [ 3327]   997  3327   134359     1239      41      310             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657993] [ 3328]   997  3328   134409      537      42      318             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.657996] [ 3330]   997  3330   134435      501      42      360             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658000] [ 3331]   997  3331   134450      447      42      383             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658004] [ 3332]   997  3332   134396      523      41      306             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658008] [ 3380]     0  3380   547746     3391     387   142985             0 java
Dec  3 15:12:13 gaia kernel: [ 8882.658012] [ 3557]     0  3557    68753       49     131      443             0 smbd
Dec  3 15:12:13 gaia kernel: [ 8882.658015] [ 7816]     0  7816    69760       53     133      441             0 smbd
Dec  3 15:12:13 gaia kernel: [ 8882.658019] [ 7963]     0  7963    70130       58     134      773             0 smbd
Dec  3 15:12:13 gaia kernel: [ 8882.658023] [ 8373]   997  8373   134978      451      42      330             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658027] [ 8512]   997  8512   134369      511      41      333             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658031] [ 8617]     0  8617    69753       49     133      445             0 smbd
Dec  3 15:12:13 gaia kernel: [ 8882.658035] [13626]   997 13626   134978      463      40      339             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658039] [ 7699]   110  7699     6851       18      17       57             0 pickup
Dec  3 15:12:13 gaia kernel: [ 8882.658042] [ 8239]   997  8239   134463      427      36      444             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658046] [ 8243]   997  8243   134464      384      36      487             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658050] [ 8245]   997  8245   134806      624      38      472             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658054] [ 8248]   997  8248   134828      621      39      414             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658058] [ 8249]   997  8249   134805      546      38      541             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658062] [ 8252]   997  8252   134884      217      39      936             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658065] [ 8256]   997  8256   134446      127      34      719             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658069] [32535]  1001 32535   133702    57151     223     9061             0 ruby
Dec  3 15:12:13 gaia kernel: [ 8882.658073] [32586]   997 32586   135216     1391      41      455             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658077] [ 3458]     0  3458    68808       54     131      467             0 smbd
Dec  3 15:12:13 gaia kernel: [ 8882.658081] [10726]     0 10726     1110        1       7       25             0 gitlab-logrotat
Dec  3 15:12:13 gaia kernel: [ 8882.658085] [27115]     0 27115     1085        0       7       23             0 sleep
Dec  3 15:12:13 gaia kernel: [ 8882.658089] [13529]  1001 13529   136709    61543     230     7436             0 ruby
Dec  3 15:12:13 gaia kernel: [ 8882.658093] [13591]   997 13591   135175     1510      38      398             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658097] [16216]  1001 16216   134258    57874     224     7458             0 ruby
Dec  3 15:12:13 gaia kernel: [ 8882.658101] [16301]   997 16301   135119     1432      38      251             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658105] [16550]     0 16550     4508        0      14       80             0 bash
Dec  3 15:12:13 gaia kernel: [ 8882.658108] [16564]     0 16564     4520        0      12       91             0 bash
Dec  3 15:12:13 gaia kernel: [ 8882.658112] [16872]     0 16872     1153        0       7       75             0 make
Dec  3 15:12:13 gaia kernel: [ 8882.658116] [16875]     0 16875     1156        0       8       58             0 make
Dec  3 15:12:13 gaia kernel: [ 8882.658119] [16878]     0 16878     1156        0       7       59             0 make
Dec  3 15:12:13 gaia kernel: [ 8882.658123] [18008]     0 18008     1120        0       8       47             0 make
Dec  3 15:12:13 gaia kernel: [ 8882.658127] [18017]     0 18017     1110        0       6       24             0 sh
Dec  3 15:12:13 gaia kernel: [ 8882.658130] [18018]     0 18018     5453        0      14      722             0 python
Dec  3 15:12:13 gaia kernel: [ 8882.658134] [18019]     0 18019   526633    45918     276    48423             0 java
Dec  3 15:12:13 gaia kernel: [ 8882.658138] [18388]   997 18388   134323      564      35       83             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658142] [18389]   997 18389   134323      622      35       83             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658146] [21942]  1001 21942   128143    59411     213     1964             0 ruby
Dec  3 15:12:13 gaia kernel: [ 8882.658149] [22117]   997 22117   134991     1758      37       67             0 postgres
Dec  3 15:12:13 gaia kernel: [ 8882.658154] [23642]     0 23642     3231       85      12        0             0 clamdscan
Dec  3 15:12:13 gaia kernel: [ 8882.658157] Out of memory: Kill process 3380 (java) score 147 or sacrifice child
Dec  3 15:12:13 gaia kernel: [ 8882.658227] Killed process 3380 (java) total-vm:2190984kB, anon-rss:13564kB, file-rss:0kB
Dec  3 15:12:14 gaia kernel: [ 8883.829080] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:12:14 gaia kernel: [ 8883.829096] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:12:29 gaia named[1308]: validating @0x7f52a89750c0: creativecommons.org A: no valid signature found
Dec  3 15:12:29 gaia named[1308]: validating @0x7f52a06c4e00: creativecommons.org AAAA: no valid signature found
Dec  3 15:12:44 gaia kernel: [ 8914.034452] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:12:44 gaia kernel: [ 8914.034468] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:13:14 gaia kernel: [ 8944.241593] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:13:14 gaia kernel: [ 8944.241619] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:13:44 gaia kernel: [ 8974.447499] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:13:44 gaia kernel: [ 8974.447515] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:14:15 gaia kernel: [ 9004.649046] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:14:15 gaia kernel: [ 9004.649062] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:14:45 gaia kernel: [ 9034.853172] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:14:45 gaia kernel: [ 9034.853189] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:15:00 gaia postfix/qmgr[2129]: CF5F358049F: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: 62B4C5802F8: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: AD1FF5802E2: from=<cla...@wandercraft.eu>, size=4538, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: 5A494580BE0: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: 0F2B2580301: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: 06B7C580392: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: 97FC65803A6: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: EDB135803C6: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: E2D15580333: from=<cla...@wandercraft.eu>, size=4538, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: EF600580332: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: 454395802E1: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: 47543580292: from=<>, size=2622, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: 23681580359: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: 8BEB65803E3: from=<cla...@wandercraft.eu>, size=4538, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: 33BFA5802F1: from=<cla...@wandercraft.eu>, size=716, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia postfix/qmgr[2129]: 3FFDF5802A7: from=<>, size=10017, nrcpt=1 (queue active)
Dec  3 15:15:00 gaia kernel: [ 9050.354562] [UFW BLOCK] IN= OUT=p1p1 SRC=192.168.1.2 DST=62.210.189.189 LEN=60 TOS=0x00 PREC=0x00 TTL=64 ID=13177 DF PROTO=TCP SPT=49785 DPT=25 WINDOW=29200
RES=0x00 SYN URGP=0
Dec  3 15:15:00 gaia kernel: [ 9050.385693] [UFW BLOCK] IN= OUT=p1p1 SRC=192.168.1.2 DST=62.210.189.189 LEN=60 TOS=0x00 PREC=0x00 TTL=64 ID=38740 DF PROTO=TCP SPT=49786 DPT=25 WINDOW=29200
RES=0x00 SYN URGP=0
Dec  3 15:15:00 gaia kernel: [ 9050.394076] [UFW BLOCK] IN= OUT=p1p1 SRC=192.168.1.2 DST=62.210.189.189 LEN=60 TOS=0x00 PREC=0x00 TTL=64 ID=31540 DF PROTO=TCP SPT=49787 DPT=25 WINDOW=29200
RES=0x00 SYN URGP=0
Dec  3 15:15:00 gaia kernel: [ 9050.417984] [UFW BLOCK] IN= OUT=p1p1 SRC=192.168.1.2 DST=62.210.189.189 LEN=60 TOS=0x00 PREC=0x00 TTL=64 ID=20046 DF PROTO=TCP SPT=49788 DPT=25 WINDOW=29200
RES=0x00 SYN URGP=0
Dec  3 15:15:00 gaia kernel: [ 9050.439802] [UFW BLOCK] IN= OUT=p1p1 SRC=192.168.1.2 DST=62.210.189.189 LEN=60 TOS=0x00 PREC=0x00 TTL=64 ID=26674 DF PROTO=TCP SPT=49789 DPT=25 WINDOW=29200
RES=0x00 SYN URGP=0
Dec  3 15:15:01 gaia kernel: [ 9051.353516] [UFW BLOCK] IN= OUT=p1p1 SRC=192.168.1.2 DST=62.210.189.189 LEN=60 TOS=0x00 PREC=0x00 TTL=64 ID=13178 DF PROTO=TCP SPT=49785 DPT=25 WINDOW=29200
RES=0x00 SYN URGP=0
Dec  3 15:15:01 gaia kernel: [ 9051.385516] [UFW BLOCK] IN= OUT=p1p1 SRC=192.168.1.2 DST=62.210.189.189 LEN=60 TOS=0x00 PREC=0x00 TTL=64 ID=38741 DF PROTO=TCP SPT=49786 DPT=25 WINDOW=29200
RES=0x00 SYN URGP=0
Dec  3 15:15:01 gaia kernel: [ 9051.393512] [UFW BLOCK] IN= OUT=p1p1 SRC=192.168.1.2 DST=62.210.189.189 LEN=60 TOS=0x00 PREC=0x00 TTL=64 ID=31541 DF PROTO=TCP SPT=49787 DPT=25 WINDOW=29200
RES=0x00 SYN URGP=0
Dec  3 15:15:01 gaia kernel: [ 9051.417525] [UFW BLOCK] IN= OUT=p1p1 SRC=192.168.1.2 DST=62.210.189.189 LEN=60 TOS=0x00 PREC=0x00 TTL=64 ID=20047 DF PROTO=TCP SPT=49788 DPT=25 WINDOW=29200
RES=0x00 SYN URGP=0
Dec  3 15:15:01 gaia kernel: [ 9051.437514] [UFW BLOCK] IN= OUT=p1p1 SRC=192.168.1.2 DST=62.210.189.189 LEN=60 TOS=0x00 PREC=0x00 TTL=64 ID=26675 DF PROTO=TCP SPT=49789 DPT=25 WINDOW=29200
RES=0x00 SYN URGP=0
Dec  3 15:15:02 gaia named[1308]: validating @0x7f52a87896a0: aus5.external.zlb.scl3.mozilla.com A: no valid signature found
Dec  3 15:15:15 gaia kernel: [ 9065.047203] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:15:15 gaia kernel: [ 9065.047219] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:15:30 gaia postfix/smtp[28278]: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out
Dec  3 15:15:30 gaia postfix/smtp[28278]: CF5F358049F: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=185131, delays=185101/0.05/30/0, dsn=4.4.1, status=deferred (connect t
o smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:30 gaia postfix/smtp[28279]: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out
Dec  3 15:15:30 gaia postfix/smtp[28281]: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out
Dec  3 15:15:30 gaia postfix/smtp[28279]: 62B4C5802F8: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=260677, delays=260646/0.06/30/0, dsn=4.4.1, status=deferred (connect t
o smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:30 gaia postfix/smtp[28282]: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out
Dec  3 15:15:30 gaia postfix/smtp[28281]: AD1FF5802E2: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=235516, delays=235486/0.07/30/0, dsn=4.4.1, status=deferred (connect t
o smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:30 gaia postfix/smtp[28282]: 5A494580BE0: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=159833, delays=159803/0.08/30/0, dsn=4.4.1, status=deferred (connect t
o smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:30 gaia postfix/smtp[28283]: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out
Dec  3 15:15:31 gaia postfix/smtp[28283]: 0F2B2580301: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=285924, delays=285894/0.11/30/0, dsn=4.4.1, status=deferred (connect t
o smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:31 gaia postfix/error[29194]: 97FC65803A6: to=<cla...@wandercraft.eu>, relay=none, delay=331, delays=300/30/0/0.03, dsn=4.4.1, status=deferred (delivery temporarily suspended:
connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:31 gaia postfix/error[29193]: 06B7C580392: to=<cla...@wandercraft.eu>, relay=none, delay=25399, delays=25369/30/0/0.03, dsn=4.4.1, status=deferred (delivery temporarily suspend
ed: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:31 gaia postfix/error[29199]: E2D15580333: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=134748, delays=134718/30/0/0.02, dsn=4.4.1, status=deferred (delivery
 temporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:31 gaia postfix/error[29195]: EDB135803C6: to=<cla...@wandercraft.eu>, relay=none, delay=252199, delays=252169/30/0/0.03, dsn=4.4.1, status=deferred (delivery temporarily suspe
nded: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:31 gaia postfix/error[29194]: EF600580332: to=<cla...@wandercraft.eu>, relay=none, delay=226999, delays=226969/30/0/0.04, dsn=4.4.1, status=deferred (delivery temporarily suspe
nded: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:31 gaia postfix/error[29193]: 454395802E1: to=<cla...@wandercraft.eu>, relay=none, delay=201800, delays=201770/30/0/0.04, dsn=4.4.1, status=deferred (delivery temporarily suspe
nded: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:31 gaia postfix/error[29200]: 47543580292: to=<cla...@wandercraft.eu>, relay=none, delay=210200, delays=210170/30/0/0.11, dsn=4.4.1, status=deferred (delivery temporarily suspe
nded: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:31 gaia postfix/error[29199]: 8BEB65803E3: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=336352, delays=336321/30/0/0.1, dsn=4.4.1, status=deferred (delivery
temporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:31 gaia postfix/error[29202]: 23681580359: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=109489, delays=109459/30/0/0.1, dsn=4.4.1, status=deferred (delivery
temporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:31 gaia postfix/error[29204]: 3FFDF5802A7: to=<ro...@wandercraft.eu>, relay=none, delay=201800, delays=201770/30/0/0.17, dsn=4.4.1, status=deferred (delivery temporarily suspend
ed: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:31 gaia postfix/error[29195]: 33BFA5802F1: to=<cla...@wandercraft.eu>, orig_to=<clamav>, relay=none, delay=59093, delays=59063/30/0/0.17, dsn=4.4.1, status=deferred (delivery t
emporarily suspended: connect to smtp.wandercraft.eu[62.210.189.189]:25: Connection timed out)
Dec  3 15:15:45 gaia kernel: [ 9095.246141] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:15:45 gaia kernel: [ 9095.246157] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:16:15 gaia kernel: [ 9125.454469] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:16:15 gaia kernel: [ 9125.454486] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:16:46 gaia kernel: [ 9155.661701] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:16:46 gaia kernel: [ 9155.661717] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:17:02 gaia CRON[31142]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Dec  3 15:17:16 gaia kernel: [ 9185.853179] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:17:16 gaia kernel: [ 9185.853195] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:17:46 gaia kernel: [ 9216.047401] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:17:46 gaia kernel: [ 9216.047417] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:18:05 gaia named[1308]: validating @0x7f52a88b3ee0: creativecommons.org AAAA: no valid signature found
Dec  3 15:18:05 gaia named[1308]: validating @0x7f52a04e4960: creativecommons.org A: no valid signature found
Dec  3 15:18:16 gaia kernel: [ 9246.250089] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:18:16 gaia kernel: [ 9246.250105] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:18:46 gaia kernel: [ 9276.449331] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:18:46 gaia kernel: [ 9276.449348] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:19:17 gaia kernel: [ 9306.642676] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:19:17 gaia kernel: [ 9306.642692] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:19:47 gaia kernel: [ 9336.843474] [UFW BLOCK] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:0
000:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337
Dec  3 15:19:47 gaia kernel: [ 9336.843490] [IPTABLES] IN=p1p1 OUT= MAC=33:33:00:00:00:01:ec:22:80:ba:2b:00:86:dd SRC=fe80:0000:0000:0000:ee22:80ff:feba:2b00 DST=ff02:0000:0000:0000:0000:00
00:0000:0001 LEN=377 TC=0 HOPLIMIT=255 FLOWLBL=0 PROTO=UDP SPT=62976 DPT=62976 LEN=337

I hope it is what you wanted. 

The export of system info is :

{"System":{"System Date":"2015-12-03T10:07:03+0100","Start Time":"2015-12-03T09:56:22+0100","JVM Vendor":"Oracle Corporation","JVM Name":"OpenJDK 64-Bit Server VM","JVM Version":"24.91-b01","Processors":2,"System Classpath":"
./lib/common/lucene-memory-4.10.4.jar:
./lib/common/commons-codec-1.8.jar:
./lib/common/lucene-highlighter-4.10.4.jar:
./lib/common/logback-core-1.1.3.jar:
./lib/common/lucene-grouping-4.10.4.jar:
./lib/common/commons-io-2.4.jar:
./lib/common/sonar-process-5.2-tests.jar:
./lib/common/lucene-queries-4.10.4.jar:
./lib/common/lucene-suggest-4.10.4.jar:
./lib/common/lucene-sandbox-4.10.4.jar:
./lib/common/logback-classic-1.1.3.jar:
./lib/common/sonar-process-monitor-5.2.jar:
./lib/common/sonar-process-5.2.jar:
./lib/common/slf4j-api-1.7.12.jar:
./lib/common/elasticsearch-1.7.2.jar:
./lib/common/lucene-misc-4.10.4.jar:
./lib/common/lucene-core-4.10.4.jar:
./lib/common/lucene-analyzers-common-4.10.4.jar:
./lib/common/lucene-join-4.10.4.jar:
./lib/common/lucene-queryparser-4.10.4.jar:
./lib/common/commons-lang-2.6.jar:
./lib/server/sonar-ws-5.2.jar:
./lib/server/activation-1.1.1.jar:
./lib/server/commons-pool-1.5.4.jar:
./lib/server/sonar-markdown-5.2.jar:
./lib/server/jruby-complete-1.7.9.jar:
./lib/server/sonar-classloader-1.0.jar:
./lib/server/commons-dbutils-1.5.jar:
./lib/server/sonar-plugin-api-5.2.jar:
./lib/server/sonar-batch-protocol-5.2.jar:
./lib/server/sonar-home-5.2.jar:
./lib/server/jcommon-1.0.12.jar:
./lib/server/sonar-db-5.2.jar:
./lib/server/sonar-update-center-common-1.13.jar:
./lib/server/sonar-server-5.2.jar:
./lib/server/jfreechart-1.0.9.jar:
./lib/server/sonar-core-5.2.jar:
./lib/server/commons-csv-1.0.jar:
./lib/server/tomcat-embed-el-8.0.18.jar:
./lib/server/woodstox-core-lgpl-4.4.0.jar:
./lib/server/lz4-1.3.0.jar:
./lib/server/sonar-views-bridge-5.2.jar:
./lib/server/tomcat-embed-logging-juli-8.0.18.jar:
./lib/server/tomcat-embed-jasper-8.0.18.jar:
./lib/server/gson-2.3.1.jar:
./lib/server/picocontainer-2.15.jar:
./lib/server/guava-17.0.jar:
./lib/server/commons-collections-3.2.1.jar:
./lib/server/protobuf-java-3.0.0-beta-1.jar:
./lib/server/tomcat-embed-core-8.0.18.jar:
./lib/server/jruby-rack-1.1.13.2.jar:
./lib/server/mybatis-3.2.7.jar:
./lib/server/commons-dbcp-1.4.jar:
./lib/server/jcl-over-slf4j-1.7.12.jar:
./lib/server/logback-access-1.1.3.jar:
./lib/server/commons-beanutils-1.8.3.jar:
./lib/server/stax2-api-3.1.4.jar:
./lib/server/staxmate-2.0.1.jar:
./lib/server/commons-email-1.3.2.jar:
./lib/server/jul-to-slf4j-1.7.12.jar:
./lib/server/log4j-over-slf4j-1.7.12.jar:
./lib/server/mail-1.4.5.jar:/opt/sonar52/lib/jdbc/mysql/mysql-connector-java-5.1.35.jar",
"BootClassPath":"/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/resources.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/rt.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/jsse.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/jce.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/charsets.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/rhino.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/jfr.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/classes",
"Library Path":"/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib","Total Memory":"370 MB","Free Memory":"221 MB","Max Memory":"716 MB","Heap":"init = 268435456(262144K) used = 148431992(144953K) committed = 370147328(361472K) max = 716177408(699392K)",
"Non Heap":"init = 24576000(24000K) used = 92344096(90179K) committed = 92930048(90752K) max = 218103808(212992K)",
"System Load Average":"173,0% (last minute)",
"Loaded Classes":15833,
"Total Loaded Classes":15833,
"Unloaded Classes":0,
"Threads":32,
"Threads Peak":36,
"Daemon Thread":28},
"SonarQube":{"Version":"5.2","External User Authentication":"","Automatic User Creation":true,"Allow Users to Sign Up":false,"Force authentication":false,"Official Distribution":true,"Home Dir":"/opt/sonar52","Data Dir":"/media/backup/sonar/data","Temp Dir":"/media/backup/sonar/temp","Logs Dir":"/opt/sonar52/logs","Logs Level":"INFO"},
"ElasticSearch":{"State":"GREEN","Indices":{"users":{"Docs":12,"Shards":5,"Store Size":"32 KB"},
"tests":{"Docs":0,"Shards":5,"Store Size":"720 bytes"},
"views":{"Docs":0,"Shards":5,"Store Size":"720 bytes"},
"issues":{"Docs":71597,"Shards":5,"Store Size":"19 MB"},
"activities":{"Docs":13988,"Shards":5,"Store Size":"1 MB"},
"rules":{"Docs":10591,"Shards":1,"Store Size":"6 MB"}},
"Number of Nodes":1,
"Nodes":{"-AgcQ826TX-Fg7yi5ngbkQ":{"Address":"inet[/127.0.0.1:9001]","Type":"Master","Disk Available":"459 GB","Store Size":"26 MB","Open Files":194,"JVM Heap Usage":"5,0%","JVM Heap Used":"60 MB","JVM Heap Max":"1007 MB","JVM Non Heap Used":"42 MB","JVM Threads":41,"Field Data Memory":"3 MB","Field Data Circuit Breaker Limit":"604 MB","Field Data Circuit Breaker Estimation":"3 MB","Request Circuit Breaker Limit":"402 MB","Request Circuit Breaker Estimation":"0 bytes","Filter Cache Memory":"72 KB","Query Cache Memory":"0 bytes","ID Cache Memory":"74 KB"}}},
"Plugins":{"scmgit":{"Name":"Git","Version":"1.0"},
"motionchart":{"Name":"Motion Chart","Version":"1.7"},
"findbugs":{"Name":"Findbugs","Version":"2.4"},
"scmsvn":{"Name":"SVN","Version":"1.0"},
"cxx":{"Name":"C++ (Community)","Version":"0.9.4"},
"tabmetrics":{"Name":"Tab Metrics","Version":"1.4.1"},
"timeline":{"Name":"Timeline","Version":"1.5"},
"genericcoverage":{"Name":"Generic Coverage","Version":"1.1"},
"java":{"Name":"Java","Version":"2.4"},
"widgetlab":{"Name":"Widget Lab","Version":"1.7"},
"uselesscodetracker":{"Name":"Useless Code Tracker","Version":"1.0"},
"scmstats":{"Name":"Scm Stats","Version":"0.3.1"}},
"JvmProperties":{"awt.toolkit":"sun.awt.X11.XToolkit",
"catalina.base":"/media/backup/sonar/temp/tc","catalina.home":"/media/backup/sonar/temp/tc","catalina.useNaming":"false","file.encoding":"UTF-8","file.encoding.pkg":"sun.io","file.separator":"/","http.agent":"SonarQube 5.2","java.awt.graphicsenv":"sun.awt.X11GraphicsEnvironment","java.awt.headless":"true","java.awt.printerjob":"sun.print.PSPrinterJob","java.class.path":"
./lib/common/lucene-memory-4.10.4.jar:
./lib/common/commons-codec-1.8.jar:
./lib/common/lucene-highlighter-4.10.4.jar:
./lib/common/logback-core-1.1.3.jar:
./lib/common/lucene-grouping-4.10.4.jar:
./lib/common/commons-io-2.4.jar:
./lib/common/sonar-process-5.2-tests.jar:
./lib/common/lucene-queries-4.10.4.jar:
./lib/common/lucene-suggest-4.10.4.jar:
./lib/common/lucene-sandbox-4.10.4.jar:
./lib/common/logback-classic-1.1.3.jar:
./lib/common/sonar-process-monitor-5.2.jar:
./lib/common/sonar-process-5.2.jar:
./lib/common/slf4j-api-1.7.12.jar:
./lib/common/elasticsearch-1.7.2.jar:
./lib/common/lucene-misc-4.10.4.jar:
./lib/common/lucene-core-4.10.4.jar:
./lib/common/lucene-analyzers-common-4.10.4.jar:
./lib/common/lucene-join-4.10.4.jar:
./lib/common/lucene-queryparser-4.10.4.jar:
./lib/common/commons-lang-2.6.jar:
./lib/server/sonar-ws-5.2.jar:
./lib/server/activation-1.1.1.jar:
./lib/server/commons-pool-1.5.4.jar:
./lib/server/sonar-markdown-5.2.jar:
./lib/server/jruby-complete-1.7.9.jar:
./lib/server/sonar-classloader-1.0.jar:
./lib/server/commons-dbutils-1.5.jar:
./lib/server/sonar-plugin-api-5.2.jar:
./lib/server/sonar-batch-protocol-5.2.jar:
./lib/server/sonar-home-5.2.jar:
./lib/server/jcommon-1.0.12.jar:
./lib/server/sonar-db-5.2.jar:
./lib/server/sonar-update-center-common-1.13.jar:
./lib/server/sonar-server-5.2.jar:
./lib/server/jfreechart-1.0.9.jar:
./lib/server/sonar-core-5.2.jar:
./lib/server/commons-csv-1.0.jar:
./lib/server/tomcat-embed-el-8.0.18.jar:
./lib/server/woodstox-core-lgpl-4.4.0.jar:
./lib/server/lz4-1.3.0.jar:
./lib/server/sonar-views-bridge-5.2.jar:
./lib/server/tomcat-embed-logging-juli-8.0.18.jar:
./lib/server/tomcat-embed-jasper-8.0.18.jar:
./lib/server/gson-2.3.1.jar:
./lib/server/picocontainer-2.15.jar:
./lib/server/guava-17.0.jar:
./lib/server/commons-collections-3.2.1.jar:
./lib/server/protobuf-java-3.0.0-beta-1.jar:
./lib/server/tomcat-embed-core-8.0.18.jar:
./lib/server/jruby-rack-1.1.13.2.jar:
./lib/server/mybatis-3.2.7.jar:
./lib/server/commons-dbcp-1.4.jar:
./lib/server/jcl-over-slf4j-1.7.12.jar:
./lib/server/logback-access-1.1.3.jar:
./lib/server/commons-beanutils-1.8.3.jar:
./lib/server/stax2-api-3.1.4.jar:
./lib/server/staxmate-2.0.1.jar:
./lib/server/commons-email-1.3.2.jar:
./lib/server/jul-to-slf4j-1.7.12.jar:
./lib/server/log4j-over-slf4j-1.7.12.jar:
./lib/server/mail-1.4.5.jar:/opt/sonar52/lib/jdbc/mysql/mysql-connector-java-5.1.35.jar","java.class.version":"51.0","java.endorsed.dirs":"/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/endorsed","java.ext.dirs":"/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/ext:/usr/java/packages/lib/ext","java.home":"/usr/lib/jvm/java-7-openjdk-amd64/jre","java.io.tmpdir":"/media/backup/sonar/temp","java.library.path":"/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib","java.net.preferIPv4Stack":"true","java.runtime.name":"OpenJDK Runtime Environment","java.runtime.version":"1.7.0_91-b02","java.specification.name":"Java Platform API Specification","java.specification.vendor":"Oracle Corporation","java.specification.version":"1.7","java.vendor":"Oracle Corporation","java.vendor.url":"http://java.oracle.com/","java.vendor.url.bug":"http://bugreport.sun.com/bugreport/","java.version":"1.7.0_91","java.vm.info":"mixed mode","java.vm.name":"OpenJDK 64-Bit Server VM","java.vm.specification.name":"Java Virtual Machine Specification","java.vm.specification.vendor":"Oracle Corporation","java.vm.specification.version":"1.7","java.vm.vendor":"Oracle Corporation","java.vm.version":"24.91-b01","jruby.compile.invokedynamic":"false","jruby.management.enabled":"false","line.separator":"\n","org.apache.catalina.startup.EXIT_ON_INIT_FAILURE":"true","org.apache.tomcat.util.buf.UDecoder.ALLOW_ENCODED_SLASH":"true","os.arch":"amd64","os.name":"Linux","os.version":"3.13.0-68-generic","path.separator":":","sun.arch.data.model":"64","sun.boot.class.path":"/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/resources.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/rt.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/jsse.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/jce.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/charsets.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/rhino.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/jfr.jar:/usr/lib/jvm/java-7-openjdk-amd64/jre/classes","sun.boot.library.path":"/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/amd64","sun.cpu.endian":"little","sun.cpu.isalist":"","sun.io.unicode.encoding":"UnicodeLittle","sun.java.command":"org.sonar.server.app.WebServer /tmp/sq-process5517151245022007914properties","sun.java.launcher":"SUN_STANDARD","sun.jnu.encoding":"UTF-8","sun.management.compiler":"HotSpot 64-Bit Tiered Compilers","sun.nio.ch.bugLevel":"","sun.os.patch.level":"unknown","user.country":"FR","user.dir":"/opt/sonar52","user.home":"/root","user.language":"fr","user.name":"root","user.timezone":"Europe/Paris"},
"Database":{"Database":"MySQL","Database Version":"5.5.46-0ubuntu0.14.04.2","Username":"sonar@localhost","URL":"jdbc:mysql://localhost:3306/sonar2?useUnicode=true&characterEncoding=utf8&rewriteBatchedStatements=true&useConfigs=maxPerformance","Driver":"MySQL Connector Java","Driver Version":"mysql-connector-java-5.1.35 ( Revision: 5fb9c5849535c13917c2cf9baaece6ef9693ef27 )","Version Status":"UP_TO_DATE","Pool Active Connections":2,"Pool Max Connections":20,"Pool Initial Size":0,"Pool Idle Connections":4,"Pool Min Idle Connections":2,"Pool Max Idle Connections":5,"Pool Max Wait (ms)":5000,"Pool Remove Abandoned":false,"Pool Remove Abandoned Timeout (seconds)":300},
"ComputeEngineQueue":{"Received":0,"Pending":0,"In progress":0,"Successfully processed":0,"Processed with error":0,"Processing time":0}}

I hope it can give you an idea, 

Thank you again, 

Fabien

fabien...@gmail.com

unread,
Dec 18, 2015, 5:39:27 AM12/18/15
to SonarQube, simon.b...@sonarsource.com
Hello Simon, 

I was wondering if you had any idea with the complete logs? 

Best 

Fabien

Le mercredi 2 décembre 2015 22:34:32 UTC+1, Simon Brandhof a écrit :

Sebastien Lesaint

unread,
Dec 18, 2015, 5:47:06 AM12/18/15
to SonarQube
Hello Fabien,

From the logs you provided, it appears that SonarQube is shutting down without any error or warning. Basically, it seems to be shutdown clean and nicely.

So, imho, your best bet to figure this out is to look for another program, cron job, service, ... stopping SonarQube specifically and any java process.

Sébastien LESAINT | SonarSource
Platform Developer

Sebastien Lesaint

unread,
Dec 18, 2015, 5:48:21 AM12/18/15
to SonarQube
SonarQube specifically and any java process.

*or any java process.

Sébastien LESAINT | SonarSource
Platform Developer

warke...@tengen.ca

unread,
Jan 15, 2016, 6:03:32 PM1/15/16
to SonarQube
I'm having the same issue as the original poster. Today SonarQube stopped twice for no apparent reason. Log file looks clean. There are no cron jobs or any other processes that should be shutting it down. The problems seem to have started after I upgraded to version 5.2.

I'm running SonarQube 5.2 on AWS Linux using Java 1.8.0_65-b17.

Julien Lancelot

unread,
Jan 18, 2016, 3:50:22 AM1/18/16
to warke...@tengen.ca, SonarQube
Hi,

Please have a look at Simon's response on this thread : https://groups.google.com/d/msg/sonarqube/bXJdG5poreQ/aSzv0n_HCwAJ.
You'll see that this issue is related to Elasticsearch on Linux, on the solution is to increase the memory.

Regards

Julien LANCELOT | SonarSource

fabien...@gmail.com

unread,
Jan 18, 2016, 6:42:15 AM1/18/16
to SonarQube, warke...@tengen.ca
Hello, 

Just to let you know, I never found anything that could explain why sonar was stopping (no cron jobs or anything else). 
For us, it actually started just before we upgraded to 5.2 

We also have concluded the problem was due to a memory issue and it now works fine on our new server whereas we have not changed anything in the sonarqube configuration. 

Regards
Reply all
Reply to author
Forward
0 new messages