Why scylla-server can restart automatically?

219 views
Skip to first unread message

yang liyuan

<yangly0815@gmail.com>
unread,
May 20, 2021, 2:25:04 AM5/20/21
to ScyllaDB users

I want to stop scylla-server and i execute "systemctl stop scylla-server", but a few minutes later, it will restart automatically. So how to stop scylla-server and it cannot restart itself until i re-execute the command "systemctl restart scylla-server". 

Thanks!
```
[root@node01 ~]# systemctl stop scylla-server
[root@node01 ~]# systemctl status scylla-server
● scylla-server.service - Scylla Server
   Loaded: loaded (/usr/lib/systemd/system/scylla-server.service; disabled; vendor preset: disabled)
  Drop-In: /etc/systemd/system/scylla-server.service.d
           └─dependencies.conf, mounts.conf
   Active: inactive (dead) since Thu 2021-05-20 13:59:04 CST; 8s ago
  Process: 17068 ExecStopPost=/opt/scylladb/scripts/scylla_stop (code=exited, status=0/SUCCESS)
  Process: 16607 ExecStart=/usr/bin/scylla $SCYLLA_ARGS $SEASTAR_IO $DEV_MODE $CPUSET $MEM_CONF (code=exited, status=0/SUCCESS)
  Process: 16585 ExecStartPre=/opt/scylladb/scripts/scylla_prepare (code=exited, status=0/SUCCESS)
 Main PID: 16607 (code=exited, status=0/SUCCESS)
   Status: "serving"

May 20 13:59:04 node01 scylla[16607]:  [shard 0] init - Shutting down cdc was successful
May 20 13:59:04 node01 scylla[16607]:  [shard 0] init - Shutting down sstables format selector
May 20 13:59:04 node01 scylla[16607]:  [shard 0] init - Shutting down sstables format selector was successful
May 20 13:59:04 node01 scylla[16607]:  [shard 0] init - Shutting down migration manager
May 20 13:59:04 node01 scylla[16607]:  [shard 0] migration_manager - stopping migration service
May 20 13:59:04 node01 scylla[16607]:  [shard 0] init - Shutting down migration manager was successful
May 20 13:59:04 node01 scylla[16607]:  [shard 0] init - Shutting down database
May 20 13:59:04 node01 scylla[16607]:  [shard 0] init - Shutting down database was successful
May 20 13:59:04 node01 scylla[16607]:  [shard 0] init - Shutting down sst_dir_semaphore
May 20 13:59:04 node01 systemd[1]: Stopped Scylla Server.
[root@node01 ~]#
[root@node01 ~]# systemctl status scylla-server
● scylla-server.service - Scylla Server
   Loaded: loaded (/usr/lib/systemd/system/scylla-server.service; disabled; vendor preset: disabled)
  Drop-In: /etc/systemd/system/scylla-server.service.d
           └─dependencies.conf, mounts.conf
   Active: active (running) since Thu 2021-05-20 14:00:56 CST; 2min 18s ago
  Process: 17068 ExecStopPost=/opt/scylladb/scripts/scylla_stop (code=exited, status=0/SUCCESS)
  Process: 17089 ExecStartPre=/opt/scylladb/scripts/scylla_prepare (code=exited, status=0/SUCCESS)
 Main PID: 17111 (scylla)
   Status: "serving"
   CGroup: /scylla.slice/scylla-server.slice/scylla-server.service
           └─17111 /usr/bin/scylla --developer-mode 1 --alternator-address 192.168.75.129 --alternator-port 8000 --experimental-features lwt --enable-keyspace-column-family-metrics 0 --log-to-syslog 1 --l...

May 20 14:01:21 node01 scylla[17111]:  [shard 0] init - Launching generate_mv_updates for non system tables
May 20 14:01:21 node01 scylla[17111]:  [shard 0] init - starting the view builder
May 20 14:01:21 node01 scylla[17111]:  [shard 0] init - starting native transport
May 20 14:01:21 node01 scylla[17111]:  [shard 0] compaction - [Compact system.truncated cd360390-b930-11eb-927a-000000000000] Compacting [/var/lib/scylla/data/system/truncated-38c19fd0fb8633....db:level=0, ]
May 20 14:01:21 node01 scylla[17111]:  [shard 0] cql_server_controller - Starting listening for CQL clients on 192.168.75.129:9042 (unencrypted, non-shard-aware)
May 20 14:01:21 node01 scylla[17111]:  [shard 0] thrift_controller - Thrift server listening on 192.168.75.129:9160 ...
May 20 14:01:21 node01 scylla[17111]:  [shard 0] init - Alternator server listening on 192.168.75.129, HTTP port 8000, HTTPS port OFF
May 20 14:01:21 node01 scylla[17111]:  [shard 0] init - serving
May 20 14:01:21 node01 scylla[17111]:  [shard 0] init - Scylla version 4.4.1-0.20210413.00da6b5e9 initialization completed.
May 20 14:01:21 node01 scylla[17111]:  [shard 0] compaction - [Compact system.truncated cd360390-b930-11eb-927a-000000000000] Compacted 2 sstables to [/var/lib/scylla/data/system/truncated-3...s merged to 8.
Hint: Some lines were ellipsized, use -l to show in full.
```



Avi Kivity

<avi@scylladb.com>
unread,
May 20, 2021, 4:15:45 AM5/20/21
to scylladb-users@googlegroups.com, yang liyuan

This shouldn't happen. Probably some other service has a dependency on it.


Try:


    systemctl list-dependencies scylla-server.service --all --reverse

--
You received this message because you are subscribed to the Google Groups "ScyllaDB users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to scylladb-user...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/scylladb-users/d04f4112-04f6-464f-976b-848c3815ecf2n%40googlegroups.com.

Young Ringer

<yangly0815@gmail.com>
unread,
May 20, 2021, 9:45:33 PM5/20/21
to ScyllaDB users
The output of the command " systemctl list-dependencies scylla-server.service --all --reverse  " is as followings:
```
[root@node01 ~]# systemctl list-dependencies scylla-server.service --all --reverse
scylla-server.service
● ├─scylla-fstrim.timer
● │ └─timers.target
● │   └─basic.target
● │     ├─atd.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─brandbot.service
● │     ├─crond.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─dbus.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─dracut-mount.service
● │     │ └─initrd.target
● │     ├─dracut-pre-pivot.service
● │     │ └─initrd.target
● │     ├─ge...@tty1.service
● │     │ └─getty.target
● │     │   └─multi-user.target
● │     │     └─graphical.target
● │     ├─irqbalance.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─mdmonitor.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─microcode.service
│     │   └─...
● │     ├─network.service
● │     │ ├─graphical.target
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─NetworkManager-wait-online.service
● │     │ └─network-online.target
● │     │   ├─network.service
● │     │   │ ├─graphical.target
● │     │   │ └─multi-user.target
● │     │   │   └─graphical.target
● │     │   ├─rhnsd.service
● │     │   │ ├─graphical.target
● │     │   │ └─multi-user.target
● │     │   │   └─graphical.target
│     │     └─...
● │     ├─NetworkManager.service
● │     │ ├─NetworkManager-wait-online.service
● │     │ │ └─network-online.target
● │     │ │   ├─network.service
● │     │ │   │ ├─graphical.target
● │     │ │   │ └─multi-user.target
● │     │ │   │   └─graphical.target
● │     │ │   ├─rhnsd.service
● │     │ │   │ ├─graphical.target
● │     │ │   │ └─multi-user.target
● │     │ │   │   └─graphical.target
│     │ │     └─...
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─plymouth-quit-wait.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─plymouth-quit.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─polkit.service
● │     ├─postfix.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─rc-local.service
● │     ├─rhel-dmesg.service
│     │   └─...
● │     ├─rhnsd.service
● │     │ ├─graphical.target
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─rhsmcertd.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─rsyslog.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─scylla-fstrim.service
● │     ├─scylla-housekeeping-daily.service
● │     ├─scylla-housekeeping-restart.service
● │     ├─scylla-jmx.service
│     │   └─...
│     │ └─...
● │     ├─sshd-keygen.service
● │     │ ├─sshd.service
● │     │ │ └─multi-user.target
● │     │ │   └─graphical.target
● │     │ ├─sshd.service
● │     │ │ └─multi-user.target
● │     │ │   └─graphical.target
● │     │ └─sshd.socket
● │     ├─sshd.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─systemd-ask-password-wall.service
● │     ├─systemd-logind.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─systemd-user-sessions.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─unbound-anchor.service
● │     ├─vmtoolsd.service
● │     │ └─multi-user.target
● │     │   └─graphical.target
● │     ├─initrd.target
● │     └─multi-user.target
● │       └─graphical.target
● ├─scylla-housekeeping-daily.timer
│   └─...
● ├─scylla-housekeeping-restart.timer
│   └─...
● ├─scylla-jmx.service
│   └─...
● └─multi-user.target
●   └─graphical.target

```

Pekka Enberg

<penberg@scylladb.com>
unread,
May 21, 2021, 3:39:16 AM5/21/21
to ScyllaDB users, Avi Kivity, Takuya ASADA
On Fri, May 21, 2021 at 4:45 AM Young Ringer <yangl...@gmail.com> wrote:
> The output of the command " systemctl list-dependencies scylla-server.service --all --reverse " is as followings:
> ```
> [root@node01 ~]# systemctl list-dependencies scylla-server.service --all --reverse
> scylla-server.service
> ● ├─scylla-fstrim.timer

Avi, Takuya, the "scylla-fstrim.timer", for example, has:

[Unit]
Description=Run Scylla fstrim weekly
After=scylla-server.service
BindsTo=scylla-server.service

Isn't "BindsTo" a *stronger* variant of "Requires" (IOW, forces
stopping too)? That is, does this not mean that when the fstrim timer
fires, it will force Scylla to start?

- Pekka

Avi Kivity

<avi@scylladb.com>
unread,
May 30, 2021, 5:41:43 AM5/30/21
to Pekka Enberg, ScyllaDB users, Takuya ASADA
Yes, I think you are right. Should be easy to check.


Young Ringer

<yangly0815@gmail.com>
unread,
Jun 21, 2021, 4:20:23 AM6/21/21
to ScyllaDB users
I modify the scylla-fstrim.timer file as followings:
[root@node01 ~]# cat /usr/lib/systemd/system/scylla-fstrim.timer
[Unit]
Description=Run Scylla fstrim daily
After=scylla-server.service
#BindsTo=scylla-server.service

[Timer]
OnCalendar=Sat *-*-* 00:00:00
RandomizedDelaySec=86400

[Install]
WantedBy=timers.target

Then i stop scylla-server again and it cannot restart itself anymore.
But will the modifying will cause another problem?

Avi Kivity

<avi@scylladb.com>
unread,
Jun 21, 2021, 5:05:08 AM6/21/21
to scylladb-users@googlegroups.com, Young Ringer

I don't think so. Please file an issue in the issue tracker, and we will fix it for everyone.

--
You received this message because you are subscribed to the Google Groups "ScyllaDB users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to scylladb-user...@googlegroups.com.

Young Ringer

<yangly0815@gmail.com>
unread,
Jun 23, 2021, 10:13:02 PM6/23/21
to ScyllaDB users
I've creat an issue for the conversation. 
Reply all
Reply to author
Forward
0 new messages