Is there a script available to install schedulix on an AWS host

222 views
Skip to first unread message

wim.ve...@billinghouse.nl

unread,
May 24, 2018, 9:22:27 AM5/24/18
to schedulix
Hi,

The past days I did some reserach on schedulix to see if it would fit our requirements. It does (it even has more capabilities that immediately required) :)

So now we are looking at setting up a schedulix environment at an Amazon Web Services (AWS) server. We found a script for that on the internet (https://gist.github.com/ziplokk1/ec77e453b5fa66d31d0553b53e475f77), we were wondering if there was an updated version for that, as schedulix is now at version 2.8

Regards,
Wim Veldhuis.


Ronald Jeninga

unread,
May 24, 2018, 9:42:53 AM5/24/18
to schedulix
Hi Wim,

I'm very pleased to hear about your progress and about the fact that schedulix meets your requirements.

I didn't write the script you mention, but I had a short look at it and it defines the schedulix version to use (INSTALLVERSION).
Since the basic procedure of compiling and installation didn't change, I expect the script to work for 2.8 as well.
If you have a AWS testsystem available I'd give it a try.

But maybe the original author is active here too?

Best regards,

Ronald

wim.ve...@billinghouse.nl

unread,
May 25, 2018, 9:58:40 AM5/25/18
to schedulix
Hi Ronald,

On the schedulix site I see a public key to validate an rpm for schedulix. Is the RPM itself also available somewhere ?
It might be easier to install an rpm than to run the entire script (which uses mysql where we want postgres etc.).

The customer would like to know how much time it would take to set up and configure the server. It is basically not in the current project scope, but the operators want something like this. 

We could try it locally, but we do not have aws atm.

Regards and have a nice weekend,
Wim Veldhuis.

Ronald Jeninga

unread,
May 25, 2018, 10:46:20 AM5/25/18
to schedulix
Hi Wim,

I've attached an rpm to add the schedulix repository.

After installation of the rpm please check /etc/yum.repos.d/schedulix.repo
You'll find several repositories, a mere schedulix and some schedulix-<version>
The basic idea is that if you use a versioned repository you won't be surprised by sudden upgrades and you only get bugfixes for that version.
If you use the schedulix repository and we think it's time to issue the next release, you'll get the next release whether you like or not.

The rpms are built for RH7/CentOS7 but might work on other platforms too.

Regards,

Ronald 
schedulix-repo-2.8-8.el7.centos.noarch.rpm

wim.ve...@billinghouse.nl

unread,
May 28, 2018, 6:25:57 AM5/28/18
to schedulix
Hi Ronald,

I installed the rpm using  'sudo rpm -Uvh schedulix-repo-2.8-8.el7.centos.noarch.rpm'
I have a correct etc/yum.repos.d/schedulix.repo file.

However, when I run 'sudo yum install schedulix' on a clean AWS linux node (RedHat 7 based), it get a 404 error:

[***]$ sudo yum install schedulix
Loaded plugins: priorities, update-motd, upgrade-helper
amzn-main                                                                                                                                                                                                             | 2.1 kB  00:00:00
amzn-updates                                                                                                                                                                                                          | 2.5 kB  00:00:00
Trying other mirror.
To address this issue please refer to the below knowledge base article


When doing wget https://www.google.com it works, and I can reach https://www.independit.de/repo/centos (but the latest and further does not seem to exist.

Regards,
Wim..


Ronald Jeninga

unread,
May 28, 2018, 6:40:03 AM5/28/18
to schedulix
Hi Wim,

I must have made a mistake while adding the latest rpms. I'll investigate this immediately.
Thank you for reporting.

I'll notify as soon as I think I've corrected the problem.

Best regards,

Ronald

Ronald Jeninga

unread,
May 28, 2018, 6:51:40 AM5/28/18
to schedulix
Hi Wim,

OK, I made some progress. For some reason does the $releasever variable expand to "latest" in the AWS environment.
So far I've encountered "7" (mainly on x86_64 platforms) and "7Server" (mainly on ppc8/ppc8le platforms).

I've added a symbolic link and tried to access the xml using wget, which worked.

Please try again and report if it worked.

Best regards and thank you,

Ronald

wim.ve...@billinghouse.nl

unread,
May 28, 2018, 7:11:13 AM5/28/18
to schedulix
One step further:

[**** ~]$ sudo yum install schedulix
Loaded plugins: priorities, update-motd, upgrade-helper
amzn-main                                                                                                                                                                                                             | 2.1 kB  00:00:00
amzn-updates                                                                                                                                                                                                          | 2.5 kB  00:00:00
schedulix                                                                                                                                                                                                             | 2.9 kB  00:00:00
schedulix/latest/x86_64/primary_db                                                                                                                                                                                    |  15 kB  00:00:00
No package schedulix available.
Error: Nothing to do


Regards,
Wim

Ronald Jeninga

unread,
May 28, 2018, 7:25:59 AM5/28/18
to schedulix
Hi Wim,

well, that's probably because there isn't a package called schedulix.

But there are a few other packages:

[ronald@ocelot tmp]$ yum list | grep schedulix
schedulix-base.x86_64                   2.7-20.el7.centos              @schedulix-2.7
schedulix-client.x86_64                 2.7-20.el7.centos              @schedulix-2.7
schedulix-doc.x86_64                    2.7-16.el7.centos              @schedulix-2.7
schedulix-examples.x86_64               2.7-16.el7.centos              @schedulix-2.7
schedulix-server-pg.x86_64              2.7-20.el7.centos              @schedulix-2.7
schedulix-zope.x86_64                   2.7-20.el7.centos              @schedulix-2.7
schedulix-server-mariadb.x86_64         2.7-20.el7.centos              schedulix-2.7

schedulix-doc is just the documentation and technically not required for anything. It will install the pdf files in /usr/share/doc/schedulix-<version>.
schedulix-examples is useful if you are trying to learn the system. The disadvantage is that you'll need an swt.jar, which isn't available as a standard package for RH7 or CentOS7.
I've added a package that installs in those environments (I "stole" it from fedora), but I wouldn't want to install this on production systems.

schedulix-base is required for everything else.
schedulix-client is required for jobserver installations.
schedulix-zope installs the zope server (this sometimes fails for reasons I can't influence, but after a few retries it usually succeeds)

schedulix-server-mariadb and schedulix-server-pg are mutually exclusive and install the server using MariaDb or PostgreSQL.

Best regards,

Ronald

PS. I currently have the 2.7 repository enabled. Depending on what I'm doing that changes pretty fast.
You shouldn't draw any conclusions from it. In fact, if it were my choice, I would definitely install the 2.8 version.

wim.ve...@billinghouse.nl

unread,
May 28, 2018, 8:30:30 AM5/28/18
to schedulix
Now missing dependencies :(
I am not very versatile in installing stuff on linux.

 sudo yum install schedulix-base.x86_64
Loaded plugins: priorities, update-motd, upgrade-helper
amzn-main                                                                                                                                                                                                             | 2.1 kB  00:00:00
amzn-updates                                                                                                                                                                                                          | 2.5 kB  00:00:00
Resolving Dependencies
--> Running transaction check
---> Package schedulix-base.x86_64 0:2.8-8.el7.centos will be installed
--> Processing Dependency: osgi(com.sun.jna) for package: schedulix-base-2.8-8.el7.centos.x86_64
--> Processing Dependency: jna for package: schedulix-base-2.8-8.el7.centos.x86_64
--> Running transaction check
---> Package jna.x86_64 0:3.5.2-2.2.amzn1 will be installed
---> Package schedulix-base.x86_64 0:2.8-8.el7.centos will be installed
--> Processing Dependency: osgi(com.sun.jna) for package: schedulix-base-2.8-8.el7.centos.x86_64
--> Finished Dependency Resolution
Error: Package: schedulix-base-2.8-8.el7.centos.x86_64 (schedulix)
           Requires: osgi(com.sun.jna)
 You could try using --skip-broken to work around the problem
 You could try running: rpm -Va --nofiles --nodigest
[*** ~]$ yum list |grep osgi
[*** ~]$

No package osgi listed, rpmfind does not show one for redhat.

Any ideas ?

Regards,
Wim

Ronald Jeninga

unread,
May 28, 2018, 9:08:47 AM5/28/18
to schedulix
Hi Wim,

this happens for some reasons on some platforms (I've seen it before) and is due to a broken jna package as far as I can see.
Maybe it helps if you install the jna first and schedulix-base afterwards (jna is then installed and no further processing takes place).

But I can't guarantee that a

yum install jna

indeed works. But if not it would at least prove my suspicion.

And if it doesn't work you can write a complaint to Amazon in the time I try to figure out a solution.

Best regards,

Ronald

wim.ve...@billinghouse.nl

unread,
May 28, 2018, 3:47:11 PM5/28/18
to schedulix
yum install jna works, but does not solve the problem.

I can not find an osgi com.sun.jna rpm file for redhat/aws

Really annoying.

Regards,
Wim Veldhuis.

Ronald Jeninga

unread,
May 29, 2018, 3:19:54 AM5/29/18
to schedulix
Hi Wim,

I absolutely share your opinion, it is really annoying!
Especially because I don't do something special within the rpm spec file:

%package base
# ----------------------------------------------------------------------------------------
#
# base package
#
# ----------------------------------------------------------------------------------------
Summary:                The schedulix base package installs all files that are used both by the server and the client
Group:                  Applications/System
Requires:               java-1.7.0-openjdk jna

And the string "osgi" is specified nowhere in the files (I'm in the lib directory of the source tree where the rpm spec files reside) :

[ronald@ocelot lib]$ grep -i osgi *
[ronald@ocelot lib]$

is what happens if I search for it. This means something else thinks to know better and requires this osgi thing from nowhere.
I already engaged the google search engine, but didn't find any understandable results. Some issues about flaws in Manifest files which sounded highly obscure to me.

I'll continue my search. In the meantime, since you now have a jna.jar (should be in /usr/share/java/jna.jar), you could install the base package with --nodeps specified.
Things can't get worse, so trying it won't harm. The other packages should install without problems (but I start doubting my understanding of the rpm logic).

Sorry for the hassle.

Best regards,

Ronald


wim.ve...@billinghouse.nl

unread,
May 29, 2018, 8:09:59 AM5/29/18
to schedulix
Hi Ronald,

Het blijft struikelen op osgi.
Ergens is die dependency terechtgekomen in de rpm. 

sudo yum deplist  schedulix-base.x86_64
Loaded plugins: priorities, update-motd, upgrade-helper
package: schedulix-base.x86_64 2.8-8.el7.centos
  dependency: /bin/sh
   provider: bash.x86_64 4.2.46-28.37.amzn1
  dependency: java-1.7.0-openjdk
   provider: java-1.7.0-openjdk.x86_64 1:1.7.0.181-2.6.14.1.79.amzn1
  dependency: jna
   provider: jna.x86_64 3.5.2-2.2.amzn1
  dependency: libc.so.6(GLIBC_2.2.5)(64bit)
   provider: glibc.x86_64 2.17-222.173.amzn1
  dependency: osgi(com.sun.jna)
   Unsatisfied dependency
  dependency: rtld(GNU_HASH)
   provider: glibc.x86_64 2.17-222.173.amzn1
   provider: glibc.i686 2.17-222.173.amzn1


Gr,
Wim.

Ronald Jeninga

unread,
May 29, 2018, 9:02:38 AM5/29/18
to schedulix
Hallo Wim,

dat is interessant. Op mijn systeem ziet het er zo uit:

[ronald@ocelot lib]$ yum deplist schedulix-base
Loaded plugins: fastestmirror, langpacks
Loading mirror speeds from cached hostfile
 * updates: mirror.infonline.de
package: schedulix-base.x86_64 2.7-20.el7.centos
  dependency: /bin/sh
   provider: bash.x86_64 4.2.46-30.el7
  dependency: java-1.7.0-openjdk
   provider: java-1.7.0-openjdk.x86_64 1:1.7.0.181-2.6.14.8.el7_5
  dependency: jna
   provider: jna.x86_64 3.5.2-8.el7
  dependency: libc.so.6(GLIBC_2.2.5)(64bit)
   provider: glibc.x86_64 2.17-222.el7
  dependency: rtld(GNU_HASH)
   provider: glibc.x86_64 2.17-222.el7
   provider: glibc.i686 2.17-222.el7
[ronald@ocelot lib]$ su -
Password: 
Last login: Thu May 17 19:09:16 CEST 2018 on pts/6
[root@ocelot ~]# vi /etc/yum.repos.d/schedulix.repo 
[root@ocelot ~]# yum list | grep schedulix
schedulix-base.x86_64                   2.7-20.el7.centos              @schedulix-2.7
schedulix-client.x86_64                 2.7-20.el7.centos              @schedulix-2.7
schedulix-doc.x86_64                    2.7-16.el7.centos              @schedulix-2.7
schedulix-examples.x86_64               2.7-16.el7.centos              @schedulix-2.7
schedulix-server-pg.x86_64              2.7-20.el7.centos              @schedulix-2.7
schedulix-zope.x86_64                   2.7-20.el7.centos              @schedulix-2.7
schedulix-base.x86_64                   2.8-8.el7.centos               schedulix
schedulix-client.x86_64                 2.8-8.el7.centos               schedulix
schedulix-server-mariadb.x86_64         2.8-8.el7.centos               schedulix
schedulix-server-pg.x86_64              2.8-8.el7.centos               schedulix
schedulix-zope.x86_64                   2.8-8.el7.centos               schedulix
[root@ocelot ~]# yum deplist schedulix-base
Loaded plugins: fastestmirror, langpacks
Loading mirror speeds from cached hostfile
package: schedulix-base.x86_64 2.8-8.el7.centos
  dependency: /bin/sh
   provider: bash.x86_64 4.2.46-30.el7
  dependency: java-1.7.0-openjdk
   provider: java-1.7.0-openjdk.x86_64 1:1.7.0.181-2.6.14.8.el7_5
  dependency: jna
   provider: jna.x86_64 3.5.2-8.el7
  dependency: libc.so.6(GLIBC_2.2.5)(64bit)
   provider: glibc.x86_64 2.17-222.el7
  dependency: osgi(com.sun.jna)
   provider: jna.x86_64 3.5.2-8.el7
  dependency: rtld(GNU_HASH)
   provider: glibc.x86_64 2.17-222.el7
   provider: glibc.i686 2.17-222.el7
[root@ocelot ~]# 

Als root heb ik repository schedulix geactiveerd. En plotseling wil die ook een osgi.
Maar, en dat is opvallend, die dependency wordt door jna.x86_64 3.5.2-8.el7 bevredigd.

Het wordt nog eigenaardiger. Ik heb zojuist nieuwe 2.7 rpms gemaakt. Die willen geen osgi.
De rpms van 2.8 echter wel, hoewel ik aan de afhankelijkheden niets veranderd heb.
Op het ogenblik begrijp ik er geen biet meer van.

Nou ja, laten we eerst maar eens die jna rpms vergelijken. Die van CentOS schijnt die osgi dependency te bevredigen, die van Amazon niet.
Het kan goed zijn dat ze niet verschillen, maar tenminste levert onze "yum deplist" een verschil die in die richting wijst.


[ronald@ocelot x86_64]$ yum -v info jna
Loading "fastestmirror" plugin
Loading "langpacks" plugin
Adding en_GB.UTF-8 to language list
Config time: 0.007
Adding en_GB to language list
Yum version: 3.4.3
rpmdb time: 0.000
Setting up Package Sacks
Loading mirror speeds from cached hostfile
 * updates: mirror.infonline.de
pkgsack time: 0.355
Installed Packages
Name        : jna
Arch        : x86_64
Version     : 3.5.2
Release     : 8.el7
Size        : 409 k
Repo        : installed
From repo   : base
Committer   : Daniel Mach <his e-mail address>
Committime  : Fri Jan 24 13:00:00 2014
Buildtime   : Tue Jun 10 05:56:18 2014
Install time: Tue Mar 22 14:04:42 2016
Installed by: Ronald Jeninga <ronald>
Changed by  : System <unset>
Summary     : Pure Java access to native libraries
URL         : https://jna.dev.java.net/
Licence     : LGPLv2+ and ASL 2.0
Description : JNA provides Java programs easy access to native shared libraries
            : (DLLs on Windows) without writing anything but Java code. JNA's
            : design aims to provide native access in a natural way with a
            : minimum of effort. No boilerplate or generated code is required.
            : While some attention is paid to performance, correctness and ease
            : of use take priority.

En de files in de rpm:

[ronald@ocelot x86_64]$ rpm -ql jna
/usr/lib64/jna
/usr/lib64/jna/libjnidispatch.so
/usr/share/doc/jna-3.5.2
/usr/share/doc/jna-3.5.2/CHANGES.md
/usr/share/doc/jna-3.5.2/LICENSE
/usr/share/doc/jna-3.5.2/LICENSE-2.0
/usr/share/doc/jna-3.5.2/OTHERS
/usr/share/doc/jna-3.5.2/README.md
/usr/share/doc/jna-3.5.2/TODO
/usr/share/java/jna.jar
/usr/share/maven-fragments/jna
/usr/share/maven-poms/JPP-jna.pom

Hoe ziet het er bij jou uit? Zijn er relevante verschillen?

Dankjewel voor jouw hulp!

Groet,

Ronald

wim.ve...@billinghouse.nl

unread,
May 29, 2018, 9:30:18 AM5/29/18
to schedulix
Hier mijn output:

[*** ~]$ yum deplist schedulix-base
Loaded plugins: priorities, update-motd, upgrade-helper
package: schedulix-base.x86_64 2.8-8.el7.centos
  dependency: /bin/sh
   provider: bash.x86_64 4.2.46-28.37.amzn1
  dependency: java-1.7.0-openjdk
   provider: java-1.7.0-openjdk.x86_64 1:1.7.0.181-2.6.14.1.79.amzn1
  dependency: jna
   provider: jna.x86_64 3.5.2-2.2.amzn1
  dependency: libc.so.6(GLIBC_2.2.5)(64bit)
   provider: glibc.x86_64 2.17-222.173.amzn1
  dependency: osgi(com.sun.jna)
   Unsatisfied dependency
  dependency: rtld(GNU_HASH)
   provider: glibc.x86_64 2.17-222.173.amzn1
   provider: glibc.i686 2.17-222.173.amzn1

sh-4.2# yum list | grep schedulix
schedulix-repo.noarch                 2.8-8.el7.centos              installed
eclipse-swt.x86_64                    1:3.6.1-6.13.el6              schedulix
schedulix-base.x86_64                 2.8-8.el7.centos              schedulix
schedulix-client.x86_64               2.8-8.el7.centos              schedulix
schedulix-server-mariadb.x86_64       2.8-8.el7.centos              schedulix
schedulix-server-pg.x86_64            2.8-8.el7.centos              schedulix
schedulix-zope.x86_64                 2.8-8.el7.centos              schedulix

sh-4.2# yum deplist schedulix-base
Loaded plugins: priorities, update-motd, upgrade-helper
package: schedulix-base.x86_64 2.8-8.el7.centos
  dependency: /bin/sh
   provider: bash.x86_64 4.2.46-28.37.amzn1
  dependency: java-1.7.0-openjdk
   provider: java-1.7.0-openjdk.x86_64 1:1.7.0.181-2.6.14.1.79.amzn1
  dependency: jna
   provider: jna.x86_64 3.5.2-2.2.amzn1
  dependency: libc.so.6(GLIBC_2.2.5)(64bit)
   provider: glibc.x86_64 2.17-222.173.amzn1
  dependency: osgi(com.sun.jna)
   Unsatisfied dependency
  dependency: rtld(GNU_HASH)
   provider: glibc.x86_64 2.17-222.173.amzn1
   provider: glibc.i686 2.17-222.173.amzn1

[*** ~]$ yum -v info jna
Loading "priorities" plugin
Loading "update-motd" plugin
Loading "upgrade-helper" plugin
Config time: 0.007
Yum version: 3.4.3
rpmdb time: 0.000
Setting up Package Sacks
pkgsack time: 0.162
Installed Packages
Name        : jna
Arch        : x86_64
Version     : 3.5.2
Release     : 2.2.amzn1
Size        : 883 k
Repo        : installed
From repo   : amzn-main
Committer   : Rodrigo Novo <roda...@amazon.com>
Committime  : Tue Aug  4 12:00:00 2015
Buildtime   : Tue Aug  4 17:39:39 2015
Install time: Mon May 28 19:24:05 2018
Installed by: EC2 Default User <ec2-user>
Changed by  : System <unset>
Summary     : Pure Java access to native libraries
URL         : https://jna.dev.java.net/
License     : LGPLv2+
Description : JNA provides Java programs easy access to native shared libraries
            : (DLLs on Windows) without writing anything but Java code. JNA's
            : design aims to provide native access in a natural way with a
            : minimum of effort. No boilerplate or generated code is required.
            : While some attention is paid to performance, correctness and ease
            : of use take priority.


[*** ~]$ rpm -ql jna
/usr/lib64/jna
/usr/lib64/jna/libjnidispatch.so
/usr/share/doc/jna-3.5.2
/usr/share/doc/jna-3.5.2/CHANGES.md
/usr/share/doc/jna-3.5.2/LICENSE
/usr/share/doc/jna-3.5.2/OTHERS
/usr/share/doc/jna-3.5.2/README.md
/usr/share/doc/jna-3.5.2/TODO
/usr/share/java/jna.jar


Ik weet niet wat de verschillen betekenen....

Gr,
Wim

Ronald Jeninga

unread,
May 29, 2018, 10:02:00 AM5/29/18
to schedulix
Hallo Wim,

dankjewel!

Bij mijn google zoek acties ben ik verwijzen naar Maven tegengekomen. Wat het allemaal betekent? Geen idee.
Maar een feit is dat de twee jna rpms duidelijk verschillend zijn.

Wat gebeurt er als je

1. yum remove jna
3. yum install ./jna-3.5.2-8.el7.x86_64.rpm
4. yum deplist schedulix-base

doet? 
Je mag natuurlijk ook een andere mirror gebruiken.

Groet,

Ronald

wim.ve...@billinghouse.nl

unread,
May 29, 2018, 10:33:32 AM5/29/18
to schedulix
Zie hier de output.

Nog steeds een unsatisfied dependency op osgi


sh-4.2# yum remove jna
Loaded plugins: priorities, update-motd, upgrade-helper
Resolving Dependencies
--> Running transaction check
---> Package jna.x86_64 0:3.5.2-2.2.amzn1 will be erased
--> Finished Dependency Resolution

Dependencies Resolved

=============================================================================================================================================================================================================================================
 Package                                             Arch                                                   Version                                                         Repository                                                  Size
=============================================================================================================================================================================================================================================
Removing:
 jna                                                 x86_64                                                 3.5.2-2.2.amzn1                                                 @amzn-main                                                 883 k

Transaction Summary
=============================================================================================================================================================================================================================================
Remove  1 Package

Installed size: 883 k
Is this ok [y/N]: y
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Erasing    : jna-3.5.2-2.2.amzn1.x86_64                                                                                                                                                                                                1/1
  Verifying  : jna-3.5.2-2.2.amzn1.x86_64                                                                                                                                                                                                1/1

Removed:
  jna.x86_64 0:3.5.2-2.2.amzn1

Complete!
Resolving mirror1.hs-esslingen.de (mirror1.hs-esslingen.de)... 129.143.116.10, 2001:7c0:700::10
Connecting to mirror1.hs-esslingen.de (mirror1.hs-esslingen.de)|129.143.116.10|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 303748 (297K) [application/x-rpm]
Saving to: ‘jna-3.5.2-8.el7.x86_64.rpm’

jna-3.5.2-8.el7.x86_64.rpm                                  100%[========================================================================================================================================>] 296.63K  --.-KB/s    in 0.1s

2018-05-29 14:31:46 (2.86 MB/s) - ‘jna-3.5.2-8.el7.x86_64.rpm’ saved [303748/303748]

sh-4.2# yum install ./jna-3.5.2-8.el7.x86_64.rpm
Loaded plugins: priorities, update-motd, upgrade-helper
Examining ./jna-3.5.2-8.el7.x86_64.rpm: jna-3.5.2-8.el7.x86_64
Marking ./jna-3.5.2-8.el7.x86_64.rpm to be installed
Resolving Dependencies
--> Running transaction check
---> Package jna.x86_64 0:3.5.2-8.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

=============================================================================================================================================================================================================================================
 Package                                          Arch                                                Version                                                     Repository                                                            Size
=============================================================================================================================================================================================================================================
Installing:
 jna                                              x86_64                                              3.5.2-8.el7                                                 /jna-3.5.2-8.el7.x86_64                                              409 k

Transaction Summary
=============================================================================================================================================================================================================================================
Install  1 Package

Total size: 409 k
Installed size: 409 k
Is this ok [y/d/N]: y
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : jna-3.5.2-8.el7.x86_64                                                                                                                                                                                                    1/1
  Verifying  : jna-3.5.2-8.el7.x86_64                                                                                                                                                                                                    1/1

Installed:
  jna.x86_64 0:3.5.2-8.el7

Complete!

wim.ve...@billinghouse.nl

unread,
May 29, 2018, 10:37:14 AM5/29/18
to schedulix
I just tried again after reinstalling jna:

sh-4.2# yum deplist schedulix-base
Loaded plugins: priorities, update-motd, upgrade-helper
package: schedulix-base.x86_64 2.8-8.el7.centos
  dependency: /bin/sh
   provider: bash.x86_64 4.2.46-28.37.amzn1
  dependency: java-1.7.0-openjdk
   provider: java-1.7.0-openjdk.x86_64 1:1.7.0.181-2.6.14.1.79.amzn1
  dependency: jna
   provider: jna.x86_64 3.5.2-2.2.amzn1
  dependency: libc.so.6(GLIBC_2.2.5)(64bit)
   provider: glibc.x86_64 2.17-222.173.amzn1
  dependency: osgi(com.sun.jna)
   Unsatisfied dependency
  dependency: rtld(GNU_HASH)
   provider: glibc.x86_64 2.17-222.173.amzn1
   provider: glibc.i686 2.17-222.173.amzn1
sh-4.2# yum install schedulix-base
Loaded plugins: priorities, update-motd, upgrade-helper
Resolving Dependencies
--> Running transaction check
---> Package schedulix-base.x86_64 0:2.8-8.el7.centos will be installed
--> Finished Dependency Resolution

Dependencies Resolved

=============================================================================================================================================================================================================================================
 Package                                                     Arch                                                Version                                                        Repository                                              Size
=============================================================================================================================================================================================================================================
Installing:
 schedulix-base                                              x86_64                                              2.8-8.el7.centos                                               schedulix                                              5.1 M

Transaction Summary
=============================================================================================================================================================================================================================================
Install  1 Package

Total download size: 5.1 M
Installed size: 5.7 M
Is this ok [y/d/N]: y
Downloading packages:
warning: /var/cache/yum/x86_64/latest/schedulix/packages/schedulix-base-2.8-8.el7.centos.x86_64.rpm: Header V4 RSA/SHA1 Signature, key ID a3858a9a: NOKEY                                                  ]  0.0 B/s | 2.0 MB  --:--:-- ETA
Public key for schedulix-base-2.8-8.el7.centos.x86_64.rpm is not installed
schedulix-base-2.8-8.el7.centos.x86_64.rpm                                                                                                                                                                            | 5.1 MB  00:00:00
Importing GPG key 0xA3858A9A:
 Userid     : "********"
 Fingerprint: fac3 8165 b83b ea0e 36e9 5b94 965a a2e7 a385 8a9a
Is this ok [y/N]: y
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
executing pre base -- 2.8-8.el7.centos
useradd: warning: the home directory already exists.
Not copying any file from skel directory into it.
  Installing : schedulix-base-2.8-8.el7.centos.x86_64                                                                                                                                                                                    1/1
executing post base -- 2.8-8.el7.centos
  Verifying  : schedulix-base-2.8-8.el7.centos.x86_64                                                                                                                                                                                    1/1

Installed:
  schedulix-base.x86_64 0:2.8-8.el7.centos

Complete!

Progress !

wim.ve...@billinghouse.nl

unread,
May 29, 2018, 10:49:21 AM5/29/18
to schedulix
I guess the db is next, since we want to use postgres (later on an rds system itself)

sh-4.2# yum install schedulix-server-pg.x86_64
Loaded plugins: priorities, update-motd, upgrade-helper
amzn-main                                                                                                                                                                                                             | 2.1 kB  00:00:00
amzn-updates                                                                                                                                                                                                          | 2.5 kB  00:00:00
Resolving Dependencies
--> Running transaction check
---> Package schedulix-server-pg.x86_64 0:2.8-8.el7.centos will be installed
--> Processing Dependency: postgresql-server for package: schedulix-server-pg-2.8-8.el7.centos.x86_64
--> Processing Dependency: postgresql-jdbc for package: schedulix-server-pg-2.8-8.el7.centos.x86_64
--> Running transaction check
---> Package postgresql-jdbc.noarch 0:8.4.701-8.11.amzn1 will be installed
---> Package postgresql92-server-compat.x86_64 0:9.2.24-1.65.amzn1 will be installed
--> Processing Dependency: postgresql92-server(x86-64) = 9.2.24-1.65.amzn1 for package: postgresql92-server-compat-9.2.24-1.65.amzn1.x86_64
--> Running transaction check
---> Package postgresql92-server.x86_64 0:9.2.24-1.65.amzn1 will be installed
--> Processing Dependency: postgresql92-libs(x86-64) = 9.2.24-1.65.amzn1 for package: postgresql92-server-9.2.24-1.65.amzn1.x86_64
--> Processing Dependency: postgresql92(x86-64) = 9.2.24-1.65.amzn1 for package: postgresql92-server-9.2.24-1.65.amzn1.x86_64
--> Processing Dependency: postgresql92(alternatives) for package: postgresql92-server-9.2.24-1.65.amzn1.x86_64
--> Processing Dependency: postgresql92(alternatives) for package: postgresql92-server-9.2.24-1.65.amzn1.x86_64
--> Processing Dependency: libpq.so.5()(64bit) for package: postgresql92-server-9.2.24-1.65.amzn1.x86_64
--> Running transaction check
---> Package postgresql92.x86_64 0:9.2.24-1.65.amzn1 will be installed
---> Package postgresql92-libs.x86_64 0:9.2.24-1.65.amzn1 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

=============================================================================================================================================================================================================================================
 Package                                                             Arch                                            Version                                                        Repository                                          Size
=============================================================================================================================================================================================================================================
Installing:
 schedulix-server-pg                                                 x86_64                                          2.8-8.el7.centos                                               schedulix                                           48 k
Installing for dependencies:
 postgresql-jdbc                                                     noarch                                          8.4.701-8.11.amzn1                                             amzn-main                                          405 k
 postgresql92                                                        x86_64                                          9.2.24-1.65.amzn1                                              amzn-main                                          4.1 M
 postgresql92-libs                                                   x86_64                                          9.2.24-1.65.amzn1                                              amzn-main                                          261 k
 postgresql92-server                                                 x86_64                                          9.2.24-1.65.amzn1                                              amzn-main                                          6.0 M
 postgresql92-server-compat                                          x86_64                                          9.2.24-1.65.amzn1                                              amzn-main                                           39 k

Transaction Summary
=============================================================================================================================================================================================================================================
Install  1 Package (+5 Dependent packages)

Total download size: 11 M
Installed size: 34 M
Is this ok [y/d/N]: y
Downloading packages:
(1/6): postgresql-jdbc-8.4.701-8.11.amzn1.noarch.rpm                                                                                                                                                                  | 405 kB  00:00:00
(2/6): postgresql92-libs-9.2.24-1.65.amzn1.x86_64.rpm                                                                                                                                                                 | 261 kB  00:00:00
(3/6): postgresql92-9.2.24-1.65.amzn1.x86_64.rpm                                                                                                                                                                      | 4.1 MB  00:00:00
(4/6): postgresql92-server-compat-9.2.24-1.65.amzn1.x86_64.rpm                                                                                                                                                        |  39 kB  00:00:00
(5/6): postgresql92-server-9.2.24-1.65.amzn1.x86_64.rpm                                                                                                                                                               | 6.0 MB  00:00:00
(6/6): schedulix-server-pg-2.8-8.el7.centos.x86_64.rpm                                                                                                                                                                |  48 kB  00:00:00
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                                                                                         12 MB/s |  11 MB  00:00:00
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : postgresql92-libs-9.2.24-1.65.amzn1.x86_64                                                                                                                                                                                1/6
  Installing : postgresql92-9.2.24-1.65.amzn1.x86_64                                                                                                                                                                                     2/6
  Installing : postgresql92-server-9.2.24-1.65.amzn1.x86_64                                                                                                                                                                              3/6
  Installing : postgresql92-server-compat-9.2.24-1.65.amzn1.x86_64                                                                                                                                                                       4/6
  Installing : postgresql-jdbc-8.4.701-8.11.amzn1.noarch                                                                                                                                                                                 5/6
executing pre server-pg -- 2.8-8.el7.centos
/var/tmp/rpm-tmp.DRoZ75: line 32: postgresql-setup: command not found

/var/lib/pgsql9/data is missing. Use "service postgresql initdb" to initialize the cluster first.
[FAILED]
error: %pre(schedulix-server-pg-2.8-8.el7.centos.x86_64) scriptlet failed, exit status 1
Error in PREIN scriptlet in rpm package schedulix-server-pg-2.8-8.el7.centos.x86_64
  Verifying  : postgresql-jdbc-8.4.701-8.11.amzn1.noarch                                                                                                                                                                                 1/6
  Verifying  : postgresql92-libs-9.2.24-1.65.amzn1.x86_64                                                                                                                                                                                2/6
  Verifying  : postgresql92-server-compat-9.2.24-1.65.amzn1.x86_64                                                                                                                                                                       3/6
  Verifying  : postgresql92-server-9.2.24-1.65.amzn1.x86_64                                                                                                                                                                              4/6
  Verifying  : postgresql92-9.2.24-1.65.amzn1.x86_64                                                                                                                                                                                     5/6
  Verifying  : schedulix-server-pg-2.8-8.el7.centos.x86_64                                                                                                                                                                               6/6

Dependency Installed:
  postgresql-jdbc.noarch 0:8.4.701-8.11.amzn1  postgresql92.x86_64 0:9.2.24-1.65.amzn1  postgresql92-libs.x86_64 0:9.2.24-1.65.amzn1  postgresql92-server.x86_64 0:9.2.24-1.65.amzn1  postgresql92-server-compat.x86_64 0:9.2.24-1.65.amzn1

Failed:
  schedulix-server-pg.x86_64 0:2.8-8.el7.centos

Complete!


Guess something might be wrong in the script itself.I did run service postgresql initdb and reissued the yum install cmd. Then it worked.
I then installed the schedulix-client and the zope server. 
Zope server took a while but also completed correctly.

Next question, how to proceeed :)

BTW, tomorrow I will not be working.

Ronald Jeninga

unread,
May 29, 2018, 11:15:57 AM5/29/18
to schedulix
Hi Wim,

well, the rpms work on a plain CentOS, so "wrong" isn't the correct expression. The Amazon postgres installation differs from the CentOS one as it seems.
And obviously is the CentOS jna somewhat better than the Amazon jna.
If we have time, we should investigate this more in depth.

Anyway congratulations with the successful installation on the AWS platform!

How to proceed...?
Create jobs, create jobserver and some testing perhaps?

I'll be working tomorrow. Although the situation relaxes somewhat, I'd still be happy with a clone of me ;-)

Best regards,

Ronald

wim.ve...@billinghouse.nl

unread,
May 29, 2018, 2:25:01 PM5/29/18
to schedulix
I'd like to create jobs and such, but it is not working :(

when I do a server-start I get the following:
INFO    [main]          29 May 2018 18:13:10 GMT Exporting WORKDIR
ERROR   [main]          29 May 2018 18:13:10 GMT Unable to connect to jdbc:postgresql:schedulixdb, org.postgresql.util.PSQLException: FATAL: Ident authentication failed for user "schedulix"ERROR   [main]             29 May 2018 18:13:10 GMT Unable to connect to jdbc:postgresql:schedulixdb, org.postgresql.util.PSQLException: FATAL: Ident authentication failed for user "schedulix"
ERROR   [main]          29 May 2018 18:13:10 GMT ****************** Start Stacktrace *********************
ERROR   [main]          29 May 2018 18:13:10 GMT de.independit.scheduler.server.util.SDMSThread.doTrace(SDMSThread.java:168)
ERROR   [main]          29 May 2018 18:13:10 GMT ****************** Start Stacktrace *********************
ERROR   [main]          29 May 2018 18:13:10 GMT de.independit.scheduler.server.exception.FatalException.<init>(FatalException.java:50)
ERROR   [main]          29 May 2018 18:13:10 GMT de.independit.scheduler.server.Server.connectToDB(Server.java:420)
ERROR   [main]          29 May 2018 18:13:10 GMT de.independit.scheduler.server.util.SDMSThread.doTrace(SDMSThread.java:168)
ERROR   [main]          29 May 2018 18:13:10 GMT de.independit.scheduler.server.RenewTicketThread.initRenewTicketThread(RenewTicketThread.java:91)
ERROR   [main]          29 May 2018 18:13:10 GMT de.independit.scheduler.server.Server.initRenewTicketThread(Server.java:112)

ERROR   [main]          29 May 2018 18:13:10 GMT de.independit.scheduler.server.exception.FatalException.<init>(FatalException.java:50)ERROR   [main]           29 May 2018 18:13:10 GMT de.independit.scheduler.server.Server.serverMain(Server.java:459)

ERROR   [main]          29 May 2018 18:13:10 GMT de.independit.scheduler.server.Server.connectToDB(Server.java:420)ERROR   [main]               29 May 2018 18:13:10 GMT de.independit.scheduler.BICServer.main(BICServer.java:144)

ERROR   [main]          29 May 2018 18:13:10 GMT de.independit.scheduler.server.RenewTicketThread.initRenewTicketThread(RenewTicketThread.java:91)ERROR   [main]                29 May 2018 18:13:10 GMT ****************** End Stacktrace   *********************


However as schedulix user I can do 'psql schedulixdb'  and do stuff.
So the db is there, it is working, but the server is not allowed to connect.

I am able to reach the zope server, but obviously do not get anything useful there.

Regards,
Wim.

Ronald Jeninga

unread,
May 29, 2018, 2:53:37 PM5/29/18
to schedulix
Hi Wim,

the jdbc connect always uses tcp/ip.

you'll have to modify you pg_hba.conf

# "local" is for Unix domain socket connections only
local   all             all                                     peer
# IPv4 local connections:
host    all             all             127.0.0.1/32            md5
#

is crucial

Regards,

Ronald

wim.ve...@billinghouse.nl

unread,
May 30, 2018, 3:49:25 PM5/30/18
to schedulix
Hi Ronald,

Yes I now have a working interface. Now I am trying to setup a jobserver.

The setup_jobserver script should take care of that, but it complains about my input params. I also noticed the script has to distinct parameters both addressed with -w (pwd of jobserver and working directory).
If I specify the user and password (copied from .sdmsrc) it can't connect.
If I only specify a name and password to use I get an error as well.

I am assuming I do have to setup a jobserver, as none is present after installing.

Below is the command and output I got.

-bash-4.2$ ./setup_jobserver -n JSNOVA -w nova
The full qualified name of the jobserver will be GLOBAL.'IP-10-0-0-34'.'SCHEDULIX'.'JSNOVA'
Is this correct? [Y/n] y
The HTTPPORT that will be used for logfile display is 15250
This can be changed at any time in the config tab of the jobserver

Connect

CONNECT_TIME : 30 May 2018 19:45:43 GMT

Connected

[SYSTEM@localhost:2506] SDMS>
End of Output

[SYSTEM@localhost:2506] SDMS> ;

[SYSTEM@localhost:2506] SDMS> begin multicommand


create or alter scope GLOBAL.'IP-10-0-0-34'
with
        group = 'ADMIN',
        config = (
                'REPOHOST' = 'localhost',
                'REPOPORT' = '2506',
                'BOOTTIME' = 'NONE',
                'USEPATH' = 'true',
                'JOBEXECUTOR' = '/opt/schedulix/schedulix/bin/jobexecutor',
                'DEFAULTWORKDIR' = '/opt/schedulix',
                'VERBOSELOGS' = 'true',
                'HTTPHOST' = 'ip-10-0-0-34',
                'NAME_PATTERN_LOGFILES' = '.*\.log',
                'ENV' = (
                        'SDMSHOST' = 'SDMSHOST',
                        'JOBID' = 'JOBID',
                        'SDMSPORT' = 'SDMSPORT',
                        'KEY' = 'KEY'
                )
        );


create or alter scope GLOBAL.'IP-10-0-0-34'.'SCHEDULIX'
with
        group = 'PUBLIC';


create or alter job server GLOBAL.'IP-10-0-0-34'.'SCHEDULIX'.'JSNOVA'
with
        group = '',
        password = 'nova',
        node = 'ip-10-0-0-34',
        config = (
                'JOBFILEPREFIX' = '/opt/schedulix/taskfiles/IP-10-0-0-34/schedulix/JSNOVA/JSNOVA-'
                , HTTPPORT = '15250'
        );


create or alter named resource RESOURCE.'STATIC'
with
        group = 'PUBLIC',
        usage = CATEGORY;


create or alter named resource RESOURCE.'STATIC'.'HOSTS'
with
        group = 'PUBLIC',
        usage = CATEGORY;


create or alter named resource RESOURCE.'STATIC'.'HOSTS'.'IP-10-0-0-34'
with
        group = 'PUBLIC',
        usage = STATIC;


create or alter named resource RESOURCE.'STATIC'.'USERS'
with
        group = 'PUBLIC',
        usage = CATEGORY;


create or alter named resource RESOURCE.'STATIC'.'USERS'.'SCHEDULIX'
with
        group = 'PUBLIC',
        usage = STATIC;


create or alter named resource RESOURCE.'STATIC'.'SERVERS'
with
        group = 'PUBLIC',
        usage = CATEGORY;


create or alter named resource RESOURCE.'STATIC'.'SERVERS'.'JSNOVA'
with
        group = 'PUBLIC',
        usage = STATIC;



create or alter resource RESOURCE.'STATIC'.'HOSTS'.'IP-10-0-0-34' in GLOBAL.'IP-10-0-0-34'
with
        group = 'PUBLIC',
        online;


create or alter resource RESOURCE.'STATIC'.'USERS'.'SCHEDULIX' in GLOBAL.'IP-10-0-0-34'.'SCHEDULIX'
with
        group = 'PUBLIC',
        online;


create or alter resource RESOURCE.'STATIC'.'SERVERS'.'JSNOVA' in GLOBAL.'IP-10-0-0-34'.'SCHEDULIX'.'JSNOVA'
with
        group = 'PUBLIC',
        online;


create or alter environment 'SCHEDULIX_JSNOVA@IP-10-0-0-34'
with
        resources = (
                RESOURCE.'STATIC'.'HOSTS'.'IP-10-0-0-34',
                RESOURCE.'STATIC'.'USERS'.'SCHEDULIX',
                RESOURCE.'STATIC'.'SERVERS'.'JSNOVA'
        );


grant USE, VIEW
on environment 'SCHEDULIX_JSNOVA@IP-10-0-0-34'
to '';


end multicommand;

ERROR:01111281413, begin multicommand


create or alter scope GLOBAL.'IP-10-0-0-34'
with
        group = 'ADMIN',
        config = (
                'REPOHOST' = 'localhost',
                'REPOPORT' = '2506',
                'BOOTTIME' = 'NONE',
                'USEPATH' = 'true',
                'JOBEXECUTOR' = '/opt/schedulix/schedulix/bin/jobexecutor',
                'DEFAULTWORKDIR' = '/opt/schedulix',
                'VERBOSELOGS' = 'true',
                'HTTPHOST' = 'ip-10-0-0-34',
                'NAME_PATTERN_LOGFILES' = '.*\.log',
                'ENV' = (
                        'SDMSHOST' = 'SDMSHOST',
                        'JOBID' = 'JOBID',
                        'SDMSPORT' = 'SDMSPORT',
                        'KEY' = 'KEY'
                )
        );


create or alter scope GLOBAL.'IP-10-0-0-34'.'SCHEDULIX'
with
        group = 'PUBLIC';


create or alter job server GLOBAL.'IP-10-0-0-34'.'SCHEDULIX'.'JSNOVA'
with
        group = ''+++++,
        password = '**********',
        node = 'ip-10-0-0-34',
        config = (
                'JOBFILEPREFIX' = '/opt/schedulix/taskfiles/IP-10-0-0-34/schedulix/JSNOVA/JSNOVA-'
                , HTTPPORT = '15250'
        );


create or alter named resource RESOURCE.'STATIC'
with
        group = 'PUBLIC',
        usage = CATEGORY;


create or alter named resource RESOURCE.'STATIC'.'HOSTS'
with
        group = 'PUBLIC',
        usage = CATEGORY;


create or alter named resource RESOURCE.'STATIC'.'HOSTS'.'IP-10-0-0-34'
with
        group = 'PUBLIC',
        usage = STATIC;


create or alter named resource RESOURCE.'STATIC'.'USERS'
with
        group = 'PUBLIC',
        usage = CATEGORY;


create or alter named resource RESOURCE.'STATIC'.'USERS'.'SCHEDULIX'
with
        group = 'PUBLIC',
        usage = STATIC;


create or alter named resource RESOURCE.'STATIC'.'SERVERS'
with
        group = 'PUBLIC',
        usage = CATEGORY;


create or alter named resource RESOURCE.'STATIC'.'SERVERS'.'JSNOVA'
with
        group = 'PUBLIC',
        usage = STATIC;



create or alter resource RESOURCE.'STATIC'.'HOSTS'.'IP-10-0-0-34' in GLOBAL.'IP-10-0-0-34'
with
        group = 'PUBLIC',
        online;


create or alter resource RESOURCE.'STATIC'.'USERS'.'SCHEDULIX' in GLOBAL.'IP-10-0-0-34'.'SCHEDULIX'
with
        group = 'PUBLIC',
        online;


create or alter resource RESOURCE.'STATIC'.'SERVERS'.'JSNOVA' in GLOBAL.'IP-10-0-0-34'.'SCHEDULIX'.'JSNOVA'
with
        group = 'PUBLIC',
        online;


create or alter environment 'SCHEDULIX_JSNOVA@IP-10-0-0-34'
with
        resources = (
                RESOURCE.'STATIC'.'HOSTS'.'IP-10-0-0-34',
                RESOURCE.'STATIC'.'USERS'.'SCHEDULIX',
                RESOURCE.'STATIC'.'SERVERS'.'JSNOVA'
        );


grant USE, VIEW
on environment 'SCHEDULIX_JSNOVA@IP-10-0-0-34'
to '';


end multicommand;
Syntax Error: expected NON EMPTY STRING

[SYSTEM@localhost:2506] SDMS>
ERROR: something went wrong while trying to create the jobserver on the server side
the created files and directories will be removed. After eliminating the error cause
the script can be executed again.



Regards,
Wim

wim.ve...@billinghouse.nl

unread,
May 30, 2018, 3:57:13 PM5/30/18
to schedulix
I also tried  ./setup_jobserver -n JSNOVA -w nova -o NOVA
but it also fails (with a different error) : ERROR:03110181532, Error in Statement 3 (CreateScope) : [NOVA, 0] not found

I am not certain which values to pass into the script (and whether I somehow need to create them first in the schedulix interface).

Regards,
Wim.

Ronald Jeninga

unread,
May 31, 2018, 6:01:13 AM5/31/18
to schedulix
Hi Wim,

sorry about the late reply.
The first errors have been fixed already, but I didn't find the time yet to create and upload the new rpms.
And the workaround you've found (specify the owner group) is indeed the right one.

But of course the owner group must exist. Which is the problem in your second attempt.

so 

echo "create group nova;" | sdmsh && ./setup_jobserver ./setup_jobserver -n JSNOVA -w nova -o NOVA

should work.

It looks like my situation is slowly relaxing. I should be able to upload the new rpms until Friday next week.

Best regards,

Ronald

Ronald Jeninga

unread,
Jun 8, 2018, 6:49:30 AM6/8/18
to schedulix
Hi Wim,

just a moment ago I uploaded the actual rpms to our repository (2.8-9).
I hope this will resolve all or at least most of your issues.

Best regards & enjoy your weekend!

Ronald
Reply all
Reply to author
Forward
0 new messages