Carte master not load balancing the incoming transformations while using the API rest

[Juan Sierra Pons]

Hi,

I have configured a Carte cluster one master and two slaves. Basically I have launched the ones located in the pwd folder

./carte.sh pwd/carte-config-master-8080.xml 

./carte.sh pwd/carte-config-8081.xml

./carte.sh pwd/carte-config-8082.xml

As far as I know there is a lack of a command tool (like pan or kitchen) to launch trans/jobs directly to the Carte cluster. I have read something about wrapping it inside a .klb https://forums.pentaho.com/threads/74921-Run-Transformation-or-Job-on-Carte-Server-from-pan-Kitchen/ but I would like to the use API instead of the wrapping 

Slaves are registered successfully as per:

curl -s -L "http://cluster:cluster@localhost:8080/kettle/getSlaves/"

<?xml version="1.0" encoding="UTF-8"?>

<SlaveServerDetections>

<SlaveServerDetection>

      <slaveserver>

        <name>Dynamic slave [localhost:8081]</name>

        <hostname>localhost</hostname>

        <port>8081</port>

        <webAppName/>

        <username>cluster</username>

<password>Encrypted 2be98afc86aa7f2e4cb1aa265cd86aac8</password>        <proxy_hostname/>

        <proxy_port/>

        <non_proxy_hosts/>

        <master>N</master>

        <sslMode>N</sslMode>      </slaveserver>

<active>Y</active>

<last_active_date>2022/03/24 12:00:17.411</last_active_date>

<last_inactive_date/>

</SlaveServerDetection>

<SlaveServerDetection>

      <slaveserver>

        <name>Dynamic slave [localhost:8082]</name>

        <hostname>localhost</hostname>

        <port>8082</port>

        <webAppName/>

        <username>cluster</username>

<password>Encrypted 2be98afc86aa7f2e4cb1aa265cd86aac8</password>        <proxy_hostname/>

        <proxy_port/>

        <non_proxy_hosts/>

        <master>N</master>

        <sslMode>N</sslMode>      </slaveserver>

<active>Y</active>

<last_active_date>2022/03/24 12:00:17.416</last_active_date>

<last_inactive_date/>

</SlaveServerDetection>

</SlaveServerDetections>

When I launch in parallel a bunch of dummy transformations (200 grouped by 20) to the master they only run in the master. None has run in any of the slaves

seq 200 |parallel -j20 -n0 'curl -s -L "http://cluster:cluster@localhost:8080/kettle/executeTrans/?rep=myRepository&trans=Juan%2FDummy1&level=Debug"'

Am I missing something?

Thanks for your time

Best regards

--------------------------------------------------------------------------------------
Juan Sierra Pons                                 ju...@elsotanillo.net
Linux User Registered: #257202      
Web: http://www.elsotanillo.net Git: http://www.github.com/juasiepo
GPG key = 0xA110F4FE
Key Fingerprint = DF53 7415 0936 244E 9B00  6E66 E934 3406 A110 F4FE
--------------------------------------------------------------------------------------

[Juan Sierra Pons]

Hi,

It seems that the problem is not with the API itself but with my run configuration or cluster configuration at spoon level

https://community.hitachivantara.com/communities/community-home/digestviewer/view-question?ContributedContentKey=dee7433b-422c-4e64-9b71-dcd8d8a4f3fd&CommunityKey=e0eaa1d8-5ecc-4721-a6a7-75d4e890ee0d

Can anyone share some experiences about how to configure a dynamic carte cluster?

Thanks for your time

Best regards