Re: question about predictionio: Exception in thread "main" java.net.ConnectException: Connection refused

[Pat Ferrel]

Hmm, looks open to me.

On Nov 8, 2023, at 5:44 PM, Jobs <iro...@gmail.com> wrote:

Sorry for troubling, however, that Google group doesn't support any new conversation now.

It is a closed group.

Pat Ferrel <p...@occamsmachete.com> 于2023年11月8日周三 23:17写道：

Ask questions on the Google group for actionml



> On Nov 7, 2023, at 10:52 PM, Jobs <iro...@gmail.com> wrote:
>
> Dear Pat,
>
> Sorry for troubling you. I looked through the predictionio-dev group, and found you there.
>
> I use similar product template. install successfully, run successfully. But when I retrain and redeploy via a cron job by timely execute the following shell script:
>
> =====
> #!/bin/bash
> export SPARK_VERSION=2.1.1
> cd /home/pio/engine/MySimilarProduct
> /PredictionIO-0.12.0-incubating/bin/pio build --verbose
> /PredictionIO-0.12.0-incubating/bin/pio train -- --driver-memory 24g
> /PredictionIO-0.12.0-incubating/bin/pio deploy -- --driver-memory 8G &
> =====
>
> */10 * * * * sh /home/pio/engine/MySimilarProduct/cron.sh >> /var/log/cron/log.log 2>&1
>
> It works well at the first 10 times. Then it raise error like
>
> [INFO] [Engine$] Compilation finished successfully.
> [INFO] [Engine$] Looking for an engine...
> [INFO] [Engine$] Found template-scala-parallel-similarproduct-assembly-0.1.0-SNAPSHOT-deps.jar
> [INFO] [Engine$] Found template-scala-parallel-similarproduct_2.11-0.1.0-SNAPSHOT.jar
> [INFO] [Engine$] Build finished successfully.
> [INFO] [Pio$] Your engine is ready for training.
> [INFO] [Runner$] Submission command: /PredictionIO-0.12.0-incubating/vendors/spark-2.1.1-bin-hadoop2.6/bin/spark-submit --driver-memory 24g --class org.apache.predictionio.workflow.CreateWorkflow --jars file:/home/pio/engine/MySimilarProduct/target/scala-2.11/template-scala-parallel-similarproduct-assembly-0.1.0-SNAPSHOT-deps.jar,file:/home/pio/engine/MySimilarProduct/target/scala-2.11/template-scala-parallel-similarproduct_2.11-0.1.0-SNAPSHOT.jar,file:/PredictionIO-0.12.0-incubating/lib/spark/pio-data-jdbc-assembly-0.12.0-incubating.jar,file:/PredictionIO-0.12.0-incubating/lib/spark/pio-data-s3-assembly-0.12.0-incubating.jar,file:/PredictionIO-0.12.0-incubating/lib/spark/pio-data-hdfs-assembly-0.12.0-incubating.jar,file:/PredictionIO-0.12.0-incubating/lib/spark/pio-data-localfs-assembly-0.12.0-incubating.jar,file:/PredictionIO-0.12.0-incubating/lib/spark/pio-data-hbase-assembly-0.12.0-incubating.jar,file:/PredictionIO-0.12.0-incubating/lib/spark/pio-data-elasticsearch-assembly-0.12.0-incubating.jar --files file:/PredictionIO-0.12.0-incubating/conf/log4j.properties --driver-class-path /PredictionIO-0.12.0-incubating/conf:/PredictionIO-0.12.0-incubating/vendors/hbase-/conf --driver-java-options -Dpio.log.dir=/home/pio file:/PredictionIO-0.12.0-incubating/lib/pio-assembly-0.12.0-incubating.jar --engine-id org.example.similarproduct.SimilarProductEngine --engine-version 4bc844b6b8bfe0e4a9812a0e694e201b7ec7fa5f --engine-variant file:/home/pio/engine/MySimilarProduct/engine.json --verbosity 0 --json-extractor Both --env PIO_STORAGE_SOURCES_HBASE_TYPE=hbase,PIO_ENV_LOADED=1,PIO_STORAGE_REPOSITORIES_METADATA_NAME=pio_meta,PIO_FS_BASEDIR=/home/pio/.pio_store,PIO_STORAGE_SOURCES_ELASTICSEARCH_HOSTS=localhost,PIO_STORAGE_SOURCES_HBASE_HOME=/PredictionIO-0.12.0-incubating/vendors/hbase-,PIO_HOME=/PredictionIO-0.12.0-incubating,PIO_FS_ENGINESDIR=/home/pio/.pio_store/engines,PIO_STORAGE_SOURCES_LOCALFS_PATH=/home/pio/.pio_store/models,PIO_STORAGE_SOURCES_ELASTICSEARCH_TYPE=elasticsearch,PIO_STORAGE_REPOSITORIES_METADATA_SOURCE=ELASTICSEARCH,PIO_STORAGE_REPOSITORIES_MODELDATA_SOURCE=LOCALFS,PIO_STORAGE_REPOSITORIES_EVENTDATA_NAME=pio_event,PIO_STORAGE_SOURCES_ELASTICSEARCH_CLUSTERNAME=predictionio,PIO_STORAGE_SOURCES_ELASTICSEARCH_HOME=/PredictionIO-0.12.0-incubating/vendors/elasticsearch-,PIO_FS_TMPDIR=/home/pio/.pio_store/tmp,PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_model,PIO_STORAGE_REPOSITORIES_EVENTDATA_SOURCE=HBASE,PIO_CONF_DIR=/PredictionIO-0.12.0-incubating/conf,PIO_STORAGE_SOURCES_ELASTICSEARCH_PORTS=9200,PIO_STORAGE_SOURCES_LOCALFS_TYPE=localfs
> [INFO] [Engine] Extracting datasource params...
> [INFO] [WorkflowUtils$] No 'name' is found. Default empty String will be used.
> [INFO] [Engine] Datasource params: (,DataSourceParams(MyApp1))
> [INFO] [Engine] Extracting preparator params...
> [INFO] [Engine] Preparator params: (,Empty)
> [INFO] [Engine] Extracting serving params...
> [INFO] [Engine] Serving params: (,Empty)
> Exception in thread "main" java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
> at org.apache.predictionio.shaded.org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.processEvent(DefaultConnectingIOReactor.java:171)
> at org.apache.predictionio.shaded.org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.processEvents(DefaultConnectingIOReactor.java:145)
> at org.apache.predictionio.shaded.org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(AbstractMultiworkerIOReactor.java:348)
> at org.apache.predictionio.shaded.org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(PoolingNHttpClientConnectionManager.java:192)
> at org.apache.predictionio.shaded.org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(CloseableHttpAsyncClientBase.java:64)
> at java.lang.Thread.run(Thread.java:748)
> Exception in thread "main" java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
> at org.apache.predictionio.shaded.org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.processEvent(DefaultConnectingIOReactor.java:171)
> at org.apache.predictionio.shaded.org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.processEvents(DefaultConnectingIOReactor.java:145)
> at org.apache.predictionio.shaded.org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(AbstractMultiworkerIOReactor.java:348)
> at org.apache.predictionio.shaded.org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(PoolingNHttpClientConnectionManager.java:192)
> at org.apache.predictionio.shaded.org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(CloseableHttpAsyncClientBase.java:64)
> at java.lang.Thread.run(Thread.java:748)
> [INFO] [Engine$] Using command '/PredictionIO-0.12.0-incubating/sbt/sbt' at /home/pio/engine/MySimilarProduct to build.
> [INFO] [Engine$] If the path above is incorrect, this process will fail.
> [INFO] [Engine$] Uber JAR disabled. Making sure lib/pio-assembly-0.12.0-incubating.jar is absent.
> [INFO] [Engine$] Going to run: /PredictionIO-0.12.0-incubating/sbt/sbt  package assemblyPackageDependency in /home/pio/engine/MySimilarProduct
>
>
> I am looking forward to a long-time runing promotion system. auto retraining auto redeloying.
>
> Can you pls help me out on this?
> Thank you in advance.
>
> --
> Best regards
> Sincerely Yours
> Jobs

--

Best regards
Sincerely Yours
Jobs