can't insert. 'no page sink provider for connecor'

592 views
Skip to first unread message

sungjae lee

unread,
Feb 7, 2017, 1:27:01 PM2/7/17
to Presto
Hello, I have problem inserting data in to table in presto that I remember it used to be working with the lower version of Presto.
I've checked the same query on hive and it works fine so it must be problem between 
This is what my catalog file looks like

hive.s3.max-backoff-time=10m

hive.max-partitions-per-writers=400

hive.allow-drop-table=true

hive.s3.max-connections=500

hive.s3.max-error-retries=50

hive.metastore-refresh-interval=1m

hive.s3.staging-directory=/mnt/tmp/

hive.s3.socket-timeout=2m

hive.s3.max-client-retries=50

hive.metastore-cache-ttl=20m

hive.metastore.uri=thrift://************:9083

hive.s3.connect-timeout=2m

connector.name=hive-hadoop2


And my query and errors, 
insert into scratch.*****
select emd5 from scratch.******

2017-02-06T13:09:10.489Z        ERROR   remote-task-callback-269616     com.facebook.presto.execution.StageStateMachine Stage 20170206_130911_01005_gbzj4.1 failed
java.lang.IllegalArgumentException: No page sink provider for connector 'profiles'
        at com.google.common.base.Preconditions.checkArgument(Preconditions.java:145)
        at com.facebook.presto.split.PageSinkManager.providerFor(PageSinkManager.java:57)
        at com.facebook.presto.split.PageSinkManager.createPageSink(PageSinkManager.java:51)
        at com.facebook.presto.operator.TableWriterOperator$TableWriterOperatorFactory.createPageSink(TableWriterOperator.java:99)
        at com.facebook.presto.operator.TableWriterOperator$TableWriterOperatorFactory.createOperator(TableWriterOperator.java:90)
        at com.facebook.presto.operator.DriverFactory.createDriver(DriverFactory.java:87)
        at com.facebook.presto.execution.SqlTaskExecution$DriverSplitRunnerFactory.createDriver(SqlTaskExecution.java:515)
        at com.facebook.presto.execution.SqlTaskExecution$DriverSplitRunnerFactory.access$1400(SqlTaskExecution.java:490)
        at com.facebook.presto.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:616)
        at com.facebook.presto.execution.TaskExecutor$PrioritizedSplitRunner.process(TaskExecutor.java:529)
        at com.facebook.presto.execution.TaskExecutor$Runner.run(TaskExecutor.java:665)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

I am using presto 152.3 that pre installed from EMR 5.2.0


Any help would be appreciated...  Thanks in advance.




mickae...@effilab.com

unread,
Oct 11, 2017, 11:07:14 AM10/11/17
to Presto
Did you find a solution?

sungjae lee

unread,
Oct 24, 2017, 11:26:25 AM10/24/17
to Presto
yes, 

one of the node in presto cluster was terminated and EMR has brought new node up with out catalog.

had to add catalog manually then restart that node to fix the issue

2017년 10월 11일 수요일 오전 11시 7분 14초 UTC-4, mickae...@effilab.com 님의 말:
Did you find a solution?
Reply all
Reply to author
Forward
0 new messages