Queries attempt to re-create bigbench Hive database

121 views
Skip to first unread message

Dave Jaffe

unread,
May 10, 2016, 4:51:52 PM5/10/16
to Big Data Benchmark for BigBench
In all my queries I am seeing Hive attempt to re-create the bigbench Hive database, followed by several retries. Eventually it continues and completes successfully:

File hadoop-cmf-hive-HIVEMETASTORE_xxxxx.localdomain.log.out:

2016-05-10 20:29:43,636 INFO  org.apache.hadoop.hive.metastore.ObjectStore: [pool-4-thread-10]: Initialized ObjectStore
2016-05-10 20:29:43,639 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [pool-4-thread-10]: </PERFLOG method=get_all_functions start=1462912183618 end=1462912183639 duration=21 from=org.apache.hadoop.hive.metastore.RetryingHMSHandler threadId=10 retryCount=0 error=false>
2016-05-10 20:29:46,591 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [pool-4-thread-10]: <PERFLOG method=create_database from=org.apache.hadoop.hive.metastore.RetryingHMSHandler>
2016-05-10 20:29:46,592 INFO  org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-4-thread-10]: 10: source:192.168.29.1 create_database: Database(name:bigbench, description:null, locationUri:null, parameters:null, ownerName:root, ownerType:USER)
2016-05-10 20:29:46,592 INFO  org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-4-thread-10]: ugi=root        ip=192.168.29.1 cmd=source:192.168.29.1 create_database: Database(name:bigbench, description:null, locationUri:null, parameters:null, ownerName:root, ownerType:USER)
2016-05-10 20:29:46,597 ERROR org.apache.hadoop.hive.metastore.RetryingHMSHandler: [pool-4-thread-10]: AlreadyExistsException(message:Database bigbench already exists)
        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_database(HiveMetaStore.java:944)
...

I am using version TPCx-BB_v1.0.1. The Load_Test completed successfully, creating the bigbench Hive database.

Has anyone see this? Is this an issue? Do I have something misconfigured?

Thanks, Dave Jaffe

Yan Tang

unread,
May 12, 2016, 11:47:50 PM5/12/16
to Big Data Benchmark for BigBench
hi, Dave
Are you using Spark 2.0 master code to run BB in spark engine?

Thanks.
Yan

在 2016年5月11日星期三 UTC+8上午4:51:52，Dave Jaffe写道：

Dave Jaffe

unread,
May 13, 2016, 11:26:41 AM5/13/16
to Yan Tang, Big Data Benchmark for BigBench
Yan,

When I run Hive on Spark I am using the Spark version (1.6.0+cdh5.7.0+180) that comes with CDH 5.7, but I am seeing the AlreadyExistsException on all queries, whether I am running Hive on MR or Hive on Spark.

Dave


--
You received this message because you are subscribed to the Google Groups "Big Data Benchmark for BigBench" group.
To unsubscribe from this group and stop receiving emails from it, send an email to big-bench+...@googlegroups.com.
To post to this group, send email to big-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/big-bench/bf55d8ac-c4df-47e6-85bf-1d48eb86c6bd%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.



--
Reply all
Reply to author
Forward
0 new messages