Q28 Validation Error

[robe...@wandisco.com]

Hi everyone! I posted a few weeks back about getting BigBench to work properly, and I'm glad to say that save one bug, everything is working completely! I've run a full test with all options omitting Q28 and it runs everything perfectly. However, we're not getting a final output and we would like to get a fully functioning benchmark with no errors, so we're trying to nail down our Q28 error. The gist of it is this: Q28 runs properly, but in the engine validation phase it fails. However, it seems like the results we have are matching, so I'm not sure why this is the case. I'll upload the logs; any help will be appreciated.
https://drive.google.com/file/d/0B1RILrYKGZbTTEtTUjhBbnp2ZEE/view?usp=sharing
https://drive.google.com/file/d/0B1RILrYKGZbTbE45cnl1TDNPR2c/view?usp=sharing

[Dave Jaffe]

Hi Robert,

Did you get a response to this?

In /root/bigbench/TPCX-BB_V1.2/engines/hive/queries/q28/engineLocalSettings.sql you need to change

set bigbench.hive.optimize.sampling.orderby=${hiveconf:bigbench.hive.optimize.sampling.orderby};

to

set bigbench.hive.optimize.sampling.orderby=false;

Maybe this will help if you haven't already made this change.

Dave

Dave Jaffe

VMware

World Leader in Active Data Replication™

Find out more wandisco.com

THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY AND MAY BE PRIVILEGED

If this message was misdirected, WANdisco, Inc. and its subsidiaries, ("WANdisco") does not waive any confidentiality or privilege. If you are not the intended recipient, please notify us immediately and destroy the message without disclosing its contents to anyone. Any distribution, use or copying of this email or the information it contains by other than an intended recipient is unauthorized. The views and opinions expressed in this email message are the author's own and may not reflect the views and opinions of WANdisco, unless the author is authorized by WANdisco to express such views or opinions on its behalf. All email sent to or from this address is subject to electronic storage and review by WANdisco. Although WANdisco operates anti-virus programs, it does not accept responsibility for any damage whatsoever caused by viruses being passed.

--
You received this message because you are subscribed to the Google Groups "Big Data Benchmark for BigBench" group.
To unsubscribe from this group and stop receiving emails from it, send an email to big-bench+unsubscribe@googlegroups.com.
To post to this group, send email to big-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/big-bench/bdd6e697-b589-4df6-a6f5-4657cc98ed86%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Dave Jaffe

davej...@gmail.com

[robe...@wandisco.com]

Hi Dave,

I'm still having this issue; thanks for the advice, I'll try that out right now!

On Monday, August 14, 2017 at 1:31:20 PM UTC-7, Dave Jaffe wrote:

Hi Robert,

Did you get a response to this?

In /root/bigbench/TPCX-BB_V1.2/engines/hive/queries/q28/engineLocalSettings.sql you need to change

set bigbench.hive.optimize.sampling.orderby=${hiveconf:bigbench.hive.optimize.sampling.orderby};

to

set bigbench.hive.optimize.sampling.orderby=false;

Maybe this will help if you haven't already made this change.

Dave

Dave Jaffe

VMware

On Fri, Aug 4, 2017 at 6:01 PM, robert.yu via Big Data Benchmark for BigBench <big-...@googlegroups.com> wrote:

Hi everyone! I posted a few weeks back about getting BigBench to work properly, and I'm glad to say that save one bug, everything is working completely! I've run a full test with all options omitting Q28 and it runs everything perfectly. However, we're not getting a final output and we would like to get a fully functioning benchmark with no errors, so we're trying to nail down our Q28 error. The gist of it is this: Q28 runs properly, but in the engine validation phase it fails. However, it seems like the results we have are matching, so I'm not sure why this is the case. I'll upload the logs; any help will be appreciated.
https://drive.google.com/file/d/0B1RILrYKGZbTTEtTUjhBbnp2ZEE/view?usp=sharing
https://drive.google.com/file/d/0B1RILrYKGZbTbE45cnl1TDNPR2c/view?usp=sharing

World Leader in Active Data Replication™

Find out more wandisco.com

THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY AND MAY BE PRIVILEGED

If this message was misdirected, WANdisco, Inc. and its subsidiaries, ("WANdisco") does not waive any confidentiality or privilege. If you are not the intended recipient, please notify us immediately and destroy the message without disclosing its contents to anyone. Any distribution, use or copying of this email or the information it contains by other than an intended recipient is unauthorized. The views and opinions expressed in this email message are the author's own and may not reflect the views and opinions of WANdisco, unless the author is authorized by WANdisco to express such views or opinions on its behalf. All email sent to or from this address is subject to electronic storage and review by WANdisco. Although WANdisco operates anti-virus programs, it does not accept responsibility for any damage whatsoever caused by viruses being passed.

--
You received this message because you are subscribed to the Google Groups "Big Data Benchmark for BigBench" group.

To unsubscribe from this group and stop receiving emails from it, send an email to big-bench+...@googlegroups.com.

To post to this group, send email to big-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/big-bench/bdd6e697-b589-4df6-a6f5-4657cc98ed86%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Dave Jaffe

davej...@gmail.com

[robe...@wandisco.com]

We fixed the error, turns out it was a whitespace issue.

[Michael Frank]

Hi,

Cloud you kindly share your final solution with us?  

System independant result aggregation and valdiation is a bit fragile. A while ago I fixed a similar issue regarding different newline styles produced by different system configurations. 

I am leaving the link to the unmerged branch fixing this for reference and for readers in the future.

https://github.com/intel-hadoop/Big-Data-Benchmark-for-Big-Bench/tree/fixesDec2016

(If the link is dead, the branch was merged and deleted)

Cheers

Michael 

To unsubscribe from this group and stop receiving emails from it, send an email to big-bench+unsubscribe@googlegroups.com.

To post to this group, send email to big-...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/big-bench/2d489d23-1727-4aff-b461-a0e040c831dc%40googlegroups.com.

[matthew...@wandisco.com]

Hi, I was the one who found the solution to the Query 28 validation. I will post the instructions below.

• CD to $directory/TPCX-BB_V1.2/engines/hive/queries/q28

• Look for the file run.sh

• Make a copy of the file using cp and give it a different name (example: COPY_run.sh)

• Vi run.sh

• Scroll to the bottom and in the query_run_valicate_method(), there is a line with a “diff” linux command

• Add “-b” after the -q

• It should look like this:

• if diff -q -b "$VALIDATION_RESULTS_FILENAME" <(hadoop fs -cat "$RESULT_DIR/*")

After we did this, we were able to run the entire benchmark without problems. 

What was wrong was during the validation when it was comparing the files, one of the files has white space at the end of certain lines. The change simply ignores white space when comparing.