Confusing documentation OpenTSDB > BigTable

[Kevin]

Hi,

Getting a bit stuck when using the documentation for using BigTable as a backend.

Link: http://opentsdb.net/docs/build/html/user_guide/backends/bigtable.html

The confusing bit is step 4:

Set the HBASE_HOME environment variable to your Bigtable shell directory, make sure the HBASE_CLASSPATH, JAVA_HOME, and GOOGLE_APPLICATION_CREDENTIALS environment variables have been set according to the values in Creating a Cloud BigTable Cluster document, and run the src/create_table.sh script. If the script fails to launch the shell, try running the shell manually and execute the create statements substituting the proper values.

Step 3 asks you to follow the guide on Google's website, which requires you to download the quickstart script. However, it's not entirely clear where HBASE_CLASSPATH and HBASE_HOME should lead.

Directory tree; https://hastebin.com/qequhevase.css

Using Debian Wheezy

Thanks!

[ManOLamancha]

Are you still setting up Bigtable? If not then it's actually safe to ignore the environment variables for the TSD side. You just have to set the configuration values. 

[Kevin Pletinckx]

Have got the Bigtable instance up, just trying to connect OpenTSDB to it, which is proving more complex than expected.

[ManOLamancha]

On Wednesday, May 23, 2018 at 12:57:54 AM UTC-7, Kevin wrote:

Have got the Bigtable instance up, just trying to connect OpenTSDB to it, which is proving more complex than expected.

It should be just a few params if you're building from the 2.4. There's old code with ALPN shims that may not work correctly, is that what you're running into? 

[Kevin]

Should probably explain my setup a bit more

I've built from 2.3.1 on Debian Wheezy using the `./build-bigtable.sh debian` command, then installing the resulting .deb package using dpkg -i

I've then updated the config file in /etc/opentsdb/opentsdb.conf to include the following lines at the bottom of it:

```

google.bigtable.project.id = CLOUD_PROJECT_ID

google.bigtable.instance.id = BIGTABLE_INSTANCE_ID

google.bigtable.zone.id = europe-west2-b

hbase.client.connection.impl = com.google.cloud.bigtable.hbase1_2.BigtableConnection

google.bigtable.auth.service.account.enable = true

google.bigtable.auth.json.keyfile = PATH_TO_GOOGLE.json

google.bigtable.grpc.channel.count = 4

```

I've also installed hbase 1.4.4 (stand-alone, not the bigtable version), and the Google Bigtable HBase quickstart git

Can I use hbase 1.4.4, or does it need to be the special Google version?

If so, what should I put for my env variables?

If there's an issue with openTSDB 2.3, will 2.4 work better?

Thanks a bunch!

[Kevin]

Probably worth mentioning,

Tried to build 2.4RC2 from the 'next' branch, fails with a couple of symbol errors, master compiles fine.

OpenJDK 1.8, upgraded Debian to Jessie, but still not able to compile.

The .deb file on the github release installs and boots fine, but not sure if that one can be used to connect to BigTable.

Either way, the problem remains and that's not being able to use BigTable as the backend.

Thanks!

[Hrish]

Your config file looks fine to me.

You don't need to install HBase separately, the debian package should have all required dependencies.

What is the error you are seeing on TSD startup?

[Hrish]

Just to add to that, you don't need HBASE_CLASSPATH and HBASE_HOME if you are connecting to Bigtable.