Need help in Spark-Scala - Hive ocntext

41 views
Skip to first unread message

Prabakaran K

unread,
Mar 2, 2017, 9:36:28 AM3/2/17
to Saro saravanan, gow...@datadotz.com, hadoop_da...@googlegroups.com, chenn...@googlegroups.com

Hi
I executed a query in Hive- it return rows of values.
And then executed same in spark-shell in Hive context like below:


import java.io.Serializable
import java.util.Properties
import org.apache.hadoop.conf.Configuration
import org.apache.hadoop.fs.FileSystem
import org.apache.hadoop.hbase.KeyValue
import org.apache.hadoop.hbase.io.ImmutableBytesWritable
import org.apache.hadoop.hbase.util.Bytes
import org.apache.spark.Logging
import org.apache.spark.SparkConf
import org.apache.spark.SparkContext
import org.apache.spark.rdd.RDD.rddToOrderedRDDFunctions
import org.apache.spark.storage.StorageLevel
import org.apache.spark.sql.Row;
import org.apache.spark.sql.types.{ StructType, StructField, StringType };
import org.apache.hadoop.hbase.client.{HTable,Put}
import org.apache.hadoop.hbase.HBaseConfiguration
import org.apache.hadoop.hbase.client.{HTable,Put}



 val hiveContext = new org.apache.spark.sql.hive.HiveContext(sc)

  hiveContext.sql("use chithrx")

  val testdf = hiveContext.sql(" select zpta_batch_batch_id,zpta_batch_ecc_material_id from ZPTA_BATCH_EH");


But output values are null.


Attached the screen shot. Could you please help me.


Thanks

Prabakaran krishnan




scala_Hive_spark_shell.docx
Reply all
Reply to author
Forward
0 new messages