Groups
Groups
Sign in
Groups
Groups
Google Cloud Dataproc Discussions
Conversations
About
Send feedback
Help
Google Cloud Dataproc Discussions
Contact owners and managers
1–30 of 323
Mark all as read
Report group
0 selected
Karthik Palaniappan
, …
mal...@google.com
3
11/1/18
Announcing support for autoscaling!
Hi Evgeniy, The graceful_decommission_timeout enabled in autoscaling properties only applies to
unread,
Announcing support for autoscaling!
Hi Evgeniy, The graceful_decommission_timeout enabled in autoscaling properties only applies to
11/1/18
Igor Berman
Aug 12
Serverless for Apache Spark autoscaling V2
Hi All need some clarification about autoscaling strategies for serverless apache spark this (https:/
unread,
Serverless for Apache Spark autoscaling V2
Hi All need some clarification about autoscaling strategies for serverless apache spark this (https:/
Aug 12
Boopathi Manickam
Jun 27
No Such Object ERROR message in dataProc temp bucket
Hello., In DataProc while GoogleAPIS writing the audit logs using get method, we are facing below
unread,
No Such Object ERROR message in dataProc temp bucket
Hello., In DataProc while GoogleAPIS writing the audit logs using get method, we are facing below
Jun 27
Leoul Daniel
Feb 21
Error 500 when trying to create a Dataproc cluster with a history server
Hello, I am trying to recreate a dataproc cluster that was previously created with the following
unread,
Error 500 when trying to create a Dataproc cluster with a history server
Hello, I am trying to recreate a dataproc cluster that was previously created with the following
Feb 21
Sriram Ganarajan
12/23/24
Native Execution
Hi, Does the native execution offered by Dataproc serverless uses a forked or a custom version of
unread,
Native Execution
Hi, Does the native execution offered by Dataproc serverless uses a forked or a custom version of
12/23/24
John J. Pappas
11/29/24
polkadot chocolate
polkadot chocolate <a href="https://polkadotchocolateofficial.com/product-category/dried-
unread,
polkadot chocolate
polkadot chocolate <a href="https://polkadotchocolateofficial.com/product-category/dried-
11/29/24
Kritika Jain
, …
Christopher Dean
3
11/27/24
Data Fusion - Pipeline Execution Error - PROVISION task failed in REQUESTING_CREATE state - event executor terminated
WELDING MACHINES AND ACCESSORIES FOR SALE ONLINE WITH SAFE AND GUARANTEED SHIPPING. SHOP BELOW
unread,
Data Fusion - Pipeline Execution Error - PROVISION task failed in REQUESTING_CREATE state - event executor terminated
WELDING MACHINES AND ACCESSORIES FOR SALE ONLINE WITH SAFE AND GUARANTEED SHIPPING. SHOP BELOW
11/27/24
Christopher Dean
11/27/24
Hand Crank Hose Reels, 1/2 in x 200 ft For Sale
WELDING MACHINES AND ACCESSORIES FOR SALE ONLINE WITH SAFE AND GUARANTEED SHIPPING. SHOP BELOW
unread,
Hand Crank Hose Reels, 1/2 in x 200 ft For Sale
WELDING MACHINES AND ACCESSORIES FOR SALE ONLINE WITH SAFE AND GUARANTEED SHIPPING. SHOP BELOW
11/27/24
Christopher Dean
11/27/24
Lincoln Remote Control For Sale Online
WELDING MACHINES AND ACCESSORIES FOR SALE ONLINE WITH SAFE AND GUARANTEED SHIPPING. SHOP BELOW
unread,
Lincoln Remote Control For Sale Online
WELDING MACHINES AND ACCESSORIES FOR SALE ONLINE WITH SAFE AND GUARANTEED SHIPPING. SHOP BELOW
11/27/24
Christopher Dean
11/27/24
Remote Output Control (12-Pin Universal Connector, 120 VAC Receptacles, 125 ft) for sale online
WELDING MACHINES AND ACCESSORIES FOR SALE ONLINE WITH SAFE AND GUARANTEED SHIPPING. SHOP BELOW
unread,
Remote Output Control (12-Pin Universal Connector, 120 VAC Receptacles, 125 ft) for sale online
WELDING MACHINES AND ACCESSORIES FOR SALE ONLINE WITH SAFE AND GUARANTEED SHIPPING. SHOP BELOW
11/27/24
raj shekhar
11/3/24
Getting an error message while creating Dataproc cluster
Hi, I am creating a dataproc cluster . I have enabled the respective apis before creating the cluster
unread,
Getting an error message while creating Dataproc cluster
Hi, I am creating a dataproc cluster . I have enabled the respective apis before creating the cluster
11/3/24
Tomas Santandreu Polanco
7/2/24
Dataproc Java 11 error reading parquet files.
Hi Team, I have a customer who is having issues using Java 11 in Dataproc running on GCE while
unread,
Dataproc Java 11 error reading parquet files.
Hi Team, I have a customer who is having issues using Java 11 in Dataproc running on GCE while
7/2/24
Tomas Santandreu Polanco
7/2/24
Databrick ALS Spark Job migration to GCP Server less spark tool
Hi Team, Do we have any tool that will help with the migration of a Databrick ALS Spark cluster to
unread,
Databrick ALS Spark Job migration to GCP Server less spark tool
Hi Team, Do we have any tool that will help with the migration of a Databrick ALS Spark cluster to
7/2/24
Harish Vij
,
Richard Holowczak
8
5/12/24
Unable to launch DataProc Cluster
It looks as if you are leaving the "Configure all instances to have only internal IP addresses”
unread,
Unable to launch DataProc Cluster
It looks as if you are leaving the "Configure all instances to have only internal IP addresses”
5/12/24
Charan Bhogaraju
5/9/24
Custom VPC Network
i have a custom vpc network in which dataproc serverless runs there is a firewall allow-internal-
unread,
Custom VPC Network
i have a custom vpc network in which dataproc serverless runs there is a firewall allow-internal-
5/9/24
Moses Sundheep
, …
Richard Holowczak
7
4/26/24
Unable to launch basic Dataproc cluster
Hi Vishal Those two messages are warning and not errors. Your cluster should have been created. If
unread,
Unable to launch basic Dataproc cluster
Hi Vishal Those two messages are warning and not errors. Your cluster should have been created. If
4/26/24
Paresh Sahare
, …
Alexander Goida
3
4/5/24
Does Dataproc support stream processing?
Hi, Dataproc by itself is an infrastructure component. Streaming might be incorporated using
unread,
Does Dataproc support stream processing?
Hi, Dataproc by itself is an infrastructure component. Streaming might be incorporated using
4/5/24
Shivam Soliya
2/19/24
Unable to find Yarn Aggregated and spark driver logs in Cloud Logging
Hey people, I am following this doc while creating a new dataproc cluster. And I have set dataproc
unread,
Unable to find Yarn Aggregated and spark driver logs in Cloud Logging
Hey people, I am following this doc while creating a new dataproc cluster. And I have set dataproc
2/19/24
Ankit Mukhija
, …
bla...@google.com
6
2/5/24
Initialization action in Serverless Dataproc job
Hi Deepanshu -- Per "Submit a Spark batch workload" docs, you can just specify the Hive
unread,
Initialization action in Serverless Dataproc job
Hi Deepanshu -- Per "Submit a Spark batch workload" docs, you can just specify the Hive
2/5/24
Boreddy Kesavareddy
2/1/24
Remote Hive metastore connection
Hi Team , If i want to read remote hive (hive metastore in one cluster but need to read that hive
unread,
Remote Hive metastore connection
Hi Team , If i want to read remote hive (hive metastore in one cluster but need to read that hive
2/1/24
Deepanshu Bhateja
,
amancuso...@gmail.com
2
1/30/24
Connecting to External Hive Metastore within Serverless Spark Jobs
Generally, see the gcloud example: https://cloud.google.com/dataproc-serverless/docs/quickstarts/
unread,
Connecting to External Hive Metastore within Serverless Spark Jobs
Generally, see the gcloud example: https://cloud.google.com/dataproc-serverless/docs/quickstarts/
1/30/24
Amir Shukayev
12/19/23
T2D instances not appearing in YARN
When creating a dataproc cluster, the machines are not visible in yarn for spark jobs. This is the
unread,
T2D instances not appearing in YARN
When creating a dataproc cluster, the machines are not visible in yarn for spark jobs. This is the
12/19/23
Amina [Admin] Jackson
,
Mich Talebzadeh
3
10/5/23
unhealthy cluster
Hi Mich, Thanks! Nope I am not autoscaling. I created a new cluster got the same behavior with
unread,
unhealthy cluster
Hi Mich, Thanks! Nope I am not autoscaling. I created a new cluster got the same behavior with
10/5/23
Rajeev Sharma
9/7/23
dataproc jdbc connector
I'm not able to make a connection to dataproc hive (project 1) from beeline (project 2) using
unread,
dataproc jdbc connector
I'm not able to make a connection to dataproc hive (project 1) from beeline (project 2) using
9/7/23
shikhar
9/4/23
Data lineage in Dataproc serverless
I am having some dataproc serverless batch jobs which read from GCS , apply some transformation and
unread,
Data lineage in Dataproc serverless
I am having some dataproc serverless batch jobs which read from GCS , apply some transformation and
9/4/23
Mich Talebzadeh
8/8/23
Google Cloud Spark on GKE
Hi, Is there such group that deals with Spark running on GKE please? Thanks
unread,
Google Cloud Spark on GKE
Hi, Is there such group that deals with Spark running on GKE please? Thanks
8/8/23
Rodel van Rooijen
,
Kristopher Kane
3
7/6/23
Passing args for dataproc batch submit (pyspark)
Right! It was the argparser in the Python script. Op donderdag 6 juli 2023 om 19:54:12 UTC+2 schreef
unread,
Passing args for dataproc batch submit (pyspark)
Right! It was the argparser in the Python script. Op donderdag 6 juli 2023 om 19:54:12 UTC+2 schreef
7/6/23
Pramit Mehta
7/6/23
DBT Transformation using Dataproc Serverless
Hey , I have been trying to run few transformations using dataproc serverless, Reading one big query
unread,
DBT Transformation using Dataproc Serverless
Hey , I have been trying to run few transformations using dataproc serverless, Reading one big query
7/6/23
Punyawee Posri
5/16/23
Dataproc apache iceberg: iceberg is not a valid Spark SQL Data Source
Hi Google Cloud Dataproc Team! I'm now trying to use apache iceberg for my nestjs project to
unread,
Dataproc apache iceberg: iceberg is not a valid Spark SQL Data Source
Hi Google Cloud Dataproc Team! I'm now trying to use apache iceberg for my nestjs project to
5/16/23
Adam Scott
,
Mich Talebzadeh
3
4/21/23
Dataproc Serverless template development: Cassandra to Bigtable error interpretation
I have tested Google connectivity to BigQuery using VM hosts This is the version of Java that works
unread,
Dataproc Serverless template development: Cassandra to Bigtable error interpretation
I have tested Google connectivity to BigQuery using VM hosts This is the version of Java that works
4/21/23
Ramesh Dharan
2/5/23
GitHub PR review for spark-bigquery connector
Hi folks, please see the conversation below from google-cloud-bigtable-discuss@ regarding the request
unread,
GitHub PR review for spark-bigquery connector
Hi folks, please see the conversation below from google-cloud-bigtable-discuss@ regarding the request
2/5/23