Greetings!
Please let me know if you have any suitable profile for below position:
Data Engineer
Palo Alto, CA - Onsite
Minimum Qualifications:
• 6+ years of Python development experience.
• 5+ years of SQL experience.
• 3+ years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, digdag.io, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M).
• 3+ years’ experience with Data Modeling.
• Experience analyzing data to discover opportunities and address gaps.
• 5+ years’ experience in custom ETL design, implementation and maintenance.
• Experience working with cloud or on-prem Big Data/MPP analytics platform(i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar).
Preferred Qualifications
• Experience with more than one coding language.
• Experience with designing and implementing real-time pipelines.
• Experience with data quality and validation.
• Experience with SQL performance tuning and E2E process optimization.
• Experience with anomaly/outlier detection.
• Experience with notebook-based Data Science workflow.
• Experience with Airflow.
• Experience querying massive datasets using Spark, Presto, Hive, Impala, etc.
Vishal Singh
Contact: +1 470-622-2710
Email: Vis...@Concept-Inc.Com