Hi,
Hope the day is treating you well,
Please send me resumes at mohd....@alignity.io
Title: Cloud Data Engineer (Java Development)
Location: Mclean, VA (Temporarily remote due to COVID)
Duration: 6 months
Visa: Any Visa (C2C is Okay)
WHAT YOU WILL BE DOING:
· Build scalable and dependable Cloud-based and hybrid data solutions
· Leverage data models, process maps, ETL and data integration processes
· Python, Java, or Scala Development to meet data quality and data management needs
· Must have common architectures including microservices, serverless, Lambda and related technologies
· Must have data centric solutions experience using both relational and NOSQL paradigms
· Design and develop data pipelines - enterprise data warehouse, Hadoop/Spark in a complex ecosystem
· Identify automation opportunities within data pipeline and recommend improvements
· Design solutions & implementing these web-based applications
· Work closely with data engineering teams
· Handling production issues within data management, identifying defects, providing defect fixes
· Interact with Data modelers to ensure sound data mapping/enterprise data management
· Consultatively evaluate/provide process improvements., coordinating control/process efforts
Requirements
YOU: (Required Skills)
· Have 10+ years experience with Java Development.
· Have 5+ years experience with Java Spark (Scala experience will be considered).
· Have Hadoop background - Hive, Yarn, HDFS, Spark.
· Have expertise in SQL, Databases - Relational (DB2, Sybase, Oracle) & NoSQL, Datawarehouses (Snowflake,Redshift).
· Have experience developing and optimizing ingestion frameworks on distributed platforms.
· Have cloud Experience (AWS - EMR, SQS/SNS, Lambda, Stepfunctions).
· Have Streaming and Change Data Capture experience (Kafka, Qlik Replicate).
· Have experience in scripting (Shell/Python).
· Have experience in using CI/CD pipelines, packaging.
· Have experience with
building Microservices, APIs.
IT WOULD BE GREAT IF YOU:
· Have experience with Docker, Redshift, Snowflake, Streaming Data apps exposure.
· Have knowledge of Kafka, any CI/CD tools, Terraform or Cloudformation
