Required - Senior Data Engineer - Remote
Kunal Singh
Hello,
We are looking for Senior Data Engineer
EXPERIENCE – 12+ years
Location: Remote in USA
Project Period: 6 months +
Job Description: The data engineer will be responsible for the end-to-end design, build, monitoring and support of Big Data architecture
including platform and applications
SUMMARY OF ESSENTIAL JOB FUNCTIONS
- Function as the Technical Decision Authority and own the data strategy and road map, data architecture definition, business intelligence/data warehouse solution and platform
- Lead data curation to meet the business requirements
- Ensure deployment of modern data structures and models to enable reliable and scalable data products and feature stores
- Monitor end-to-end application stack (Hadoop, Vertica, Tableau, Hue, Superset etc) and lead/provide end-to-end operation support for all applications.
- Develop processes for automating, testing, and deploying the work
- Identify risks and opportunities of potential logic and data issues within the data environment
- Lead other team members and provide technical leadership in all phases of a project from discovery and planning through implementation and delivery.
- Lead the resolution activities for complex data issues.
- Develop and maintain documentation relating to all assigned systems and projects
- Ability to independently perform proof of concepts for new tools and frameworks and present to leadership
- Work in an agile environment. Develop and drive multiple cross-departmental projects.
- Establish effective working relationships across disparate departments to deliver business results.
- Collaborate effectively with the global team and ensure day to day deliverables are met
MINIMUM REQUIREMENTS
- Strong Experience with big data tools and data processing: Hadoop, Spark, Scala, Kafka, Yarn cluster, Java, etc.
- Strong experience with object-oriented/object function scripting languages: SQL, Python, Java, Scala, etc.
- Experience working with AWS
- Experience on SQL/NoSQL databases like Vertica, Postgres, Cassandra, etc.
- Experience with data modelling highly preferred
- Experience on streaming /event driven technologies work such as Lambda, Kinesis, Kafka, etc.
- Nice to have but not required - exposure to ML (frameworks like pytorch/tensorflow), model management and serving, containerizing and application development experience with Talend, Tableau, Snowflake, Redshift etc.
- Prior experience as a senior data architect, technical lead, system architect, or similar is required
- Excellent verbal and written communication skills.
Kind Regards!
Kunal
V2 Innovations Inc
42180 Ford Rd, Ste 302, Canton, MI 48187
Email: ku...@v2innovationsinc.com
Cell: (734) 357 8123
Fax: (734) 408 4744
Disclaimer: We respect your Online Privacy. This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. If you are not interested in receiving our e-mails then please reply with a "REMOVE" in the subject line and mention all the e-mail addresses to be removed with any e-mail addresses, which might be diverting the e-mails to you. We are sorry for the inconvenience