Hiring Big Data Engineer
Abhinav Mohanty
Hello Everyone,
Please share suitable profiles.
Don’t call me, Once I review the profile will give you a call.
|
If you are sharing any profile, please mention: Location – Work Authorization – "Before submitting any candidates please share the visa back and front copy must and LinkedIn id " |
Role: Big Data Engineer
Location: Rockville, MD (Remote)
Shift: Night Shift (11:00 PM – 7:00 AM EST, Monday–Friday)
Interview Process: 3 Rounds
No H1B, CPT, OPT
Job Summary:
Job Profile and Summary
This position is for a mid-level support engineer that will
provide primarily support of Big data operations in AWS for Market Regulation.
Supported platforms include AWS Services, UNIX, Windows, SQL, Postgres, Batch
Scheduling, etc. Additionally should work under minimal supervision to maintain
enterprise Linux infrastructure across on-premises data centers and cloud
environments. This role combines traditional systems administration with modern
DevOps practices, leveraging containerization technologies, cloud platforms
(AWS & Azure), and AI-powered tools to ensure Infrastructure meets defined
quality standards while driving operational excellence and innovation.
Work Conditions:
• Remote work environment, This is a night shift schedule (11pm -7am).
Monday through Friday
• Occasional weekend support will be required.
Essential Job Functions:
• Big data operations activities for AWS services in support of the
processing of market volumes of big data. Work involves monitoring batch
processing, data processing execution, SQL status queries, management /
remediation of issues, and escalation activities.
• Work also includes automation of data monitoring using Python scripting and
SQL queries. Usage of central batch processing tools like JAMS or any other
equivalent is valuable to have. Scripting experience is required, and mid-level
knowledge of Python and PowerShell is desired. *** has a very mature automated
deployment pipeline for deploying applications through their development
lifecycles.
• SQL, Postgres, Oracle, or equivalent database experience and building/running
queries is a must.
• Review and analyze process and system specifications to ensure delivery
requirements are met across hybrid Linux and Windows environments.
• Operate cloud infrastructure solutions on AWS (EC2, ECS, Lambda, CloudWatch,
IAM) and Azure (Virtual Machines, Container Instances, Monitor, Active
Directory)
• Ensure the Company's Reliability, Availability and Serviceability (RAS)
metrics are sustained and improved through proactive monitoring, automation,
and continuous optimization across hybrid environments.
• Document test plans as well as create/revise and execute Bash, Python, or
other scripting languages for automation and infrastructure-as-code
implementations.
• Proficiency in Workload Automation Scheduler and ability to Implement and
manage batch schedules using software such as JAMS/Broadcom AutoSys
• Monitor system performance and resolve scheduling conflicts or failed job as
well as implement change management procedures for Job scheduling
• Implements and updates monitoring tools for Linux systems, containerized
applications, and cloud resources using industry-leading platforms and
AI-enhanced observability solutions.
• Monitors operating system and cloud infrastructure performance to achieve
optimum performance levels, checking system logs, analyzing CPU/memory/IO
usage, and using performance monitoring tools to detect and resolve
bottlenecks.
• Proficiency in Operating System & Software Debugging, experienced-level
troubleshooting of Windows Server and/or Linux operating systems, including
patching, application deployment, and server hardware maintenance.
• Proficiency in CI/CD pipeline tools such as Jenkins and GitLab with good
understanding of git branching strategies, deployment pipelines and
performances and ability to identify and resolve deployment failures.
• Interface with other team members and other teams to ensure technology
solutions and staff are aligned with customer expectations and overall
technology vision, including DevOps, Security, and Application Development
teams.
• Lead/Co-lead internal process improvement initiatives focused on automation,
containerization, and AI adoption. Provide feedback on processes by offering
suggestions.
• Participate in periodic Disaster Recovery (DR), Business Continuity Planning
(BCP) and Sarbanes Oxley (SOX) testing and reporting, including validation of
backup/recovery procedures for Linux systems, containerized applications, and
cloud resources.
Education/Experience Requirements:
• Bachelor’s degree in Computer Science, Information Systems or related discipline with at least five (5) years of related experience, or equivalent training and / or work experience.
• Past senior level systems administrator experience in a production environment.
• Knowledge of industry leading monitoring and diagnostic tools
• Knowledge of at least one operating system and at least one contemporary scripting language.
• Knowledge of communication and network technologies.
• Exposure to common operational practices like metrics reporting, change management, incident management, problem management and communication
• Strong written and verbal technical communication skills.
• Demonstrated ability to develop effective working relationships that improved the quality of work products.
• Should be well organized, thorough, and able to handle competing priorities.
• Ability to maintain focus and develop proficiency in new skills rapidly.
• Ability to work in a fast-paced environment.
• Ability to working well under pressure