Hi,
Greetings from SightSpectrum,
Role: Bigdata Developer
Location: Baltimore, MD
Duration 12+ months
Job Overview:
- 5-7 years of work experience in Bigdata technology including tools such as Hadoop, Spark, Map Reduce, Sqoop, HBase, Hive.
- Hands on experience in Spark, Scala, Kafka.
- Should be able to work on small enhancements to the existing production process which involves Unix Shell scripting, file handling, data copy from Dev to Prod, Data copy from external sources, encryption, decryption etc.
- Should be able to understand the existing Hadoop environment, framework to develop and deploy code for any new requirements.
- Unix shell scripting Knowledge and basic idea about unix file system, file transfer protocol (ftp, sftp, ssh, scp etc). Knowledge on firewall, file encryption/decryption etc will be added advantage.
- Any programming skill such as python or java will be added advantage.
- Basic Knowledge on any one RDBMS such as Oracle or MySQL, some basic knowledge on data models, theoretical/working knowledge on dimension model and/or entity relationship model, normalization etc.
- Develop, recommend and discuss technical designs that meet those requirements.
- Analyzing, documenting, and performing system configuration and setup as well as integration and system testing.
- Troubleshooting issues with existing systems and resolve. Ability to work in team environment and client interfacing skills.
- Knowledge on job scheduling such as Cron job or any UI based scheduler.
- Production job monitoring in Tidal - Verify whether jobs are running as per schedule, are there any long running jobs, failed job, restart, are there any missing data from source, reaching out to source point of contact and publish SLA to downstream teams.
- Run jobs manually with increased memory parameters if required from Unix command line.
- Should be able to understand data issues in Prod, analyze the root cause and provide solutions such as full data reload or missing data load within SLA.
- Strong Communication, Articulation, Analytical Skills.
- Good Communication and Interpersonal Skills.
Ranjith NL
Talent Acquisition – US
+1 201-855-0472 (Mobile)
+1 681-334-0363 (Desk)
ranj...@sightspectrum.com
GTalk:
ranj...@sightspectrum.com
https://www.linkedin.com/in/ranjith-n-l-a16288aa/
www.sightspectrum.com