Dear Candidate,
Greetings!
Opening for Scala/Spark Developers
Work Location: Bangalore,Pune & Chennai
Direct HCL Payroll.
Skill - Technical
o Fundamentals of Spark using the Dataframe API
o Understanding partitioning of data
o Responsible for developing, enhancing, re-engineering & maintaining applications with Scala.
o Analysing and performance tuning Spark queries e.g. looking at the DAG
o Creating Scala/Spark jobs for data transformation and aggregation.
o Creating unit tests for Spark transformations and helper methods.
o Write Scaladoc-style documentation with all code
o Knowledge of Hadoop and its ecosystem of technologies especially Hive
o Understand Fundamental Data Structures & their Implementation
o Contributes to quality assurance by writing unit and functional tests.
o Ensures development happens for all Software Components in accordance with Detailed Software Requirements specification, the functional design and the technical design document.
o Basic knowledge of UNIX
o Demonstrate source control knowledge (preferably GIT)
o Ability to analyse databases directly using query language tools such as SQL
o Experience on ETL process on Big Data
o Have an understanding of data relationships, normalisation
· Non-Technical
o Use of JIRA / Confluence
o Appreciation of release management and software maintenance
o Provides Level 3 support
o Contributes to problem and root cause analysis.
o Collaborates with colleagues participating in other stages of the Software Development Lifecycle (SDLC).
o Strong analytical skills.
o Should have good understanding of architecture
o Ability to work in virtual teams
o Excellent team player and open minded approach
o Ability to share information, transfer knowledge and expertise to team members.
o Ability to design and write code in accordance with provided business requirements
o Ability to work in a fast paced environment with competing and alternating priorities with constant focus on delivery.
o Candidate is expected to have high desire to learn new technologies and implement various solutions in fast paced environment.
· Nice To Have
o Knowledge of control M
o Hands on experience of Team City
o Understanding of Financial Products
o Ability to interpret and write complex SQLs
· Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
· Monitoring performance and advising any necessary infrastructure changes
· Defining data retention policies
· Skills and Qualifications
· Proficient understanding of distributed computing principles
· Proficiency with Hadoop v2, MapReduce, HDFS
· Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming {?????? {??????if stream-processing is relevant for the role}?????? }??????
· Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
· Experience with integration of data from multiple data sources
· Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
· Knowledge of various ETL techniques and frameworks, such as Flume
· Experience with various messaging systems, such as Kafka or RabbitMQ
· Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O
· Good understanding of Lambda Architecture, along with its advantages and drawbacks
· Experience with Cloudera/MapR/Hortonworks
Exp- 4 to 12 yrs
Notice- immediate to Serving Notice Period 60days
Please share below Details,
Full Name:
Mob No:
Mail ID :
Current Company:
Current Location:
preferred work location:
Total EXP: -
Relevant EXP: -
Current ctc:
Expected ctc:
Notice Period(in Days &LWDif serving) :
Available for Saturday Drive(Jan 15th, Time:10am-5pm) If available, pls mention Time:
Any previous interview with HCL in the last 3 months:
Interested candidates can apply your CV to the below mail ID.
sunda...@hcl.com