Read Notes Before Sending Profiles || Direct Client Hiring Cloudera Big Data Administrator || Location: Reston, VA or Washington DC (100% Remote) || Visa: H1B/H4-EAD (only)
Mohd Waseem
Hi,
I hope you're doing well.
This is Mohd Waseem, a recruiter with Lumen Solutions Group Inc., a dynamic small and minority-owned, Disadvantaged Business Enterprise headquartered in Florida, USA. As a leading consulting services and solutions provider, we focus on IT Staffing, Business / IT Strategy, Business Process Blueprints, Enterprise Architecture, Enterprise Transformation for our clients.
Our client base includes Fortune 500, Government, non-profit and emerging growth companies.
Please review the job description below. If you are interested in this position, please forward your updated resume for immediate consideration and preferred time to discuss this opportunity further.
Job Title: Cloudera Big Data Administrator
Job Location: Reston or DC – once or twice in month in office for meetings 100% remote
Job Type: Contract
Notes:
- This is for This is a CLOUDERA BIG DATA ADMINISTRATOR POSITION and NOT A DEVELOPER POSITION
- Only for H1B/H4-EAD
- Must have 7 years of experience in USA
- Only for DC/MD/VA/DE/NC/PA /NJ / NY /FL/ TX Candidates with Local ID Proof
Job Description:
This is a Cloudera Big Data Administrator position and
not a developer position. Experience with building Cloudera cluster CDP public
cloud and AMI upgrade, setting up NiFi, SOLR, HBase, Kafka, Knox in Cloud using
CDP Public Cloud v7.2.17 or higher. Be able to write the shell scripts to
monitor the health check of services and respond accordingly to any warning or
failure conditions. Monitoring the health of all the services running in the
production cluster using the Cloudera Manager. Performing/Accessing the
databases, metastore tables and writing Hive, Impala queries using HUE.
Responsible for monitoring the health of the Services on top of all clusters.
Working closely with different teams like Application development team,
Security team, Platform Support to identify and implement the Configurational
changes that are needed on top of the cluster for better performance of the
services.
Skills Must Require:
Cloudera CDP Public Cloud v7.2.17 or higher
Apache Kafka - strong Administration & troubleshooting skills
Kafka Streams API
stream processing with KStreams & Ktables
Kafka integration with IBM MQ
Kafka broker management
Topic/ offset management
Apache Nifi - Administration
Flow management
registry server management
controller service management
NiFi to Kafka /HBase /SOLR integration
Hbase - administration
database management
troubleshooting
SOLR - administration
managing Logging level
managing shards & high availability
Collection management
Rectify resource intensive & long running SOLR queries
Additional Must Have Skills includes:
• Proficient with handling AWS EC2, S3, EBS, EFS
• Ensure Cloudera installation and configuration is at optimal specifications
(CDP, CDSW, Hive, Spark, NiFi).
• Design and implement big data pipelines and automated data flows using
Python/R and NiFi.
• Assist and provide expertise as it pertains to automating the entire project
lifecycle.
• Perform incremental updates and upgrades to the Cloudera environment with
newer version.
• Assist with new use cases (i.e., analytics/ML, data science, data ingest and
processing), Infrastructure (including new cluster deployments, cluster
migration, expansion, major upgrades, COOP/DR, and security).
• Assist in testing, governance, data quality, training, and documentation
efforts.
• Move data and use YARN to allocate resources and schedule jobs.
• Manage job workflows with Hue.
• Implement comprehensive security policies across the Hadoop cluster using
Ranger.
• Troubleshoot potential issues with Kerberos, TLS/SSL, Models, and Experiments,
as well as other workload issues that data scientists might encounter once the
application is running.
• Supporting the Big Data / Hadoop databases throughout the development and
production lifecycle.
• Troubleshooting and resolving database integrity issues, performance issues,
blocking and deadlocking issues, replication issues, log shipping issues,
connectivity issues, security issues, performance tuning, query optimization,
using monitoring and troubleshooting tools.
• Create, test, and implement scripting for automation support.
• Experience in working with Kafka ecosystem (Kafka Brokers, Connect,
Zookeeper) in production is ideal.
• Implement and support streaming technologies such as Kafka, Spark & Kudu.
Regards,
Mohd Waseem
US IT Recruiter, Lumen Solutions Group Inc.
Email: mohdwas...@gmail.com