Home       |     Overview      |     Candidate Login      |     Post Resume       |     Contact us
 
  
     
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     
Hadoop Infrastructure Projects Red Hat Enterprise Linux Administrator
(Jobs in P
 
Requirement id 72688
Job title Administrator
Job location in Phoenix, AZ
Skills required Problem-Solving, Troubleshooting Skills, Hadoop, Scripting, Infrastructure Projects Red Hat Enterpri
Open Date 24-Aug-2018
Close Date
Job type Contract
Duration 3 Months
Compensation DOE
Status requirement ---
Job interview type Face to Face interview
   Email Recruiter: coolsoft
Job Description Administrator: Problem-Solving, Troubleshooting Skills, Hadoop, Scripting, Infrastructure Projects Red Hat Enterpri

Candidate must be our W2 Employee

Job Description :

Job Description Summary for Sr. Cloudera Hadoop Administrator


The Sr. Cloudera Hadoop Administrator is responsible for building and maintaining the CDH clusters running Spark on YARN in AWS. This is an opportunity to work in a cloud environment, pushing the technology boundaries and old ways of thinking, to create and maintain a high-volume infrastructure that will scale horizontally and addresses security, reliability, performance, availability and scalability.



PRIMARY DUTIES AND ACCOUNTABILITIES



Administration

· Respond to outages during business and after-hours. Participates in 24x7 on-call rotation process

· 24x7 management of Cloudera Hadoop and Spark cluster environments, on AWS EC2 cloud and container infrastructure (as applicable), including service allocation and configuration for the cluster, capacity planning, performance tuning, monitoring, troubleshooting and root cause analysis

· Implement, manage and provide support for large Cloudera Hadoop style clusters across all environments

· Manage and support of Hadoop Services including HDFS, Hive, Impala, and SPARK. Primarily using Cloudera Manager but some command-line.

· Develop scripts and tools to automate common Hadoop administration tasks

· Deploy & Maintain Hadoop cluster, scale cluster as required

· Optimize and tune the Hadoop environment to meet the performance requirements

· Perform upgrades of the CDH Cluster

· Monitor and manage back-up and Disaster Recovery processes

· Provision servers, patch, and maintain them

· Answering trouble tickets around the Hadoop ecosystem

· Provide integration support of tools that need to connect to the OFR Hadoop ecosystem. This may include tools like Tableau, Talend, generic ODBC/JDBC, etc.

· Administer data access permissions

· Manage and review log files

· Perform File system management and monitoring



Capacity/Performance Management and Future Planning

· Provide capacity planning and estimate the requirements for lowering or increasing the capacity of the Hadoop cluster

· Screen Hadoop cluster job performances and capacity planning

· Work with Systems and Network Engineers to evaluate new and different types of hardware to improve performance or capacity

· Contribute to the evolving distributed systems architecture to meet changing requirements for scaling, reliability, performance, manageability, and cost

· Responsible for monitoring the Linux, Hadoop, and Spark communities and vendors and report on important defects, feature changes, and or enhancements to the team



Operational Reporting/Metrics and Process Development

Create key performance metrics, measuring the utilization, performance and overall health of the cluster.
Report utilization and performance metrics to user communities
Develop and maintain operational best practices for smooth operation of large Hadoop clusters



SKILLS, EDUCATIONAL BACKGROUND AND EXPERIENCE

BS/MS degree in computer science or related field.
5+ years plus of hands-on experience in deploying and administering secure multi petabyte scale Hadoop cluster.
Strong problem solving and trouble shooting skills.
Deep expert level understanding of Hadoop design principals and the factors that affect distributed system performance.
Well versed in installing, administering and managing Hadoop clusters running CDH5, YARN, Spark, Cloudera manag
 
Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 72688 while calling.
 
Other jobs in AZ: Chandler (14), Phoenix (9), Scottsdale (1), Tempe (4),
 
 
 
 
(Administrator: Problem-Solving, Troubleshooting Skills, Hadoop, Scripting, Infrastructure Projects Red Hat Enterpri in Phoenix, AZ)
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     

    About Us     Services    Privacy policy    Legal     Contact us