Hadoop Spark Scala Python Scripting Cloud Developer Agile Methodologies SDLC Azure En   Requirement id 116273 Job title Engineer Job location in San Francisco, CA Skills required Hadoop, Spark, Scala, Python Scripting Cloud Developer Agile M Open Date 26-Apr-2021 Close Date Job type Contract Duration 12 Months Compensation DOE Status requirement --- Job interview type ---    Email Recruiter: coolsoft Job Description Engineer: Hadoop, Spark, Scala, Python Scripting Cloud Developer Agile M Description: Top 3 required technical skills: Automation Dev Ops Engineering [Hadoop, Spark] Operational experience in real-time, streaming and data pipelines relevant frameworks [NiFi or Airflow] Java/ Scala and Python programming PCF or Cloud experience in general. Role Partner on the design the next implementation of Client secure, global data and insight architecture, building new Stream processing capabilities and operationalizing “Unified Data Acquisition and Processing (UDAP) platform” Identify and resolve performance bottlenecks either proactively Explore automation opportunity and develop tools to automate some of the day to day operations tasks Provide performance metrics and maintain dashboards to reflect production systems health Conceptualize and implement proactive monitoring where possible to catch issues early Experiment with new tools to streamline the development, testing, deployment, and running of our data pipelines. Work with cross functional agile teams to drive projects through full development cycle. Collaborate with other data engineering teams to improve the data engineering ecosystem and talent within Client. All About You At least Bachelors degree in Computer Science, Computer Engineering or Technology related field or equivalent work experience Intermediate experience in Data Warehouse related projects in product or service based organization Foundational experience as a Site Reliability Engineering or DevOps Engineer Foundational experience overall with experience as a software engineer or software architect Experience solving for scalability, Performance and stability Expert knowledge of Linux operating systems and environment and Scripting (Shell and Python preferred) Expert at troubleshooting complex system and application stacks Operational Experience in Big Data Stacks ( Hadoop ecosystem, Spark is a plus) Operational Experience in real-time ,streaming and data pipelines relevant frameworks ( Kafka and NiFi is a plus) Operational experience troubleshooting network/server communication Experience with performance Tuning of Database Schemas, Databases, SQL, ETL Jobs, and related scripts Expertise in enterprise metrics/monitoring with frameworks such as Splunk, Druid, Grafana Experience with cloud computing services, particularly deploying and running services in Azure or GCP   Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 116273 while calling.   Other jobs in CA: Anaheim (4), Brea (3), Brisbane (2), Carlsbad (3), Concord (1), Culver City (1), Cupertino (5), Downtown Los Angeles (3), El Monte (3), El Segundo (1), Foothill Ranch (2), Irvine (1), La Jolla (2), Lake Forest (1), Larkspur Landing (1), Long Island (1), Los Angeles (27), Newport (1), Newport Beach (3), Orange (2), Orange County (7), Pasadena (1), Poway (5), Rancho Cordova (1), Redwood City (3), Sacrament (1), Sacramento (19), San Diego (87), San Francisco (24), San Jose (4), Simi Valley (1), South San Francisco (1), Westlake Village (2), Hadoop job openings in San Francisco, CA Jobs List Hadoop Admin - 68150 Create date: 30-Sep-2020 Candidate must be our W2 Employee. Job Description : Responsibilities • Implementing, managing and administering the overall Hadoop infrastructure • Adding and removing nodes using cluster monitoring tools like Ambari • Support Hadoop cluster move to a different data center while ensuring.... (This job is for - Implementation Hadoop Python Jobs in CA SANFRANCISCO Administrator - (in San Francisco, CA)) Business Data Analyst - 64244 Create date: 18-Jun-2020 Candidate must be our W2 Employee. Job Description : Location: · Can work Remote/Virtual - Will be supporting two regions LAC and NA, must be able to work core hours. Contract: · 1 year – strong chance of conversion Interview Timeline: · Phone, Skype Interviews: 2/3 .... (This job is for - Hadoop Hive Jobs in CA SanFrancisco Analyst - (in San Francisco, CA)) Data Engineer - 55625 Create date: 13-Nov-2019 Job Description : The Analytics Platform and Solutions data pipeline delivers value to various business partners by providing tools and capabilities to analyze large data sets for research, analytics, campaign management, reporting and tactical/strategic decision making. Our systems development team is looking for a Developer who has pas.... (This job is for - Hadoop Hive Jobs in CA SanFrancisco Engineer - (in San Francisco, CA)) ML Infrastructure Consultant - 49833 Create date: 18-Jul-2019 Candidate must be our W2 Employee We should submit only GC, GC EAD, L2 EAD, H4 EAD and Citizens. Notes : On-site interview Tuesday 7/16 for 30 minutes from 3-5pm. CANDIDATES MUST BE LOCAL. Description: our client has created a team to develop artificial intelligence-based technology and appoint.... (This job is for - Hadoop Jobs in CA SanFrancisco Consultant - (in San Francisco, CA)) Sr. Data Engineer - 16019 Create date: 12-Jul-2019 Description: Our enterprise retail client in San Francisco is in need of Sr. Data Engineers to build out their next generation analytics platform. They want to add data science and deep learning to their supply chain and ecommerce analytics platform to allow them to leverage big data into actionable insights. With better forecasting accu.... (This job is for - Hadoop Spark Jobs in CA SanFrancisco Engineer - (in San Francisco, CA))    Hadoop job openings in other states Jobs List Back End Java Developer - 85842 Create date: 03-Jun-2022 Description: General skills Nice to have Databricks Hadoop is preferred but any big Data warehousing experience IT skills Must have Backend data experience Data Warehousing Java/springboot API knowledge AWS Datalayer knowledge (This job is for - Hadoop Jobs in NY NewYork Developer - (in New York, NY)) Data Warehouse Designer/Developer - 58707 Create date: 05-Oct-2021 Description: Responsibilities Our Client in Columbus, Ohio is seeking an experienced Data Warehouse Designer / Developer for a contract role. CANDIDATES MUST BE LOCAL TO CENTRAL OHIO OR RELOCATED BY DAY ONE FOR CONSIDERATION. The Data Warehouse Designer/Developer will be responsible for Enterprise data wa.... (This job is for - Hadoop ETL ELT Jobs in OH Columbus Developer - (in Columbus, OH)) Technical Specialist - 58686 Create date: 30-Sep-2021 Description: Responsibilities Our client in Columbus Ohio is seeking an Enterprise Data Warehouse / ETL Developer. Local candidates are highly preferred. Candidates are required to report onsite on Day 1 of the assignment. The Technical Specialist will be responsible for the clients Enterprise data wareho.... (This job is for - Hadoop ETL Jobs in OH Columbus Specialist - (in Columbus, OH)) Data Warehouse Designer / Developer - 58526 Create date: 20-Aug-2021 Description: Our Client in Columbus, Ohio is seeking an experienced Data Warehouse Designer / Developer for a contract role CANDIDATES MUST BE LOCAL TO CENTRAL OHIO OR RELOCATED BY DAY ONE FOR CONSIDERATION The Data Warehouse Designer/Developer will be responsible for Enterprise data warehouse design, development, i.... (This job is for - Hadoop Hive Jobs in OH Columbus Developer - (in Columbus, OH)) Technical Specialist 3/TS3 - 83945 - SP Create date: 07-Apr-2021 start date:5/3/2021 End date:06/30/2021 submission deadline:4/12/2021 client info : MCD Note: * Interviews: TEAMS * The selected candidate does not have to be local to Columbus, OH and can work remotely * REPOST OF 82361 AND 83069 - DO NOT RESUBMIT CANDIDATES Hadoop Jobs in OH Columbus Specialist - (in Columbus, OH))    Hadoop job openings in CA Jobs List Senior Data Engineer - 73197 Create date: 23-Mar-2021 Note: Please only send candidates that are local to the area. They are only considering local candidates at this time. The previous retail experience is a big plus. Candidate must be our W2 Employee. Candidate must be local: Yes Job Description: Position Summary * Very Strong engineering skill.... (This job is for - Hadoop Teradata Jobs in CA SanBruno Engineer - (in San Bruno, CA)) Data Engineer - 72884 Create date: 12-Mar-2021 Candidate must be our W2 Employee. Job Description: Data Engineer We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. .... (This job is for - Hadoop Spark Kafka Jobs in CA SouthSanFrancisco Engineer - (in South San Francisco, CA)) Data Engineer - 68549 Create date: 15-Oct-2020 Job Description : * Strong development skills around Hadoop, Hive, Pig Latin, Spark, Scalding, Map Reduce, Storm, Kafka * Knowledge of Spark and NoSQL databases * Have working experience in Google Cloud Platform * Strong skills in object oriented design, Core Java, Scala, shell scripting/Python Hadoop Hive Pig Jobs in CA Sunnyvale Engineer - (in Sunnyvale, CA)) Product Engineer - 64580 Create date: 01-Jul-2020 Note :Staff Aug Candidate must be our W2 Employee. Job Description :Essential Functions (Tasks and Responsibilities): Partner closely with other Product Managers to understand new product offerings being built, and work with analysts to recommend the right metrics to measure performance of those features <.... (This job is for - Hadoop Hive Spark Jobs in CA SanJose Engineer - (in San Jose, CA)) Data Engineer - 64436 Create date: 24-Jun-2020 Candidate must be our W2 Employee. Candidate must be local : Yes Job Description : Day to Day Responsibilities: 1) Perform automation of test cases using pyspark/python 2) Perform manual query using SQL/Hive/pyspark/MongodB query 3) Perform data validation of different parameters fr.... (This job is for - AWS Hadoop MY SQL Jobs in CA SanJose Engineer - (in San Jose, CA)) (Engineer: Hadoop, Spark, Scala, Python Scripting Cloud Developer Agile M in San Francisco, CA)

Featured Jobs Budgeting Office Consultant (Jobs in Harrisburg, Pennsylvania) PMP Manager (Jobs in Atlanta, Georgia) Javascript Developer (Jobs in Tucker, Georgia) Architecture - - Specialist (Jobs in Raleigh, North Carolina) Typography Power Consultant (Jobs in Nashville, Tennessee) - Consultant (Jobs in Bismarck, North Dakota) SSIS JAVA Analyst (Jobs in Richmond, Virginia) TSOISPF Specialist (Jobs in Columbus, Ohio) Integration IT Specialist (Jobs in Columbus, Ohio) API CI Developer (Jobs in Richmond, Virginia)