Hadoop Spark Kafka API Development SQL NoSQL Databases DynamoDB Engineer (Jobs in   Requirement id 115003 Job title Engineer Job location in South San Francisco, CA Skills required Hadoop, Spark, Kafka, API Development SQL NoSQL Databases Dyna Open Date 12-Mar-2021 Close Date Job type Contract Duration 12 Months Compensation DOE Status requirement --- Job interview type ---    Email Recruiter: coolsoft Job Description Engineer: Hadoop, Spark, Kafka, API Development SQL NoSQL Databases Dyna Candidate must be our W2 Employee. Job Description: Data Engineer We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. Responsibilities for Data Engineer: ? Create and maintain a data pipeline for automating data ingestion from multiple data sources ? Build the data platform capabilities required for optimal extraction, transformation, and loading of data from a wide variety of data sources. ? Keep our data separated and secure across national boundaries through multiple data centers and AWS regions ? Work with data and analytics experts to strive for greater functionality in our data systems. ? Assemble large, complex data sets that meet functional / non-functional business requirements. ? Identify, design, and implement a solution for automating manual processes and optimizing data delivery ? Work with stakeholders including the Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. Qualifications for Data Engineer ? Experience with Data Pipeline and ETL Tools such as Apache Airflow, AWS Data Pipeline, AWS Glue, Talend ? Experience with Data Warehouse solution - Redshift, Snowflake ? Experience with AWS cloud services: S3, Athena, RDS, EC2, EMR, RDS, Lambda, ? Experience with object-oriented/object function scripting languages: Python, Java, Scala, etc ? Experience with big data tools: Hadoop, Spark, Kafka, etc. ? Experience with relational SQL and NoSQL databases, including Postgres and DynamoDB. ? Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. ? Experience with Kubernetes, EKS, API Development ? Advanced working SQL knowledge and experience working with relational databases and NOSQL databases. ? Experience building and optimizing big data data pipelines, architectures and data sets. ? Experience performing root cause analysis on internal and external data ingestion. ? Strong analytic skills related to working with Structured, Semi-Structured and Unstructured datasets. ? A successful history of manipulating, processing and extracting value from large disconnected datasets. ? Working knowledge of message queuing, stream processing, and highly scalable big data data stores. ? Experience supporting and working with cross-functional teams in a dynamic environment.   Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 115003 while calling.   Other jobs in CA: Anaheim (4), Brea (3), Brisbane (2), Carlsbad (3), Concord (1), Culver City (1), Cupertino (5), Downtown Los Angeles (3), El Monte (3), El Segundo (1), Foothill Ranch (2), Irvine (1), La Jolla (2), Lake Forest (1), Larkspur Landing (1), Long Island (1), Los Angeles (27), Newport (1), Newport Beach (3), Orange (2), Orange County (7), Pasadena (1), Poway (5), Rancho Cordova (1), Redwood City (3), Sacrament (1), Sacramento (19), San Diego (87), San Francisco (24), San Jose (4), Simi Valley (1), South San Francisco (1), Westlake Village (2),    Hadoop job openings in other states Jobs List Back End Java Developer - 85842 Create date: 03-Jun-2022 Description: General skills Nice to have Databricks Hadoop is preferred but any big Data warehousing experience IT skills Must have Backend data experience Data Warehousing Java/springboot API knowledge AWS Datalayer knowledge (This job is for - Hadoop Jobs in NY NewYork Developer - (in New York, NY)) Data Warehouse Designer/Developer - 58707 Create date: 05-Oct-2021 Description: Responsibilities Our Client in Columbus, Ohio is seeking an experienced Data Warehouse Designer / Developer for a contract role. CANDIDATES MUST BE LOCAL TO CENTRAL OHIO OR RELOCATED BY DAY ONE FOR CONSIDERATION. The Data Warehouse Designer/Developer will be responsible for Enterprise data wa.... (This job is for - Hadoop ETL ELT Jobs in OH Columbus Developer - (in Columbus, OH)) Technical Specialist - 58686 Create date: 30-Sep-2021 Description: Responsibilities Our client in Columbus Ohio is seeking an Enterprise Data Warehouse / ETL Developer. Local candidates are highly preferred. Candidates are required to report onsite on Day 1 of the assignment. The Technical Specialist will be responsible for the clients Enterprise data wareho.... (This job is for - Hadoop ETL Jobs in OH Columbus Specialist - (in Columbus, OH)) Data Warehouse Designer / Developer - 58526 Create date: 20-Aug-2021 Description: Our Client in Columbus, Ohio is seeking an experienced Data Warehouse Designer / Developer for a contract role CANDIDATES MUST BE LOCAL TO CENTRAL OHIO OR RELOCATED BY DAY ONE FOR CONSIDERATION The Data Warehouse Designer/Developer will be responsible for Enterprise data warehouse design, development, i.... (This job is for - Hadoop Hive Jobs in OH Columbus Developer - (in Columbus, OH)) Technical Specialist 3/TS3 - 83945 - SP Create date: 07-Apr-2021 start date:5/3/2021 End date:06/30/2021 submission deadline:4/12/2021 client info : MCD Note: * Interviews: TEAMS * The selected candidate does not have to be local to Columbus, OH and can work remotely * REPOST OF 82361 AND 83069 - DO NOT RESUBMIT CANDIDATES Hadoop Jobs in OH Columbus Specialist - (in Columbus, OH))    Hadoop job openings in CA Jobs List Senior Software Development Engineer Create date: 26-Apr-2021 Description: Top 3 required technical skills: Automation Dev Ops Engineering [Hadoop, Spark] Operational experience in real-time, streaming and data pipelines relevant frameworks [NiFi or Airflow] Java/ Scala and Python programming PCF or Cloud experience in general. Role .... (This job is for - Hadoop Spark Scala Jobs in CA SanFrancisco Engineer - (in San Francisco, CA)) Senior Data Engineer - 73197 Create date: 23-Mar-2021 Note: Please only send candidates that are local to the area. They are only considering local candidates at this time. The previous retail experience is a big plus. Candidate must be our W2 Employee. Candidate must be local: Yes Job Description: Position Summary * Very Strong engineering skill.... (This job is for - Hadoop Teradata Jobs in CA SanBruno Engineer - (in San Bruno, CA)) Data Engineer - 68549 Create date: 15-Oct-2020 Job Description : * Strong development skills around Hadoop, Hive, Pig Latin, Spark, Scalding, Map Reduce, Storm, Kafka * Knowledge of Spark and NoSQL databases * Have working experience in Google Cloud Platform * Strong skills in object oriented design, Core Java, Scala, shell scripting/Python Hadoop Hive Pig Jobs in CA Sunnyvale Engineer - (in Sunnyvale, CA)) Hadoop Admin - 68150 Create date: 30-Sep-2020 Candidate must be our W2 Employee. Job Description : Responsibilities • Implementing, managing and administering the overall Hadoop infrastructure • Adding and removing nodes using cluster monitoring tools like Ambari • Support Hadoop cluster move to a different data center while ensuring.... (This job is for - Implementation Hadoop Python Jobs in CA SANFRANCISCO Administrator - (in San Francisco, CA)) Product Engineer - 64580 Create date: 01-Jul-2020 Note :Staff Aug Candidate must be our W2 Employee. Job Description :Essential Functions (Tasks and Responsibilities): Partner closely with other Product Managers to understand new product offerings being built, and work with analysts to recommend the right metrics to measure performance of those features <.... (This job is for - Hadoop Hive Spark Jobs in CA SanJose Engineer - (in San Jose, CA)) (Engineer: Hadoop, Spark, Kafka, API Development SQL NoSQL Databases Dyna in South San Francisco, CA)

Featured Jobs Developer (Jobs in Atlanta, Georgia) Data Architect ETL Specialist (Jobs in Raleigh, North Carolina) SQL Architect (Jobs in Richmond, Virginia) Business Analyst Financial Analyst (Jobs in Fredericksburg, Virginia) Cyber Architect (Jobs in Columbia, South Carolina) VxRails Consultant (Jobs in Boise, Idaho) Project Manager Microsoft Manager (Jobs in Raleigh, North Carolina) Agile Jira UAT Manager (Jobs in Atlanta, Georgia) - - Analyst (Jobs in Portland, Oregon) HTMLCSSJavaScript Developer (Jobs in Lincoln, Nebraska)