Spark Python Pyspark AWS Cloud Platform Engineer (Jobs in Costa Mesa, CA)   Requirement id 112715 Job title Engineer Job location in COSTA MESA, CA Skills required Spark, Python, Pyspark, AWS Cloud Platform Open Date 05-Jan-2021 Close Date Job type Contract Duration 6 Months Compensation DOE Status requirement --- Job interview type ---    Email Recruiter: coolsoft Job Description Engineer: Spark, Python, Pyspark, AWS Cloud Platform Candidate must be our W2 Employee. Job Description: About the Role: Ascend Sandbox is an integrated BigData and analytics platform. Our clients, some of the Americas largest financial institutions, use this platform to understand consumer credit behavior and build models for credit decisioning, marketing and account review purposes. We are looking for an expert platform engineer with in-depth knowledge on BigData analytics & public cloud platforms to help us run this peta-byte scale BigData platform and provide the best possible experience for our clients. What Youll Do Here • Responsible for continuous platform enhancements, upgrades, availability, reliability and security of the Ascend Sandbox platform. • Provide end-to-end observability of our Ascend Sandbox platform. • Responsible for resolving incidents reported by Sandbox users and take preventive actions. • Help Sandbox users with troubleshooting failed MapReduce/Hive/Spark applications. • Help Sandbox users to improve the performance and optimize their MapReduce/Hive/Spark applications. • Participate in follow-the-sun on-call rotation to address any emergency production incidents affecting the Sandbox platform. What Youll Need To Succeed Must Have skills: • Deep understanding of Linux, networking fundamentals and security. • Solid professional coding experience with at least one scripting language - Shell, Python etc. • Experience working with AWS cloud platform and infrastructure. • Experience managing large BigData clusters in production (at least one of -- Cloudera, Hortonworks, EMR) • Excellent knowledge and solid work experience providing observability for BigData platforms using tools like Prometheus, InfluxDB, Dynatrace, Grafana, Splunk etc. • Experience managing BigData clusters with compute decoupled from storage (Eg: S3) on public cloud platforms. • Expert knowledge on Hadoop Distributed File System (HDFS) and Hadoop YARN. • Decent knowledge of various Hadoop file formats like ORC, Parquet, Avro etc. • Deep understanding of Hive (Tez), Hive LLAP, Presto and Spark compute engines. • Ability to understand query plans and optimize performance for complex SQL queries on Hive and Spark. • Hands on experience supporting Spark with Python (PySpark) and R (SparklyR, SparkR) languages. • Experience working with Data Analysts, Data Scientists and at least one of these related analytical applications like SAS, R-Studio, JupyterHub, H2O etc. • Able to read and understand code (Java, Python, R, Scala), but expertise in at least one scripting language. • Experience managing JVM based applications in production. • Excellent written and oral communication. Nice to have skills: • Previous experience leading or playing critical role in production migration from one BigData analytics platform to other, preferably from CDH to CDP. • Experience with workflow management tools like Airflow, Oozie etc. • Implementation history of Terraform, Packer, Ansible, Chef, Jenkins or any other similar tooling. • Prior working knowledge of Active Directory and Windows OS based VDI platforms like Citrix, AWS Workspaces etc. • Professional coding experience in at least one programming language, preferably Java. • Experience with other public cloud platforms like Azure and GCP is a bonus   Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 112715 while calling.   Other jobs in CA: Anaheim (4), Brea (3), Brisbane (2), Carlsbad (3), Concord (1), Culver City (1), Cupertino (5), Downtown Los Angeles (3), El Monte (3), El Segundo (1), Foothill Ranch (2), Irvine (1), La Jolla (2), Lake Forest (1), Larkspur Landing (1), Long Island (1), Los Angeles (27), Newport (1), Newport Beach (3), Orange (2), Orange County (7), Pasadena (1), Poway (5), Rancho Cordova (1), Redwood City (3), Sacrament (1), Sacramento (19), San Diego (87), San Francisco (24), San Jose (4), Simi Valley (1), South San Francisco (1), Westlake Village (2), Spark job openings in COSTA MESA, CA Jobs List Software Engineer - Big Data - 71403 Create date: 01-Feb-2021 Note: Primarily looking for a Java / Spark developer Candidate must be our W2 Employee. Job Description: Position : JAVA / SPARK DEVELOPER (with big data experience) 12+ month contract Costa Mesa, CA or San Jose, CA Requirements • BS degree in computer science,.... (This job is for - Java Spark Kafka Jobs in CA CostaMesa Engineer - (in COSTA MESA, CA))    Spark job openings in other states Jobs List DevOps Engineer IV - 113501 - SP Create date: 23-Jan-2023 start date : 02/27/2023 End date : 6 Months from projected start date submission deadline : January 30th, at 4:00PM CST. client info : Milwaukee County Note : * Interview Process: Microsoft Teams 60 minutes. One round * Duration of the Contract: 6 month contract. * O.... (This job is for - Spark ELT Jobs in WI Milwaukee Engineer - (in Milwaukee, WI)) App Dev - Java - Sr - 72430 Create date: 01-Mar-2021 Note: Upon offer, it is required to show consultants W2 take home pay in the Exh A. Job Description: - At least 4 years of professional work experience in data management, data warehousing or unstructured data environments - At least 3 years of experience in open source programming languages for large scale data ana.... (This job is for - Spark Hadoop Jobs in VA McLean Developer - (in Mclean, VA)) Data Warehouse Engineer - 72259 Create date: 23-Feb-2021 Candidate must be our W2 Employee. Job Description: Data Warehouse Engineer Duration: 12 month contract + potential to extend and/or convert Location: Remote (Client site located in Nashville, TN) Overview: Seeking a candidate with extensive experience on designing, delivering and ma.... (This job is for - Spark Scala Jobs in TN Nashville Engineer - (in Nashville, TN)) G28 Python Developer - 71477 Create date: 02-Feb-2021 Candidate must be our W2 Employee. We should submit only GC,GC - EAD, L2-EAD,H4-EAD and Citizens. Job Description: Looking for someone to work very closely with an SA to work on the QME. Quality Measure Engine is a Certified engine that is designed based on a facts based framework. Each measure is comprised of facts.... (This job is for - Python Spark Pyspark Jobs in NC Raleigh Developer - (in Raleigh, NC)) Software Engineer - 70723 Create date: 11-Jan-2021 Job Description: 100 percent remote Needs to be more backend focused, Python, Athena Spark, CLickhouse The Sr. Software Engineer will be responsible for: Shaping the architecture and building out our suite of reporting and client facing products Continuously improving the process for which we.... (This job is for - Python Spark NodeJs Jobs in NY Syosset Engineer - (in Syosset, NY))    Spark job openings in CA Jobs List Senior Software Development Engineer Create date: 26-Apr-2021 Description: Top 3 required technical skills: Automation Dev Ops Engineering [Hadoop, Spark] Operational experience in real-time, streaming and data pipelines relevant frameworks [NiFi or Airflow] Java/ Scala and Python programming PCF or Cloud experience in general. Role .... (This job is for - Hadoop Spark Scala Jobs in CA SanFrancisco Engineer - (in San Francisco, CA)) Data Bricks Sr Software Engineer - 73296 Create date: 24-Mar-2021 Candidate must be our W2 Employee. Job Description: DataBricks Software Engineer Remote, Irvine, Ca, or Schaumberg, IL 8am - 4pm PST zone We are looking for someone to be apart of our Scrum Teams that will be working on production support for the Cloud project. They will be working on new development.... (This job is for - Spark Python Jobs in CA Irvine Engineer - (in Irvine, CA)) Data Engineer - 72884 Create date: 12-Mar-2021 Candidate must be our W2 Employee. Job Description: Data Engineer We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. .... (This job is for - Hadoop Spark Kafka Jobs in CA SouthSanFrancisco Engineer - (in South San Francisco, CA)) Senior Spark SQL Data Engineer - 66003 Create date: 19-Aug-2020 Candidate must be our W2 Employee. We should submit only GC,GC - EAD, L2-EAD,H4-EAD and Citizens. Job Description : Title: Senior Spark SQL Data Engineer Location: Remote – West Coast office times Duration: End of the Year Contract, possibility of conversion Our team is undergoing a .... (This job is for - SparkHadoob Jobs in CA Remote Engineer - (in Remote, CA)) Senior Spark SQL Data Engineer - 63884 Create date: 08-Jun-2020 Candidate must be our W2 Employee. We should submit only GC,GC - EAD, L2-EAD,H4-EAD and Citizens. Job Description : Moving from Tera data to Hadoop. Spark is now on top of Hadoop and is a viable replacement for Tera data. - The partners that rely on eBays systems need help configuring Spark SQL queries si.... (This job is for - Spark Hadoop Jobs in CA SanJose Engineer - (in San Jose, CA)) (Engineer: Spark, Python, Pyspark, AWS Cloud Platform in COSTA MESA, CA)

Featured Jobs Developer (Jobs in Atlanta, Georgia) Data Architect ETL Specialist (Jobs in Raleigh, North Carolina) SQL Architect (Jobs in Richmond, Virginia) Business Analyst Financial Analyst (Jobs in Fredericksburg, Virginia) Cyber Architect (Jobs in Columbia, South Carolina) VxRails Consultant (Jobs in Boise, Idaho) Project Manager Microsoft Manager (Jobs in Raleigh, North Carolina) Agile Jira UAT Manager (Jobs in Atlanta, Georgia) - - Analyst (Jobs in Portland, Oregon) HTMLCSSJavaScript Developer (Jobs in Lincoln, Nebraska)