Home       |     Overview      |     Candidate Login      |     Post Resume       |     Contact us
 
  
     
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     
Spark GIT ETL Data Integration Data Warehouse Python Development Scala Programming De
 
Requirement id 92691
Job title Developer
Job location in Houston, TX
Skills required Spark, GIT, ETL, Data Integration Data Warehouse Python D
Open Date 20-May-2019
Close Date
Job type Contract
Duration 12 Months
Compensation DOE
Status requirement ---
Job interview type ---
   Email Recruiter: coolsoft
Job Description Developer: Spark, GIT, ETL, Data Integration Data Warehouse Python D

start date:6/4/2019
End date: 06/06/2020
submission deadline:5/28/2019

Description:

The Sr, Data Integration Developer will be working on a program designed to facilitate external collaborative relationships as well as to serve internal research and operational needs. The program will leverage a platform for research discoveries in collaboration with development partners.

Data Integration Developer/Data Engineer will be responsible for:

Designing and developing data pipelines in Palantir Foundry using Spark SQL and PySPARK
Testing pipeline
Merging code in a GIT based repository, submitting for review and operationalizing pipeline
Supporting data pipeline issues, if any
Revising any quality issues and fixing pipeline
Configuring data quality rules in Foundry Platform
Requirements:
Five years of ETL development work experience.
Bachelors Degree in Computer Engineering or equivalent
Nice to have:
Masters Degree

Position Description:

Function
Provides analysis of research and/or financial data integration requirements in terms of decision support, data warehouse and/or business intelligence or data management environments.

Scope
Impacts data management for institutional data.

Essential Job Functions
Develops programming and systems solutions to integrate data into reporting and data management environments. Captures integration metadata and rules associated with integrations into metadata repository. Designs simple to complex queries using structure query language. Performs problem solving and formulation and testing of hypotheses and complex analysis of data. Oversees efforts to ensure consistent methodologies are followed and makes recommendations where necessary. Advises on proper programming techniques and assists in programming complex problems.

Responsibilities:
Design and develop data pipelines in Palantir Foundry using Spark SQL and PySPARK
Test pipeline
Merge code in a GIT based repository, submit for review and operationalize pipeline
Support data pipeline issues if any
Review any quality issues and fix pipeline
Configure data quality rules in Foundry Platform
Knowledge of Python, Scala or Java is preferred
This email and any files transmitted with it are confidential and or privileged information internal to our organization and intended solely for the use of the individual(s) or entity or entities to whom they are addressed. This message contains confidential information and is intended only for the recipients. If you have received this email in error please notify the sender by replying to this email and then delete this message and any attachments. If you are not the named addressee you may not disseminate, distribute or copy this e-mail. If you are the intended recipient you are notified that unauthorized disclosure, copy, storage, or distribution of this information is strictly prohibited.
 
Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 92691 while calling.
 
Other jobs in TX: Austin (21), Dallas (32), Fort Worth (30), Ft Worth (1), Grand Prairie (1), Houston (12), Hunstville (2), Huntsville (1), Irving (3), Plano (4), San Antonio (9), Woodlands (1),
Spark job openings in Houston, TX
Jobs List

Python Developer - 34718
Create date: 16-May-2018
Job Description :

Title: Python Developer Length: 3 month contract with likely extension Location: Houston, TX Description: - 5+ years experience using Python (not sure how long has been Python is on the market, but you get my point that it has to be an expert) - Experience working connecting Python with relational databases (Oracle/Sql .... (This job is for - Spark Hadoop Jobs in TX Houston Developer - (in Houston, TX))
 
 Spark job openings in other states
Jobs List

DevOps Engineer IV - 113501 - SP
Create date: 23-Jan-2023
start date : 02/27/2023

End date : 6 Months from projected start date

submission deadline : January 30th, at 4:00PM CST.

client info : Milwaukee County

Note :

* Interview Process: Microsoft Teams 60 minutes. One round

* Duration of the Contract: 6 month contract.

* O.... (This job is for - Spark ELT Jobs in WI Milwaukee Engineer - (in Milwaukee, WI))

Senior Software Development Engineer
Create date: 26-Apr-2021
Description:

Top 3 required technical skills:

Automation Dev Ops Engineering [Hadoop, Spark]
Operational experience in real-time, streaming and data pipelines relevant frameworks [NiFi or Airflow]
Java/ Scala and Python programming
PCF or Cloud experience in general.

Role

.... (This job is for - Hadoop Spark Scala Jobs in CA SanFrancisco Engineer - (in San Francisco, CA))

Data Bricks Sr Software Engineer - 73296
Create date: 24-Mar-2021
Candidate must be our W2 Employee.

Job Description:

DataBricks Software Engineer
Remote, Irvine, Ca, or Schaumberg, IL

8am - 4pm PST zone

We are looking for someone to be apart of our Scrum Teams that will be working on production support for the Cloud project. They will be working on new development.... (This job is for - Spark Python Jobs in CA Irvine Engineer - (in Irvine, CA))

Data Engineer - 72884
Create date: 12-Mar-2021
Candidate must be our W2 Employee.

Job Description: Data Engineer

We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. .... (This job is for - Hadoop Spark Kafka Jobs in CA SouthSanFrancisco Engineer - (in South San Francisco, CA))

App Dev - Java - Sr - 72430
Create date: 01-Mar-2021
Note: Upon offer, it is required to show consultants W2 take home pay in the Exh A.

Job Description:

- At least 4 years of professional work experience in data management, data warehousing or unstructured data environments

- At least 3 years of experience in open source programming languages for large scale data ana.... (This job is for - Spark Hadoop Jobs in VA McLean Developer - (in Mclean, VA))
 
 Spark job openings in TX
Jobs List

Sr. Business Intelligence Developer - 55216
Create date: 05-Nov-2019
Description:

Required Skills :
* 5+ years of Software Development experience with expertise in Business Intelligence & Analytics Tools.
* Combination of experience in any of the following tools/platforms required:
o Big Data platform: Knowledge of Hadoop, HDFS, Spark, Solr
o Scripting: JavaScript, Python, SQL, Stored .... (This job is for - Hadoop Spark SOLR Jobs in TX FortWorth Developer - (in Fort Worth, TX))

Sr. Business System Analyst Data Science - NTTJP00020457
Create date: 10-May-2019
Start Date : 05/20/2019
End Date : 12/31/2020
Submission Dead Line : 05/16/2019

Description :

We know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our companys growth, market presence and our ability to hel.... (This job is for - SparkHadoop Jobs in TX Addison Analyst - (in ADDISON, TX))

Talend Developer - 45841
Create date: 10-Apr-2019
Candidate must be your W2 Employee.

Job Description :

This company is in the process of building a Customer Master Data solution on Hadoop Platform and is looking for a strong Talend/Spark ETL Developer to help design and build the data feeds to the Customer Master.



Responsibilities

Under.... (This job is for - SparkAutosys Jobs in TX SanAntonio Developer - (in San Antonio, TX))

Techno-Functional Lead
Create date: 04-Apr-2019
Description:

Responsibilities

The Techno-Functional Lead will be responsible for development/ maintenance of a User Data Pipeline Project.

Must Have

Programming experience in Hadoop, Spark, Scala and **SQL. **
Enterprise data warehousing experience (Teradata, Vertica, Oracle etc)
Sco.... (This job is for - Hadoop Spark Jobs in TX Austin TechLead - (in Austin, TX))

Hadoop Architect - J-11-080-318
Create date: 13-Jan-2016
Note:
Start date : 1/25/2016
End date : 1/23/2017
Submission deadline: 1/19/2016
Description:

Austin, Texas client seeks an Expert Level Hadoop Consultant (Contract)

Enterprise Design and Developer :

Role :

Define Solution Architecture, Designing and Developing NextGe.... (This job is for - Spark Hibernate HBase Jobs in TX AUSTIN Architect - (in Austin, TX))
(Developer: Spark, GIT, ETL, Data Integration Data Warehouse Python D in Houston, TX)
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     

    About Us     Services    Privacy policy    Legal     Contact us