Home       |     Overview      |     Candidate Login      |     Post Resume       |     Contact us
 
  
     
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     
Server Postgres Database Oracle Cassandra ETL Tools & Methods C++ Python Scala AWS
 
Requirement id 102343
Job title Engineer
Job location in The Woodlands, TX
Skills required SQL, Server, NoSQL Databases, Postgres Database Oracle Cassandra ETL T
Open Date 21-Jan-2020
Close Date
Job type Contract to Hire
Duration 6 Months
Compensation DOE
Status requirement not found
Job interview type ---
   Email Recruiter: coolsoft
Job Description Engineer: SQL, Server, NoSQL Databases, Postgres Database Oracle Cassandra ETL T

Job Description :

Data Pipeline Engineer

Job Overview

We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our companys data architecture to support our next generation of products and data initiatives. They will be open to a changing environment of tools and services as we buildout our Data Science and IT groups in the coming months.



Responsibilities for Data Engineer

Create and maintain optimal data pipeline architecture,
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL: awareness of AWS or other big data technologies.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.



Qualifications for Data Engineer

Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing big data data pipelines, architectures and data sets.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong analytic skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
A successful history of manipulating, processing and extracting value from large disconnected datasets.
Working knowledge of message queuing, stream processing, and highly scalable big data data stores.

Someone with Big Data development experience. This could include experience with a Hadoop distribution (Cloudera, Hortonworks, MapR) or a cloud solution (Amazon Web Services (AWS), MS Azure, or Google Cloud Platform (GCP))



Education

We are looking for a candidate with 2+ years of experience in a Data Engineer role, who has attained a Graduate degree or 5+ years and an undergraduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.



Position requirements:

Strong relational/non-relational database knowledge (SQL Server, noSQL, Oracle, Postgres, Cassandra etc.)
Strong database scripting experience (SQL, ETL Tools, etc.)
Experience with big data tools: Hadoop, Spark, Kafka, etc.
Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
Experience with stream-proc
 
Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 102343 while calling.
 
Other jobs in TX: Austin (21), Dallas (32), Fort Worth (30), Ft Worth (1), Grand Prairie (1), Houston (12), Hunstville (2), Huntsville (1), Irving (3), Plano (4), San Antonio (9), Woodlands (1),
SQL job openings in The Woodlands, TX
Jobs List

Senior Data Engineer - 38351
Create date: 10-Sep-2018
Candidate must be our W2 Employee


We should submit only GC,GC - EAD, L2-EAD,H4-EAD and Citizens


Candidates RTR form should be only on the name of APEX Systems

Client Info :Anadarko Petroleum Corporation


Job Description :

Need a strong problem solver and strategic thin.... (This job is for - job Jobs in TX TheWoodlands Engineer - (in The Woodlands, TX))
 
 SQL job openings in other states
Jobs List

Data Warehouse Developer I -136603
Create date: 23-Oct-2024
No of Submissions : 1

start date : 11/18/2024

End date : 06/30/2025

submission deadline : 10/25 at 4 CST.

client info : DPI

Note:

* Interview Process: Via Teams

* Duration: Till June 30, 2025, with possibility of extension

* Onsite or Remote: Candidate must.... (This job is for - Data Warehousing Jobs in WI Madison Developer - (in Madison, WI))

Programmer Analyst 6 - 135098
Create date: 17-Sep-2024
No of Submissions : 1

Start date : 10/21/2024

End Date : 1 Years from projected start date

Submission deadline : 9/24 at 10AM EST.

Client Info : LARA

Note:

* Interviews: 1st round interviews will be held via MS Teams. 2nr round interviews may be held in person, so candidates must b.... (This job is for - JavaScript Jobs in MI Lansing Analyst - (in Lansing, MI))

NCDPI - SQL/Snowflake-Tableau Analyst - Senior (746385)
Create date: 09-Sep-2024
No of Submissions : 2

Start date : 09/16/2024

End Date : 09/15/2025

Submission deadline : 09/13/2024

Client Info : NCDPI

Note:

* Agency Interview Type : In Person Only

* Onsite

Description :

Currently, the enterprise is a complex, multi-platform data.... (This job is for - SnowflakeDB2 Jobs in NC Raleigh Analyst - (in Raleigh, NC))

Senior Quality Assurance Specialist - 134717
Create date: 04-Sep-2024
No of Submissions : 1

Start date : 10/1/2024

End Date : 10/1/2027

Submission deadline : 9/11/2024 3:00:00 PM

Client Info : MDHS

Note:

* No max bill rate

* Onsite Required

* Do not submit remote/hybrid candidates, MDHS does not make exceptions to this rule and .... (This job is for - Visio Jobs in MS Jackson Specialist - (in Jackson, MS))

Technical Specialist IV - B36991W112
Create date: 28-Aug-2024
No of Submissions : 1

Start date : 09/23/2024

End Date : 09/23/2025

Submission deadline : 09/02/2024

Client Info :

Bill Rate : USD 95.00 Per Hour

Max Rate : USD 103.00 Per Hour

Note:

* Position Location : Remote

* Candidate must be local or willin.... (This job is for - job Jobs in OR Salem Specialist - (in Salem, OR))
 
 SQL job openings in TX
Jobs List

ITSAC 529300502 Systems Analyst 3 -SP
Create date: 21-Mar-2023
Bid URL:

Note: Online Submission
Note: RTR form must be signed by the candidate
Note: Total estimated hours per Candidate shall not exceed 1271 hours

Submission Deadline: 3/28/2023 5:00 pm CT
Start Date: 4/24/2023
End Date: 8/31/2023

Client: Texas Health and Human Services Commission (HHSC)
.... (This job is for - job Jobs in TX Austin Analyst - (in Austin, TX))

Spotfire Developer- 91143
Create date: 23-Feb-2023
Start Date : 3/14/2023
End Date : 6 months from start date

Submission Deadline : 3/2/2023

Note:
* Interview: Phone or video call

* On-site/Remote: On-site

Description :

Responsibilities

The objective of the project is to

• Collabor.... (This job is for - Analytical Skills Tibco Jobs in TX Houston Developer - (in Houston, TX))

ETL Developer
Create date: 07-Jul-2021
Note: GC and USC only - w2 candidates only

Description:

Extract Transform & Load - Performs analysis, design, code, and testing of moderate to extremely complex reports and data extracts. Supports multiple Texas Medicaid data warehouse systems to perform job, works on multiple assignments concurrently, and completes work in qu.... (This job is for - ETL OLAP Jobs in TX Austin Developer - (in Austin, TX))

Storage Engineers - 73440
Create date: 30-Mar-2021
Candidate must be our W2 Employee.

Job Description:

Client is interested in a REMOTE Lead Storage Backup Engineer!

Storage and Data Protection Migration Experience Required.

We need a high-qualified backup storage person to lead migration efforts for end of life service. The engineer will lead configurati.... (This job is for - job Jobs in TX RoundRock Engineer - (in ROUND ROCK, TX))

Sr. Decision Support Analyst - 73332
Create date: 25-Mar-2021
Note: we will need this information for submittal Location: Interview Avail: Start: Last 4 SSN: Rate: DOB: Highest Level of Education Earned: • Name of Degree: • Name of School: • Graduation Year: Phone: Email:

Job Description:

Department: Contract Administration : 8303
HPLAN
Job Category: Non-Clinical-Business Profe.... (This job is for - Analysis Jobs in TX Houston Analyst - (in Houston, TX))
(Engineer: SQL, Server, NoSQL Databases, Postgres Database Oracle Cassandra ETL T in The Woodlands, TX)
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     

    About Us     Services    Privacy policy    Legal     Contact us