Python Spark Pyspark Scala AWS Teradata Tableau Hive Hadoop ETL Linux Based Systems   Requirement id 112014 Job title Engineer Job location in Durham, NC Skills required Bachelor Degree In Computer Science, SQL Programming, Python, Spark Pyspark Scala AWS Teradata Tableau Open Date 02-Dec-2020 Close Date Job type Contract Duration 3 Months Compensation DOE Status requirement not found Job interview type ---    Email Recruiter: coolsoft Job Description Engineer: Bachelor Degree In Computer Science, SQL Programming, Python, Spark Pyspark Scala AWS Teradata Tableau Note :100% remote, extending contract. Candidate must be our W2 Employee. We should submit only GC,GC - EAD, L2-EAD,H4-EAD and Citizens. Job Description : Data Engineer The Data Engineer will work closely with senior engineers, data scientists and other stakeholders to design and maintain moderate to advanced data models. The Data Engineer is responsible for developing and supporting advanced reports that provide accurate and timely data for internal and external clients. The Data Engineer will design and grow a data infrastructure that powers our ability to make timely and data-driven decisions. · Extract data from multiple sources, integrate disparate data into a common data model, and integrate data into a target database, application, or file using efficient programming processes · Document, and test moderate data systems that bring together data from disparate sources, making it available to data scientists, and other users using scripting and/or programming languages · Write and refine code to ensure performance and reliability of data extraction and processing · Participate in requirements gathering sessions with business and technical staff to distill technical requirement from business requests · Develop SQL queries to extract data for analysis and model construction · Own delivery of moderately sized data engineering projects · Define and implement integrated data models, allowing integration of data from multiple sources · Design and develop scalable, efficient data pipeline processes to handle data ingestion, cleansing, transformation, integration, and validation required to provide access to prepared data sets to analysts and data scientists · Ensure performance and reliability of data processes · Define and implement data stores based on system requirements and consumer requirements · Document and test data processes including performance of through data validation and verification · Collaborate with cross functional team to resolve data quality and operational issues and ensure timely delivery of products · Develop and implement scripts for database and data process maintenance, monitoring, and performance tuning · Analyze and evaluate databases in order to identify and recommend improvements and optimization · Design eye-catching visualizations to convey information to users Hiring Requirements · Bachelors degree in Computer Science or related field or equivalent experience · 3 years of SQL programming skills (Intermediate to Advance SQL programming skills) · 3 years programming experience in Python/Spark/PySpark, Scala, AWS, Teradata, etc. · Demonstrated experience working with large and complex data sets · Experience with business intelligence tools (Tableau) ** Must have SAS experience** Hiring Preferences · Experience with Hadoop, Hive and/or other Big Data technologies · Experience with ETL or Data Pipeline tools · Experience with query and process optimization · Experience working in AWS and/or using Linux based systems · Ability to translate task/business requirements into written technical requirements · Reliable task estimation skills · Excellent quantitative, problem solving and analytic skills · Ability to document data pipeline architecture and design · Ability to collaborate effectively with business stakeholders, performance consultants, data scientists, and other data engineers · Proficient in use of MS Office applications including expert level Excel programming · Ability to quickly become an expert in operational processes and data of lin   Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 112014 while calling.   Other jobs in NC: Chapel Hill (2), Charlotte (58), Dix Campus (1), Greensboro (3), Morrisville (2), North Charlotte (2), Raleigh (96), St Raleigh (2), Winston Salem (3), Bachelor Degree In Computer Science job openings in Durham, NC Jobs List Analyst/Developer - 20230222113539 Create date: 22-Feb-2023 Start date :3/13/2023 End Date :6+months from the start date Submission deadline :03-01-2023 Note : Job Site : Remote Description : --------------------------------------------- Corporate IT is actively searching for experienced Senior .Net Software Engineers who will leverage their t.... (This job is for - Angular Jobs in NC Durham Developer - (in Durham, NC)) Principal Data Engineer - 65012 Create date: 15-Jul-2020 Candidate must be our W2 Employee. We should submit only GC,GC - EAD, L2-EAD,H4-EAD and Citizens. Job Description : Principal Data Engineer The Principal Data Engineer will work closely with senior engineers, data scientists and other stakeholders to design and maintain moderate to advanced data models. The Data Eng.... (This job is for - Python Jobs in NC Durham Engineer - (in Durham, NC)) Project Manager - 58996 Create date: 05-Feb-2020 Job Description : Project Manager Opportunity located in Providence, RI! Apex Systems combines with parent company On Assignment to make it the 2nd largest IT staffing agency in the country. Apex has an opportunity for Project Manager Role in Durham, NC. This is a 6+ month contract to hire opportunity. Here are the .... (This job is for - job Jobs in NC Durham Manager - (in Durham, NC)) Performance Engineer - 56738 Create date: 12-Dec-2019 Note: Candidates may be asked to submit prior W2s for the background check following an offer. All candidates MUST be willing to provide them if requested during the background check. Selling points for candidate : long term contract Job Description : Position: Performance Engineer Job ID: 1033.... (This job is for - AWS TOMCAT Jobs in NC Durham Consultant - (in Durham, NC)) IOS Developer - 56722 Create date: 12-Dec-2019 Candidate must be our W2 Employee. Job Description : It has an opportunity for an iOS Developer role in the Durham, NC area. This is a 1+ year contract position Position: iOS Developer Job ID: 1033254 Location: Durham, NC Duration: 1+ Year Contract Position Position Description: <.... (This job is for - job Jobs in NC Durham Consultant - (in Durham, NC))    Bachelor Degree In Computer Science job openings in other states Jobs List Project Manager -63758 Create date: 20-Dec-2024 No of Submissions : 2 Start date : 01/06/2025 End Date : 06/30/2025 Submission deadline : 01/03/2025 Client Info : ATL APD Note: * Position Location: On Site Description : T Project Manager, SR General Description and Classificatio.... (This job is for - Project Manager Jobs in GA Atlanta Manager - (in Atlanta, GA)) Network Engineer III - 138226 Create date: 17-Dec-2024 No of Submissions : 2 Start date : 12/02/2024 End Date : 06/30/2025 Submission deadline : 12/26/2024 4:00:00 PM Client Info : Supreme Court Note: * Interview Process: via Teams * Duration of the Contract: 6/30/2025, with potential for extension * Onsite .... (This job is for - Cybersecurity Design Jobs in WI Madison Engineer - (in Madison, WI)) Programmer Analyst 5 - 137813 Create date: 04-Dec-2024 No of Submissions : 1 Start date : 01/06/2025 End Date : 1 Years from projected start date Submission deadline : 12/11/2024 10:00:00 AM Client Info : LARA Note: * Interviews: Interviews held via MS Teams. Cameras must be ON. * Duration: 1 year with desire for contr.... (This job is for - ASPNet&C JavaScript Jobs in MI Lansing Analyst - (in Lansing, MI)) GA DHS - Boomi Administrator (750879) Create date: 03-Dec-2024 No of Submissions : 2 Start date : 01/06/2025 End Date : 06/30/2025 Submission deadline : 12/09/2024 Client Info : DHS Note: * Agency Interview Type : Either Web Cam or In Person * Remote Description : The Boomi Administrator will work to ensur.... (This job is for - BOOMI Jobs in GA Atlanta Administrator - (in Atlanta, GA)) Technical Writer - 8721768 Create date: 18-Nov-2024 No of Submissions: 1 Start Date: 12/2/2024 End Date: 06/30/2025 Submission Deadline: 11/20/2024 Note: * Candidate Must Be Local * Remote Position * Max Rate for this Position 81.00 Per Hour Description: The IT Technical Writer will be responsible .... (This job is for - SDLC Jobs in CO Denver Consultant - (in Denver, CO))    Bachelor Degree In Computer Science job openings in NC Jobs List NCDIT - NG911 Administrative Specialist (750015) Create date: 28-Oct-2024 No of Submissions : 2 Start date : 11/01/2024 End Date : 06/30/2025 Submission deadline : 10/29/2024 Client Info : NCDIT Note: * Agency Interview Type : Either Webcam Interview or In Person * Onsite Description : The NC911 NMAC Network Monitoring an.... (This job is for - job Jobs in NC Raleigh Specialist - (in Raleigh, NC)) DHHS MS Power Platform Developer -Architect (733790) Create date: 26-Apr-2024 Remote No of Submissions :1 start date :05/01/2024 End date :11/01/2024 submission deadline :05/02/2024 client info : NCDHHS-PMO Description : Job Summary: We are seeking a highly skilled and motivated MS Power Platform.... (This job is for - Dataverse Jobs in NC Raleigh Developer - (in Raleigh, NC)) NCDOT - Technical Specialist- Mid Level (727933) Create date: 06-Feb-2024 Hybrid Start date :02/12/2024 End Date : 02/11/2025 Submission deadline : 02/12/2024 Client Info : NCDOT Description : ------------------------------------------------------ **Requirement is for the candidates remote work location must be in the Raleigh, North Carolina area. Currently.... (This job is for - job Jobs in NC Raleigh Specialist - (in Raleigh, NC)) DHHS MS Power Platform Developer Architect (715012) Create date: 19-Jul-2023 Remote Start date :08/01/2023 End Date :01/31/2024 Submission deadline :07/21/2023 Client Info :NCDHHS-PH Description : ------------------------------------------------------ Job Summary: We are seeking a highly skilled and motivated MS Power Platform Business Analyst to jo.... (This job is for - job Jobs in NC Raleigh Developer - (in Raleigh, NC)) NCDOT - Technical Specialist- Mid Level (710352) Create date: 11-May-2023 Hybrid Start date :06/05/2023 End Date :06/04/2024 Submission deadline :05/16/2023 Client Info :NCDOT Description : **The candidate will be allowed to work remotely until all staff return to site. At that point the candidate will be required to come onsite. *** Contractors who live o.... (This job is for - job Jobs in NC Raleigh Specialist - (in Raleigh, NC)) (Engineer: Bachelor Degree In Computer Science, SQL Programming, Python, Spark Pyspark Scala AWS Teradata Tableau in Durham, NC)

Featured Jobs Budgeting Office Consultant (Jobs in Harrisburg, Pennsylvania) PMP Manager (Jobs in Atlanta, Georgia) Javascript Developer (Jobs in Tucker, Georgia) Architecture - - Specialist (Jobs in Raleigh, North Carolina) Typography Power Consultant (Jobs in Nashville, Tennessee) - Consultant (Jobs in Bismarck, North Dakota) SSIS JAVA Analyst (Jobs in Richmond, Virginia) TSOISPF Specialist (Jobs in Columbus, Ohio) Integration IT Specialist (Jobs in Columbus, Ohio) API CI Developer (Jobs in Richmond, Virginia)