Spark ELT Python Development SQL Microsoft CICD Pipelines Data Engineering Written A   Requirement id 138686 Job title Engineer Job location in Milwaukee, WI Skills required Azure Data Factory, Spark, ELT, Python Development SQL Microsoft CICD Pi Open Date 23-Jan-2023 Close Date Job type Contract Duration 6 Months Compensation DOE Status requirement --- Job interview type ---    Email Recruiter: coolsoft Job Description Engineer: Azure Data Factory, Spark, ELT, Python Development SQL Microsoft CICD Pi start date : 02/27/2023 End date : 6 Months from projected start date submission deadline : January 30th, at 4:00PM CST. client info : Milwaukee County Note : * Interview Process: Microsoft Teams 60 minutes. One round * Duration of the Contract: 6 month contract. * Onsite or Remote? 100% Remote Description : • Implement technologies that supports the data strategy (30%) - Develop, implement the Data Lake/Lakehouse architecture while providing guidance on best practices. • Define and implement data pipelines that enable analytics and operational dashboards (30%) - Design and develop high quality batch and real time data pipelines at a senior level. • Define and Implement Data Engineering standards and best practices that improve quality and efficiency (20%) - Define and promote data engineer standards, best practices, and design patterns. • Define and Implement Data Engineering workflows that improve quality and reduce the time to release new features (10%) - Design and implement CI/CD workflows and pipelines. • Ensure the team can support ongoing development and operations of new technology (10%) - Mentor other members of the team in new technology and skills. Experience/Skills Needed: • Azure Data Factory • Spark Notebook • Creating ELT Pipelines in Azure Synapse Analytics and Data Bricks • Languages including Python, SQL • Lakehouse Architecture using medallion design (bronze, silver, gold) • CICD pipelines in Azure • Implementing an environment from ground up • Setting best practices for data engineering • Mentorship of team of data engineers • Clear and proactive communication - verbal/written • Taking initiative and working autonomously with some direction • Addressing data quality and profiling   Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 138686 while calling.   Other jobs in WI: De Pere (2), Green Bay (8), Kenosha (2), Madidson (1), Madison (36), Menomonee Falls (19), Milwaukee (59), Sun Prarie (1), Unknown (2), Waukesha (2),    Azure Data Factory job openings in other states Jobs List Chesterfield County Data Warehouse Architect 4 (743061) Create date: 24-Jul-2024 Hybrid No of Submissions : 3 start date :08/05/2024 End date :07/31/2025 submission deadline : 7/29/2024 client info : Chesterfield County Note: * Agency Interview Type: Both Web Cam and In Person Interview Descript.... (This job is for - job Jobs in VA Chesterfield Architect - (in Chesterfield, VA)) NCDEQ - Data Project Manager (740337) Create date: 24-Jun-2024 * Remote No of Submissions : 2 Start date :06/17/2024 End Date :06/15/2025 Submission deadline :06/28/2024 Client Info :NCDEQ-ITS Note: * Either Webcam Interview or In Person * Equipment can be shipped to the candidate. Description : Curre.... (This job is for - SSIS Jobs in NC Raleigh Manager - (in Raleigh, NC)) NCDEQ - Data Analyst /Architect-Xpert (740356) Create date: 24-Jun-2024 * Remote No of Submissions : 2 Start date :06/24/2024 End Date :06/24/2025 Submission deadline :06/28/2024 Client Info :NCDEQ-ITS Note: * Either Webcam Interview or In Person * Equipment can be shipped to the candidate. Description : Curren.... (This job is for - SSIS Technology Jobs in NC Raleigh Architect - (in Raleigh, NC)) Chesterfield County Data Warehouse Architect 4 (735517) Create date: 02-May-2024 Hybrid No of Submissions : 3 start date :05/20/2024 End date :10/14/2025 submission deadline :5/7/2024 client info :Chesterfield County Description : *Local Richmond area candidates or those willing to relocate to the Richmo.... (This job is for - Hipaa Jobs in VA Chesterfield Architect - (in Chesterfield, VA)) Chesterfield County Data Warehouse Architect 4 (730461) Create date: 29-Feb-2024 Hybrid Start date :03/18/2024 End Date : 10/14/2025 Submission deadline : 3/5/2024 Client Info : Chesterfield County Description : ------------------------------------------------------ *Local Richmond area candidates or those willing to relocate to the Richmond area during this engag.... (This job is for - SSIS Sql Server 2000 Jobs in VA Chesterfield Architect - (in Chesterfield, VA))     (Engineer: Azure Data Factory, Spark, ELT, Python Development SQL Microsoft CICD Pi in Milwaukee, WI)

Featured Jobs Budgeting Office Consultant (Jobs in Harrisburg, Pennsylvania) PMP Manager (Jobs in Atlanta, Georgia) Javascript Developer (Jobs in Tucker, Georgia) Architecture - - Specialist (Jobs in Raleigh, North Carolina) Typography Power Consultant (Jobs in Nashville, Tennessee) - Consultant (Jobs in Bismarck, North Dakota) SSIS JAVA Analyst (Jobs in Richmond, Virginia) TSOISPF Specialist (Jobs in Columbus, Ohio) Integration IT Specialist (Jobs in Columbus, Ohio) API CI Developer (Jobs in Richmond, Virginia)