GIT CI/CD Pyspark Engineer (Jobs in Boston, MA)   Requirement id 113711 Job title Engineer Job location in Boston, MA Skills required GIT, CI/CD, Azure DevOps, Pyspark Open Date 04-Feb-2021 Close Date Job type Contract Duration 6 Months Compensation DOE Status requirement --- Job interview type ---    Email Recruiter: coolsoft Job Description Engineer: GIT, CI/CD, Azure DevOps, Pyspark Note: 100% Remote (working EST hours, EST preferred) Candidate must be our W2 Employee. Job Description: Responsibility: Implement scaleable and sustainable data engineering solutions using Azure Databricks, PySpark and PySQL. The data pipelines must be created, maintained, and optimized as workloads move from development to production for specified use cases. Identify appropriate (and innovative) data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements. Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained. Working within an Agile delivery / DevOps methodology Competency: Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks). Strong ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, metadata, and workload management. The ability to work with IT in integrating analytics and data science output into business processes and workflows. Deep hands-on development expertise in data architecture, batch, and real-time data integration, Azure Databricks, Apache Spark, relational databases (SQL Server). Must be team oriented with strong collaboration, prioritization, and adaptability skills required. Experience with Apache Kafka. Required Skills/Technologies Bachelors degree in Computer Science, Information Systems, Business Administration, or other related field. Minimum of 10 years IT experience encompassing the following Azure Databricks o Delta o Scala / Pyspark / Spark SQL o PySQL (or SQL Plus) o Azure DevOps o Git for CI/DC o Azure Data Factory o Azure SQL Database o Azure Data Lake experience o Some Data Science exposure just from an analysis perspective   Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 113711 while calling.   Other jobs in MA: Boston (103), Burlington (1), Cambridge (1), Canton (3), Chelsea (9), Franklin (1), Lexington (2), Malden (10), Marlborough (2), Maynard (2), Newton (1), Quincy (6), Sharon (1), Waltham (1), Welesley (1), Wellesley (6), Westborough (1), Westbourough (1),    GIT job openings in other states Jobs List NCDOT - Specialist- Expert (737022) Create date: 21-May-2024 Hybrid No of Submissions : 2 start date :06/29/2024 End date :06/28/2025 submission deadline : 05/22/2024 client info : NCDOT Description : ***The candidate will be allowed to work remotely until all staff return to site. At t.... (This job is for - GIT Jobs in NC Raleigh Specialist - (in Raleigh, NC)) NC FAST Senior Automation Engineer (734136) Create date: 26-Apr-2024 No of Submissions : 1 Start date : 05/06/2024 End date : 05/02/2025 Submission deadline : 05/02/2024 Client info : NCDHHS-NCFAST Note : * Hybrid Description : The primary role is to lead Automation effort of infrast.... (This job is for - GITAutomation Jobs in NC Raleigh Engineer - (in Raleigh, NC)) Applications Developer Lead - SME Level - 128505 Create date: 21-Mar-2024 Start date : 4/22/2024 End date : 09/30/2024 Submission deadline : 3/28/2024 3:00:00 PM Client info : MDEK12 Note : * 100% remote Description : The Mississippi Department of Education is seeking an Application Developer to.... (This job is for - GIT Azure Jobs in MS Jackson Developer - (in Jackson, MS)) Programmer Analyst 5 -124523 Create date: 14-Nov-2023 Start date : 01/01/2024 End date : At least 1984 Hours from projected start date Submission deadline : 11/20 at 10AM EST. Client info : eMichigan Note: * Interviews: MS Teams video interview with camera ON. * Duration: 1 year with potential contract to hire * Positio.... (This job is for - JavaScript GIT HTML Jobs in MI Lansing Analyst - (in Lansing, MI)) GTRI Full Stack Developer Sr. (716425) Create date: 01-Aug-2023 Start date :8/28/2023 End Date : 6/30/2024 Submission deadline :08/02/2023 Client Info : Georgia Tech - OIT Note: Remote Description : ------------------------------------------------------ Candidate must be a US CITIZEN to be considered for this position. Georgia Tech Rese.... (This job is for - GIT Jobs in GA Atlanta Developer - (in Atlanta, GA))    GIT job openings in MA Jobs List Technical Lead III-US - 73551 Create date: 31-Mar-2021 Note: no subvending long term contract, fully remote candidates can sit anywhere in the us as long as they can work on EST. Candidate must be our W2 Employee. Job Description: Position: Azure Technical Lead Location: Remote Duration: 1+ year Position Description: Our IT Cl.... (This job is for - GIT PowerShell Jobs in MA Waltham TechLead - (in Waltham, MA)) Release Engineer - 38156 Create date: 04-Sep-2018 Job Description : Position Description: It is looking for a DevOps Engineer to help support product engineering by: Providing technical guidance and leadership in the construction of a new build environment to host a large system composed of many subsystems including a Linux based distribution, open source packa.... (This job is for - GIT Jobs in MA Lowell Engineer - (in LOWELL, MA)) (Engineer: GIT, CI/CD, Azure DevOps, Pyspark in Boston, MA)

Featured Jobs Troubleshooting Engineer (Jobs in Des Moines, Iowa) Application Developer (Jobs in Richmond, Virginia) Business Analyst Business Analyst (Jobs in Richmond, Virginia) Consultant (Jobs in Murfreesboro, Tennessee) TFS Automation Analyst (Jobs in Dimondale, Michigan) Cloud Architect (Jobs in Lansing, Michigan) GitHub Consultant (Jobs in Lansing, Michigan) IT Developer (Jobs in Atlanta, Georgia) Microsoft Consultant (Jobs in ANDERSON, South Carolina) Business Analyst JAD SQL Analyst (Jobs in Lansing, Michigan)