Hadoop Hive ETL Big Data UnixLinux Shell Script Visio Excel Bachelors Degree Develop   Requirement id 118694 Job title Developer Job location in Columbus, OH Skills required SQL Database, Hadoop, Hive, ETL Big Data UnixLinux Shell Script Visi Open Date 20-Aug-2021 Close Date Job type Contract Duration 10 Months Compensation DOE Status requirement --- Job interview type ---    Email Recruiter: coolsoft Job Description Developer: SQL Database, Hadoop, Hive, ETL Big Data UnixLinux Shell Script Visi Description: Our Client in Columbus, Ohio is seeking an experienced Data Warehouse Designer / Developer for a contract role CANDIDATES MUST BE LOCAL TO CENTRAL OHIO OR RELOCATED BY DAY ONE FOR CONSIDERATION The Data Warehouse Designer/Developer will be responsible for Enterprise data warehouse design, development, implementation, migration, maintenance and operation activities. Candidate will work closely with the Data Governance and Analytics team. Candidate will be one of the key technical resources for data warehouse projects for various Enterprise data warehouse projects and building critical data marts, data ingestion to Big Data platform for data analytics and exchange with State and Medicaid partners. This position is a member of Department ITS and works closely with the Business Intelligence & Data Analytics team. Day-To-Day Job Duties to be performed: • Participate in Team activities, Design discussions, Stand up meetings and planning Review with team. • Perform data analysis, data profiling, data quality and data ingestion in various layers using big data/Hadoop/Hive/Impala queries, PySpark programs and UNIX shell scripts. • Follow the organization coding standard document, Create mappings, sessions and workflows as per the mapping specification document. • Perform Gap and impact analysis of ETL and IOP jobs for the new requirement and enhancements. • Create jobs in Hadoop using SQOOP, PYSPARK and Stream Sets to meet the business user needs. • Create mockup data, perform Unit testing and capture the result sets against the jobs developed in lower environment. • Updating the production support Run book, Control M schedule document as per the production release. • Create and update design documents, provide detail description about workflows after every production release. • Continuously monitor the production data loads, fix the issues, update the tracker document with the issues, Identify the performance issues. • Performance tuning long running ETL/ELT jobs by creating partitions, enabling full load and other standard approaches. • Perform Quality assurance check, Reconciliation post data loads and communicate to vendor for receiving fixed data. • Participate in ETL/ELT code review and design re-usable frameworks. • Create Remedy/Service Now tickets to fix production issues, create Support Requests to deploy Database, Hadoop, Hive, Impala, UNIX, ETL/ELT and SAS code to UAT environment. • Create Remedy/Service Now tickets and/or incidents to trigger Control M jobs for FTP and ETL/ELT jobs on ADHOC, daily, weekly, Monthly and quarterly basis as needed. • Model and create STAGE / ODS / Data warehouse Hive and Impala tables as and when needed. • Create Change requests, workplan, Test results, BCAB checklist documents for the code deployment to production environment and perform the code validation post deployment. • Work with Hadoop Admin, ETL and SAS admin teams for code deployments and health checks. • Create re-usable UNIX shell scripts for file archival, file validations and Hadoop workflow looping. • Create re-usable framework for Audit Balance Control to capture Reconciliation, mapping parameters and variables, serves as single point of reference for workflows. • Create PySpark programs to ingest historical and incremental data. • Create SQOOP scripts to ingest historical data from EDW oracle database to Hadoop IOP, created HIVE tables and Impala views creation scripts for Dimension tables. • Participate in meetings to continuously upgrade the functional and technical expertise. REQUIRED Skill Sets: • 8+ years of experience with Big Data, Hadoop on Data Warehousing or Data Integration projects. • Anal   Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 118694 while calling.   Other jobs in OH: Cincinnati (1), Cleveland (1), Columbus (233), Dublin (8), Solon (2), SQL Database job openings in Columbus, OH Jobs List Business Analyst (IT) III Senior - 20221201014206 Create date: 01-Dec-2022 start date:12/19/2022 End date:3+months from start date submission deadline:12/8/2022 Note: * On-Site Position Description: Description: Must Have R or Python SQL Nice To Have ADO job Jobs in OH Columbus Analyst - (in Columbus, OH)) Business Analyst (IT) III (Senior) - 20221201013612 Create date: 01-Dec-2022 start date:12/19/2022 End date: 3+months from start date submission deadline:12/8/2022 Note: * Job Site: Remote Description: Must Have: 3+ years of experience with relational databases/SQL Snowflake Tableau Snowflake Jobs in OH Columbus Analyst - (in Columbus, OH)) ETL Developer - 46031 Create date: 15-Apr-2019 Job Description : we are looking for a ETL Developer in Columbus, Ohio. Responsibilities: Responsible for defining, storing, managing and provisioning the data structures required to support the enterprise with consumption through various Business Intelligence platforms in a fast-paced and fluid environment. Teradata Snowflake Jobs in OH Columbus Developer - (in Columbus, OH)) Informatica Developer - 10018 Create date: 14-May-2018 Client Info : Nationwide Insurance Informatica Developer contractor with the following skill set: Required: Informatica PowerCenter (3+ Years) Database SQL (3+ Years) GIT Nice to Have: ESP (Scheduling Tool) UNIX (Shell Scripting) Reporting Tool (BO,.... (This job is for - GIT Jobs in OH Columbus Developer - (in Columbus, OH))    SQL Database job openings in other states Jobs List NCDOT - AASHTOWare Project Technical Specialist (751135) Create date: 20-Nov-2024 No of Submissions: 2 Start Date: 12/2/2024 End Date: 12/17/2025 Submission deadline: 11/26/2024 Client info: NCDOT Note: * Remote work from home * Either Webcam Interview or In Person * The candidate will need to use their own equipment from home to remote into.... (This job is for - job Jobs in NC Raleigh Specialist - (in Raleigh, NC)) GA DOR - Applications Developer 1 (751588) Create date: 20-Nov-2024 Onsite No of Submissions : 2 Start date : 12/16/2024 End Date : 06/30/2025 Submission deadline : 12/02/2024 Client Info : DOR - IT Note: * Agency Interview Type: In Person Only Description : *THE TAX CLEARANCE LETTER COMPLIANCE ITEM, IS DUE AT THE TIM.... (This job is for - Analytical Skills Jobs in GA Atlanta Developer - (in Atlanta, GA)) Programmer 6 - 136923 Create date: 04-Nov-2024 No of Submissions : 1 Start date : 12/02/2024 End Date : 12/01/2025 Submission deadline : 11/14/2024 10:00:00 AM Client Info : MDOT Note: * Interviews: MS Teams video interview with camera ON. * Duration: 1 year with possible extension * Position locatio.... (This job is for - GitHub Jobs in MI Lansing Consultant - (in Lansing, MI)) DHHS- SQL Server Administrator (748082) Create date: 30-Sep-2024 Hybrid No of Submissions : 1 start date :09/30/2024 End date :03/26/2025 submission deadline : 10/04/2024 client info : NCDHHS-AM Note: * Agency Interview Type: Webcam Interview Only Description : Due to.... (This job is for - Troubleshooting Jobs in NC Raleigh Administrator - (in Raleigh, NC)) GA DOR - Applications Developer 1 (740631) Create date: 02-Jul-2024 No of Submissions :2 Start date :7/22/2024 End Date :06/30/2025 Submission deadline :07/15/2024 Client Info :DOR - IT Description : *THE TAX CLEARANCE LETTER COMPLIANCE ITEM, IS DUE AT THE TIME OF CANDIDATE SUBMISSION* (pls review the compliance tab on how the candidate can obtain th.... (This job is for - Java Jobs in GA Atlanta Developer - (in Atlanta, GA))    SQL Database job openings in OH Jobs List Mid-Level Data Engineer - J-11-456-636 Create date: 03-Dec-2019 Description: Data Engineer to work with a marketing team to do a gap analysis of their current data / reporting and EDW environment, including working with marketing to understand their data needs, including existing EDW and new requirements Must Haves ETL experience (data stage preferred, informatica ok as.... (This job is for - job Jobs in OH Dublin Engineer - (in Dublin, OH)) Back-End Java Developer - 52753 Create date: 16-Sep-2019 Candidate must be our W2 Employee Description : Essential Job Functions: Design, code and u? nit test web services and/or web applications with an eye ? towards simplicity, reliability, scalability, extensibility, p? erformance and re-use Familiar with some ? software design patterns and software engin.... (This job is for - SSIS Jobs in OH BlueAsh Developer - (in BLUE ASH, OH)) Cognos Developer - Mid Level - J-11-432-727 Create date: 12-Aug-2019 Description: Mid-level Cognos Developer, contract to hire or long term contract. This position will be joining an existing Agile team made up of experienced developers. Therefore, a slightly junior to mid-level resource would be acceptable. Career-Level position within field. Considered highly skilled and proficien.... (This job is for - job Jobs in OH Gahanna Developer - (in Gahanna, OH)) Cognos Developer Mid Level - J-11-423-092 Create date: 08-Jul-2019 *Note: Experience: Typically 8-12 years IT Software Developer experience. Technical knowledge usually acquired from an educational institution or through equivalent work experience. Description: Mid-level Cognos Developer, contract to hire or long term contract. This position will be joining an existin.... (This job is for - job Jobs in OH Gahanna Developer - (in Gahanna, OH)) PC SAS Developer With ETL/BI Experience - J-11-412-119 Create date: 06-Jun-2019 start date:6/12/2019 End date:12/06/2019 submission deadline:6/10/2019 Description: Ideal Candidate will have: - Experience gathering report requirements from various resources, so superior communication skills are a must. - Will have experience pulling data.... (This job is for - SSIS Jobs in OH PepperPike Developer - (in Pepper Pike, OH)) (Developer: SQL Database, Hadoop, Hive, ETL Big Data UnixLinux Shell Script Visi in Columbus, OH)

Featured Jobs Budgeting Office Consultant (Jobs in Harrisburg, Pennsylvania) PMP Manager (Jobs in Atlanta, Georgia) Javascript Developer (Jobs in Tucker, Georgia) Architecture - - Specialist (Jobs in Raleigh, North Carolina) Typography Power Consultant (Jobs in Nashville, Tennessee) - Consultant (Jobs in Bismarck, North Dakota) SSIS JAVA Analyst (Jobs in Richmond, Virginia) TSOISPF Specialist (Jobs in Columbus, Ohio) Integration IT Specialist (Jobs in Columbus, Ohio) API CI Developer (Jobs in Richmond, Virginia)