Home       |     Overview      |     Candidate Login      |     Post Resume       |     Contact us
 
  
     
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     
Spark Hive Hadoop ETL AWS Maven Agile Developer
(Jobs in Rockville, MD)
 
Requirement id 91867
Job title Developer
Job location in Rockville, MD
Skills required SQL Database, Spark, Hive, Hadoop ETL AWS Maven Agile
Open Date 01-May-2019
Close Date
Job type Contract
Duration 24 Months
Compensation DOE
Status requirement ---
Job interview type Face to Face interview
   Email Recruiter: coolsoft
Job Description Developer: SQL Database, Spark, Hive, Hadoop ETL AWS Maven Agile

Job Description :

we are looking for a multiple Big Data Developers in Montgomery County, MD!


Location: Rockville, MD

Job: Revamping home page for Centralizing web pages

Title: Big Data Developer


Summary

We are looking for big data developers for an ETL project in an enterprise data platform group. The big data developers will work on ingesting, storing, validating and transforming data in a consumable format for business intelligence teams and data analysts to get deeper business insight from the data.



Job Responsibilities

Understand complex business requirements
Design and develop ETL pipeline for collecting, validating and transforming data according to the specification
Develop unit tests and performance tests
Maintain optimal data pipeline architecture
Design ETL jobs for optimal execution in AWS cloud environment
Reduce processing time and cost of ETL workloads
Participate in peer reviews and design/code review meetings
Provide support for production support operations team
Implement data quality checks.
Identify areas where machine learning can be used to identify data anomalies


Experience & Qualifications

10+ years of experience in programming language Java or Scala
10+ years of experience in ETL projects
3+ years of experience in big data projects
Believes in Scrum/Agile, and has deep experience delivering software when working on teams that use Scrum/Agile methodology
Strong and creative analytical and problem-solving skills

Required Technical Skills & Knowledge


Strong experience in Java or Scala
Strong experience in big data technologies like AWS EMR, Hadoop, Hive, Apache Spark, Apache Hbase, AWS Dynamo DB, AWS Lambda
Must be able to write complex SQL queries
Experience in performance tuning and optimization
Familiar with columnar storage formats ORC, Parquet and various compression techniques
Experience in writing Unix shell scripts
Unit testing using Junit or Scalatest
Git/Maven/Gradle
Code Reviews
Agile



The following skills are a plus


AWS Cloud
BPM/Activiti
Python scripting
 
Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 91867 while calling.
 
Other jobs in MD: Annapolis (1), Baltimore (34), Baltimore Maryland (1), Beltsville (3), Downtown Baltimore (1), Elkridge (1), Frederick (2), Hanover (1), North Baltimore (2), Owings Mills (1), Rockville (1), Sparks (2), Timonium (4), Woodlawn (7),
 
 SQL Database job openings in other states
Jobs List

Programmer 6 - 136923
Create date: 04-Nov-2024
No of Submissions : 1

Start date : 12/02/2024

End Date : 12/01/2025

Submission deadline : 11/14/2024 10:00:00 AM

Client Info : MDOT

Note:

* Interviews: MS Teams video interview with camera ON.

* Duration: 1 year with possible extension

* Position locatio.... (This job is for - GitHub Jobs in MI Lansing Consultant - (in Lansing, MI))

DHHS- SQL Server Administrator (748082)
Create date: 30-Sep-2024
Hybrid

No of Submissions : 1

start date :09/30/2024

End date :03/26/2025

submission deadline : 10/04/2024

client info : NCDHHS-AM

Note:

* Agency Interview Type: Webcam Interview Only

Description :

Due to.... (This job is for - Troubleshooting Jobs in NC Raleigh Administrator - (in Raleigh, NC))

GA DOR - Applications Developer 1 (740631)
Create date: 02-Jul-2024
No of Submissions :2

Start date :7/22/2024

End Date :06/30/2025

Submission deadline :07/15/2024

Client Info :DOR - IT

Description :

*THE TAX CLEARANCE LETTER COMPLIANCE ITEM, IS DUE AT THE TIME OF CANDIDATE SUBMISSION* (pls review the compliance tab on how the candidate can obtain th.... (This job is for - Java Jobs in GA Atlanta Developer - (in Atlanta, GA))

ID - ITD-Software Engineer - (714575)
Create date: 20-Jul-2023
Start date :07/31/2023

End Date :06/30/2024

Submission deadline :07/25/2023

Client Info :Idaho Transportation Department - Department of Motor Vehicles

Description :
------------------------------------------------------
IMPORTANT NOTES ABOUT THIS POSITION:

1 - FULLY ONSITE POSITION .... (This job is for - job Jobs in ID Boise Engineer - (in Boise, ID))

DHHS- SQL Server Administrator (705912)
Create date: 14-Mar-2023
Hybrid

Start date :03/20/2023

End Date :03/19/2024

Submission deadline :03/17/2023

Client Info :NCDHHS-AM

Description :
------------------------------------------------------
Due to the growth of SQL Server usage in ITD, NC DHHS is in need of a SQL Server Administrator to provide supp.... (This job is for - Sql Server 2000SSIS Jobs in NC Raleigh Administrator - (in Raleigh, NC))
 
 SQL Database job openings in MD
Jobs List

MySQL Database Administrator - 30717
Create date: 04-Jan-2018
Client Info : 3M - Silver Spring

Candidates RTR form should be only on the name of APEX Systems

We should submit only GC,GC - EAD, L2-EAD,H4-EAD and Citizens


Job Description :

Role: MySQL Database Administrator

Location: Silver Spring, MD

Overview: Apex Systems, the nations s.... (This job is for - DBA Jobs in MD SilverSpring Administrator - (in SILVER SPRING, MD))

SQL Data Analyst - J-10-995-109
Create date: 29-Apr-2015
The Analyst, Financial and Quantitative Analytics will participate in the development, implementation and dissemination of new and/or existing management reporting projects related to Healthcare utilization, cost, and risk adjustment for Inovalons Risk Adjustment products and services. The Analyst will support health data analysis initiatives throu.... (This job is for - MS OfficeT SQL Jobs in MD BOWIE Analyst - (in Bowie, MD))
(Developer: SQL Database, Spark, Hive, Hadoop ETL AWS Maven Agile in Rockville, MD)
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     

    About Us     Services    Privacy policy    Legal     Contact us