SterlingVARecruiter
the smart solution for Sterling jobs

Senior Data Engineer

Company: The Silicon Partners Inc.
Location: Sterling
Posted on: May 17, 2019

Job Description:

Position Title Senior Data Engineer Location Sterling , VA Duration FTE Key Areas of Responsibility Lead the design, implementation, and continuous delivery of pipelines using distributed AWS based big data technologies supporting data processing initiatives across batch and streaming datasets Responsible for development using Scala , Python languages and Big Data Frameworks such as Spark, EMR, Presto, AWS Athena, Kafka, Zepplin , and Kinesis Provide administrative support on deployed AWS platform components Identify, evaluate and implement cutting edge big data pipelines and frameworks required to provide requested capabilities to integrate external data sources and APIs Review, analyse and evaluate market requirements, business requirements and project briefs in order to design the most appropriate end-to-end technology solutions Process and manage high volume real time customer interaction streams Provide architectural support by building Proof of Concepts Prototypes Self-Starter to deliver data engineering solutions to optimize both the cost and existing solution Stay current with emerging technologies and industry trends Required Qualifications Bachelor's Degree or higher in Computer Sciences or similar Minimum of 5-6 years Software Industry experience 3 years of development experience with AWS services Must have EC2, EMR, RedShift, Data Pipeline or Airflow, S3, Cloud Formation and CLI (must to have) and Jenkins 3 years of development experience with Apache Spark, Presto, SQL, notebook and NoSQL Implementation 4 years of extensive working knowledge in different programming Scala (Must), Shell and Python (Must). Proficiency working with structured, semi-structured and unstructured data sets including social, web logs and real time streaming data feeds Able to tune Big Data solutions to improve performance and end-user experience Knowledge on Visualization and Data Science Tools. Expert level usage with Jenkins, GitHub is preferred Spark developer certification is a plus Ability and eagerness to constantly learn and teach others Experience in the media industry is a plus

Keywords: The Silicon Partners Inc., Sterling , Senior Data Engineer, Engineering , Sterling, Virginia

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Principal QA Engineer, CNO with Security Clearance
Description: Secure our Nation, Ignite your Future Become an integral part of a diverse team that leads the world in the Mission, Cyber, and Intelligence Solutions MCIS group. At ManTech International Corporation, (more...)
Company: ManTech International
Location: Vienna
Posted on: 05/27/2019

RF Engineer (Spectrum Management)
Description: Overview Peraton is seeking a Spectrum Management Engineer in Greenbelt, MD or Houston, TX to support the Space Communication Network Services contract SCNS . This position provides support to the NASA (more...)
Company: Peraton
Location: Greenbelt
Posted on: 05/27/2019

Diesel Truck Technician - Excellent Benefits!
Description: Join Employer as Truck Technician Servicing--Loudoun County Fire br Multiple Shifts Available 12:00pm - 8:30pm and 2:30pm - 11:00pm br Employer is proud to offer: br ul br li 24- 35 hourly (more...)
Company: First Vehicle Services
Location: Dunn Loring
Posted on: 05/27/2019


Research Scientist/Engineer-Modeling and Simulation
Description: Experienced Scientist or Engineer to support development of mass transport models to include the design, analysis, and implementation of the laboratory techniques proposed for addressing model development (more...)
Company: DCS Corp
Location: Abingdon
Posted on: 05/27/2019

Integration and Test Engineer
Description: Fairfax,Virginia,United States 6K8CP3The Boeing Company is currently seeking an Integration and Test Engineer to join its Fairfax, Virginia location. Responsibilities for this position may include: ul (more...)
Company: Boeing
Location: Fairfax
Posted on: 05/27/2019

Financial Engineering Professional - Investments & Capital Markets
Description: Are you looking for development beyond the ordinary A place full of interesting challenges and the engineers up to solving them Then welcome to Financial Engineering. This is the place where the models (more...)
Company: Freddie Mac
Location: Mc Lean
Posted on: 05/27/2019

ASE & EVT Bonus Pay - Diesel Truck Mechanic
Description: Join First Vehicle Services as Truck Technician Servicing Loudoun County Fire Multiple Shifts Available 12:00pm - 8:30pm and 2:30pm - 11:00pm First Vehicle Services is proud to offer: ul li 24- (more...)
Company: First Vehicle Services
Location: Oakton
Posted on: 05/27/2019

Sign on Bonus - Diesel Truck Mechanic
Description: Join Employer as Truck Technician Servicing--Loudoun County Fire br Multiple Shifts Available 12:00pm - 8:30pm and 2:30pm - 11:00pm br Employer is proud to offer: br ul br li 24- 35 hourly (more...)
Company: First Vehicle Services
Location: Fairfax
Posted on: 05/27/2019

FISMA Technical Writer/Expert
Description: MSC is searching for a Senior Software Developer to join our Bioinformatics team at NIH. This opportunity is a 6 month position with MSC and it is on-site at the NIH in Rockville, MD. The FISMA Technical (more...)
Company: Medical Science & Computing (MSC)
Location: Bethesda
Posted on: 05/27/2019

Diesel Truck Technician
Description: Join First Vehicle Services as Truck Technician Servicing--Loudoun County Fire Multiple Shifts Available 12:00pm - 8:30pm and 2:30pm - 11:00pm First Vehicle Services is proud to offer: 24- 35 hourly (more...)
Company: First Vehicle Services
Location: Dunn Loring
Posted on: 05/27/2019

Log In or Create An Account

Get the latest Virginia jobs by following @recnetVA on Twitter!

Sterling RSS job feeds