SterlingVARecruiter Since 2001
the smart solution for Sterling jobs

Senior Data Engineer

Company: The Silicon Partners Inc.
Location: Sterling
Posted on: October 20, 2020

Job Description:

Position Title Senior Data Engineer Division Global Technology Operations Location Sterling, VA Duration Long term contract Department Global Data Analytics Reports to Sr. Manager Data Engineering Interview Video Must have Scala, Spark , AWS EMR,Redshift,EC2, S3 Role The Data Engineer should be a technical contributor who has hands-on knowledge of all phases in building large-scale cloud based distributed data processing systems and applications. You will be part of the Global Data Analytics engineering technology team and will partner closely with a team of data scientists, business analysts data engineers leading Discovery s cloud based Big Data Analytics strategy.You ll work on implementing complex AWS based big data projects with a focus on collecting, parsing, managing, analyzing and visualizing large sets of data to turn information into insights using multiple technology platforms. Therefore, this role requires an understanding of how a secure big data cloud environment is architected to gain real insights faster, with less friction and complexity. The data engineer should be passionate about working with cutting edge technologies in solving problems and developing prototypes using different open source tools for the selected solutions.You ll need to be an innovative forward-thinker who will help lead end-to-end execution of data engineering initiatives and contribute directly to existing and emerging business strategies and goals. Creativity, Attention to detail and ability to work in a collaborative team environment are essential.The Data Engineer will work closely with the Data Engineering Director to decide on needed infrastructure architecture and software design needs and act according to the decisions. Key Areas of Responsibility Lead the design, implementation, and continuous delivery of pipelines using distributed AWS based big data technologies supporting data processing initiatives across batch and streaming datasets Responsible for development using Scala, Python languages and Big Data Frameworks such as Spark, EMR, Presto, AWS Athena, Kafka, Zepplin, and Kinesis Provide administrative support on deployed AWS platform components Identify, evaluate and implement cutting edge big data pipelines and frameworks required to provide requested capabilities to integrate external data sources and APIs Review, analyses and evaluate market requirements, business requirements and project briefs in order to design the most appropriate end-to-end technology solutions Process and manage high-volume real-time customer interaction streams Provide architectural support by building Proof of Concepts Prototypes Self-Starter to deliver data engineering solutions to optimize both the cost and existing solution Stay current with emerging technologies and industry trends Required Qualifications Bachelor's Degree or higher in Computer Sciences or similar Minimum of 5-6 years Software Industry experience 3 years of development experience with AWS services Must have EC2, EMR , RedShift, Data Pipeline,S3, Cloud Formation and Jenkins 3 years of development experience with Apache Spark, Presto, SQL, notebook and NoSQL Implementation 4 years of extensive working knowledge in different programming Scala ,Shell and Python. Proficiency working with structured, semi-structured and unstructured data sets including social, web logs and real time streaming data feeds Able to tune Big Data solutions to improve performance and end-user experience Knowledge on Visualization and Data Science Tools. Expert level usage with Jenkins, GitHub is preferred Spark developer certification is a plus Ability and eagerness to constantly learn and teach others Experience in the media industry is a plus

Keywords: The Silicon Partners Inc., Sterling , Senior Data Engineer, Engineering , Sterling, Virginia

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Machine Learning Computer Vision Engineer, Senior
Description: Are you excited at the prospect of unlocking the secrets held by a data set Are you fascinated by the possibilities presented by the IoT, machine learning, and artificial intelligence advances In an (more...)
Company: Booz Allen Hamilton
Location: Laurel
Posted on: 10/21/2020

Tire Technician (Outside/Inside)
Description: Description: Tire Business names Service Tire Truck Centers as one of the best Tire Companies to work for in the United States in 2019. STTC offers an excellent benefit package, very competitive pay, (more...)
Company: Service Tire Truck Center Inc.
Location: Lancaster
Posted on: 10/21/2020

Principal Network Engineer
Description: The Network Engineer will be working on cutting edge network design and operations. This position will support various customers within Health Solutions. This is an excellent opportunity to learn, grow, (more...)
Company: Mansai Corporation
Location: Gwynn Oak
Posted on: 10/20/2020


Sr ServiceNow Engineer
Description: Description This position is 100 Remote SAIC is currently looking to hire a Sr. ServiceNOW Engineer to support our DC metro team via telework. Duties and Responsibilities Provides technical engineering (more...)
Company: SAIC
Location: Reston
Posted on: 10/21/2020

Tech/Engineering Manager
Description: ROLE Technical Engineering Manager LOCATION Rockville, MD OVERVIEW Apex Systems has an immediate opening for a Technical Engineering Manager with a client located in Rockville, MD. The position will require (more...)
Company: Apex Systems
Location: Rockville
Posted on: 10/21/2020

Sr Engineer (BGE New Business and C&I)
Description: Description -At Exelon, we've got a place for you Join the nation's leading competitive energy provider, with one of the largest electricity generation portfolios and retail customer bases in the country. (more...)
Company: Exelon Corporation
Location: Baltimore
Posted on: 10/20/2020

ATM DevOps Engineer
Description: 1750 Tysons 12023 , United States of America, McLean, VirginiaATM DevOps EngineerThe ideal candidate will be able to jump right into a DevOps role in the Capital One ATM Kiosk space. Looking for a person (more...)
Company: Capital One
Location: Glenn Dale
Posted on: 10/20/2020

Lead iOS Engineer
Description: Towers Crescent 12066 , United States of America, Vienna, VirginiaLead iOS EngineerDo you want to work for a tech company that writes its own code, develops its own software, and builds its own products (more...)
Company: Capital One
Location: Brinklow
Posted on: 10/20/2020

Mac Tools Seeking Mechanics - Technicians - Training Provided
Description: Build a Great Career and a Quality Life with Mac Tools. br br Feel the freedom and independence of working on your own, in a stress free environment - with no one to answer to, except yourself Join (more...)
Company: Mac Tools
Location: Arnold
Posted on: 10/20/2020

Auto Mechanic
Description: 7118 - Laurel - 8800 Freestate Dr, Laurel, Maryland, 20723 CarMax, the way your career should be General Summary: Under general supervision, the State Inspection Technician performs State vehicle safety (more...)
Company: CarMax
Location: Laurel
Posted on: 10/20/2020

Log In or Create An Account

Get the latest Virginia jobs by following @recnetVA on Twitter!

Sterling RSS job feeds