SterlingVARecruiter Since 2001
the smart solution for Sterling jobs

Senior Data Engineer

Company: The Silicon Partners Inc.
Location: Sterling
Posted on: June 10, 2019

Job Description:

Position Title Senior Data Engineer Division Global Technology Operations Location Sterling, VA Duration 8-12 Months Department Global Data Analytics Reports to Sr. Manager Data Engineering Must have Scala, Spark, AWS EMR, AWS Airflow Role The Data Engineer should be a technical contributor who has hands-on knowledge of all phases in building large-scale cloud based distributed data processing systems and applications. You will be part of the Global Data Analytics engineering technology team and will partner closely with a team of data scientists, business analysts data engineers leading Discovery s cloud based Big Data Analytics strategy. You ll work on implementing complex AWS based big data projects with a focus on collecting, parsing, managing, analyzing and visualizing large sets of data to turn information into insights using multiple technology platforms. Therefore, this role requires an understanding of how a secure big data cloud environment is architected to gain real insights faster, with less friction and complexity. The data engineer should be passionate about working with cutting edge technologies in solving problems and developing prototypes using different open source tools for the selected solutions. You ll need to be an innovative forward-thinker who will help lead end-to-end execution of data engineering initiatives and contribute directly to existing and emerging business strategies and goals. Creativity, Attention to detail and ability to work in a collaborative team environment are essential. The Data Engineer will work closely with the Data Engineering Director to decide on needed infrastructure architecture and software design needs and act according to the decisions. Key Areas of Responsibility Lead the design, implementation, and continuous delivery of pipelines using distributed AWS based big data technologies supporting data processing initiatives across batch and streaming datasets Responsible for development using Scala, Python languages and Big Data Frameworks such as Spark, EMR, Presto, AWS Athena, Kafka, Zepplin, and Kinesis Provide administrative support on deployed AWS platform components Identify, evaluate and implement cutting edge big data pipelines and frameworks required to provide requested capabilities to integrate external data sources and APIs Review, analyses and evaluate market requirements, business requirements and project briefs in order to design the most appropriate end-to-end technology solutions Process and manage high-volume real-time customer interaction streams Provide architectural support by building Proof of Concepts Prototypes Self-Starter to deliver data engineering solutions to optimize both the cost and existing solution Stay current with emerging technologies and industry trends Required Qualifications Bachelor's Degree or higher in Computer Sciences or similar Minimum of 5-6 years Software Industry experience 3 years of development experience with AWS services Must have EC2, EMR , RedShift, Data Pipeline,S3, Cloud Formation and Jenkins Experience with Apache Airflow is required. 3 years of development experience with Apache Spark, Presto, SQL, notebook and NoSQL Implementation 4 years of extensive working knowledge in different programming Scala ,Shell and Python. Proficiency working with structured, semi-structured and unstructured data sets including social, web logs and real time streaming data feeds Able to tune Big Data solutions to improve performance and end-user experience Knowledge on Visualization and Data Science Tools. Expert level usage with Jenkins, GitHub is preferred Spark developer certification is a plus Ability and eagerness to constantly learn and teach others Experience in the media industry is a plus

Keywords: The Silicon Partners Inc., Sterling , Senior Data Engineer, Other , Sterling, Virginia

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Other Jobs


SIGINT/GIS- TS/SCI w/ Polygraph
Description: Job Description: br br The Intelligence Group at Leidos is currently seeking an All-Source Targeter/Analyst for an Intelligence Community customer. The successful candidate will work as a member (more...)
Company: Leidos
Location: Chantilly
Posted on: 06/27/2019

Solutions Architect / Systems Engineer - TS/SCI w/ Poly Required
Description: Job Description: br br Seeking a Systems Engineer. The candidate will assist the PMO with administrative tasks, help with developing innovative concepts and solutions across the program, and work (more...)
Company: Leidos
Location: Chantilly
Posted on: 06/27/2019

Sr RF Systems Engineer - TS/SCI w/ Poly Required
Description: Job Description: br br Seeking a System engineer in this exciting position working with the Tech Director on developing innovative concepts and solutions dealing with RF technology. The candidate (more...)
Company: Leidos
Location: Chantilly
Posted on: 06/27/2019


Travel Nurse - Step Down RN - Leesburg, VA
Description: Want to spend summer 45 minutes from Bush Gardens in Williamsburg VA, Step Down Registered Nurse RN needed in Leesburg VA br Start your next travel opportunity with this great Registered Nurse RN (more...)
Company: General Healthcare Resources - Travel Nursing
Location: Leesburg
Posted on: 06/27/2019

Current College Students - Independent Tutor (Make $1000+/Mo
Description: Are you a master expert Or perhaps a dedicated biology student An absolute SAT wizard Whatever your expertise is, there are people all over the world who need
Company: Varsity Tutors
Location: Harrisonburg
Posted on: 06/27/2019

Watch Administrator
Description: Job Description:This position is for a 12 hour shift 6 AM to 6 PM OR 6PM to 6AM, 3/4 days per week, including weekends and holidays . This position will provide technical support to mission-targeted (more...)
Company: Leidos
Location: Chantilly
Posted on: 06/27/2019

Contact Center Operations Team Lead
Description: The Operations Team Lead reflects the voice of the Brands and supports the Plow Hearth mission and core values by overseeing the customer experience and brand reputation through interactions with the (more...)
Company: Plow and Hearth, LLC
Location: Charlottesville
Posted on: 06/27/2019

Transit Bus Operator
Description: Do you want a part-time job Do you want your job to have meaning and provide a service that directly impacts the local community If so, consider applying to the City of Harrisonburg's Transit Bus Operator (more...)
Company: City of Harrisonburg
Location: Harrisonburg
Posted on: 06/27/2019

Work From Home!
Description: We are looking for people that enjoy working with other people. If you have an upbeat personality and like to help people, you will have tremendous success with our company.
Company: Garcia Healthcare
Location: Chantilly
Posted on: 06/27/2019

Network and IT System Engineer
Description: Job Description: br br The Leidos Defense Intelligence Group has a current opening for a Network and IT System Engineer supporting the U.S. Government in a challenging, dynamic setting located (more...)
Company: Leidos
Location: Chantilly
Posted on: 06/27/2019

Log In or Create An Account

Get the latest Virginia jobs by following @recnetVA on Twitter!

Sterling RSS job feeds