SterlingVARecruiter Since 2001
the smart solution for Sterling jobs

Senior Data Engineer

Company: The Silicon Partners Inc.
Location: Sterling
Posted on: February 12, 2020

Job Description:

Position Title: Senior Data Engineer Division: Global Technology & Operations Location: Sterling, VA Duration: 8 Months Department: Global Data Analytics Reports to: Sr. Manager Data Engineering Interview: Video Must have : Scala, Spark , AWS EMR. Role: The Data Engineer should be a technical contributor who has hands-on knowledge of all phases in building large-scale cloud based distributed data processing systems and applications. You will be part of the Global Data & Analytics engineering technology team and will partner closely with a team of data scientists, business analysts & data engineers leading Discovery s cloud based Big Data & Analytics strategy.You ll work on implementing complex AWS based big data projects with a focus on collecting, parsing, managing, analyzing and visualizing large sets of data to turn information into insights using multiple technology platforms. Therefore, this role requires an understanding of how a secure big data cloud environment is architected to gain real insights faster, with less friction and complexity. The data engineer should be passionate about working with cutting edge technologies in solving problems and developing prototypes using different open source tools for the selected solutions.You ll need to be an innovative forward-thinker who will help lead end-to-end execution of data engineering initiatives and contribute directly to existing and emerging business strategies and goals. Creativity, Attention to detail and ability to work in a collaborative team environment are essential.The Data Engineer will work closely with the Data Engineering Director to decide on needed infrastructure architecture and software design needs and act according to the decisions. Key Areas of Responsibility: Lead the design, implementation, and continuous delivery of pipelines using distributed AWS based big data technologies supporting data processing initiatives across batch and streaming datasets Responsible for development using Scala, Python languages and Big Data Frameworks such as Spark, EMR, Presto, AWS Athena, Kafka, Zepplin, and Kinesis Provide administrative support on deployed AWS platform components Identify, evaluate and implement cutting edge big data pipelines and frameworks required to provide requested capabilities to integrate external data sources and APIs Review, analyses and evaluate market requirements, business requirements and project briefs in order to design the most appropriate end-to-end technology solutions Process and manage high-volume real-time customer interaction streams Provide architectural support by building Proof of Concepts & Prototypes Self-Starter to deliver data engineering solutions to optimize both the cost and existing solution Stay current with emerging technologies and industry trends Required Qualifications: Bachelor's Degree or higher in Computer Sciences or similar Minimum of 5-6 years Software Industry experience 3 years of development experience with AWS services Must have EC2, EMR , RedShift, Data Pipeline,S3, Cloud Formation and Jenkins 3 years of development experience with Apache Spark, Presto, SQL, notebook and NoSQL Implementation 4 years of extensive working knowledge in different programming Scala ,Shell and Python. Proficiency working with structured, semi-structured and unstructured data sets including social, web logs and real time streaming data feeds Able to tune Big Data solutions to improve performance and end-user experience Knowledge on Visualization and Data Science Tools. Expert level usage with Jenkins, GitHub is preferred Spark developer certification is a plus Ability and eagerness to constantly learn and teach others Experience in the media industry is a plus - provided by Dice

Keywords: The Silicon Partners Inc., Sterling , Senior Data Engineer, Engineering , Sterling, Virginia

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Engineer
Description: Engineer 13 br The City of Aberdeen, located in Harford County MD, has an opening for our
Company: City of Aberdeen/Attn: T. Hartman
Location: Baltimore
Posted on: 02/21/2020

Senior Infrastructure Engineer _AWS Redshift
Description: Hi ,We are looking for a Senior Infrastructure Engineer AWS Redshift for our Direct Client in Columbia MD., Please let me know your interest in this.Title: Senior Infrastructure Engineer
Company: ComTec Information Systems
Location: Columbia
Posted on: 02/21/2020

Mechanical Engineer Sr
Description: Job DescriptionDescription: This position is contingent upon contract award and/or funding. Mechanical engineer will work as part of an engineering team to develop mechanical solutions to a variety of (more...)
Company: Lockheed Martin
Location: Baltimore
Posted on: 02/21/2020


Cyber Security Engineer
Description: Minimum Required Skills:TS/SCI, Systems Engineering, Information Systems, Information Assurance, Cyber SecurityIf you are a Cyber Security Engineer with experience, please read on Based in Northern Virginia, (more...)
Company: CyberCoders
Location: Falls Church
Posted on: 02/21/2020

Scientist I, Antibody Discovery and Protein Engineering
Description: Job Description NextCure is a clinical-stage biopharmaceutical company committed to discovering and developing novel, first-in-class immunomedicines to treat cancer and other immune-related diseases by (more...)
Company: NextCure, Inc.
Location: Beltsville
Posted on: 02/21/2020

Salesforce Devops Engineer
Description: Salesforce DevOps Engineer Are you a creative thinker that loves to be on the cutting edge, solving problems though technology and design Do you believe that digital technology has the power to make (more...)
Company: Deloitte
Location: Arlington
Posted on: 02/21/2020

Quality Engineer IV SPIE
Description: Essential Skills: Serves as Quality Manager for PM SPIE programs, with duties as identified below: Plan, develop, implement, and manage Quality on assigned programs over their life cycle, ensuring that (more...)
Company: DCS Corp
Location: Fort Belvoir
Posted on: 02/21/2020

Network Voice L3 Engineer
Description: S2S Soft is a Global IT Solutions and Services company with unmatched expertise spread across various Industrial Internet like IT Staff, Document Management, Software Development, Mechanical Design and (more...)
Company: S2SSoft
Location: Baltimore
Posted on: 02/21/2020

Senior Network Engineer
Description: nTech Solutions, a leader in the recruitment of professionals, has an immediate opening for a Senior Network Engineer in the Baltimore, MD area. Terms of Employment W2 Contract: 6 Months nTech Benefits (more...)
Company: nTech Solutions
Location: Baltimore
Posted on: 02/21/2020

Angular Engineer
Description: Eliassen Group is assisting our large SaaS client in Columbia MD with finding a mid-level Angular Engineer that will develop modern, scalable front-end applications being deployed in AWS. You'll join (more...)
Company: Eliassen Group
Location: Columbia
Posted on: 02/21/2020

Log In or Create An Account

Get the latest Virginia jobs by following @recnetVA on Twitter!

Sterling RSS job feeds