5 days old
2018-08-092018-09-06

Principal Data Engineer- Cloud

Waltham, MA 02451
  • Job Code
    634493
job summary:

Be a key leader and contributor to the design and development of a scalable and cost-effective cloud-based data platform based on a data lake design

 
location: Waltham, Massachusetts
job type: Permanent
work hours: 9 to 5
education: Bachelors
 
responsibilities:

- Be a key leader and contributor to the design and development of a scalable and cost-effective cloud-based data platform based on a data lake design

- Be collaborative with team members, Product Management, Architects, data producers and data consumers throughout the company

- Develop data platform components in a cloud environment to ingest data and events from cloud and on-premises environments as well as third parties

- Build automated pipelines and data services to validate, catalog, aggregate and transform ingested data

- Build automated data delivery pipelines and services to integrate data from the data lake to internal and external consuming applications and services

- Build and deliver cloud-based deployment and monitoring capabilities consistent with DevOps models

- Keep knowledge and skills current with the latest cloud services, features and best practices

 
qualifications:

- Extensive experience developing big data, business intelligence, marketing automation and/or other analytics infrastructure or pipelines - data lake experience preferred

- 10 years experience in developing and architecting solutions using big data, data warehousing

- 3 ++ years hands-on experience developing data lake solutions using Amazon's AWS (certification preferred)

- Experience with data streaming technologies (Kinesis, Storm, Kafka, Spark Streaming) and real time analytics

- Working experience and detailed knowledge in Java, JavaScript, or Python

 
skills:

- Knowledge of ETL, Map Reduce and pipeline tools (Glue, EMR, Spark)

- Experience with large or partitioned relational databases (Aurora, MySQL, DB2)

- Experience with NoSQL databases (DynamoDB, Cassandra) - Agile development (Scrum) experience

- Other preferred experience includes working with DevOps practices, SaaS, IaaS, code management (CodeCommit, git), deployment tools (CodeBuild, CodeDeploy, Jenkins, Shell scripting), and Continuous Delivery

- Primary AWS development skills include S3, IAM, Lambda, RDS, Kinesis, APIGateway, Redshift, EMR, Glue, and CloudFormation


Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

Categories

Featured Jobs

Career News

Before you go...

Our free job seeker tools include alerts for new jobs, saving your favorites, optimized job matching, and more! Just enter your email below.

Share this job:

Principal Data Engineer- Cloud

Randstad Technologies
Waltham, MA 02451

Share this job

Principal Data Engineer- Cloud

Randstad Technologies
Waltham, MA
US

Separate email addresses with commas

Enter valid email address for sender.

Join us to start saving your Favorite Jobs!

Sign In Create Account
Powered ByCareerCast