12 days old

Senior Hadoop Engineer

Pleasanton, CA 94588
  • Job Code
  • Payrate
    $64 To $72

Client is looking for big ideas-6.9 petabytes are a good start. That's how much data we manage and store in Information Technology at client company-more than the Library of Congress can claim. We're home to some other big ideas, like creating Client HealthConnect, the nation's largest electronic medical record system. Using social media and text messaging to help members engage in their own care. And developing predictive modeling tools that anticipate health issues before they're an issue.

It's the kind of thinking that's shaping the future of technology, health care, and the lives of all 8.6 million of our members. If you're ready to contribute your own big ideas, join us.

We are seeking strong Technical Staff to join the Client Big Data Landing Zone team. We currently have an opening for a Solution Architect, responsible for architecture, development and technical Life cycle management of the strategic Client Big Data Landing Zone project across Delivery and Production Support phases.

Client Big Data Landing Zone provides a common data platform for structured and unstructured data to enable innovation within the Client health technology ecosystem.

The (Big Data Engineer) Consultant Specialist, provides technical consulting, design and coding/ prototyping for Client Big Data Landing Zone activities.

Job Responsibilities:

  • Support the design of Big Data Solutions
  • Develop prototypes and proof of concepts for selected solutions.
  • Develop and support Java/Map Reduce and Spark applications in a distributed platform.
  • Work with Business Customers in understanding the business requirements and implementing the solutions
  • Define logical and physical data model including data mapping and distribution layouts
  • Define ETL mapping and process flow
  • Help customers and admin team on performance tuning of Hive and Impala queries
  • Experienced with Java/J2EE application development and deployment
  • Implement automation to cut down time on manual processes
  • Work with core production support personnel in IT and Engineering to automate deployment and operation of the cluster
  • Understands Hadoop environment builds cluster setup, performance tuning and monitoring.
  • Work with tools running in the Hadoop distribution

Minimum Qualifications

  • Bachelor's degree in Computer Science or equivalent (with experience)
  • 2-3 years of development experience in Java and Spark on a distributed platform.
  • 3-5 years of experience in developing Java/J2EE application
  • Hands on experience with Hue, Hive, Impala and SQL Databases
  • 3 years of professional experience working in Linux environments
  • 2-3 years of professional experience working with Hadoop stack, preferably with Cloudera CDH.
  • 5-7 years of experience with relational database design and development
  • Good collaboration & communication skills, the ability to participate in an interdisciplinary team.
  • Strong written communications and documentation experience
  • Solid understanding of automation tools like Jenkins
  • Knowledge of best practices related to data security.
  • An understanding of Hadoop design principals, security and the factors that affect distributed system performance.

Preferred Qualifications

  • 1-2 years of scripting languages. Preferable python, bash or Scala.
  • Experience with performance tuning queries
  • Working knowledge of Solr, hbase, Kudu, Kafka, Sentry, and Kerberos for Security
  • Certified java developer is a plus


  • Information Technology

Randstad utilizes a technology-driven focus with a human touch to provide better staffing and business solutions to organizations around the world. Our team of experts match professionals with available career opportunities in a variety of fields.

Featured Jobs

Career News

Share this job:

Senior Hadoop Engineer

Randstad Technologies
Pleasanton, CA 94588

Share this job

Senior Hadoop Engineer

Randstad Technologies
Pleasanton, CA

Separate email addresses with commas

Enter valid email address for sender.

Join us to start saving your Favorite Jobs!

Sign In Create Account
Powered ByCareerCast