8 days old

Sr. Software Engineer - Data Operations

San Francisco, CA 94129
  • Job Code
  • Payrate
    $130,000 To $145,000

As a Software Engineer in a position of technical leadership, you will have an immediate impact on the platform that collects, stores, processes, and analyzes the data that drives the core of our business. An ideal candidate is hands-on with a few years of experience building and maintaining scalable cloud-based data pipelines. Most services are written in Java 8, and if you have experience with ops work / deployment, machine learning, or data science/analytics, even better!

Our microservice-based infrastructure includes tools like Docker, Kubernetes, Cassandra, Spark, and Kafka. This means you can design, develop and deploy your own services with little or no delay. Test-driven development, continuous deployment, pair programming, and a supportive environment are key priorities.


  • Design, develop, and maintain a distributed data processing pipeline.
  • Tune deployed code for low latency, high throughput, and reliability.
  • Agile software development using Java 8.
  • Monitor systems for uptime and performance. Ensure recovery from any outages. Assist with data-related troubleshooting and problem solving.
  • Maintain and improve testing infrastructure and coverage.
  • Use statistical profiling and other techniques to detect and identify errant datasets.
  • Diagnose technical requirements, recommend solutions and/or tools for data processing.
  • Collaborate with product managers and other engineers to understand and document functional requirements.


  • Must have minimum 4 years of Java experience with min 1 year experience in Java 8
  • Experience in extracting data from HTML using regular expressions
  • Experience using REST, SOAP, AMQP-based APIs to retrieve data
  • Familiarity with NoSQL databases, such as MongoDB, Cassandra, Elasticsearch, or HBase. Strong knowledge of SQL and relational databases such as MySQL or Postgres
  • Familiarity with distributed computing clusters like Spark or Hadoop is a plus
  • Experience with messaging systems such as Kafka or RabbitMQ preferable
  • Familiarity with Agile and pair programming
  • Accustomed to using automated testing best practices (e.g. JUnit, Mockito)
  • Intuitive sense for spotting and investigating inconsistencies/anomalies in data. Unwavering standards for data quality and consistency. Strong desire for highest quality code and craftsmanship.
  • Bachelors or Masters degree in Computer Science preferable.
  • Experience with cloud platforms such as AWS, Google, or Azure preferable.
  • Any minimal front-end dev experience (React, Angular, D3) considered a plus.
  • Experience in data warehousing and ETL pipeline design, implementation, and maintenance is a plus


  • Information Technology

Featured Jobs

Career News

Before you go...

Our free job seeker tools include alerts for new jobs, saving your favorites, optimized job matching, and more! Just enter your email below.

Share this job:

Sr. Software Engineer - Data Operations

Randstad Technologies
San Francisco, CA 94129

Share this job

Sr. Software Engineer - Data Operations

Randstad Technologies
San Francisco, CA

Separate email addresses with commas

Enter valid email address for sender.

Join us to start saving your Favorite Jobs!

Sign In Create Account
Powered ByCareerCast