5 days old

Big Data Engineer - Hadoop

Matthews, NC 28105
  • Job Code
  • Payrate
    $52 To $60

Big Data Engineer - Hadoop

Job description:

This position of senior data engineer is responsible for designing and maintaining highly scalable data management systems, building high-performance algorithms, prototypes and predictive models, as well as creating customer software components by employing a variety of programming languages and off-the-shelf tools to marry systems together. In his/her role, the data engineer will work closely with data architects to determine what data management systems are appropriate, and with data scientists to determine which data is needed for analysis. This position will work with stakeholders to understand their information needs and translate these into technical solutions using such tools as Spark, Hbase, Hive, NiFi, Kafka, Sqoop, Python, R, and etc.. This position will work intimately with existing team of Data Science staff to take existing or new/prototype models and convert them into scalable analytical solutions.

More specifically, responsibilities include: -Translating complex functional and technical requirements into detailed architecture, design, and high performing software. -Leading Big Data analytical solutions leveraging transformational technologies. -Driving user ideation analysis and elaboration, design and development of software applications, testing, and building automation tools. -Selecting data solution software and defining hardware requirements. -Translating business requirements into system requirements. -Building next-generation Big Data analytics framework developed on a group of core technologies. -Coding, testing, and documenting new or modified data systems to create robust and scalable applications for data analytics. -Ensuring all automated processes preserve data by managing the alignment of data availability and integration processes. -Collaborating with data architects, modelers and IT team members on project goals. -Assisting with extracting standard sets of features from important datasets that will be leveraged by Data Science team. -Converting code from applications in R, Python or other languages into Spark applications.

Required Qualifications

-Master's degree in computer science or engineering with total 10+ years' relevant experience -5+ years of experience in data management and/or data engineering

- 4+ years of experience in development in big data environments (Hadoop, Hive, Spark). -Hands-on coding skills in Spark (1.6 and 2.0), R, Python, Java, and/or C#

-Fundamental understanding of RDBMS and extensive experience using ETL tools

-Collaborations skills working with data architects, modelers, and other IT team members

Desired Qualifications

-Ph.D degree in computer science, engineering, or management information systems.

-Extensive experience in large scale system implementation and project management.

-Mastery of machine learning, algorithms and advanced mathematics.

-Excellent verbal and written communication skills as well as the ability to bridge gaps between data science and business management.

-Experience with SAP HANA definitely a plus


  • Information Technology

Featured Jobs

Career News

Before you go...

Our free job seeker tools include alerts for new jobs, saving your favorites, optimized job matching, and more! Just enter your email below.

Share this job:

Big Data Engineer - Hadoop

Randstad Technologies
Matthews, NC 28105

Share this job

Big Data Engineer - Hadoop

Randstad Technologies
Matthews, NC

Separate email addresses with commas

Enter valid email address for sender.

Join us to start saving your Favorite Jobs!

Sign In Create Account
Powered ByCareerCast