21 days old

Senior Data Architect

New York, NY 10281
  • Job Code
    706664
  • Payrate
    $70 To $80
job summary:

Summary:

  • The Senior Data Architect position will be part of the Insight Core Hadoop platform team within Global Markets.
  • The Data Architect is responsible for the overall design of the wide data/information architecture which maps to the enterprise architecture and balances the need for access against security and performance requirements.
 
location: New York, New York
job type: Contract
salary: $70 - 80 per hour
work hours: 9am to 5pm
education: Bachelors
 
responsibilities:

Responsibilities:

  • Design and help develop ETL, replication schemes, and query optimization techniques that support highly-varied (structured, semi-structured, and unstructured) and high-velocity (near real-time) data processing and delivery
  • Ensure the data architecture is optimized for large dataset acquisition, analysis, storage, cleansing, transformation and reclamation
  • Develop standards and methodologies for benchmarking, performance, evaluation, testing, data security and data privacy
  • Recommend and set goals for unified data management practices such as meta-data management, provenance management, governance, stewardship, data quality and lifecycle management
  • Perform impact analysis, performance tuning, capacity planning for the enterprise data warehouse and its infrastructure as source systems are added and new integration business rules and logic are introduced
  • Establish and enforce policies, procedures, standards, methodologies, and metrics for data quality, metadata management, and master data management
  • Educational Requirements:
  • Bachelor's Degree in Information/Computer Science or related field
 
qualifications:

Required Skills:

  • Expertise with Hadoop and its ecosystem Hive, Pig, Spark, HDFS, HBase, Oozie, Sqoop, Flume, Zookeeper, Kerberos, Sentry, Impala etc.
  • Ability to rapidly learn new software languages, frameworks and APIs quickly
  • Hands on development experience and high proficiency in Java / Python
  • Skilled in data analysis, profiling, data quality and processing to create visualizations
  • Experience working with Agile Methodology
  • Good SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases (Hive, Impala, Kudu a plus).
  • Experience building and optimizing big data data pipelines, architectures and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
 
skills: Required Skills:

  • Expertise with Hadoop and its ecosystem Hive, Pig, Spark, HDFS, HBase, Oozie, Sqoop, Flume, Zookeeper, Kerberos, Sentry, Impala etc.
  • Ability to rapidly learn new software languages, frameworks and APIs quickly
  • Hands on development experience and high proficiency in Java / Python
  • Skilled in data analysis, profiling, data quality and processing to create visualizations
  • Experience working with Agile Methodology
  • Good SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases (Hive, Impala, Kudu a plus).
  • Experience building and optimizing big data data pipelines, architectures and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Experience supporting and working with cross-functional teams in a dynamic environment.

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

Categories

Posted: 2019-08-26 Expires: 2019-09-23

Featured Jobs

Career News

Before you go...

Our free job seeker tools include alerts for new jobs, saving your favorites, optimized job matching, and more! Just enter your email below.

Share this job:

Senior Data Architect

Randstad Technologies
New York, NY 10281

Join us to start saving your Favorite Jobs!

Sign In Create Account
Powered ByCareerCast