Senior Data Engineer

New York, United States · Engineering expand job description ↓

Description

ABOUT 605

At 605 we are engineers, analysts, data scientists, media experts, marketing strategists and political operatives. Our team of data scientists pioneered the field of TV data analytics. We offer unique, independent audience measurement and analytics to build better marketing and programming initiatives within the media and entertainment industries.

The Sr. Data Engineer at 605 must have a broad and deep data skillset as well as strong analytical capabilities . In addition to being a hands on individual contributor, the ideal candidate is a productive team player and a mentor to Junior. Data Engineers. Additionally, we are looking for strong technical experts.


Responsibilities include:

  • Actively participate in team technical discussions in all things data
  • Identify and address issues with data sets from multiple vendors
  • Identify and address code and data quality issues
  • Actively participate in code reviews and grooming sessions
  • Actively participate in technology architecture discussions for product development
  • Translate business requirements into strategy
  • Advocate for software best practices within your team as well as across engineering
  • Be ultra-responsive and capable of making instant decisions, always kicking the ball forward
  • Work on unique and interesting data challenges around architecting, building and managing pipelines that securely process hundreds of terabytes of data
  • Work closely with analysts and statisticians to ensure the validity of our processes


Our engineers are expected to wear a number of hats and have the opportunity to touch all parts of the stack. Our stack includes Apache Spark, Scala, Redshift and an ever-growing list of many other cool technologies.

Requirements

  • Skillful user of Apache Spark
  • Experience wrangling terabytes of big, complicated, imperfect data
  • Experience with AWS products (Redshift, EMR, S3, IAM, RDS, etc)
  • You have a deep understanding of scalable systems and you have large-scale engineering experience in an Agile development environment
  • Bachelor's degree in Computer Science or a related field (or 4 additional years of relevant work experience)
  • A strong understanding of data structures, algorithms, and effective software design
  • Significant development experience with a major modern language (e.g. Java, Scala, Python, Ruby, C/C++, etc.)
  • Significant experience working with structured and unstructured data at scale and comfort with a variety of different stores (key-value, document, columnar, etc.) as well as traditional RDBMSes and data warehouses
  • Experience with or interest in AWS Glue, Redshift Spectrum and any other tools that enable data querying at scale
  • Experience writing unit, functional and integration tests
  • Comfort with version control systems (e.g. Git, SVN)
  • Excellent verbal and written communication skills; must work well in an agile, collaborative team environment

Preferred Qualifications

  • Master's in Computer Science or a related field
  • Practical experience with supervised machine learning techniques
  • Strong background with test-driven development
  • Basic understanding of statistics and experience with statistical packages such as R, Matlab, SPSS, etc

Benefits

Important and Standard

  • Comprehensive health, dental and vision insurance for employees and their families
  • Life & Disability insurance
  • 401k plan with match, eligible for match after one year
  • Pre-tax flexible compensation plan for medical, transit, parking or dependent care expenses
  • Up to 15 paid vacation days depending on grade level
  • 7 paid sick days in a calendar year - if you’re sick, you stay home

Other cool benefits

  • 4 work from home days/month
  • A kitchen stocked with sodas, snacks, yogurt and other goodies
  • A tight knit start up community who likes to eat! We celebrate everyone’s birthdays, have frequent team lunches, and do events in and out of the office
  • 605 is an active participant in conferences

EEO STATEMENT

At 605, we’re just as passionate about diversity as we are about pioneering the field of TV data analytics. We are committed to cultivating an environment of mutual respect and equal opportunity. All hiring and advancement decisions are made on the basis of qualification, merit, and business need.

Personal information
Your Profile
Application Details