DESCRIPTION
Would you like to build highly available, scalable and distributed engineering systems for one of the largest data lakes in Amazon? Does Petabyte scale excite you?
The Analytics & Data Management (ADM) team owns the central data lake for Advertising unifying Petabytes of data generated across the Ads pipeline such as campaigns, ad-serving, billing, clicks, impressions and more and into a single scalable repository. This is used across the organization to drive hundreds of thousands of complex queries for analysis, measurement and reporting decisions for our customers. The data lake enables customers such as data engineers, business analysts, ML engineers, research scientists, economists and data experts to collect what they need via world-class self-service tools.
ADM is building the next version of its data lake, called Spektr, for 5x growth. As an SDM leader, you and your team will have the unique opportunity to design, innovate and deliver microservices built over Java, AWS, EMR and Spark while innovating with the AWS Big Data stack such as Athena and Redshift. You will innovate for key tenets such as scale, cost, efficiency and self-serve to support Spektr’s YoY growth. You will create value that materially impacts the speed and quality of decision making across the organization resulting in tangible business growth.
Key job responsibilities
– Manage a team of software and data engineers across levels
– Drive a consistent, project management framework and development processes to deliver high quality software, iteratively
– Engage with decision makers such as Product & Program Managers to understand customer requirements and goal commitments
– Own crucial growth, cost and efficiency goals with high confidence delivery strategies for your team
– Ensure testability, maintanability and low operational footprint for your team’s services, and manage on-call
– Hire, manage and nurture technical talent
A day in the life
– Strategic leadership of the Spektr Service and Data Availability charter
– Champion engineering and operational excellence via metrics and establish a process for regular improvement.
– Anticipate bottlenecks, manage risk and escalations, and balance the business needs versus technical constraints.
– Broaden your technical skills and work in an environment that thrives on creativity, efficient execution, and product innovation.
– Build frugal solutions that will help make Spektr data lake cost wise leanest datalake in Amazon
About the team
The mission of the Analytics & Data Management (ADM) team is to provide Amazon Advertising and its key Partner teams with easy access to centralized, high quality, compliant data to drive the needs of their business that help drive informed analyses and decisions for our customers, and to determine and deploy investments for future growth, via a set of central and unified products and services. Our team focuses on simplicity, usability, speed, compliance, cost efficiency and enabling high-velocity decision making so our customers can generate high quality insights faster.
We are a global team with presence across IN and NA.
BASIC QUALIFICATIONS
– 7+ years of engineering experience
– 3+ years of engineering team management experience
– 8+ years of leading the definition and development of multi tier web services experience
– Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
– Experience partnering with product or program management teams
– Experience designing or architecting (design patterns, reliability and scaling) of new and existing systems
PREFERRED QUALIFICATIONS
– Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy
– Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers