Required Skills:
8-10+ years of Data Engineering experience in Cloud and Big Data technologies like Azure, Spark, PySpark, Hive, Scala or Java, SQL queries
2+ years of good hands on experience in data extraction, ingestion, transformation and processing of large and complex data sets in Azure big data services
Development / Coding experience required in:
Azure Data Factory
Azure Data Lake Storage
Azure Databricks
PySpark
Azure DevOps, CI/CD
SQL Queries, Functions, Procedures
Azure Data Flow
Azure Synapse
Azure SQL Database / Azure SQL Data Warehouse
Experience with AGILE / SAFe project delivery. Strong experience with estimating tasks for user stories.
Verbal and written communication skills, problem solving skills, customer service and interpersonal skills.
Expert ability to work independently and manage one’s time.
Expert mentoring skills necessary to provide support and constructive performance feedback.
Expert knowledge of the full software development lifecycle: from business/systems analysis, through requirements gathering and functional specification authoring, to development, testing and delivery.
Expert ability to troubleshoot issues and make system changes as needed to resolve issue.
Education/Experience:
Bachelor’s degree in computer science, data engineering or relevant IT field required.
Certifications:
DP-200 / DP-201 / DP-203 : Azure Data Engineering Associate
SAFe 5 Practitioner
AZ-400: Designing and Implementing Microsoft DevOps Solutions
Azure Data Factory