Design and implement scalable data engineering and analytics solutions in Azure and Databricks. * Set up and maintain data governance, security, and compliance standards in Azure. o Azure Data Lake Storage (ADLS Gen2), permissions, architecture, integration. o Azure SDKs for Python, REST APIs, OAuth2 authentication, service principals & managed identities. o (Optional) Azure Data Factory for pipeline orchestration. * Understanding of data modeling (star schema, snowflake schema), ETL / ELT best practices, and data governance in Azure. * Experience with CI / CD pipelines (Azure DevOps, GitHub Actions) and testing frameworks (Great Expectations).
mehr