Data Analyse, profile and plan work, aligned with project priorities. 3 contract data engineers to supplement existing team during implementation phase of new data platform. * Write clean and testable code using PySpark and SparkSQL scripting languages, to enable our customer data products and business applications. * Build and manage data pipelines and notebooks, deploying code in a structured, trackable and safe manner. * Document your data developments and operational procedures. * Ensure adherence to data/software delivery standards and effective delivery. * Help monitor, troubleshoot and resolve production data issues when they occur. * Excellent understanding of Data Lakehouse architecture built on ADLS. * Excellent understanding of data pipeline architectures using ADF and Databricks. * Strong understanding of designing, constructing, administering, and maintaining data warehouses and data lakes.
mehr