Purpose of the role:
This role will centre on the design, implementation and maintenance of data models and related architecture for the Data Platform. Providing technical expertise in evaluating requirements, developing efficient assets and maintaining technical design documents and data catalogues.
Responsibilities:
- Provide expertise in evaluating requirements, creating technical design documents and applying an Agile development methodology
- Develop high-performing and secure data models and repositories that support the cloud data strategy including ingestion, validation, data quality, transformation, integration and modelling activities
- Monitor and optimise the data models and repositories to support performance and contribute to continuing process improvement
- Deploy new or implement changes to existing data models in line with the Change Management Framework
- Document and adhere to data platform policies, procedures and standards
- At all times, ensure compliance with the Information Security standards
- Collaborate with a range of internal or external stakeholders and contractors to develop data models
Skills required:
- Experience working with non-relational databases and unstructured data is beneficial
- Proven experience working with data platform services including Data Factory, Data Lake Storage Gen 2, Databricks, SQL Database, Synapse and Active Directory
- Experience using DevOps to manage tasks and CI/CD development within an Agile framework
- Exposure to Purview, Power BI and Profisee is an advantage
- Good knowledge of SQL and PySpark data processing languages
- Knowledge of Json, XML, DAX and RegEx is an advantage