Principal Data Architect at nbn defining and evolving enterprise data models for the digital future of Australia. Providing leadership in data governance and advanced analytics practices.
About the role
- Senior Data Engineer leading development and optimization of data solutions. Managing complex projects, ensuring data quality, and mentoring junior engineers in data engineering.
Responsibilities
- Lead design and optimization of complex data solutions.
- Oversee data engineering projects.
- Mentor junior engineers.
- Ensure solutions align with organizational goals.
- Provide strategic guidance.
Requirements
- 10+ years in data engineering/ETL roles, with at least 6+ years in Azure cloud ETL leadership.
- Azure certifications (e.g., Azure Analytics Specialty, Solutions)
- Azure Data Sources: Azure Data Lake Storage (ADLS), Blob Storage, Azure SQL Database, Synapse Analytics.
- External Sources: APIs, on-prem databases, flat files (CSV, Parquet, JSON).
- Tools: Azure Data Factory (ADF) for orchestration, Databricks connectors.
- Apache Spark: Strong knowledge of Spark (PySpark, Spark SQL) for distributed processing.
- Data Cleaning & Normalization: Handling nulls, duplicates, schema evolution.
- Performance Optimization: Partitioning, caching, broadcast joins.
- Delta Lake: Implementing ACID transactions, time travel, and schema enforcement.
- Azure Data Factory (ADF): Building pipelines to orchestrate Databricks notebooks.
- Azure Key Vault: Secure credential management.
- Azure Monitor & Logging: For ETL job monitoring and alerting.
- Networking & Security: VNET integration, private endpoints.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Mid/Senior Data Engineer building centralized data lake for Yassir. Collaborating on analytics projects and developing data processing pipelines.
Data Engineering Advisor creating data systems and pipelines for data management solutions. Collaborating with stakeholders and using analytics to solve business problems in the financial sector.
Senior Finance Data Architect responsible for shaping finance data strategy at Standard Life. Leading enterprise - level data architecture for regulatory reporting and strategic insights.
Cloud Data Engineer at SEB focusing on Customer Relationship Management. Joining the Cloud Data Engineering Team to optimize data pipelines and improve customer insights.
Data Architect designing scalable data architectures for analytics and reporting at XTEL. Collaborating with international teams to ensure data quality and infrastructure improvements.
Lead Enterprise Data Architect building and owning foundational data management capabilities at a technology - driven company. Enhancing data architecture for AI and operational use with strategic leadership and technical expertise.
Associate Data Engineer supporting data engineering projects at The Hartford in Hartford, CT and Charlotte, NC. Engaging in projects that involve data analysis and developing data assets using various technologies.
Senior Data Engineer / Snowflake Architect leading the design and optimization of data solutions. Working closely with clients and internal teams to build scalable architectures in a hybrid environment.
Data Engineer II developing ETL/ELT solutions for higher education data warehouse. Ensuring reliable institutional data for strategic decision - making by university leaders.