Big Data Architect involved in the Data Engineering Team, drafting architectures and sizing efforts. Collaborating with key team members to ensure data platform efficiency and best practices.
Responsibilities
Involved in drafting technical solutions tied within the Big Data team within the Data Engineering Team.
Draft architectures together with the Lead Big Data Engineer, Enterprise Data Architect and Lead BI to come up with the best possible architectures.
Using experience to size efforts of large tasks accordingly, key for other key roles within the team.
Supports the team in refinement sessions to estimate better.
Supports the Lead Big Data Engineer to draft works that can be inclusive of all the team to avoid silos.
Provide input in project planning.
Supports team to be able to contribute to peer reviewing collectively.
Requirements
Assesses as-is the current data platform, defines future state platform together with the BDE team lead. Performs gap analysis to drive the future state data platform (including implementation) with frequent discussions with internal parties such as the team lead, enterprise architect, data governance and data-devops.
Understands leading/emerging Big Data technologies and trends on the market and can communicate these effectively to a wide audience.
Clearly communicates any updates, new technologies or practises with the team lead and the BDE team in a clear manner.
Ensures that the BDE adheres to best practices, this ensures that coding standards and the accuracy, validity, and reusability of data is maintained.
Excellent working SQL knowledge and experience with both relational and columnar databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Collaboration with key stakeholders for specific research, work effort sizing.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.
Data Consultant at SDG Group specializing in Data & Analytics projects. Collaborate on technical - functional definitions, ETL, data modeling, and visualization for cloud solutions.
Data Engineer (dbt) at SDG Group involved in all phases of data projects. Collaborate on data ingestion, transformation, and visualization in a hybrid environment.
Senior Data Engineer responsible for growing customer - defined targeting calculations and developing key/value databases for real - time data processing.
Data Engineer developing and maintaining the Data Lakehouse platform using Microsoft Azure technology stack at RBC. Collaborating with business and technology teams to enhance data ingestion and modeling processes.
Data Engineer focused on creating a data platform for automated cyber insurance. Collaborating with stakeholders to deliver data processing capabilities and governance.