Big Data Architect involved in the Data Engineering Team, drafting architectures and sizing efforts. Collaborating with key team members to ensure data platform efficiency and best practices.
Responsibilities
Involved in drafting technical solutions tied within the Big Data team within the Data Engineering Team.
Draft architectures together with the Lead Big Data Engineer, Enterprise Data Architect and Lead BI to come up with the best possible architectures.
Using experience to size efforts of large tasks accordingly, key for other key roles within the team.
Supports the team in refinement sessions to estimate better.
Supports the Lead Big Data Engineer to draft works that can be inclusive of all the team to avoid silos.
Provide input in project planning.
Supports team to be able to contribute to peer reviewing collectively.
Requirements
Assesses as-is the current data platform, defines future state platform together with the BDE team lead. Performs gap analysis to drive the future state data platform (including implementation) with frequent discussions with internal parties such as the team lead, enterprise architect, data governance and data-devops.
Understands leading/emerging Big Data technologies and trends on the market and can communicate these effectively to a wide audience.
Clearly communicates any updates, new technologies or practises with the team lead and the BDE team in a clear manner.
Ensures that the BDE adheres to best practices, this ensures that coding standards and the accuracy, validity, and reusability of data is maintained.
Excellent working SQL knowledge and experience with both relational and columnar databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Collaboration with key stakeholders for specific research, work effort sizing.
Associate Data Engineer undergoing training in data engineering tools and collaborating with senior engineers on projects. Hands - on experience with real - world datasets and cloud - based platforms.
Data Engineer developing data infrastructures and pipelines for Motive's Enterprise clients. Collaborating across teams to enhance data processing with modern tools and frameworks.
Senior Data Engineer writing production code and maintaining data pipelines for commercial banking insights. Collaborating with other teams to deliver powerful data solutions.
Lead Data Engineer responsible for designing and implementing data solutions. Work with AWS and Snowflake in a global data and AI company headquartered in New York.
Senior Data Engineer developing ingestion, ETL & ELT processes with Azure Synapse at Indra Group. Supporting data solutions and compliance in a collaborative hybrid work environment.
Senior Data Engineer building data pipelines for business intelligence at Getsafe. Involves designing and maintaining a Data Warehouse platform using tools like SQL and Python in a hybrid work environment.
Data Engineer developing automated data pipelines for Creditreform. Collaborating with Data Scientists and Analysts and ensuring data quality and consistency.
Data Engineer building and maintaining core data infrastructure for Aircall's AI customer communications platform. Support data reliability and scalability for high - impact use cases.
Senior Data Engineer shaping data landscape and leading ETL/ELT solutions for mission - critical engineering projects in the UK. Collaborating with teams to deliver high - quality data products.