Data Architect designing and implementing scalable data pipelines and ETL processes at EY. Leading data engineering deliverables and building AI driven use cases in Azure cloud.
Responsibilities
Needs to be hands-on with design and implementation of scalable data pipelines, ETL processes, and data warehousing solutions to align with Azure Well-Architected Framework (WAF) pillars
Accountable for a suite of data models with relatively high complexity, leveraging a strong understanding of data modelling standards to ensure high quality
Drive best practices for data security, data privacy, and data integrity
Ensure the reliability and efficiency of data infrastructure in the Azure cloud
Understands AI driven data engineering tools; and work on building cutting edge AI driven use cases and ensure availability of AI ready data
Works with other departments across the business to help define and deliver business value, as well as interfacing and communicating with program teams, management and stakeholders to deliver large, complex projects
Leading the production of high-quality data engineering deliverables, helping to ensure project timelines are met, and providing informal mentoring / training to junior members of the team
Leading the design, development and implementation of processes to extract, transform and load data from disparate sources into a form that is consumable by analytics processes within a given project, reviewing deliverables to ensure high quality
Develop and define future state data architectures aligned with industry best practices and organizational needs
Proficient in designing Data Architecture strategy, developing data architecture for modern data platform, assessing enterprise existing data architecture and devise recommendations
Leading translation of requirements, design and solution architecture deliverables into detailed design specifications
Define and implement data management strategies to align with business objectives
Leading the delivery of data quality reviews including data cleansing where required to ensure integrity and quality
Evaluating and resolving issues regarding data quality reviews, cleansing, data integration and migration, leveraging advanced technical knowledge and showing technical leadership in aspects of data engineering while driving continuous improvement efforts
Providing a leadership role for the work group, ensuring the appropriate expectations, principles, structures, tools and responsibilities are in place to deliver the project
Analyzing the latest industry trends such as cloud computing and distributed processing and inferring potential impact on businesses (short and long-term)
Providing advanced technical expertise to maximize efficiency, reliability and value from current data engineering processes.
Researching and monitoring existing client base and industry developments to identify potential new product opportunities from emerging technologies
Developing strong working relationships with peers across engineering, collaborating to develop leading data engineering solutions
Driving adherence to the relevant data engineering and data modeling processes, procedures, standards, and may input into the definition, maintenance and implementation of technology standards
Requirements
Hands-on experience in building Data Architecture using various data architecture patterns like Data Mesh, Data Fabric, Data Lakehouse, Data observability & Data as a Service (DaaS)
Proficient in Azure services (e.g., Azure Data Lake, Azure SQL Database, Azure Synapse Analytics) to build scalable and efficient data solutions.
Experience in building data orchestration through Azure Data Factory, Function App, Logic App.
Proficient in SQL and familiar with programming languages such as Python and Java
Extensively worked on Databricks performance optimization
Experience designing and building Data Platforms integrating disparate data sources
Experience in design and development of various authentication and authorization methods to ensure data security.
Expertise in working with MPP designs to speeds the performance of huge databases that deal with massive amounts of data
Expertise in Azure, Azure Data Bricks, Azure SQL, Spark
Expertise developing dataflows using NiFi/ADF, Databricks
Advanced, hands-on design and implementation experience of large analytic warehouse.
Advanced, hands-on experience in Spark architecture and implementation using several methods
Experience in working with Distributed Message Systems like Kafka.
Hands on experience on Python, PySpark or R.
Expert in creating and analyzing complex SQL queries and procedures.
Understanding of big data and distributed Architecture.
Creating Ingestion workflows using Oozie or similar tools
Knowledge of security measures like HTTPS and Kerberos
Benefits
medical and dental coverage
pension and 401(k) plans
a wide range of paid time off options
flexible vacation policy
designated EY Paid Holidays
Winter/Summer breaks
Personal/Family Care
other leaves of absence when needed to support your physical, financial, and emotional well-being
Senior Consultant focusing on data migrations within Master Data Management for Scheer group. Engaging in project leadership, consulting, and strategy development for data migration projects.
Data Engineer developing ETL processes and BI solutions for RUF Lebensmittelwerk. Collaborating on data models in a cloud environment with Microsoft technologies.
Manager leading data and analytics projects to enhance client operations across multiple states at PwC. Focusing on strategic planning, mentoring junior staff, and project success.
Data Engineer II specializing in automated systems for data processing and analysis in property taxation. Collaborating across teams to ensure accuracy and deliver timely solutions.
Data Architect leading scalable cloud - based architectures at Fidelity. Collaborating with cross - functional teams to modernize brokerage recordkeeping systems and ensure data compliance.
Salesforce Solutions Architect specializing in Data Engineering at Pottencial, integrating Salesforce with analytical platforms. Leading governance and scalable solutions in CRM environments.
Data Engineer developing complex software systems for a multinational IT services company in Switzerland. Utilizing data engineering techniques and high - level programming languages.
Senior Data Management Engineer designing and implementing data solutions for a global IT consulting leader. Collaborating with teams to ensure data accessibility, quality, and governance.
Senior Data Management Engineer designing and implementing enterprise data solutions for a global IT leader. Collaboration with stakeholders to ensure data quality and scalability.
Senior Data Management Engineer at a leading IT Consulting firm. Designing enterprise data solutions ensuring data quality and governance using Informatica tools.