Hybrid Data Architect

at EY

• Job title: Data Architect
• Job type: Full Time
• Experience level: Mid level, Senior
• Salary: $145,500 - $280,000 per year
• Degree requirement: Bachelor's Degree
• Tech skills: Azure, Cloud, ETL, Java, Kafka, PySpark, Python, Spark, SQL
• Location requirements: Hybrid, Hoboken, United States

About the role

• Data Architect designing and implementing scalable data pipelines and ETL processes at EY. Leading data engineering deliverables and building AI driven use cases in Azure cloud.

Responsibilities

• Needs to be hands-on with design and implementation of scalable data pipelines, ETL processes, and data warehousing solutions to align with Azure Well-Architected Framework (WAF) pillars
• Accountable for a suite of data models with relatively high complexity, leveraging a strong understanding of data modelling standards to ensure high quality
• Drive best practices for data security, data privacy, and data integrity
• Ensure the reliability and efficiency of data infrastructure in the Azure cloud
• Understands AI driven data engineering tools; and work on building cutting edge AI driven use cases and ensure availability of AI ready data
• Works with other departments across the business to help define and deliver business value, as well as interfacing and communicating with program teams, management and stakeholders to deliver large, complex projects
• Leading the production of high-quality data engineering deliverables, helping to ensure project timelines are met, and providing informal mentoring / training to junior members of the team
• Leading the design, development and implementation of processes to extract, transform and load data from disparate sources into a form that is consumable by analytics processes within a given project, reviewing deliverables to ensure high quality
• Develop and define future state data architectures aligned with industry best practices and organizational needs
• Proficient in designing Data Architecture strategy, developing data architecture for modern data platform, assessing enterprise existing data architecture and devise recommendations
• Leading translation of requirements, design and solution architecture deliverables into detailed design specifications
• Define and implement data management strategies to align with business objectives
• Leading the delivery of data quality reviews including data cleansing where required to ensure integrity and quality
• Evaluating and resolving issues regarding data quality reviews, cleansing, data integration and migration, leveraging advanced technical knowledge and showing technical leadership in aspects of data engineering while driving continuous improvement efforts
• Providing a leadership role for the work group, ensuring the appropriate expectations, principles, structures, tools and responsibilities are in place to deliver the project
• Analyzing the latest industry trends such as cloud computing and distributed processing and inferring potential impact on businesses (short and long-term)
• Providing advanced technical expertise to maximize efficiency, reliability and value from current data engineering processes.
• Researching and monitoring existing client base and industry developments to identify potential new product opportunities from emerging technologies
• Developing strong working relationships with peers across engineering, collaborating to develop leading data engineering solutions
• Driving adherence to the relevant data engineering and data modeling processes, procedures, standards, and may input into the definition, maintenance and implementation of technology standards

Requirements

• Hands-on experience in building Data Architecture using various data architecture patterns like Data Mesh, Data Fabric, Data Lakehouse, Data observability & Data as a Service (DaaS)
• Proficient in Azure services (e.g., Azure Data Lake, Azure SQL Database, Azure Synapse Analytics) to build scalable and efficient data solutions.
• Experience in building data orchestration through Azure Data Factory, Function App, Logic App.
• Proficient in SQL and familiar with programming languages such as Python and Java
• Extensively worked on Databricks performance optimization
• Experience designing and building Data Platforms integrating disparate data sources
• Experience in design and development of various authentication and authorization methods to ensure data security.
• Expertise in working with MPP designs to speeds the performance of huge databases that deal with massive amounts of data
• Expertise in Azure, Azure Data Bricks, Azure SQL, Spark
• Expertise developing dataflows using NiFi/ADF, Databricks
• Advanced, hands-on design and implementation experience of large analytic warehouse.
• Advanced, hands-on experience in Spark architecture and implementation using several methods
• Experience in working with Distributed Message Systems like Kafka.
• Hands on experience on Python, PySpark or R.
• Expert in creating and analyzing complex SQL queries and procedures.
• Understanding of big data and distributed Architecture.
• Creating Ingestion workflows using Oozie or similar tools
• Knowledge of security measures like HTTPS and Kerberos

Benefits

• medical and dental coverage
• pension and 401(k) plans
• a wide range of paid time off options
• flexible vacation policy
• designated EY Paid Holidays
• Winter/Summer breaks
• Personal/Family Care
• other leaves of absence when needed to support your physical, financial, and emotional well-being