Lead ETL Architect developing, testing, and deploying solutions at S&P Global. Collaborating with teams and optimizing data processes in an environment focused on essential intelligence.
About the role
- Data & Analytics Engineer working with stakeholders to maintain the Data platform. Collaborating with team members to ensure efficient access to organizational data.
Responsibilities
- Perform end to end automation of ETL/ELT process for various datasets that are being ingested into the Data Platform.
- Design, develop and maintain data ingestion pipelines.
- Create Spark jobs for data transformation and aggregation.
- Develop, enhance, and manage conceptual, enterprise logical (LDM) and physical data models (PDM) to ensure the information models can meet end user and developer needs.
- Understand and apply logical entity-relational design concepts.
- Recommend opportunities for reuse of data models in the new environments.
- Develop dimensional models and views needed for data analytics and reporting.
- Optimize and update logical and physical data models to support new and existing projects.
- Leads the development of creative new data integrations, modifications to existing software, and/or makes decisions regarding integrating software applications data in accordance with agreed upon specifications.
- Serve as a subject matter expert of our solutions and address to a business or technical audience.
- Collaborate with Analysts, Architects and Developers to establish and maintain the Data Platform framework.
- Prepare and maintain technical documentation.
Requirements
- Bachelor's degree in a technical field such as computer science, computer engineering or related field
- 4+ years' experience with Data Modelling.
- 4+ years’ experience with Python programming language
- 4+ years’ experience with Apache Spark streaming and batch framework
- 4+ years’ experience developing data lake
- 2+ years experience of Databricks
- Knowledge of Microsoft Azure Platform
- Strong understanding and experience of relational/non-relational database, including design and implementation
- Strong communication skills required to communicate effectively with business and other stake holders
- Strong Analytical and Problem-Solving Skills
- Excellent Time Management Skills
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Analytics Engineer at UK's premier publisher assisting data - driven insights for customer understanding. Bridging gap between data engineering and analytics with clean, reliable data access.
Analytics Engineer designing and developing software solutions for complex data at OCLC. Collaborating with teams to enhance data access and analytics capabilities.
Analytics Engineer enabling data - driven decisions across clinical and operational functions at QualDerm Partners. Responsible for data collection, analysis, visualization, and stakeholder collaboration.
Lead Digital Analytics Engineer driving modernization of site analytics and data layer for multi - brand ecommerce. Architecting a unified measurement foundation and collaborating with various stakeholders across the organization.
SAP Analytics Developer managing and delivering SAP BW/BI solutions for Niterra. Collaborating with stakeholders to optimize business intelligence and data warehousing capabilities.
Analytics Engineer responsible for data consolidation and maintenance, supporting reporting and dashboards at Brilliant Corners for vulnerable populations.
ETL Developer maintaining data pipelines and supporting data quality for IMT Insurance. Collaborating with the data team and learning ETL tools under guidance.
Analytics Engineer creating scalable data models to support multiple products at Marshmallow. Collaborating across teams to enhance data - driven decision - making and optimize product offerings.
Analytics Engineer working in fintech, focusing on data modeling, SQL, and Power BI for strategic decisions. Engaging in high transaction volume environments with hybrid workspace setup.