Data Engineer building data solutions using SQL, Python, and AWS for fintech. Focused on ETL processes and big data technologies to meet business needs.
Responsibilities
Assemble large, complex datasets that meet functional and non-functional business requirements;
Build the infrastructure and delivery solutions required for data extraction, transformation, and loading (ETL), suitable for a wide variety of data sources using PySpark, SQL, AWS and Databricks;
Create diagrams for proposed technical solutions, such as data models, data flows, deployment diagrams, etc.;
Strong programming experience in Python or other object-oriented languages for big data processing;
Design, build, and maintain scalable data pipelines and related data access patterns using big data tools and languages;
Research, evaluate, and adopt new technologies, tools, and frameworks focused on high-volume data processing.
Requirements
Education: Bachelor's degree in Business Administration with specialization or a solid background in Information Systems, Systems Analysis, Computer Science, Software Engineering, Statistics, or Mathematics.
Data analysis skills;
Experience writing SQL queries;
Experience programming in Python;
Knowledge of PySpark for Big Data processing;
Familiarity with the Databricks platform;
Knowledge of Data Modeling;
Experience with AWS and cloud technologies as a whole;
Results-oriented with excellent communication and interpersonal skills;
Adherence to secure development best practices;
Business awareness, focused on building value-driven solutions for customers;
Proactivity;
Initiative;
Experience and understanding of Agile methodologies.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.
Data Engineer (dbt) at SDG Group involved in all phases of data projects. Collaborate on data ingestion, transformation, and visualization in a hybrid environment.
Data Consultant at SDG Group specializing in Data & Analytics projects. Collaborate on technical - functional definitions, ETL, data modeling, and visualization for cloud solutions.
Senior Data Engineer responsible for growing customer - defined targeting calculations and developing key/value databases for real - time data processing.
Data Engineer developing and maintaining the Data Lakehouse platform using Microsoft Azure technology stack at RBC. Collaborating with business and technology teams to enhance data ingestion and modeling processes.