Data Engineer building data solutions using SQL, Python, and AWS for fintech. Focused on ETL processes and big data technologies to meet business needs.
Responsibilities
Assemble large, complex datasets that meet functional and non-functional business requirements;
Build the infrastructure and delivery solutions required for data extraction, transformation, and loading (ETL), suitable for a wide variety of data sources using PySpark, SQL, AWS and Databricks;
Create diagrams for proposed technical solutions, such as data models, data flows, deployment diagrams, etc.;
Strong programming experience in Python or other object-oriented languages for big data processing;
Design, build, and maintain scalable data pipelines and related data access patterns using big data tools and languages;
Research, evaluate, and adopt new technologies, tools, and frameworks focused on high-volume data processing.
Requirements
Education: Bachelor's degree in Business Administration with specialization or a solid background in Information Systems, Systems Analysis, Computer Science, Software Engineering, Statistics, or Mathematics.
Data analysis skills;
Experience writing SQL queries;
Experience programming in Python;
Knowledge of PySpark for Big Data processing;
Familiarity with the Databricks platform;
Knowledge of Data Modeling;
Experience with AWS and cloud technologies as a whole;
Results-oriented with excellent communication and interpersonal skills;
Adherence to secure development best practices;
Business awareness, focused on building value-driven solutions for customers;
Proactivity;
Initiative;
Experience and understanding of Agile methodologies.
Data Engineer developing and maintaining data pipelines and applications at EvidenceCare. Collaborating across teams to generate actionable insights from healthcare data for better decision - making.
Data Engineer managing and expanding enterprise business intelligence and data platform. Focusing on Tableau development and administration with a strong engineering background.
Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.