Data Engineer developing complex data pipelines for Symphony, a global software company. Collaborating with teams and driving data solutions in a hybrid work environment.
Responsibilities
Lead and drive the development of complex data pipelines and ETL processes, ensuring the highest quality of data and user experience.
Collaborate with product and design teams to translate high-level requirements into detailed data architectures and designs.
Ensure the performance, quality, and responsiveness of data solutions, implementing best practices for performance optimization.
Work closely with cross-functional teams, including UX/UI Designers, Data Scientists, and Product Managers, to ensure seamless integration and delivery of data solutions.
Stay abreast of the latest industry trends and emerging technologies, proactively integrating new solutions and methodologies to enhance our development processes.
Provide technical guidance and coaching to Data Engineers, conducting code reviews and fostering a collaborative development environment.
Develop and maintain comprehensive testing strategies to ensure the reliability and stability of data pipelines.
Create and maintain detailed documentation for code, architecture, and development processes.
Requirements
Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent practical experience.
6+ years of professional experience in Data Engineering.
Proficiency in SQL.
Experience with one or more programming languages such as Python, Scala or Java.
Docker and containerization.
Understanding of data warehousing concepts.
Data engineering and ETL tools and methodologies.
Knowledge of big data technologies like Hadoop, Spark, or Kafka.
Knowledge of version control systems (e.g., Git).
Familiarity with data visualization tools.
Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
OLAP, OLTP environments.
Understanding the basics of relational and non-relational data modeling.
CI/CD and Infrastructure as Code (IaC).
Proficiency in RESTful API design and implementation.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.
Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.
Junior Data Engineer at OneMarketData focusing on data quality and integrity in financial datasets. Collaborating with senior analysts and assisting in data management and analysis tasks.
Senior Data Engineering Analyst developing and implementing data solutions. Collaborating in a diverse environment focused on data processing and analysis for clients' digital transformation.
Principal Software Engineer in Threat Data Platform developing AI - driven tools for threat intelligence automation. Collaborating on robust data pipelines for PANW’s product ecosystem.
Senior Azure Data Engineer maintaining business intelligence solutions for Grupo Gloria, implementing and stabilizing projects in Azure and Databricks with Power BI reporting.
Staff Data Engineer at URBN developing AI - powered digital experiences by integrating algorithmic solutions with creative tools. Collaborating with cross - functional teams for impactful product evolution.
Senior Data Engineer at Anglian Water responsible for scalable data solutions and team collaboration. Leading design, build, and operation of secure data pipelines for critical services.