Founding Staff Data Engineer building and leading data engineering team for AI - driven art valuation platform. Establishing architecture and standards for data systems and pipelines.
About the role
- Lead Data Engineer overseeing and managing the Data Engineering team. Developing ETL pipelines and ensuring data integrity within Cloud (Azure) infrastructure.
Responsibilities
- Oversees and manages the work of Data Engineer who design and develop ETL pipelines and processes in our Cloud Infrastructure.
- Responsible for the overall data integrity and quality, pipeline performance, and cost optimization within our Cloud (Azure) infrastructure.
- Manages the day-to-day tasks and development work of the Data Engineering team to ensure alignment with objectives and deliverables.
- Conducts continuous evaluation and improvement on the ETL pipelines created by the Data Engineers to ensure cost effectiveness and performance.
- Designs and implement automatic data quality reporting, communicating directly with different stakeholders whenever there are deviations.
- Create and implement technical roadmaps to ensure we have the most up-to-date Cloud infrastructure.
- Ensure technical alignment with the Data Engineering team from HQ.
Requirements
- Bachelor's degree in computer science, software engineering, information technology, or a related field.
- Advanced degree is a plus.
- 3+ years experience in data engineering, including hands-on experience in building and maintaining data pipelines and data infrastructure.
- 3+ years proven experience leading and managing a team of data engineers, including setting objectives, providing guidance, and assessing performance
- A strong foundation in data engineering principles, including data integration, ETL (Extract, Transform, Load) processes, data warehousing, and data modeling.
- Proficiency in programming languages commonly used in data engineering, such as Python, Java, Scala, or SQL.
- Proficiency with big data technologies and platforms, such as Hadoop, Spark, Apache Kafka, and distributed data processing frameworks.
- Experience with various database systems, including relational databases (e.g., SQL Server, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
- Proficiency on cloud platforms like Azure, AWS, etc. for data storage and processing.
- Ability to lead and manage a team of data engineers, including setting objectives, providing guidance, and assessing performance.
Benefits
- 30% travel projected
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer responsible for developing, maintaining ETL processes and integrating data solutions. Collaborating with teams on data quality and cloud migration initiatives.
Data Engineer optimizing data architectures and pipelines at Nexu. Focused on building reliable and efficient data flows while collaborating with cross - functional teams.
Senior Software Engineer designing and maintaining scalable data solutions for restaurant tech industry at SpotOn. Collaborating with cross - functional teams to enhance reporting and analytics platforms.
Data Architect needed to define and evolve data architecture supporting scientific compute at EIT. Collaborate and lead in large - scale research environments for transformative scientific challenges.
Engineering Data Coordinator leading a data engineering team in Azure and Databricks at Deroyque. Focusing on project management, quality assurance, and team development based in Campinas.
Data Migration Analyst responsible for supporting data migration and data quality initiatives at Abby Care, tackling family caregiving challenges.
Data Migration Specialist managing ongoing Salesforce data quality initiatives for Abby Care. Executing and validating data migrations while ensuring data accuracy.
Data Engineer designing and optimizing data solutions for Qualco Intelligent Finance. Focus on data integrity, consistency, and reusability in analytics deliverables within a hybrid environment.
Data Architect leading data architecture and design for LifeByte's technology ecosystem. Collaborating with multiple teams to ensure robust data governance, compliance, and innovative strategies.