Founding Staff Data Engineer building and leading data engineering team for AI - driven art valuation platform. Establishing architecture and standards for data systems and pipelines.
About the role
- Senior Data Engineer responsible for developing, maintaining ETL processes and integrating data solutions. Collaborating with teams on data quality and cloud migration initiatives.
Responsibilities
- Develop, maintain and optimize ETL/ELT processes across different platforms (SQL Server, Spark, NoSQL).
- Migrate data routines and data loads from SQL Server to Spark (PySpark).
- Develop scripts and automations in Python.
- Model and structure data following governance and performance best practices.
- Collaborate with architects, analysts and testers to ensure data quality and integrity.
- Support data migration and modernization initiatives in cloud environments (GCP).
Requirements
- Minimum of 4 years of experience in data modeling, integration and data processing.
- Proficiency in ANSI SQL, data modeling and relational databases.
- Experience with SQL Server and Spark (PySpark).
- Knowledge of Python and NoSQL.
- Understanding of ETL/ELT concepts and data engineering best practices.
- Experience with GCP.
- Strong verbal and written communication skills and analytical problem-solving abilities.
Benefits
- Not specified
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Data Engineer optimizing data architectures and pipelines at Nexu. Focused on building reliable and efficient data flows while collaborating with cross - functional teams.
Senior Software Engineer designing and maintaining scalable data solutions for restaurant tech industry at SpotOn. Collaborating with cross - functional teams to enhance reporting and analytics platforms.
Data Architect needed to define and evolve data architecture supporting scientific compute at EIT. Collaborate and lead in large - scale research environments for transformative scientific challenges.
Engineering Data Coordinator leading a data engineering team in Azure and Databricks at Deroyque. Focusing on project management, quality assurance, and team development based in Campinas.
Data Migration Analyst responsible for supporting data migration and data quality initiatives at Abby Care, tackling family caregiving challenges.
Data Migration Specialist managing ongoing Salesforce data quality initiatives for Abby Care. Executing and validating data migrations while ensuring data accuracy.
Lead Data Engineer overseeing and managing the Data Engineering team. Developing ETL pipelines and ensuring data integrity within Cloud (Azure) infrastructure.
Data Engineer designing and optimizing data solutions for Qualco Intelligent Finance. Focus on data integrity, consistency, and reusability in analytics deliverables within a hybrid environment.
Data Architect leading data architecture and design for LifeByte's technology ecosystem. Collaborating with multiple teams to ensure robust data governance, compliance, and innovative strategies.