Data Engineer at CBTW handling data pipelines and ETL processes using SAS. Collaborating with business stakeholders and ensuring data governance within SAS environments.
About the role
- Data Engineer I at Catalyst Brands developing and optimizing data pipelines for cross-functional teams. Designing next generation data platform architecture to meet increasing data demands in a retail environment.
Responsibilities
- Design, build, and maintain scalable, secure and reliable data pipelines and platforms.
- Develop ETL processes to ingest, transform, and load data into the data lake, ensuring data quality, integrity, and consistency.
- Collaborate with business stakeholders, report developers, and data scientists to understand data requirements and translate them into technical solutions for various business purposes.
- Drive performance, scalability, and cost optimization across data infrastructure.
- Implement data governance, quality, security, and compliance practices.
- Troubleshoot data issues, identify root causes, and implement solutions in a timely manner.
- Demonstrate excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
Requirements
- Bachelor’s degree in computer science, engineering or related field with 2+ years of experience in a Data Engineer role.
- Experience as a Data Engineer with a strong track record of designing and implementing data solutions.
- Proficiency in a programming language such as Python, with experience in building data pipelines and workflows.
- Experience with cloud data warehousing technologies, such as Snowflake and Redshift.
- Experience with distributed computing frameworks Spark.
- Familiarity with cloud platforms AWS and their services (e.g., S3, EC2, EMR, Glue, CloudWatch, Athena, Lambda).
- Knowledge of database concepts, data modeling, schemas, and query languages (SQL and Hive).
- Experience with Agile/Scrum development processes and methodologies.
- Master’s degree in computer science, engineering, data science related field (Preferred).
- Experience with containerization and orchestration technologies, such as Docker and Kubernetes (Preferred).
- Experience building CI/CD pipelines using tools like GitLab and Bitbucket (Preferred).
- Familiarity with data pipeline orchestration tools, such as Airflow and Jenkins (Preferred).
- Knowledge of data visualization and reporting tools, such as MicroStrategy, Tableau, and Power BI (Preferred).
- Understanding of data quality and monitoring techniques and tools, such as Great Expectations (Preferred).
- Knowledge of data governance processes (lineage, cataloging, dictionaries) using tools like DataHub (Preferred).
- Familiarity with streaming data processing and real-time analytics technologies, such as Kafka (Preferred).
- Retail industry experience (Preferred).
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Engineer at Grupo Iter responsible for data pipelines and architecture in Azure. Collaborating on data governance and integrating analytics with Power BI.
Data Analyst for Technical Registrations at Alpargatas. Responsible for SAP data governance and product registration processes.
Full Stack Data Architect for Concurrency designing Azure data - intensive applications. Leading complex data architecture initiatives and mentoring engineering teams in a high - performance environment.
AHEAD builds digital business platforms; seeking a Data Engineer in a development program. Join us to grow into a technical leader emphasizing skills across various practices.
Data Engineer creating clean, reliable data pipelines for Plenti, a fintech lender. Collaborating with modern tools like AWS and Databricks to enhance data quality and analytics.
Data Platform Specialist overseeing data quality and platform operations at Stackgini. Collaborating with teams to enhance data management solutions and improve system performance.
Staff Data Engineer at PPRO transforming data ecosystem into a self - service platform. Leading technical vision for data engineering and building scalable infrastructures.
SSIS Data Engineer at iKnowHow Group focusing on data migration projects. Involves data modeling, integration, and using T - SQL/SQL alongside SSIS packages.
Principal Data Engineer designing and implementing data solutions that ensure trust and transparency in supply chains. Collaborating with global teams and mentoring fellow engineers in data practices.