Data Engineer at CBTW handling data pipelines and ETL processes using SAS. Collaborating with business stakeholders and ensuring data governance within SAS environments.
Responsibilities
- Senior Lead Data Engineer
Requirements
- Key Responsibilities:
- Architect, construct , test and maintain ELT pipelines using Hadoop and Spark SQL
- Manage and optimize the infrastructure ensuring reliability and performance
- Design and implement data models and schemas for enterprise data warehouse and data marts
- Write and maintain scripts in Python for various applications
- Develop, optimize, troubleshoot complex SQL queries and database structures for relational and non-relational databases
- Work closely with analysts and product managers to understand data requirements and deliver high-quality data
- Provide technical guidance and mentorship to other team members fostering best practices in data engineering
- Monitor system performance, identify bottlenecks, implement solutions to ensure high data availability
- **
- Required Skills:
- High proficiency in the Hadoop ecosystem (HDFS, MapReduce, Yarn) and Apache Spark, Scala for large scale data processing
- Good knowledge in Python for data manipulation and scripting
- Mastery of advanced SQL and deep experience working with relational databases and datawarehouses
- Hands-on experience with workflow management tools like Apache Airflow
- Familiarity with Unix shell scripting for automation and system management
- **
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Data Engineer I at Catalyst Brands developing and optimizing data pipelines for cross - functional teams. Designing next generation data platform architecture to meet increasing data demands in a retail environment.
Data Engineer at Grupo Iter responsible for data pipelines and architecture in Azure. Collaborating on data governance and integrating analytics with Power BI.
Data Analyst for Technical Registrations at Alpargatas. Responsible for SAP data governance and product registration processes.
Full Stack Data Architect for Concurrency designing Azure data - intensive applications. Leading complex data architecture initiatives and mentoring engineering teams in a high - performance environment.
AHEAD builds digital business platforms; seeking a Data Engineer in a development program. Join us to grow into a technical leader emphasizing skills across various practices.
Data Engineer creating clean, reliable data pipelines for Plenti, a fintech lender. Collaborating with modern tools like AWS and Databricks to enhance data quality and analytics.
Data Platform Specialist overseeing data quality and platform operations at Stackgini. Collaborating with teams to enhance data management solutions and improve system performance.
Staff Data Engineer at PPRO transforming data ecosystem into a self - service platform. Leading technical vision for data engineering and building scalable infrastructures.
SSIS Data Engineer at iKnowHow Group focusing on data migration projects. Involves data modeling, integration, and using T - SQL/SQL alongside SSIS packages.