Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
About the role
- Data Architect delivering modern data solutions for clients including data ingestion, pipeline design, and cloud services in Southeast Asia. Mentoring the Rackspace data practice team locally and promoting Azure capabilities.
Responsibilities
- As a Data Architect for Data, you are passionate about data and technology solutions and are driven to learn about them and keep up with market evolution.
- You will play an active role in delivering modern data solutions for clients including data ingestion/data pipeline design and implementation, data warehouse & data lake architectures, cognitive computing and cloud services.
- You are enthusiastic about all things data, have strong problem-solving and analytical skills, are tech savvy and have a solid understanding of software development.
- In this role you will be helping to grow the Rackspace data practice in Southeast Asia. You will be the expert in the region and support the delivery of our data projects on Azure.
- As the local expert you’ll be involved in presenting to customers at events and promoting our capabilities to Azure. With a large Azure data team of over 150 people in the region it is also an opportunity to mentor and shape the data practice during our growth phase.
- More generally, Data Architect are the cornerstone of our delivery success, overseeing our most strategic accounts.
- They are empowered to make key delivery decisions and work closely with technical resources as well as our Engagement/Project Managers to ensure our customers experience successful outcomes.
- The Data Architect needs to understand client's business and technology requirements within their domain, identify gaps, areas of opportunity, and design future state improvements and lead the team of data engineers and data analysts to deliver these with high quality and customer satisfaction.
Requirements
- 12+ years' experience leading engagements from design to implementation of creative data solutions leveraging the latest in Spark based modern data platforms on public cloud
- At least 5 full lifecycle data platform deployments on Azure using first party services for Data and Analytics
- Extensive experience with following technologies: Azure Data Factory, Azure Synapse Analytics, Azure Databricks,
- Extensive experience of Azure foundation and cloud engineering concepts including network, security, cost estimation, common IaaS and PaaS services and monitoring.
- Strong Spark, SQL, Data Modeling, Data lakehouse concepts.
- Programming / scripting experience using python and scala.
- 6+ years' experience architecting solutions for optimal extraction, transformation and loading of data from a wide variety of traditional and non-traditional sources such as structured, unstructured, and semi-structured using SQL, NoSQL and data pipelines for real-time, streaming, batch and on-demand workloads
- 4+ years' experience with analytics/data management strategy formulation, architectural blueprinting and effort estimation of analytics
- 5+ years working in cloud or multi-server complex environments. Extensive experience with Azure is required.
- Ability to simplify complex technical concepts into an easy-to-understand non-technical language to facilitate, communicate and interact with executives and business stakeholders
- Ability to deal with ambiguity by making the appropriate decisions considering the relative costs and benefits of potential actions.
- Experience with Agile development methods in data-oriented projects
- Experience with Dashboarding and Reporting Tools used in the industry (Tableau, Power BI, Qlik, etc.)
- Certifications in architecture, data engineering and development from Azure is preferred
- Knowledge of software configuration management environments and tools such as JIRA, Git, Jenkins, TFS, Shell, PowerShell, Bitbucket.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.
VP, Senior Data Engineer responsible for designing and developing cloud data solutions for insider risk in Information Security at SMBC. Collaborating with multiple teams to enhance cybersecurity data platform.
Data Engineer responsible for architecting, developing, and maintaining Allegiant’s enterprise data infrastructure. Overseeing transition to cloud hosted data warehouse and developing next - generation data tools.
Senior Data Engineer developing Azure - based data solutions for clients in the Data & AI department. Collaborating with architects and consultants to enhance automated decision making.