Senior Data Engineer designing and scaling data infrastructure for analytics, machine learning, and business intelligence in a software supply chain security company.
About the role
- Lead the strategy and execution of complex and large Global Specialty Data and Analytics portfolio
- Develop and implement a strategic roadmap to modernize legacy data and analytics ecosystems using Cloud and AI
- Solve for data complexity by enabling data domains and data products for all consumption architypes and stakeholders including reporting, data science, AI/ML and analytics
- Ensure data architecture and solutions align with enterprise-wide standards for Data, AI and Analytics
- Effectively communicate strategy, execution progress, and outcomes to diverse stakeholders and promote data capabilities through thought leadership and presentations
- Implementing AI data pipelines that integrate structured, semi-structured, and unstructured data to support AI and Agentic solutions
- Design, build and maintain scalable real-time data pipelines for efficient ingestion, processing, and delivery
- Oversee the design, development, and maintenance of data pipelines, data warehouses, data lakes and reporting systems
- Build, mentor, and lead a high-performing team including business data analysts, data engineers and release train engineers
- Identify and champion developer productivity improvements across the end-to-end data management lifecycle
- Stay current with emerging trends in data engineering and AI/ML and recommend innovative tools and technologies to enhance data capabilities enabling business strategy
- Define and implement robust data management frameworks to ensure successful adoption of Enterprise Data Governance and Data Quality practices
- Effectively manage the budget and financials for GS Data and Analytics portfolio
Requirements
- 15+ years in data engineering, data management and building large-scale data ecosystems
- Bachelor’s or Master’s degree in Computer Science, Data Science or a related field
- 5+ years in senior leadership roles managing large and complex data and analytics portfolio with a people budget of at least $10M
- Proven strategic and innovative thinker with a track record of enabling transformative data capabilities
- Mastery level data engineering and architecture skills, including deep expertise in data architecture patterns, data warehouse, data integration, data lakes, data domains, data products, business intelligence, and cloud technology capabilities
- Technical expertise in LLMs, AI platforms, prompt engineering, LLM optimization, Retrieval-Augmented Generation (RAG) architectures and vector database technologies (Vertex AI, Postgres, OpenSearch, Pinecone etc.)
- Strong experience with GCP, Vertex AI or AWS required
- Experience in multi cloud environment
- Experience in Lang chain, AI agents, Vertex AI and Google Agent ecosystem
- Strong experience with the design and development of complex data ecosystems leveraging next-generation cloud technology stack across AWS or GCP Cloud and Snowflake
- Exceptional presentation and verbal/written communication skills; must be able to communicate effectively at all levels across the organization
- Ability to lead successfully in a lean, agile, and fast-paced organization, leveraging Scaled Agile principles and ways of working
- Excellent negotiation, influencing, and conflict resolution skills; adept at building strong cross-functional relationships
Benefits
- Other rewards may include short-term or annual bonuses
- Long-term incentives
- On-the-spot recognition
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
NI
NinjaTraderSenior Data Engineer
Data Engineer developing architecture and pipelines for data analytics at NinjaTrader. Empowering analysts and improving business workflows through data - driven solutions.
SP
SpecsaversData Engineer
Data Engineer designing and developing data solutions at Specsavers. Collaborating on data pipelines and migrations with analysts and stakeholders.
AL
AlterricData Engineer
Data Engineer joining Alterric to collaborate on data platform projects and analytics solutions. Working with Azure Cloud technologies to ensure data quality and integrity for informed decision - making.
KY
KyndrylELK Data Engineer
Data Engineer at Kyndryl transforming raw data into actionable insights using ELK Stack. Responsible for developing, implementing, and maintaining data pipelines and processing workflows.
TC
The Clorox CompanySenior Data Engineer
Senior Data Engineer at Clorox developing cloud - based data solutions. Leading data engineering projects and collaborating with business stakeholders to optimize data flows.
FT
FCamara Consulting & TrainingData Engineer – AWS Stack
Data Engineer building solutions on AWS for high - performance data processing. Leading initiatives in data architecture and analytics for operational support.
SI
SilaeSenior Data Engineer
Senior Data Engineer overseeing Databricks platform integrity, optimizing data practices for efficient usage. Leading teams on compliance while mentoring a junior Data Engineer.
Associate Data Engineer contributing to software applications development and maintenance using Python. Collaborating with teams for clean coding and debugging practices in Pune, India.
Lead Data Engineer responsible for delivering scalable cloud - based data solutions and managing cross - functional teams. Collaborating with global stakeholders and ensuring high - quality project execution in a fast - paced environment.