Senior Data Engineer with AWS expertise leading financial data architecture and scalable solutions. Collaborating in wealth management to enhance data quality and systems.
About the role
- Lead Data Engineer architecting enterprise data platform at Ness Digital Engineering. Drive data engineering roadmap and ensure scalability, performance, and innovation.
Responsibilities
- Lead the data architecture and engineering strategy, ensuring alignment with business and technology roadmaps.
- Design and implement data models, pipelines, and data integration frameworks across multiple platforms.
- Partner with stakeholders to translate business requirements into scalable data solutions.
- Optimize data pipelines for performance, scalability, and reliability, including query tuning and resource management within Snowflake.
- Drive adoption of best practices in data engineering design patterns and modern cloud architectures.
- Implement and monitor data validation procedures to ensure data accuracy and consistency across systems.
- Work closely with project managers, data architects, and business analysts to align project milestones and deliverables with business goals.
- Mentor and guide data engineering teams (onsite & offshore) to deliver high-quality outcomes.
- Ensure compliance with data governance, security, and privacy standards.
- Create and maintain detailed documentation of data pipelines, data flow diagrams, and transformation logic.
- Troubleshoot and resolve issues related to data pipelines, including job failures and performance bottlenecks.
Requirements
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- 8+ years of experience in data engineering with a strong focus on Data Architecture, Data Modelling (Conceptual, Logical, Physical), ELT processes and data pipeline development.
- Hands-on experience with Snowflake cloud data platform, including data sharing, secure views, and performance optimization.
- Proficiency in SQL and familiarity with data integration and ETL/ELT tools.
- Azure Data Services and other Cloud Technologies (Glue, EMR)
- Data Bricks hands on experience
- Python for data engineering workflows
- Strong understanding of data engineering design patterns
- Strong problem-solving skills and the ability to work independently to meet deadlines.
- Excellent communication skills for effectively interacting with technical and non-technical stakeholders.
Benefits
- Flexible remote options
- Diverse projects
- Access to development resources
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Migration Specialist handling large - scale data migration from legacy to enterprise PLM platform. Analyzing data structures, developing strategies, and ensuring integrity across systems.
Director leading strategy, governance, and delivery of enterprise data platform at Phillips 66. Partnering with AI, Data Science, and business teams to enhance analytics and business systems.
Product Owner driving ERP data migration initiatives for BioNTech’s global landscape. Leading effective data management and ensuring compliance with regulatory standards in a fast - paced environment.
Data Engineer II leading development and delivery of data pipelines for Syneos Health. Collaborating with teams to optimize data processing and integrate solutions into production environments.
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.