SP
SpecsaversData Engineer
Data Engineer designing and developing data solutions at Specsavers. Collaborating on data pipelines and migrations with analysts and stakeholders.
About the role
- Provide technical thought leadership and compare different technologies to meet business requirements and cost control drivers
- Work with Business and IT groups to design and deliver a data lake platform
- Produce & maintain the overall solution design for the entire Data Lake Platform
- Execute data strategy and help in the design and architecture of solutions on the platform
- Enforce technical best practices for Big Data management and solutions, from software selection to technical architectures and implementation
- Document and publish best practices, guidelines, and training information
- Ensure all functional solutions and components of the Data Lake platform service are designed and implemented to meet SLAs
- Contribute to continuous improvement of support & delivery functions and recommend enhancements to application services
- Focus on data quality throughout ETL & data pipelines, driving improvements to data management, storage, and security
Requirements
- Bachelor/master's degree in computer science, computer engineering, information technology, or relevant field
- At least 8+ years’ experience in working in software development
- At least 8+ years’ experience in building massively scalable distributed data processing solutions
- At least 6+ years’ experience of database design & development
- At least 4 years of experience in Apache Spark, ElasticSearch, Cassandra, Hadoop, Apache Hive, Snowflake, Jupyter notebook, databricks
- At least 4 years of experience in PostgreSQL or Oracle DB (Oracle 11g+, PostgresSQL 9+, AWS RDS)
- At least 4 years of experience in Technologies and Tools like AWS, AWS Glue, Lambda
- Experience building Data Pipelines & ETL jobs using cloud-native technologies & design patterns
- Experience in designing resilient systems & creating disaster recovery plans
- Experience working in Master Data Management & designing CMSes or evaluating 3rd party CMS products
- Experience working in Agile Scrum or Kanban teams & deploying solutions using Continuous Delivery best practices
- Experience using automated database migration tools & strong opinions on version control best practices for SQL scripts
- Technical skills: pySpark, Python, Java, Query engines, Postgres/SQL, AWS, Java/Kotlin
Benefits
- Hybrid work model
- Flexible and employee friendly work environment
- 9 hours of work per day including 1-hour lunch break
- Equal employment opportunities and non-discrimination policy
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
AL
AlterricData Engineer
Data Engineer joining Alterric to collaborate on data platform projects and analytics solutions. Working with Azure Cloud technologies to ensure data quality and integrity for informed decision - making.
KY
KyndrylELK Data Engineer
Data Engineer at Kyndryl transforming raw data into actionable insights using ELK Stack. Responsible for developing, implementing, and maintaining data pipelines and processing workflows.
TC
The Clorox CompanySenior Data Engineer
Senior Data Engineer at Clorox developing cloud - based data solutions. Leading data engineering projects and collaborating with business stakeholders to optimize data flows.
FT
FCamara Consulting & TrainingData Engineer – AWS Stack
Data Engineer building solutions on AWS for high - performance data processing. Leading initiatives in data architecture and analytics for operational support.
SI
SilaeSenior Data Engineer
Senior Data Engineer overseeing Databricks platform integrity, optimizing data practices for efficient usage. Leading teams on compliance while mentoring a junior Data Engineer.
Associate Data Engineer contributing to software applications development and maintenance using Python. Collaborating with teams for clean coding and debugging practices in Pune, India.
Data Engineer focusing on development and optimization of data pipelines in an insurance context. Ensuring data integrity and supporting data - driven decision - making processes.
Lead Data Engineer responsible for delivering scalable cloud - based data solutions and managing cross - functional teams. Collaborating with global stakeholders and ensuring high - quality project execution in a fast - paced environment.
FC
Ford Motor CompanyFull Stack Data Engineer
Full Stack Data Engineer on a Central Engineering Portfolio Team in Chennai delivering curated data products and collaborating with data engineers and product owners.