SP
SpecsaversData Engineer
Data Engineer designing and developing data solutions at Specsavers. Collaborating on data pipelines and migrations with analysts and stakeholders.
About the role
- Design, implement, and maintain scalable data pipelines using ELK Stack (Elasticsearch, Logstash, Kibana) and Beats for monitoring and analytics.
- Develop data processing workflows to handle real-time and batch data ingestion, transformation and visualization.
- Implement techniques like grok patterns, regular expressions, and plugins to handle complex log formats and structures.
- Configure and optimize Elasticsearch clusters for efficient indexing, searching, and performance tuning.
- Collaborate with business users to understand their data integration & visualization needs and translate them into technical solutions.
- Create dynamic and interactive dashboards in Kibana for data visualization and insights that can enable to detect the root cause of the issue.
- Leverage open-source tools such as Beats and Python to integrate and process data from multiple sources.
- Collaborate with cross-functional teams to implement ITSM solutions integrating ELK with tools like ServiceNow and other ITSM platforms.
- Anomaly detection using Elastic ML and create alerts using Watcher functionality.
- Extract data by Python programming using API.
- Build and deploy solutions in containerized environments using Kubernetes.
- Monitor Elasticsearch clusters for health, performance, and resource utilization.
- Automate routine tasks and data workflows using scripting languages such as Python or shell scripting.
- Provide technical expertise in troubleshooting, debugging, and resolving complex data and system issues.
- Create and maintain technical documentation, including system diagrams, deployment procedures, and troubleshooting guides.
Requirements
- At least 3 years of experience with ELK Stack and Python programming, along with a minimum of 5 years overall experience in the IT industry.
- ELK Stack: Deep expertise in Elasticsearch, Logstash, Kibana, Beats and Anomaly detection.
- Programming: Good understanding in Python for scripting and automation.
- ITSM Platforms: Hands-on experience with ServiceNow or similar ITSM tools.
- Containerization: Understanding with Kubernetes and containerized applications.
- Operating Systems: Strong working knowledge of Windows, Linux, and AIX environments.
- Open Source Tools: Familiarity with various open-source data integration and monitoring tools.
- Additional Skills: Knowledge of network protocols, log management, and system performance optimization.
- Experience in integrating ELK solutions with enterprise IT environments.
- Strong analytical and problem-solving skills with attention to detail.
- Knowledge in MySQL or NoSQL Databases will be added advantage.
- Fluent in English (written and spoken).
Benefits
- Health insurance
- 401(k) matching
- Flexible working hours
- Paid time off
- Remote work options
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
AL
AlterricData Engineer
Data Engineer joining Alterric to collaborate on data platform projects and analytics solutions. Working with Azure Cloud technologies to ensure data quality and integrity for informed decision - making.
TC
The Clorox CompanySenior Data Engineer
Senior Data Engineer at Clorox developing cloud - based data solutions. Leading data engineering projects and collaborating with business stakeholders to optimize data flows.
FT
FCamara Consulting & TrainingData Engineer – AWS Stack
Data Engineer building solutions on AWS for high - performance data processing. Leading initiatives in data architecture and analytics for operational support.
SI
SilaeSenior Data Engineer
Senior Data Engineer overseeing Databricks platform integrity, optimizing data practices for efficient usage. Leading teams on compliance while mentoring a junior Data Engineer.
Associate Data Engineer contributing to software applications development and maintenance using Python. Collaborating with teams for clean coding and debugging practices in Pune, India.
Lead Data Engineer responsible for delivering scalable cloud - based data solutions and managing cross - functional teams. Collaborating with global stakeholders and ensuring high - quality project execution in a fast - paced environment.
Data Engineer focusing on development and optimization of data pipelines in an insurance context. Ensuring data integrity and supporting data - driven decision - making processes.
FC
Ford Motor CompanyData Engineer
Data Engineer designing and implementing data pipelines and services for Ford Pro analytics. Working with diverse teams and technologies to drive data - driven solutions.
FC
Ford Motor CompanyFull Stack Data Engineer
Full Stack Data Engineer on a Central Engineering Portfolio Team in Chennai delivering curated data products and collaborating with data engineers and product owners.