KY
KyndrylELK Data Engineer
Data Engineer at Kyndryl transforming raw data into actionable insights using ELK Stack. Responsible for developing, implementing, and maintaining data pipelines and processing workflows.
About the role
- Identify, analyze, organizing, and storing raw data from various mediums (RDBMS, flat files, APIs, etc.)
- Develop, test, and deploy scalable data pipelines for critical business needs
- Evaluate, maintain, and enhance current data pipelines and architecture
- Maintaining code repositories adhering to proper branching flows
- Building and maintaining CI/CD framework and architecture
- Deploying and maintaining testing frameworks/suites for data pipelines and CI
- Developing, deploying, and maintaining APIs and endpoints for analyst and system use
- Deploying and maintenance of Kubernetes cluster(s)
- Peer code reviews
- Collaborate with business, development, and analytics teams to gather requirements
- Participate in data governance and stewardship program to enhance control and dissemination of data with best practices
- Develop and maintain technical documentation for pipeline architecture and tooling
Requirements
- Strong object-oriented/functional programming skills
- Python/Scala programming experience
- Proficient with ANSI SQL skills
- Familiarity with orchestration tools (Dagster preferred), Docker/Podman, CI/CD tools, and version control (git)
- Familiar and/or experience with lightweight directory access
- Experience and/or knowledge of Agile Development methodologies and SDLC
- Excellent problem-solving and analytical skills
- Proven ability to extract data from a variety of sources (Relational/Non-Relational Databases, APIs, FTP/SFTP, etc.)
- Comfortable using cloud technology platforms (AWS preferred)
- Proven abilities to take initiative and be innovative
- College Degree and/or 3 - 5 years related experience.
- Will you now or in the future require sponsorship for employment (e.g., H-1B visa)?
Benefits
- Hybrid work schedule!
- Company-sponsored Medical, Dental, Vision, Life, and Disability Insurance (Short-Term and Long-Term).
- 401k Retirement Plan with a generous 9% match
- Four weeks of PTO
- Pet Insurance
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
TC
The Clorox CompanySenior Data Engineer
Senior Data Engineer at Clorox developing cloud - based data solutions. Leading data engineering projects and collaborating with business stakeholders to optimize data flows.
FT
FCamara Consulting & TrainingData Engineer – AWS Stack
Data Engineer building solutions on AWS for high - performance data processing. Leading initiatives in data architecture and analytics for operational support.
SI
SilaeSenior Data Engineer
Senior Data Engineer overseeing Databricks platform integrity, optimizing data practices for efficient usage. Leading teams on compliance while mentoring a junior Data Engineer.
Associate Data Engineer contributing to software applications development and maintenance using Python. Collaborating with teams for clean coding and debugging practices in Pune, India.
Lead Data Engineer responsible for delivering scalable cloud - based data solutions and managing cross - functional teams. Collaborating with global stakeholders and ensuring high - quality project execution in a fast - paced environment.
Data Engineer focusing on development and optimization of data pipelines in an insurance context. Ensuring data integrity and supporting data - driven decision - making processes.
FC
Ford Motor CompanyData Engineer
Data Engineer designing and implementing data pipelines and services for Ford Pro analytics. Working with diverse teams and technologies to drive data - driven solutions.
FC
Ford Motor CompanyFull Stack Data Engineer
Full Stack Data Engineer on a Central Engineering Portfolio Team in Chennai delivering curated data products and collaborating with data engineers and product owners.
EL
EUROCLEAR UK & INTERNATIONAL LIMITEDData Engineer – Fixed Term Contract, 12 months
Data Engineer developing best - in - class data platforms for ClearBank with a focus on data insights and automation. Collaborating closely with stakeholders and supporting data science initiatives.