Senior Data Engineer designing and scaling data infrastructure for analytics, machine learning, and business intelligence in a software supply chain security company.
About the role
- Write data infrastructure & analytics software tools for Data Science
- Guide Data Scientists on best practices in software engineering
- Modernize existing SAS and Hive SQL codebase to higher performance structures leveraging parallel computing capabilities
- Instrument data feeds for observability, profiling, and monitoring
- Develop shared resources to support Data Science work such as automated profiling and analysis tools
- Write detailed, complete, and enduring documentation to enable long term support
Requirements
- Bachelor’s degree
- Spark experience
- Hive SQL knowledge
- Software/data engineering in Python
- Machine Learning toolkits in Python/Spark
- Building reusable frameworks for data ingestion and storage in Hadoop or AWS/S3
- Relational databases knowledge including optimizing/tuning queries, indexing, partitioning, etc.
- SAS knowledge and ability to convert from SAS to Python
Benefits
- Hybrid work model for collaborative environment
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
NI
NinjaTraderSenior Data Engineer
Data Engineer developing architecture and pipelines for data analytics at NinjaTrader. Empowering analysts and improving business workflows through data - driven solutions.
SP
SpecsaversData Engineer
Data Engineer designing and developing data solutions at Specsavers. Collaborating on data pipelines and migrations with analysts and stakeholders.
AL
AlterricData Engineer
Data Engineer joining Alterric to collaborate on data platform projects and analytics solutions. Working with Azure Cloud technologies to ensure data quality and integrity for informed decision - making.
KY
KyndrylELK Data Engineer
Data Engineer at Kyndryl transforming raw data into actionable insights using ELK Stack. Responsible for developing, implementing, and maintaining data pipelines and processing workflows.
TC
The Clorox CompanySenior Data Engineer
Senior Data Engineer at Clorox developing cloud - based data solutions. Leading data engineering projects and collaborating with business stakeholders to optimize data flows.
FT
FCamara Consulting & TrainingData Engineer – AWS Stack
Data Engineer building solutions on AWS for high - performance data processing. Leading initiatives in data architecture and analytics for operational support.
SI
SilaeSenior Data Engineer
Senior Data Engineer overseeing Databricks platform integrity, optimizing data practices for efficient usage. Leading teams on compliance while mentoring a junior Data Engineer.
Associate Data Engineer contributing to software applications development and maintenance using Python. Collaborating with teams for clean coding and debugging practices in Pune, India.
Lead Data Engineer responsible for delivering scalable cloud - based data solutions and managing cross - functional teams. Collaborating with global stakeholders and ensuring high - quality project execution in a fast - paced environment.