Senior Data Engineer architecting and maintaining scalable data systems while collaborating with cross - functional teams at SpotOn, aimed at empowering independent restaurants.
About the role
- Data Engineer building and maintaining data infrastructure for AI life science products. Collaborating with cross-functional teams to deliver impactful solutions while participating in Agile processes.
Responsibilities
- Develop, maintain and update ETL catalog.
- Build, maintain and update repeatable and trackable data pipelines.
- Collect, analyze and organize raw data in collections of datasets.
- Design databases and data stores for big datasets with performance considerations in mind.
- Collaborate with engineers and data scientists to develop and productize prototypes.
- Participate in architectural decisions regarding our data architecture.
- Participate in our Agile processes like planning and daily stand-up meetings.
Requirements
- 3+ years of professional experience as a data engineer or in a similar role.
- Proven experience with Relational and NoSQL data stores.
- Proven experience with data models, data mining, and segmentation techniques.
- Experience with big data tools, specifically Spark (preferably with Databricks).
- Experience with data pipeline / workflow orchestration tools (Azure DataFactory, Prefect).
- Experience with cloud compute frameworks like Azure Batch.
- Experience with Python.
- Experience with SQL query authoring.
- Experience with Git and collaborative development workflows.
- Experience with data manipulation and transformation using Pandas and/or Polars.
- Experience working with cross-functional teams in agile environments.
- Excellent verbal and written communication in English.
- Ability to provide clear and concise step-by-step technical help, verbally and in writing.
- Ability to interact effectively with audiences of varying technical backgrounds & seniority.
- BS/MS degree in Computer Science, Information Technology or a related field (nice to have).
- Familiarity with Atlassian stack of tools(Jira, Jira service management & Confluence)(nice to have).
- Familiarity with microservices-based architectures (nice to have).
- Familiarity with bioinformatics or life sciences data (nice to have).
Benefits
- Competitive compensation packages based on qualifications.
- Flexible work schedule.
- Professional and personal development opportunities.
- Private life & health insurance.
- Room to experiment, learn and have fun.
- Peers with big smiles and fascinating ideas.
- A multi-disciplinary, multinational team that values trust and autonomy.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Analytics & Data Engineer joining a data - driven team at Adlook, building data products and automating data pipelines. Collaborate across teams to enhance data analysis and AI functionality.
Data Engineer building data foundations for People Analytics at Notion. Designing data systems and collaborating with People leadership to enhance workforce decision - making.
T&T Consultant driving the growth of AI & Data solutions at Deloitte Southeast Asia. Leading client transformations through data, analytics, and intelligent automation.
Lead the Artificial Intelligence & Data team at Deloitte Southeast Asia. Drive IA business growth and deliver innovative solutions in data and analytics.
IT Senior Data Architect developing data solutions including data modeling, governance, and management for Eversource in a hybrid role.
Data Engineer building data solutions for Travelers' analytics team. Responsible for designing, building, and operationalizing complex data pipelines with a focus on AI and Machine Learning.
Senior Data Engineer designing and deploying complex data products in a collaborative environment focused on continuous improvement. Leading initiatives to optimize data solutions and ensuring technical excellence.
Data Engineer working closely with clients to develop sustainable data solutions. Engaging in consultancy and hands - on implementation within a hybrid role in Bruvo.
Data Engineer specializing in digital transformation at Bounteous. Collaborating on data solutions and migration projects with a focus on data integrity and quality.