Senior Data Engineer role at AI & Data Engineering focused on Databricks engineering.
About the role
- Data Engineer responsible for building and maintaining data transformation pipelines at OnePay. Collaborating across teams in a mission-driven fintech environment.
Responsibilities
- Building and maintaining One's data infrastructure.
- Developing and owning One's streaming data transformation pipeline.
- Managing and supporting reporting and analytics tools.
- Collaborating closely with our Data Analysts and Data Scientists.
- Tracking and defining metrics around performance.
- Additional duties as assigned by your manager.
Requirements
- 5 + years of experience
- Experience in Databricks, Apache Spark, Scala, Python, SQL
- Experience designing and implementing low latency data pipelines using Spark structured streaming
- Experience optimizing SQL queries and lake / warehouse data structures
- Cost-conscience creative problem solving
- Proficient in AWS cloud services and technologies
- Experience building, shipping — and growing — non-trivial products & services
- Passion for your craft, people, and our mission. You value quality across code, communication, and culture.
- A desire to keep growing your skills, and an ability to learn quickly. We hire for slope, not just y-intercept.
Benefits
- Competitive salary, stock options, and benefits from Day 1
- Comprehensive health insurance coverage (health insurance, accident and disability insurance, term life insurance), including mental health support and wellness programs
- Hybrid work model (Bengaluru office three days a week), various time off programs (vacation, sick, other paid leaves, and paid regional holidays)
- Monthly transport and work-from-home allowances
- A high-growth, mission-driven, inclusive culture where your work has real impact
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer at Yü Group responsible for leading data engineering team and optimizing data solutions within the energy sector.
Data Engineer managing payment processing and data accuracy while collaborating with financial teams. Building and optimizing data pipelines for transactional data in a hybrid work environment.
Data Engineer building analytical tools for Dry Bulk market data operations at Kpler. Join a team of over 700 experts transforming data into actionable strategies.
Data Engineer developing tools for maintaining data integrity in cargo tracking at Kpler. Collaborating with analysts and engineers to enhance data quality management.
Lead Azure Data Engineer designing and optimizing data ecosystems on Microsoft Cloud. Responsible for building scalable data platforms and pipelines for analytics and reporting.
Data Engineer providing support for IBM DataStage ETL jobs at Callibrity. Collaborating with stakeholders and working to modernize technology solutions in a hybrid work environment.
Cloud Data Engineer implementing tailored solutions for Volkswagen Group data processing. Building ETL/ELT pipelines while collaborating with technical experts.
Data Engineer responsible for building scalable data infrastructure that supports data - driven decisions. Collaborating with team to maintain systems and unlock data value for organizations.
Data Engineer designing and optimizing data pipelines using Databricks and Google Cloud Platform. Collaborating with analysts and scientists to deliver high - quality data products.