Data Engineer at Concept Reply developing innovative data - driven solutions in IoT. Collaborating with teams to unlock the potential of data and cloud computing.
About the role
- Senior Data Engineer at SiteMinder responsible for building data pipelines and models. Collaborating within a data hub supporting reporting initiatives for the hotel commerce platform.
Responsibilities
- Dedicate your time to developing, testing, and maintaining high-quality, scalable ETL/ELT data pipelines using Python, PySpark, and Databricks on AWS
- You will lead the development of new data features and services across the full product lifecycle, from architectural design to deployment including technologies like Terraform, spark structured streaming, dlt, etc.
- Create CI/CD controlled data engineering deployments using Databricks Asset Bundles and leverage Databricks serverless compute with cost optimization techniques to deliver performant data products
- Work within a fast-paced agile team, collaborating closely with Product Managers, Data Scientists, and fellow engineers to solve complex data challenges. You will help ensure the quality, integrity, and security of data throughout the data lifecycle, implementing best practices in data governance
- Take technical ownership of major components of our data platform architecture. You will lead design discussions, ensuring our data systems are secure, scalable, and maintainable
- Analyse workloads, queries, clusters/warehouses, jobs, and services to identify inefficiencies and savings opportunities
- Implement continuous monitoring and intelligence dashboards for cost and performance optimization
- Stay ahead of new Snowflake/Databricks features and translate them into marketable product differentiators
Requirements
- Extensive experience with data engineering; **DataBricks & DBT** (Mandatory)
- Proven expertise in platform internals:
- **Databricks**: clusters, jobs, Delta Lake, Spark optimization, autoscaling, Unity Catalog
- Strong **SQL + Python skills** for automation, monitoring, and recommendation logic
- Experience with frameworks like **Terraform & Airflow**
- Track record of delivering performance gains and cost savings through platform-level optimizations
- Startup mindset: hands-on, automation-driven, customer-value obsessed
- **Preferred but not mandatory**
- Databricks Certification
- Familiarity with compliance frameworks like SOC2, GDPR
- Knowledge of LLMs and AI frameworks
Benefits
- Mental health and well-being initiatives
- Generous parental (including secondary) leave policy
- Flexibility to work in a Hybrid model (2 days in-office)
- Paid birthday, study and volunteering leave every year
- Sponsored social clubs, team events, and celebrations
- Employee Resource Groups (ERG) to help you connect and get involved
- Investment in your personal growth offering training for your advancement
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer creating and managing data pipelines for critical data solutions at S&P Global. Collaborating on enterprise - scale data processing in a supportive, innovative environment.
Data Engineer supporting and evolving data environment in cloud migration. Maintain and optimize existing databases while designing modern data solutions with cross - functional collaboration.
Senior Data Engineer responsible for data pipeline projects at Suprema Gaming. Focus on batch and streaming data solutions while collaborating with business teams.
Senior data leader managing the enterprise data architecture at Breakthru Beverage. Leading high - performing teams in data engineering and defining modern data strategies.
Data Engineer at Equinix implementing data architecture solutions for scalability and analytics. Collaborating with teams to design data pipelines and maintain data models for business objectives.
Data Warehouse Architect developing and optimizing robust data warehouse environments on SAP BW/4HANA. Critical for enabling advanced analytics and reporting across the organization.
Data Engineering Manager leading a new Data Engineering team in Bengaluru. Shaping the design and scaling of core data engineering practices across the organization.
Senior Google Data Architect designing and delivering scalable data solutions on Google Cloud Platform. Collaborating across teams to shape target - state data architectures and influence enterprise data strategy.
Sr. ETL/Data Warehouse Lead at Huntington designing, developing, and supporting ETL and Data Warehousing framework. Analyzing systems based on specifications and providing technical assistance.