Hybrid Data & Analytics Engineer

Posted 5 days ago

Apply now

About the role

  • Perform end to end automation of ETL/ELT process for various datasets that are being ingested into the Data Platform.
  • Design, develop and maintain data ingestion pipelines.
  • Create Spark jobs for data transformation and aggregation.
  • Develop, enhance, and manage conceptual, enterprise logical (LDM) and physical data models (PDM) to ensure the information models can meet end user and developer needs.
  • Understand and apply logical entity-relational design concepts.
  • Recommend opportunities for reuse of data models in the new environments.
  • Develop dimensional models and views needed for data analytics and reporting.
  • Optimize and update logical and physical data models to support new and existing projects.
  • Leads the development of creative new data integrations, modifications to existing software, and/or makes decisions regarding integrating software applications data in accordance with agreed upon specifications.
  • Serve as a subject matter expert of our solutions and address to a business or technical audience.
  • Collaborate with Analysts, Architects and Developers to establish and maintain the Data Platform framework.
  • Prepare and maintain technical documentation.

Requirements

  • Bachelor's degree in a technical field such as computer science, computer engineering or related field
  • 4+ years' experience with Data Modelling.
  • 4+ years’ experience with Python programming language
  • 4+ years’ experience with Apache Spark streaming and batch framework
  • 4+ years’ experience developing data lake
  • 2+ years experience of Databricks
  • Knowledge of Microsoft Azure Platform
  • Strong understanding and experience of relational/non-relational database, including design and implementation
  • Strong communication skills required to communicate effectively with business and other stake holders
  • Strong Analytical and Problem-Solving Skills
  • Excellent Time Management Skills

Job title

Data & Analytics Engineer

Job type

Experience level

Mid levelSenior

Salary

Not specified

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job