Data Engineering Analyst at Inmetrics developing and optimizing data pipelines, ensuring data quality. Collaboration with business teams aligning data solutions with business objectives.
About the role
- Data Engineer at PG&E focusing on data extraction and transformation solutions in the Electric Operations unit. Leading teams for complex data issues and ensuring data quality.
Responsibilities
- Designs, develops, modifies, configures, debugs and evaluates jobs for extracting data from various sources, implements transformation logic, and stores data in various formats fit for use by stakeholders.
- Collects metadata about jobs including data lineage and transformation logic.
- Works with teams, clients, data owners, and leadership throughout the development cycle practicing continuous improvement.
- Leads a team on moderately complex to complex data and analytics-centric problems having broad impact that require in-depth analysis and judgment to obtain results or solutions.
- Identifies, designs and implements internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
- Resolves application programming analysis problems of broad scope within procedural guidelines.
- Provides assistance to other programmers/analysts on unusual or especially complex problems that cross multiple functional/technology areas.
- Conceptualizes and generates infrastructure that allows big data to be accessed and analyzed with verified data quality and metadata is appropriately captured and catalogued.
- Collaborates with peers to develop departmental standards, norms, and new goals/objectives.
- Plans work to meet assigned general objectives; reviews progress regularly and solutions may provide an opportunity for creative/non-standard approaches.
- Assesses data pipeline performance and suggests/implements changes as required.
- Communicates (oral and written) recommendations.
- Mentors/provides guidance to less experienced colleagues.
Requirements
- BA/BS in Computer Science, Management Information Systems or related field of study, or equivalent experience
- 7 years of experience with data engineering/ETL ecosystems such as Palantir Foundry, Spark, Informatica, SAP BODS, OBIEE
- Experience with multiple data engineering/ETL ecosystems
- Experience with machine learning algorithm deployment
- Master’s degree in Computer Science, Management Information Systems or related field, or equivalent experience (desired)
- Experience leading development teams
- Business Intelligence and data access tool expertise, including advanced SQL, data modeling, and performance optimization.
- Strong software engineering fundamentals (Git, CI/CD, unit and integration testing) with production data pipelines experience
- Proficiency in Python and SQL within Palantir Foundry, including PySpark-based transformations and data workflows
Benefits
- This job is also eligible to participate in PG&E’s discretionary incentive compensation programs.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Engineer working on open - source Data Lakehouse and data pipeline development. Involves data integration and ensuring data quality in a hybrid work environment.
Data Engineer creating data pipelines in Databricks for a fast - growing digital banking platform. Responsible for ensuring data quality and optimising processes to support decision - making.
Data Engineer building scalable data pipelines and collaborating with teams at Ekimetrics. Involved in data quality, governance, and maintaining data integrity.
Senior Data Engineer developing data solutions and scalable systems at SimplePractice. Collaborating with teams to enhance analytics and decision - making for health and wellness clinicians.
Data Engineer II managing the data ingestion efforts at SimplePractice, supporting the data - driven journey and analytics across the enterprise.
Senior Data Engineer responsible for designing and implementing cloud - native data platforms for LPL Financial. Collaborating with stakeholders to enhance party reference data services and solutions.
Data Engineer in charge of designing and building data integration pipelines with Informatica and AWS technologies. Work collaboratively to deliver high - quality solutions in an agile environment.
Senior Software Engineer specializing in data engineering and infrastructure for cloud - native solutions at Cloudera. Leading technical direction and mentoring engineers in a high - impact role.
Senior Data Engineer at Sonatype responsible for building data pipelines and BI solutions. Collaborating with teams to design infrastructures empowering analytics and decision - making.