Data Engineer designing and building data pipelines for PG&E's reliability initiatives. Engaging in continuous improvement and collaborating with various stakeholders in hybrid role.
Responsibilities
Designs, develops, modifies, configures, debugs and evaluates jobs for extracting data from various sources
Implements transformation logic, and stores data in various formats fit for use by stakeholders
Collects metadata about jobs including data lineage and transformation logic
Works with teams, clients, data owners, and leadership throughout the development cycle practicing continuous improvement
Assembles large, complex sets of data that meet non-functional and functional business requirements
Builds high-performance data pipelines and prototypes that enable business use of the data
Builds infrastructure for optimal extraction, transformation and loading of data from various data sources
Understands business requirements and applies them to complex software engineering and analysis
Communicates (oral and written) recommendations with peers inside the department
Partners with team members to understand and incorporate standards information and requirements into work procedures
Identifies and analyzes to departmental standards, norms, and new goals/objectives
Assists in data, design, product, and executive teams with data-related technical issues
Understands the infrastructure that allows big data to be accessed and analyzed
Utilizes department standard issue tracking, source control, and documentation tools.
Requirements
Bachelors Degree in Computer Science or job-related discipline or equivalent experience
Masters Degree in Computer Science or job-related discipline or equivalent experience preferred
1 year of experience with data engineering/ETL ecosystem, such as Palantir Foundry, Spark, Informatica, SAP BODS or OBIEE
Experience with data engineering and data transformations via a training or apprenticeship program acceptable
Business Intelligence and data access tool knowledge
Knowledge of software engineering principles such as unit testing, CI/CD, source control.
Benefits
This job is also eligible to participate in PG&E’s discretionary incentive compensation programs.
Principal Data Engineer designing and developing innovative data analytical solutions for the gaming industry. Leading and mentoring while engaging with clients to fulfill their data engineering needs.
Specialist, Data Engineering at CoverMyMeds enhancing and expanding data platforms for commercial data products. Collaborating with multiple teams to design scalable data solutions from various sources.
Team Lead in Data Engineering at Avanquest mentoring data engineering team and ensuring efficient data management across platforms. Collaborating with departments to align solutions and optimize workflows.
Data Architect at RSM leading AI - driven data migration initiatives within Salesforce ecosystem. Implementing data governance and optimizing performance across complex datasets.
Senior Data Engineer at Capgemini designing and optimizing scalable data architectures on Databricks and GCP. Collaborating across teams to transform business needs into reliable technical solutions.
Data Engineer transforming legacy on - premises systems to cloud - native architectures for advanced data analytics. Collaborating with teams to build efficient data solutions using Python and AWS.
Data Engineering Academy focused on Snowflake and Databricks for professionals interested in expanding their technical capabilities. Fully remote with future office work in Monterrey or Saltillo after completion.
Senior Data Engineer at Intent HQ designing and scaling data platforms. Building high - impact intelligence from millions of customer insights with a focus on performance and reliability.
SAP Data Engineer supporting MERKUR GROUP's evolution into a data - driven company. Responsible for data integration, modeling, and collaboration with various departments in Group Finance.
Data Engineer at Booz Allen Hamilton organizing data and developing advanced technology solutions. Leading data engineering activities for mission - driven projects and mentoring multidisciplinary teams.