Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
About the role
- Senior Data Engineer building front-end and back-end infrastructure for enterprise data platform at Beghou Consulting. Supporting client teams and developing analytics tools in life sciences.
Responsibilities
- This role builds front-end and back-end infrastructure for the firm’s in-house enterprise data platform as well as explores, enables, and documents new technologies.
- This position also works independently to support client teams with different data needs, including deployment for new clients, support for existing clients, development of backend datasets for dashboards, and support for the front-end.
- Ensures reliability and stability of the enterprise data platform and tools used by internal teams and clients.
- Demonstrates knowledge of the data platform components (warehouse, monitoring, language, etc.) and data engineering (ETL design, schema design, etc.) and performs unit testing.
- Builds and enhances data integration, management, and analytics tools and pipelines.
- Documents code, deployments, best practices, and improvements.
- Designs and builds ETL/ELT data systems, including cloud-based APIs, automated data transfer systems, and code management solutions.
- Acts as a regular point of contact for data engineering projects and collaborates with the internal consulting team and the data platform and technology teams to complete projects for clients successfully.
- Participates in and contributes ideas to brainstorm, design, and implement more complex processes and analyses to solve challenging and abstract problems.
- Develops and implements best practice guidance and supporting materials for data management and advanced analytics pipelines.
- Creates high-quality presentations, deliverables, and code that meet objectives, with project manager guidance.
- Performs other job-related duties as assigned.
Requirements
- At least 5 years’ experience in data engineering using Python, including the use of pandas or PySpark.
- Experience working with Databricks extensively (including installing packages, understanding and setting cluster configurations, managing jobs, user management, handling permissions, managing Unity Catalogues, Databricks APIs and AI tools, and handling configuration issues) and relational database technologies, such as PostgreSQL, Oracle, MySQL, Redshift, Snowflake.
- Software development fundamentals, including Agile development, version control systems such as Git or DevOps, code reviews, testing, and documentation.
- Experience working with AI tools.
- Experience configuring AzureAD/SAML/Okta/Oauth and administering AWS or Azure security best practices, preferred.
- Experience with WYSIWYG ETL tools (Azure Data Factory, Informatica, SnapLogic, Boomi), preferred.
- Container orchestration systems experience using Docker, Kubernetes, AWS ECS, preferred.
- At least 6 months experience in web application development using Flask, Django, JavaScript, Ajax, or CSS/HTML is preferred.
- Candidates holding a recognized data engineering certification are preferred (e.g., Databricks Data Engineer, Google Cloud Professional Data Engineer, Azure Data/Fabric Data Engineer, AWS Certified Data Engineer).
- Proficiency using Microsoft Office products, including Excel, PowerPoint, and Word.
- Life Sciences industry experience, preferred.
- Excellent communication skills. Ability to communicate with business stakeholders as well as technical development teams
- Strong problem-solving skills, excellent critical and creative thinking skills and ability to brainstorm ideas
- Ability to work in a team and collaborate across teams effectively
- Ability to adapt quickly to changing technologies
- Ability to assess and identify bottlenecks and potential failures.
Benefits
- At Beghou Consulting, you'll join a highly collaborative, values-driven team where technical excellence, analytical rigor, and personal growth converge.
- Whether you're passionate about AI innovation, building commercialization strategies, or shaping the next generation of data-first solutions in life sciences, this is a place to make an impact!
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.
VP, Senior Data Engineer responsible for designing and developing cloud data solutions for insider risk in Information Security at SMBC. Collaborating with multiple teams to enhance cybersecurity data platform.
Data Engineer responsible for architecting, developing, and maintaining Allegiant’s enterprise data infrastructure. Overseeing transition to cloud hosted data warehouse and developing next - generation data tools.
Senior Data Engineer developing Azure - based data solutions for clients in the Data & AI department. Collaborating with architects and consultants to enhance automated decision making.
Data Engineer II focusing on strategic ingestion product for Travelers. Building data solutions and collaborating across teams to support analytic transformation.
Data Engineer at Tatum focusing on scalable data solutions and blockchain technology. Collaborating with teams to ensure data integrity and manage data infrastructure in a hybrid setup.