Data Engineer/Analyst maintaining and improving data infrastructure for Braiins. Collaborating with technical and business teams to ensure reliable data flows and insights.
About the role
- Data Engineer designing and implementing data pipelines and services for Ford Pro analytics. Working with diverse teams and technologies to drive data-driven solutions.
Responsibilities
- Develop EL/ELT/ETL pipelines to make data available in BigQuery analytical data store from disparate batch, streaming data sources for the Business Intelligence and Analytics teams.
- Work with on-prem data sources (Hadoop, SQL Server), understand the data model, business rules behind the data and build data pipelines (with GCP, Informatica) for one or more Ford Pro verticals. This data will be landed in GCP BigQuery.
- Build cloud-native services and APIs to support and expose data-driven solutions.
- Partner closely with our data scientists to ensure the right data is made available in a timely manner to deliver compelling and insightful solutions.
- Design, build and launch shared data services to be leveraged by the internal and external partner developer community.
- Building out scalable data pipelines and choosing the right tools for the right job. Manage, optimize and Monitor data pipelines.
- Provide extensive technical, strategic advice and guidance to key stakeholders around data transformation efforts. Understand how data is useful to the enterprise.
Requirements
- Bachelors Degree
- 3+ years of experience with SQL and Python
- 2+ years of experience with GCP or AWS cloud services; Strong candidates with 5+ years in a traditional data warehouse environment (ETL pipelines with Informatica) will be considered
- 3+ years of experience building out data pipelines from scratch in a highly distributed and fault-tolerant manner.
- Comfortable with a broad array of relational and non-relational databases.
- Proven track record of building applications in a data-focused role (Cloud and Traditional Data Warehouse)
- Experience with GCP cloud services including BigQuery, Cloud Composer, Dataflow, CloudSQL, GCS, Cloud Functions and Pub/Sub.
- Inquisitive, proactive, and interested in learning new tools and techniques.
- Familiarity with big data and machine learning tools and platforms. Comfortable with open source technologies including Apache Spark, Hadoop, Kafka.
- 1+ year experience with Hive, Spark, Scala, JavaScript.
- Strong oral, written and interpersonal communication skills
- Comfortable working in a dynamic environment where problems are not always well-defined.
- M.S. in a science-based program and/or quantitative discipline with a technical emphasis.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Medior Data Engineer handling Azure migrations for a major urban mobility client. Focused on data pipeline development and ensuring platform reliability with cutting - edge technologies.
Developing ML and computer vision solutions for cutting - edge autonomous vehicle dataset pipeline at Mobileye. Collaborating across teams for data curation and advanced perception algorithms.
Data Migration Lead in a hybrid role managing data migration for a major transformation programme in the media sector. Collaborating with various teams to ensure data integrity and successful migration.
Consultant ML & DataOps at Smile integrating data science projects for major clients. Designing MLOps solutions and enhancing data governance in a collaborative environment.
Data Engineer developing and maintaining data pipelines for Coolbet’s analytical services. Working within an Agile framework to ensure data reliability and efficiency.
API Data Engineer developing innovative data - driven solutions and advancing data architecture for AI Control Tower. Building and integrating APIs and data pipelines to support organizational needs.
Journeyman Data Architect supporting Leidos' enterprise data and analytics program for the Department of War. Collaborating on solutions for data architecture, cloud environments, and governance.
Senior Software Engineer developing backend services and data infrastructure for integrated products at Booz Allen. Collaborating with a small elite team to deliver reliable and scalable services.
AWS Streaming Data Engineer developing software and systems in a fast, agile environment. Utilizing experience with real - time data ingestion and processing systems across distributed environments.