Dados Arquitetos projetando soluções na nuvem com foco em arquiteturas híbridas em São Paulo. Trabalhando com Databricks, Azure e GCP.
About the role
- Data Engineer supporting a growing analytics platform for federal customers. Engage in Agile team collaboration, developing data pipelines, and ensuring high-quality data processing.
Responsibilities
- Complete development efforts across data pipeline to store, manage, store, and provision to data consumers.
- Being an active and collaborating member of an Agile/Scrum team and following all Agile/Scrum best practices.
- Write code to ensure the performance and reliability of data extraction and processing.
- Support continuous process automation for data ingest.
- Achieve technical excellence by advocating for and adhering to lean-agile engineering principles and practices such as API-first design, simple design, continuous integration, version control, and automated testing.
- Work with program management and engineers to implement and document complex and evolving requirements.
- Help cultivate an environment that promotes customer service excellence, innovation, collaboration, and teamwork.
- Collaborate with others as part of a cross-functional team that includes user experience researchers and designers, product managers, engineers, and other functional specialists.
Requirements
- Must be a US Citizen.
- Must be able to obtain a Public Trust Clearance.
- 7+ years of IT experience including experience in design, management, and solutioning of large, complex data sets and models.
- Experience with developing data pipelines from many sources from structured and unstructured data sets in a variety of formats.
- Proficiency in developing ETL processes, and performing test and validation steps.
- Proficiency to manipulate data (Python, R, SQL, SAS).
- Strong knowledge of big data analysis and storage tools and technologies.
- Strong understanding of the agile principles and ability to apply them.
- Strong understanding of the CI/CD pipelines and ability to apply them.
- Experience with relational database, such as, PostgreSQL.
- Work comfortably in version control systems, such as, Git Repositories.
Benefits
- Health, Dental, and Vision
- Life Insurance
- 401k
- Flexible Spending Account (Health, Dependent Care, and Commuter)
- Paid Time Off and Observance of State/Federal Holidays
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Junior Data Engineer in Data Management at Engineering focusing on defining and developing Data Platform solutions. Collaborate on analytics architectures while engaging in technical project management.
Data Solution Architect responsible for delivering data and integration solutions at Expleo. Collaborating with stakeholders and managing solutions to support strategic decision - making.
Data Engineer focusing on Azure solutions and data pipelines. Involves technical leadership and implementing data architecture in a hybrid work setup.
Data Architect establishing technical vision for data landscape at Arc'teryx. Leading design of scalable, integrated data systems for decision - making across the organization.
Sr Staff Data Engineer managing complex data engineering projects and mentoring team at PayPal. Developing data architectures and ensuring compliance with regulations.
Data Engineer at PayPal leading the design of complex data systems and architectures. Collaborating across teams to ensure data quality and optimize engineering processes.
Sr. Manager leading complex data engineering projects and driving global process improvements at PayPal. Collaborating with leadership to deliver actionable insights and best practices for data management.
Staff Data Engineer at PayPal designing and implementing data systems to support business needs. Leading data engineering projects and mentoring junior engineers while ensuring data quality and integrity.
Data Engineer at Anglian Water responsible for building scalable data pipelines and analytics. Collaborate with cross - functional teams using Azure data technologies in an Agile environment.