Data Architect at Integrant responsible for designing and building data solutions for analytical purposes. Involves eliciting requirements, data pipelines, and coaching teams on methodologies.
About the role
- Data Engineer (GCP) designing and maintaining scalable data platforms at LUZA Group in Portugal. Collaborating and ensuring data integrity across multiple complex datasets.
Responsibilities
- Design, build, and maintain scalable data platforms.
- Collect, process, and analyze large and complex data sets from various sources.
- Develop and implement data processing workflows using data processing framework technologies such as Spark and Apache Beam.
- Collaborate with cross-functional teams to ensure data accuracy and integrity.
- Ensure data security and privacy through proper implementation of access controls and data encryption.
- Extract data from various sources, including databases, file systems, and APIs.
- Monitor system performance and optimize for high availability and scalability.
Requirements
- Experience with cloud platforms and services for data engineering (GCP).
- Experience with Big Data tools such as Spark, Flink, Kafka, Elastic Search, Hadoop, Hive, Sqoop, Flume, Impala, Kafka Streams and Connect, Druid, etc.
- Experience with relational and NoSQL databases.
- Experience with data integration and ETL tools (e.g., Apache Kafka, Talend).
- Experience with version control tools such as Git.
- Stack Tech: Python, Java, or Scala. Spark, Apache Beam. Flink, Kafka, Elastic Search, Hadoop, Hive, Sqoop, Flume, Impala, Kafka Streams and Connect, Druid. SQL. Relational and NoSQL databases. Cloud platforms (GCP, AWS S3, Azure Data Factory). Git.
- Knowledge of data modeling and database design principles.
- Understanding of distributed systems and data processing architectures.
Benefits
- Our company does not sponsor work visas or work permits.
- All applicants must have the legal right to work in the country where the position is based.
- Only candidates who meet the required qualifications and match the profile requested by our clients will be contacted.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer developing and maintaining data pipelines for clients in an Agile setting. Collaborating with teams to enhance data quality and mentoring junior engineers.
Lead Data Engineer overseeing the migration from Redshift to AWS RDS and mentoring data analysts in Python and DataOps practices.
Senior Data Engineer designing and maintaining scalable data pipelines using modern technologies. Collaborating with cross - functional teams and providing mentorship in a dynamic environment.
Data Architect leading design and implementation of cloud data platforms for digital transformation. Collaborating with stakeholders to define data strategies and governance models.
Data Engineer Consultant designing and optimizing data infrastructure for clients' business needs. Working with SQL and data visualization tools in a mainly remote role with some onsite responsibilities in Denver.
Data Engineer creating Real - Time Data Processing applications for a leading iGaming operator. Work involves stream data manipulation and collaboration in an Agile environment.
Data Engineer at Voodoo optimizing real - time data pipelines for gaming and consumer apps to support growth. Joining a top - tier data team dedicated to monetizing via advertising partners in a competitive landscape.
Cloud Data Engineer designing data architectures for cloud platforms at fifty - five. Collaborating with local and global teams to optimize marketing ROI and customer experience.
SAP Specialist responsible for designing, developing, and executing data migration objects in Hydro’s SAPEX program. Ensuring successful ETL processes and maintaining data quality.