Associate Tech Architect role focusing on data engineering within Azure Cloud at Quantiphi. Aiming to support data transformation projects with expertise in cloud tech and data solutions.
Responsibilities
Support the planning and implementation of data flow design, provide sizing and configuration assistance
Assisting the Solution Architects on programs for transformations and modernizations of data solutions using Azure cloud data technologies
Write production quality code to deploy ML workflows in a distributed environment
Design and Build Azure Data Pipelines and Data StreamsDesign and build a hybrid data solution using a combination of on-premise and in-cloud services
Diagnose and troubleshoot complex distributed systems problems and develop solutions with a significant impact on our massive scale
Build tools to ingest and process terabyte-scale data on a daily basis
Communicate with a wide set of teams, including product owners, business analysts, data and enterprise architects, platform engineers, and cloud vendors, etc
Compilation of detailed design documents, technical specification documents, and test plans as required
Independently manage development tasks as per technical specification documents, prod deployment,post-prod support, etc
Managing support to Unit Testing, SIT & UAT
Coordinate with business and support teams on testing and migration activities
Requirements
6 + Years of Experience
Strong hands-on knowledge of Spark/Pyspark
Expertise in writing SQL queries and performance optimization
Strong hands-on experience with a programming language like Python(preferred), java, or scala
Prior experience with working on cloud platforms like Azure(preferred), AWS or GCP
Prior experience of ADF is a plus
DataBricks experience is good to have
Data Warehouse: Snowflake or Synapse
Design Dimensional Models for Data Warehouse and Data Marts
Knowledge of version control systems and build automation tools like Azure DevOps and/or MLOps
Experience with operating system internals, file systems, disk/storage technologies, and storage Protocol
Benefits
Ample opportunities to learn
Grow and interact with colleagues from varied experience and backgrounds around the globe
PSL Architect leading digital product solutions for aircraft completion at Airbus. Managing architectural vision and governance across cloud platforms and enterprise integration.
Data Architect at Vivo focusing on data solutions and AI architecture principles for cloud environments. Collaborating with teams to modernize and innovate data handling processes.
Senior Software Architect responsible for microservices architecture and development for Deutsche WertpapierService Bank AG. Working with a modern technology stack and collaborating across teams.
Infrastructure Access Product Owner defining strategy and managing roadmap for cybersecurity solutions at State Street. Leading efforts in workload access controls and secrets management across the organization.
Senior Cloud & WAN Architect design network interconnections across multi - cloud environments for Kyndryl. Leading security architecture planning and automation implementation using Terraform for cloud - based network solutions.
Architect managing architectural responsibilities, project coordination, and budget compliance at Duisburg Zoo. Engaging in design and construction processes to create natural habitats for diverse species.
Senior IT Architect responsible for Microsoft 365 and Windows infrastructure at Th. Geyer GmbH & Co. KG. Managing user identities, security solutions, and project implementations.
Technical point of contact coordinating hardware development and engineering processes for leading airport logistics provider. Ensuring quality and efficiency through innovative approaches and teamwork.
Domain Architect developing innovative solutions for customers in Assurance domain at Nokia. Collaborating closely with stakeholders to translate their needs into high - impact solutions.
Domain Architect at Nokia delivering advanced solution consulting. Partnering with customers to create high - impact solutions in telecom integrations.