Senior Solutions Architect designing digital manufacturing solutions at LyondellBasell. Leading architecture for production, reliability, energy, and sustainability use cases with a focus on innovation.
About the role
- Senior Solutions Architect designing scalable Big Data solutions at Cloudera. Working with customer technical teams to deliver high quality data solutions across Asia Pacific.
Responsibilities
- Work directly with customer business and technical teams to understand requirements and develop high quality solutions
- Design highly scalable and reliable data pipelines to consume, integrate, and analyze large amounts of data from various sources.
- Able to understand big data use-cases and recommend standard design, implementation patterns used in Hadoop-based deployments
- Able to document and present complex architectures for the customer’s technical teams
- Work closely with Cloudera teams at all levels to ensure project and customer success
- Design effective data models for optimal storage and retrieval, deploy inclusive data quality checks to ensure high quality of data
- Design, build, tune and maintain data pipelines using Hadoop, NiFi or related data integration technologies
- Install, deploy, augment, upgrade, manage and operate large Hadoop clusters
- Write and produce technical documentation, customer status reports and knowledge-base articles
- Keep up with current Hadoop, NiFi, Big Data ecosystem / technologies.
Requirements
- Overall 12+ years IT experience, with at least 4+ years of production experience working with Hadoop and/or NiFi, data engineering.
- Hands-on experience with all aspects of developing, testing and implementing low-latency big data pipelines.
- Demonstrated production experience in data engineering, data management, cluster management and/or analytics domains.
- Experience designing data queries against data in the HDFS environment using tools such as Apache Hive
- Experience implementing MapReduce, Spark jobs
- Experience setting up multi-node Hadoop clusters
- Experience in systems administration or DevOps experience with one or more open-source operating systems
- Experience with Data Warehouse design, ETL (Extraction, Transformation & Load), architecting efficient software designs for DW platform.
- Experience implementing operational best practices such as alerting, monitoring, and metadata management.
- Strong understanding with various enterprise security practices and solutions such as LDAP and/or Kerberos
- Experience using configuration management tools such as Ansible, Puppet or Chef
- Familiarity with scripting tools such as bash shell scripts, Python and/or Perl
- Experience with Apache NiFi is desired
- Significant previous work writing to network-based APIs, preferably REST/JSON or XML/SOAP
- Understanding of the Java ecosystem and enterprise offerings, including debugging and profiling tools
- Ability to understand and translate customer requirements into technical requirements
- Excellent verbal and written communications.
Benefits
- Generous PTO Policy
- Support work life balance with Unplugged Days
- Flexible WFH Policy
- Mental & Physical Wellness programs
- Phone and Internet Reimbursement program
- Access to Continued Career Development
- Comprehensive Benefits and Competitive Packages
- Paid Volunteer Time
- Employee Resource Groups
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Bilingual Senior Solutions Architect designing end - to - end enterprise solutions for financial services. Collaborating with stakeholders in French and English - speaking regions to develop scalable architectures.
Senior AI Solutions Architect designing and implementing enterprise AI solutions using Microsoft Azure. Collaborating with stakeholders and building scalable AI/ML pipelines.
Solution Architect bridging customer needs and platform engineering at Woven by Toyota. Collaborate with Inventors to design scalable solutions leveraging the Robot Platform.
Senior Solution Architect for Envitia designing modern data - driven solutions. Leading architecture delivery and pre - sales efforts in Defence sector.
Data Solutions Architect at Envitia, delivering innovative data - centric solutions for clients. Collaborating with teams to architect solutions using AWS and Azure technologies while ensuring quality and compliance.
AI Solution Engineer focusing on AI/ML and data execution within platform engineering for federal agencies. Collaborating with a Solution Architect on sprint - based platform releases.
AI Solution Engineer supporting analytics workflows, data ingestion, and ML operations for a Supply Chain Enterprise program. Involves executing ETL processes and maintaining data pipelines in a government context.
Account Solution Architect at Red Hat assisting customers with hybrid cloud solutions. Building relationships and architecting innovative solutions across diverse industries.
Dental Software Implementation Specialist ensuring smooth onboarding for ClearDent's customers by providing project management, coordination, and training. Work involves training, consultation, and relationship management with dental practices.