Senior Solutions Architect developing scalable solutions using Hadoop and related technologies at Cloudera. Collaborating with APAC Professional Services team and customer technical teams.
Responsibilities
Work directly with customer business and technical teams to understand requirements and develop high quality solutions
Design highly scalable and reliable data pipelines to consume, integrate, and analyze large amounts of data from various sources
Able to understand big data use-cases and recommend standard design, implementation patterns used in Hadoop-based deployments
Able to document and present complex architectures for customer’s technical teams
Work closely with Cloudera teams at all levels to ensure project and customer success
Design effective data models for optimal storage and retrieval, deploy inclusive data quality checks to ensure high quality of data
Design, build, tune and maintain data pipelines using Hadoop, NiFi or related data integration technologies
Install, deploy, augment, upgrade, manage and operate large Hadoop clusters
Write and produce technical documentation, customer status reports and knowledge-base articles
Keep up with current Hadoop, NiFi, Big Data ecosystem / technologies.
Requirements
Overall 12+ years IT experience
At least 4+ years of production experience working with Hadoop and/or NiFi, data engineering
Hands-on experience with developing, testing and implementing low-latency big data pipelines
Demonstrated production experience in data engineering, data management, cluster management and/or analytics domains
Experience designing data queries against data in the HDFS using tools such as Apache Hive
Experience implementing MapReduce, Spark jobs
Experience setting up multi-node Hadoop clusters
Experience in systems administration or DevOps experience with one or more open-source operating systems
Experience with Data Warehouse design, ETL, architecting efficient software designs for DW platform
Experience implementing operational best practices such as alerting, monitoring, and metadata management
Strong understanding with various enterprise security practices and solutions such as LDAP and/or Kerberos
Experience using configuration management tools such as Ansible, Puppet or Chef
Familiarity with scripting tools such as bash shell scripts, Python and/or Perl
Strong understanding of the Java ecosystem and enterprise offerings
Solutions Architect responsible for integrations across transformation programs in cybersecurity at Exclusive Networks. Collaborating with teams to deliver robust, scalable integration architectures.
Integration Engineer designing and building BDO's integration platform using Azure Integration Services. Leading development and collaborating with data, cloud, and governance teams.
AEM Solution Architect leading architecture evaluation and providing technical guidance for PA.gov. Collaborating with cross - functional teams to optimize Adobe Experience Manager Cloud platform.
IT Solutions Engineer designing, building, and supporting software systems for APS's energy operations. Collaborating on AI - driven digital solutions to improve reliability and support clean energy initiatives.
Infotainment Integration Engineer developing HMI solutions for Daimler Truck vehicle products. Collaborate globally to ensure quality deliverables on time in innovative HMI functions.
Solutions Engineer focusing on pre - sales engagements, delivering tailored demos and technical documentation for AI - powered privacy solutions. Collaborating with sales and engineering teams for enterprise clients.
Solutions Consultant for GRC & Cyber Risk at Comcast, engaging with clients to drive new business and design tailored technical solutions. Involves enterprise sales and solution consulting.
Solution Engineer focusing on IT Automation solutions at First Quality. Involves system development, integration, and collaboration with engineering teams.