Solution Architect delivering overall technical architecture for digital transformation projects at the Department of Transport. Engaging stakeholders, addressing cross - functional priorities, and ensuring solution alignment.
About the role
- Senior Solutions Architect developing scalable solutions using Hadoop and related technologies at Cloudera. Collaborating with APAC Professional Services team and customer technical teams.
Responsibilities
- Work directly with customer business and technical teams to understand requirements and develop high quality solutions
- Design highly scalable and reliable data pipelines to consume, integrate, and analyze large amounts of data from various sources
- Able to understand big data use-cases and recommend standard design, implementation patterns used in Hadoop-based deployments
- Able to document and present complex architectures for customer’s technical teams
- Work closely with Cloudera teams at all levels to ensure project and customer success
- Design effective data models for optimal storage and retrieval, deploy inclusive data quality checks to ensure high quality of data
- Design, build, tune and maintain data pipelines using Hadoop, NiFi or related data integration technologies
- Install, deploy, augment, upgrade, manage and operate large Hadoop clusters
- Write and produce technical documentation, customer status reports and knowledge-base articles
- Keep up with current Hadoop, NiFi, Big Data ecosystem / technologies.
Requirements
- Overall 12+ years IT experience
- At least 4+ years of production experience working with Hadoop and/or NiFi, data engineering
- Hands-on experience with developing, testing and implementing low-latency big data pipelines
- Demonstrated production experience in data engineering, data management, cluster management and/or analytics domains
- Experience designing data queries against data in the HDFS using tools such as Apache Hive
- Experience implementing MapReduce, Spark jobs
- Experience setting up multi-node Hadoop clusters
- Experience in systems administration or DevOps experience with one or more open-source operating systems
- Experience with Data Warehouse design, ETL, architecting efficient software designs for DW platform
- Experience implementing operational best practices such as alerting, monitoring, and metadata management
- Strong understanding with various enterprise security practices and solutions such as LDAP and/or Kerberos
- Experience using configuration management tools such as Ansible, Puppet or Chef
- Familiarity with scripting tools such as bash shell scripts, Python and/or Perl
- Strong understanding of the Java ecosystem and enterprise offerings
- Excellent verbal and written communications
Benefits
- Generous PTO Policy
- Support work life balance with Unplugged Days
- Flexible WFH Policy
- Mental & Physical Wellness programs
- Phone and Internet Reimbursement program
- Access to Continued Career Development
- Comprehensive Benefits and Competitive Packages
- Paid Volunteer Time
- Employee Resource Groups
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Insurance Solutions Consultant providing high - quality customer service in group insurance policy management. Managing policy lifecycle tasks and maintaining accurate records confirming policy terms with client engagements.
Senior Data Solution Engineer at Zurich integrating finance data and developing solutions with Azure technologies. Collaborate with IT experts and implement solutions for finance applications.
Integration Engineer supporting Moon to Mars exploration operations and commercial transportation systems at Aerospace Corporation. Collaborating with NASA and ensuring compliance with agency operational requirements.
Global Solution Architect engaging with MDS and MPS customers to understand needs and provide adaptive solutions. Building relationships with key executives and conducting performance testing.
Solution Architect designing and implementing .Net applications for an Infosys subsidiary in New York. Requires over 8 years of experience in software design and development.
Lead Solutions Architect responsible for designing systems and applications for agile digital enterprise at Transamerica. Collaborating with architects and engineers to modernize digital experience and data platforms.
Solutions Architect leading sales efforts for external clients at Faith Technologies. Delivering innovative solutions in the Digital Power domain through collaboration with internal teams.
Strategic senior - level Solution Architect defining digital transformation roadmap. Responsible for Oracle ERP/SCM and Workday integration and governance at QTS Data Centers.
Director Solution Architecture at Webster, shaping architecture for Corporate IT platforms. Leading strategic delivery and aligning investments with business outcomes.