Enterprise Data & AI Platform Engineer

Technical Skills

Core Skills (Must Have)

Cloudera Data Platform (CDP)

Cloudera Machine Learning (CML)

Hadoop Ecosystem (HDFS, YARN, Hive, Impala, Ozone) Apache Spark

Hybrid Cloud Architecture (AWS & On-Premises)

AWS Core Services (EC2, EKS, IAM, S3, VPC, CloudWatch)

AI/ML Infrastructure Support (GPU, Containers, Kubernetes)

AI/ML Services: SageMaker/Bedrock/OpenSearch/Glue/Athena/EMR

Preferred Skills

Vulnerability Management, Security Patching, Hardening & Compliance Management

Platform Upgrade, Migration & Maintenance Activities

Microservices Architecture & REST APIs

Certificate & Secrets Management

OpenShift / Kubernetes Administration

Hybrid Infrastructure Operations (AWS & On-Prem)

MLOps Platforms and AI Model Lifecycle Management

Linux / Unix Administration

OpenShift / Kubernetes Administration

Platform Monitoring, Troubleshooting & Performance Tuning

Good to Have

Cloudera Certifications (CDP, CML, Cloudera Administrator)

Big Data Certifications (Spark, Iceberg, Hadoop)

AWS Certifications:

AWS Certified Solutions Architect

AWS Certified AI Practitioner

Experience with CI/CD Tools (Jenkins, GitLab CI/CD, GitHub Actions, ArgoCD)

Infrastructure as Code (Terraform, Ansible, CloudFormation)

Experience with SRE Practices, Observability & Monitoring Platforms

Exposure to Data Lakehouse Architectures and Apache Iceberg

Experience supporting Generative AI platforms and LLM workloads

Knowledge of Vector Databases, RAG Architectures and AI Governance

DevSecOps and Cloud Security Best Practices

Multi-Cloud or Hybrid Cloud Platform Management

Why Join

Join a team that powers OCBC's enterprise Data, Analytics, and AI platforms across hybrid cloud environments. You'll work with leading technologies including Cloudera CDP/CML, AWS Cloud, Big Data, and AI/ML platforms, while driving innovation, reliability, and operational excellence.

How You Succeed

Success in this role comes from your ability to manage and optimize complex hybrid cloud data platforms, automate operations, resolve issues proactively, and collaborate effectively with Data, AI/ML, Infrastructure, Security, and SRE teams.

What You Do

Administer and support Cloudera Data Platform (CDP), Cloudera Machine Learning (CML), Hadoop, and Spark environments across AWS and on-premises infrastructure.

Manage platform upgrades, security patching, vulnerability remediation, certificate management, and platform hardening activities.

Support containerized platforms on Kubernetes, OpenShift, and AWS EKS, ensuring high availability and performance.

Monitor, troubleshoot, and optimize Data, Analytics, AI/ML, and Generative AI platforms including AWS services such as SageMaker, Bedrock, EMR, and S3.

Automate operational processes using Shell/Python scripting and collaborate with Infrastructure, Security, and SRE teams to improve platform reliability and scalability.

Who You Are

A degree in Computer Science, Information Technology, or a related field

At least 3 years of experience in software development, preferably in a banking or financial services environment

Proficient in one or more programming languages, such as Java, Python, or C++

Experience with Agile development methodologies and version control systems such as Git

Strong problem-solving skills, with the ability to analyze complex technical issues and develop creative solutions

Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams

Diploma or Degree in Computer Science, Information Technology, Engineering, or a related discipline.

5-8 years of experience supporting enterprise Data, Analytics, or AI/ML platforms, with hands-on expertise in Cloudera Data Platform (CDP), Cloudera Machine Learning (CML), Hadoop, and Apache Spark.

Strong experience in hybrid cloud environments, including AWS services (EC2, EKS, IAM, S3, CloudWatch) and on-premises infrastructure, with knowledge of Kubernetes/OpenShift and Linux administration.

Proven experience in platform operations, upgrade and maintenance activities, security patching, incident management, troubleshooting, and automation using Shell and/or Python scripting.