Cloudera Data Lakehouse Platform Administrator & Support Engineer
الوصف الوظيفي
About Tata Consultancy Services (TCS)
Tata Consultancy Services (TCS) is a global leader in IT services, consulting, and business solutions, renowned for partnering with the world’s largest enterprises in their transformative journeys over the past five decades. As part of the esteemed Tata Group, TCS delivers a comprehensive portfolio of business, technology, and engineering services through its innovative Location Independent Agile™ delivery model—a benchmark for excellence in software development. With a workforce of over 616,171 highly skilled consultants representing 157 nationalities across 53 countries, TCS continues to drive digital transformation for businesses worldwide. For more information, visit www.tcs.com or follow TCS news at @TCS_News.
Position Overview
We are seeking a highly skilled Cloudera Data Lakehouse Platform Administrator & Support Engineer to join our dynamic team in Jeddah, Saudi Arabia. In this critical role, you will be responsible for administering, supporting, and optimizing the Cloudera Data Platform (CDP) within a Data Lakehouse environment. Your expertise will ensure the seamless operation of distributed storage, processing, analytics, and real-time data ingestion systems, while maintaining robust security, governance, and compliance standards. This position requires a proactive problem-solver with a strong technical foundation in big data technologies and a commitment to delivering high-quality support in a 24/7 production environment.
Key Responsibilities
- Cloudera Platform Administration:
- Administer and support Cloudera Data Platform (CDP) services across Data Lakehouse environments, ensuring optimal performance and reliability.
- Manage platform configuration, cluster health, service dependencies, and capacity planning to meet evolving business demands.
- Execute installation, patching, upgrades, scaling, and routine maintenance activities to uphold platform integrity.
- Ensure platform readiness across Bronze, Silver, and Archive layers, aligning with data governance and lifecycle management policies.
- Storage Administration:
- Monitor and manage distributed storage systems, including HDFS and Apache Ozone, to ensure data availability, replication, and performance.
- Troubleshoot storage failures, disk issues, and performance bottlenecks to minimize downtime and data loss.
- Administer quotas, archival policies, retention schedules, backup, and recovery processes to safeguard critical data assets.
- Processing & Analytics Platform Support:
- Provide expert support for distributed data processing and analytical workloads using technologies such as Spark, Hive, Impala, Iceberg, HBase, Kudu, Phoenix, and Solr.
- Troubleshoot job failures, query issues, metadata inconsistencies, and resource contention to optimize performance for batch, interactive, and low-latency workloads.
- Collaborate with data engineering teams to enhance query efficiency and platform scalability.
- Streaming & Data Ingestion Support:
- Monitor and support real-time and batch data ingestion pipelines using Kafka and NiFi to ensure reliable and secure data flows.
- Troubleshoot latency, backpressure, topic management, and consumer issues to maintain data integrity and timeliness.
- Implement best practices for data ingestion to support mission-critical analytics and reporting.
- Security, Governance & Compliance:
- Support security and governance frameworks, including Kerberos, Ranger, and Atlas, to enforce access controls, metadata visibility, and compliance adherence.
- Assist in audit readiness activities and policy enforcement to mitigate risks and ensure regulatory compliance.
- Collaborate with security teams to implement and maintain robust security measures across the platform.
- Incident, Problem & Change Management:
- Provide L1/L2 production support using ITIL-aligned processes to resolve incidents, perform root cause analysis (RCA), and implement preventive actions.
- Support release management, deployment, patching, and planned maintenance activities to ensure minimal disruption to operations.
- Participate in shift-based and on-call support rotations to maintain 24/7 service availability and responsiveness.
- Monitoring, Documentation & Automation:
- Monitor platform services using Cloudera Manager and operational dashboards to proactively identify and address potential issues.
- Maintain comprehensive runbooks, standard operating procedures (SOPs), support procedures, and architecture documentation to ensure knowledge continuity.
- Automate routine administrative and monitoring tasks to enhance operational efficiency and reduce manual intervention.
Technology Stack
- Storage: HDFS, Apache Ozone
- Processing & Analytics: Apache Spark, Hive, Impala, Iceberg
- NoSQL / Search: HBase, Kudu, Phoenix, Apache Solr
- Streaming / Ingestion: Kafka, NiFi
- AI / Analytics: Cloudera AI
- Platform Management: Cloudera Manager, YARN, ZooKeeper
- Security / Governance: Kerberos, Ranger, Atlas
- Operating Systems: Linux/Unix
Required Skills & Experience
- 5–8 years of hands-on experience in Cloudera/Hadoop platform administration and production support within enterprise environments.
- Proven expertise in administering Cloudera Data Platform (CDP), HDFS, Ozone, Spark, Hive, and Impala.
- Strong working knowledge of Kafka, NiFi, HBase, Kudu, Solr, and Iceberg for data processing and analytics.
- Experience in cluster monitoring, patching, upgrades, and troubleshooting to maintain high availability and performance.
- Deep understanding of security, governance, and platform operations, with a focus on compliance and risk mitigation.
- Proven track record in providing 24/7 SLA-driven production support, including on-call responsibilities and incident management.
- Excellent problem-solving skills with the ability to diagnose and resolve complex technical issues efficiently.
- Strong communication and collaboration skills to work effectively with cross-functional teams and stakeholders.
Why Join TCS?
As a valued member of TCS, you will have the opportunity to work with cutting-edge technologies, collaborate with industry experts, and contribute to transformative projects that shape the future of global businesses. We offer a dynamic work environment, continuous learning opportunities, and a comprehensive benefits package designed to support your professional and personal growth. If you are passionate about big data, cloud platforms, and delivering exceptional support, we encourage you to apply and become part of our global team.
يمكن أن يرتكب الذكاء الاصطناعي أخطاءً.
ℹ️ إخلاء مسؤولية توظيف:
موقع وظائف السعودية (ksajobshub.com) هو محرك بحث ومجمع لإعلانات الوظائف من المصادر والشركات الرسمية في المملكة العربية السعودية. نحن لا نتقاضى أي مبالغ مالية أو رسوم من الباحثين عن عمل، وتتم عمليات التقديم مباشرة عبر الانتقال للرابط الأصلي للجهة المعلنة.