EI
Hi Professionals,
Role Data Architect (Databricks)
Duration: Fulltime
Key Responsibilities:
• Solution Design & Implementation: Architecting and building scalable, secure, and high-performance data solutions on the Databricks platform using technologies like DLT Pipelines, Spark, Delta Lake, AI/BI Genie, etc.
• Data Pipeline Development: Designing and implementing end-to-end data pipelines, including ETL/ELT processes, for both batch and real-time data processing.
• Data Governance & Security: Defining and implementing data governance policies, access controls, and security measures to ensure data integrity and compliance with regulations.
• Performance Optimization: Optimizing Databricks workloads for cost efficiency, performance, and reliability, including Spark tuning and resource management.
• Mentorship & Guidance: Providing technical leadership and mentorship to other team members, sharing knowledge and best practices related to Databricks and data engineering.
• Technical Doc ...