AI
• Job Responsibilities
• Data Ingestion and Integration: You will need to ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure using services such as Azure Data Factory for ETL jobs.
• Data Transformation and Processing: Large-scale data transformation and processing tasks to prepare the data for analysis and reporting using Azure Databricks and Azure Synapse Analytics and tools like Apache Spark.
• Data Storage and Management: Develop, build and manage the appropriate storage solutions for data using Azure SQL Database, Azure Cosmos DB for structured data, Azure Data Lake Storage for big data and unstructured data, and Azure Blob Storage.
• Data Warehousing: Implementing data warehousing solutions using services such as Azure Synapse Analytics to create scalable and distributed analytics capabilities for handling large datasets.
• Data Modeling and Analysis: Collaborate with machine learning engineers to design and implement d ...