Data platform Operation Analyst
Published
Job : Data platform Operation Analyst
Location : Remote (India)
Duration : Contract
Shift: Should work till 2:30 PM EST (Till 12:00 AM IST).
Responsibilities:
- Azure Databricks Management:
• Monitor Azure resources and services to ensure optimal performance and availability.
• Develop and implement data ingestion pipelines using Azure Databricks to collect, process, and store data from various sources.
• Monitor system alerts and respond to incidents in a timely manner to minimize downtime.
• Collaborate with data engineers to design and deploy scalable data processing solutions.
- Power BI Operations:
• Maintain and support operation of Power BI reports, dashboards, and data visualizations to meet business requirements.
• Manage Power BI datasets, data models, and data refresh schedules to ensure accurate and up-to-date reporting.
• Create and maintain user access controls, security settings, and governance policies within the Power BI environment.
• Provide training and support to end-users on Power BI usage, best practices, and troubleshooting techniques.
- Data Integration and ETL:
• Implement Extract, Transform, Load (ETL) processes to integrate data from disparate sources into Azure Databricks and Power BI.
• Optimize data pipelines for performance, scalability, and reliability, using tools like Azure Data Factory
- Performance Monitoring and Optimization:
• Monitor data pipeline performance metrics, identify bottlenecks, and implement optimizations to improve overall efficiency.
• Conduct regular performance tuning and capacity monitoring activities to ensure the Azure Databricks and Power BI environments meet evolving business needs.
• Analyze data usage patterns and recommend enhancements to optimize resource utilization and reduce costs
- Documentation and Collaboration:
• Document technical designs, configurations, and procedures related to Azure Databricks and Power BI environments.
• Collaborate with cross-functional teams, including data engineers, data scientists, business analysts, and IT professionals, to support Client onboarding and offboarding activities.
• Participate in meetings, workshops, and knowledge-sharing sessions to foster collaboration and continuous improvement.
Qualifications:
• 3 to 5 years of experience in data engineering, business intelligence, or related roles.
• Proficiency in Azure Databricks, including cluster management, notebook development, and job scheduling.
• Strong experience with Power BI, including report development, data modeling, and administration.
• Solid understanding of data integration concepts, ETL processes, and data warehousing principles.
• Experience with SQL, Python, or other programming languages for data manipulation and analysis.
• Familiarity with cloud computing platforms and their data services.
• Excellent analytical, problem-solving, and communication skills.
• Ability to work independently and collaboratively in a dynamic environment.
• Relevant certifications in Azure and Power BI are a plus.