Above position is expected to implement Data Orchestration -Data Transformation and Data integration using MS Azure services.
Data Extraction, Transformation, Loading are main responsibilities considering enterprise data management for data lakes and data warehouses.
MS Azure Data Engineer (MS Certified) is preferred.
Implement Azure Cloud data warehouses, Azure and No-SQL databases and hybrid data scenarios
Manage Azure DevOps pipelines
Develop batch processing, streaming and integration solutions
Automate Azure Data Factory pipelines
Manage source data access security
Configure authentication and authorization
Manage and enforce data policies and standards
Monitor databases and data processing for a specified scenario
Implement big data real-time processing and integration solutions
Education: B.E./M.Sc./M.E./M. Tech.
Experience: 5 â 7 years in Core Data Engineering.
Minimum 3 Years in Azure Data Engineering
Knowledge & Skills
Very strong @ SQL-PL SQL-Spark SQL.
Interaction with No SQL Databases
Interaction with Event Hub, IoT Hub Databases
Files Processing â XML, CSV, Excel, Jason, etc. Formats
Structured and Non-Structured Data processing
Data ETL Capabilities.
Knowledge of Distributed Big Data Processing
Data Warehouse and Data Lake Implementation experience in past.
Interaction with REST APIs , Web Services
Good verbal & written English communication
Ability to work with globally diverse teams.
Readiness to work in flexible work timings.
Abstract& Analytical Thinking.
An interpersonal savvy. A very good team player
Nimble learning. Willingness to explore and adapt