Data Engineer - 8176
- Requisition Title : Data Engineer
- Skills : 'AWS GLUE ETL'
- Relevant Experience Required : 4 - 6 years
- Job Location : Bengaluru
Role Summary :
The Data Engineer will work with the team to create high end data and analytics driven ETL solutions,
will be part of the data lake team and leveraging aws,big data tools and technologies.
Essential Responsibilities : The Data Engineer, they will be part of Data lake cross-disciplinary team team,, typically involving large, complex data sets.
The candidate should
Implement Data warehouse & Big/Small data designs,data lake solutions with very good data quality capabilities.
Thorough with the concepts of Continuous Integration, Deployment and Delivery (CI/CD).
• Very good hands on at Data modelling and designing ETL pilelines & solutions.
• Integrate domain data knowledge into development of data requirements.
• Look across multiple systems, understands the purpose of each system and defines data requirements by systems.
• Identify downstream implications of data loads/migration (e.g., data quality, regulatory, etc)
Mandatory Characteristics :
- Hands on working experience in AWS GLUE ETL tool and having good knowledge on any of the ETL tools(Informatica cloud,Talend etc.)
- Must have working experience with SQL, and databases (e.g.: Postgres, Redshift) implementing Data Models.
- Expertise with Python Language and Apache Spark. Have working experience in projects involving these.
- Strong hands on exposure to AWS Analytics services particulary Lambda,Step functions,EMR, Athena, Glue, Data-Pipelines
- Understanding and technical knowledge on AWS service like EC2, S3. Should have used these technologies in previously executed projects.
- Ability to leverage data assets to respond to complex questions that require timely answers
- Strong communication and interpersonal skills
- Should have a minimum 3+ years of working experience in above technologies or projects
Qualifications/Requirements : Bachelor's Degree in Computer Science, Information Technology or equivalent with 4 to 6 years of experience as senior data engineer.
Qualifications: Any PG / Graduation