New Jobs for Cloud Data Engineer in Pune for Air Products

19 November 2020 - Explore Cloud Data Engineer jobs in Pune with 0 to 1 year experience via Air Products. Register here to apply online for similar kind of Cloud Data Engineer jobs.

PRINCIPAL ACCOUNTABILITIES

Build and maintain data pipelines in support of the enterprise AWS S3 Data Lake.
Contribute to the core design of data architecture, data pipelines, data models and schemas, and implementation plans for the data lake
Enable an innovative approach to data platforms in order to greatly increase the flexibility, scalability, and reliability of IT services at an optimal cost
Work in cross-disciplinary teams to understand enterprise needs and ingest rich data sources.
Work with analytics and data science team members to optimize data platforms to better meet their needs
Maintain the proper infrastructure to support ETL from a variety of sources using SQL, SAP Data Services, and big data technologies
Design ETL processes based on enterprise architecture and custom project needs
Perform design reviews, plan, develop, and resolve technical issues
Work closely with management to prioritize business and information request backlogs
Ensures data governance and data security procedures are followed
Implement data warehouses on platforms such as AWS Redshift
Research, experiment, and utilize leading data and analytics technologies in AWS
Educate and train yourself and others as you evangelize the merits of data and analytics
Be proactive in keeping your skills fresh
Generate new ideas, never say or think 'that's not my job.'

Job Requirements

6+ years as a Python, PySpark, Scala, Java software developer building scalable real-time streaming ETL applications and data warehouses.
Advanced experience working within the AWS and AWS tools (S3, Glue, EMR, Athena, Redshift)
Advanced programming experience with Python and PySpark
Experienced in maintaining infrastructure as code using Terraform
Advanced understanding of both SQL and NoSQL technologies such as MongoDB / DocumentDB
Solid understanding of data warehouse design patterns and best practices
Experience in working with and processing large data sets in a time-sensitive environment while minimizing errors
Hands-on experience working with big data technologies (Hadoop, Hive, Spark, Kafka)
Ability to develop test plans and stress test platforms
Demonstrated strength in process development, process adherence, and process improvement
Experience with complex Job scheduling
Experience integrating external APIs
Active in the Data Science / Data Engineering community
Effective analytical, conceptual, and problem-solving skills
Must be organized, disciplined, and task/goal oriented
Able to prioritize and coordinate work through interpretation of high-level goals and strategy
Effective team player with a positive attitude
Strong oral and written English language communications skills

Air Products jobs - Cloud Data Engineer

Cloud Data Engineer

Job Description

Job Particulars

About Company