Vice President - Data Engineer
Req #: 190106496
Location: Bangalore East, KA IN
Job Category: Technology
Employment Type: Full Time
People manager expectations:
• This role is a Technical Lead who will be responsible for delivering end to end solutions for projects accepted by the Helix Inform domain.
• Will be responsible for coordinating between Product Owners, Architects, Design Authorities, Scrum Masters, SREs, Scrum Teams to ensure the application meets the business requirements and satisfies timeliness of delivery and quality of product.
• Will be responsible to provide direction to scrum teams on all aspects and will have the responsibility to ensure the criteria of “Definition of Done” is met by the scrum teams.
• Will be responsible to create a support framework for the application when it is delivered in any environment.
• Will expected to take on the responsibility of managing a team of about 6 resources
603 Level – Tech Lead/Expert:
• 5+ years’ experience with building large scale big data applications
• 10+ years’ experience with full development lifecycle from inception through implementation
• Experience building Data Lake using Cloudera or Hortonworks distributions
• Hands-on experience in HDFS, MapReduce, Yarn & Hive
• Extensive experience in Spark leveraging Python, Scala or R.
• Hands-on experience with Scala or Java 8
• Hands-on experience with Spark – RDDs, Datasets, Dataframes, Spark SQL,
• Hands-on experinece with streaming technologies such Spark Streaming and Kafka
• Hands-on experience using SQL, Spark SQL, HiveQL
• Experience working on 1 or more NoSQL Databases such as Cassandra, HBase, MongoDB, DynamoDB, Elastic Search
• Experience with Oracle databases
• Hands-on experience using CI/CD processes for application software integration and deployment using Maven, Git, Jenkins, Jules
• Experience with private cloud – PCF
• Experience in developing software solutions leveraging Test Driven Development (TDD)
• Expertise in Data governance and Data Quality
• Experience working with PCI Data is a plus
• Experience working with Data Scientists
• In depth knowledge of OO and SOLID design principles
• Demonstrable experience of successfully delivering big data projects using Kafka, Spark, Cassandra and related stack on premise or cloud
• Able to tune big data solutions to improve performance
• Excellent understand of Spring framework
• Experinece in Data Science, Machine Learning, Deep learning, Business Intelligence and Visualization.
• Preferrable – experience in Financial industry