Data Engineer with Databricks jobs in Hyderabad at Nisum

Nisum is a leading global digital commerce firm headquartered in California, with services spanning digital strategy and transformation, insights and analytics, blockchain, business agility, and custom software development. Founded in 2000 with the customer-centric motto “Building Success Together®,” Nisum has grown to over 1,400 professionals across the United States, Chile, India, and Pakistan. A preferred advisor to leading Fortune 500 brands, Nisum enables clients to achieve direct business growth by building the advanced technology they need to reach end customers in today’s world, with immersive and seamless experiences across digital and physical channels.What You’ll Do

Design, develop and deploy modern data warehouse solutions in AWS/Azure cloud platform.
Gather and document business requirements and translate it into technical design documents.
Create technical documentation, e.g. data flow diagrams, end user guide and technical operations guides.
Create technical documentation, e.g. data flow diagrams, end user guide and technical operations guides.
Monitor data load jobs and perform root cause analysis of production issues.
Lead the efforts in building end to end streaming and batch data analytics pipelines. From data ingestion, processing, storage, analysis, machine-learning to visualization. Understand big-data principles and best practices. Deliver projects in data analytics, machine learning and AI.
Design architectures publish reference code and establish data structure design based on business requirements. Should be pretty hands on.
Perform code reviews, ensure code quality and encourage a culture of excellence.
Communicate/work effectively in a team environment.

What You Know

5+ years of experience designing and building solutions on Big Data and Data Analytics.
Azure / AWS / GCP cloud services experience is mandatory.
Must have hands-on experience with Databricks.
At least two full implementation project experience with heterogenous source system.
Experience transforming data in various formats, including JSON, XML, CSV, AVRO, Parquet , ORC and zipped files is required.
Experience in building Data Lake on Cloud.
Experience in some of the following: Python, Scala, HDFS/MapReduce, Hive, Sqoop, Flume, Spark, Kafka, Apache Airflow Advanced SQL, No SQL (Cassandra / HBase) and Databricks
Good to have Machine Learning and R experience or knowledge.
Experience programming in Java or Python or Scala, etc.
Expertise in at least two of these technologies: Relational Databases, Analytical Databases, NoSQL databases.
Experience with Apache Airflow, Cloud Scheduler.
Familiarity with standard source repositories (GIT, BitBucket)
Experience and solid knowledge in Agile (Scrum) Methodologies
Spark / Databricks certification is a major advantage.

Education

Bachelor’s degree in Computer Science, Engineering or equivalent demonstrable experience.

Benefits

In addition to competitive salaries and benefits packages, Nisum India offers its employees some unique and fun extras:
Continuous Learning - Year-round training sessions are offered as part of skill enhancement certifications sponsored by the company on an as need basis. We support our team to excel in their field.
Parental Medical Insurance - Nisum believes our team is the heart of our business and we want to make sure to take care of the heart of theirs. We offer opt-in parental medical insurance in addition to our medical benefits.
Activities - From the Nisum Premier League's cricket tournaments to hosted Hack-a-thon, Nisum employees can participate in a variety of team building activities such as skits, dances performance in addition to festival celebrations.
Free Meals - Free snacks and dinner is provided on a daily basis, in addition to subsidized lunch