Senior Data Engineer jobs in HyderabadBangaloreKochi at FullContact Technologies Pvt Ltd.

Title: Senior Data Engineer

Location: Remote

Employment: Full-time

Experience: 5-8 years

The Role

Work on the Data Pipeline team as Senior Software Engineer to design and build performant new features and enhancements in our data pipelines to support existing and new use cases in Identity Resolution. The data sets range from millions to billions, and we use appropriate tools to activate the datasets for both internal and external consumers. The team primarily writes in Java and Scala, operates in the AWS cloud, and works to have fully automated deployments with rich suites of automated tests.

Responsibilities

You will work closely with the group of dynamic engineers of FullContact, both in India and abroad, to chase down programmatic challenges and day to day engineer-tasks.
Be part of the architectural design/modification and implementation of the company’s products.
Process large amounts of data leveraging big data technologies such as Spark, EMR, Kafka, and more
Design and implement scalable software/systems
Build automated unit and functional testing around features and systems
Work with a team to build super-fast, scalable distributed systems
Work with a team to solve difficult problems and then successfully implement it
Work with Product management on understanding features
Responsible for reviewing current systems, presenting ideas for system improvements.

Necessary Skills

Very knowledgeable in ensuring a superior customer experience
Very knowledgeable in Spark, Kafka and working with large volumes of data and big data technology
Very knowledgeable in backend technologies and patterns
- Scala, Java, API Frameworks (i.e. Dropwizard)
- Large scale and NoSQL databases (i.e. Cassandra, Scylla, HBase)
- Traditional RDBMS and SQL (MySQL, Postgres, Aurora, Athena, etc)
Experience in cloud technologies (i.e. AWS) and deploying in the cloud
- CI/CD tools such as Spinnaker / Jenkins / Docker / Kubernetes
- Cloud configuration and deployment templates (Terraform, Ansible, etc)
- Linux / Unix and CLI scripting
- Observability tools (i.e. PagerDuty, Graphite, Grafana, etc)
Experience in managing cloud costs through reservations and instance type selection
Excellent written and verbal communication skills
Customer focused in ensuring a superior customer experience
Nice to Haves:
- Experience in managing and evolving core CI/CD infrastructure to enable rapid innovation for developers
- Experience in Druid
- Experience in Machine learning
- Experience in Identity Resolution
- Experience in Docker & Kubernetes

About FullContact

FullContact is the premier provider of SaaS-based identity resolution that empowers brands to improve their customer experience and authentically engage with consumers. FullContact’s leading position in the identity resolution space informs our thoughts and direction on privacy and consent issues as we are creating end-to-end solutions for brands, publishers, and platforms. Using a consumer-first approach with our product offerings, we aim to make relationships better and that starts with our employees.