Big Data Engineer

Experience : 0 to 3 Years
Job Role : Engineer
Posted on 02 Jun 20
Job is expired
Job DescriptionLast Date 01 Aug 20

Software Developers at IBM are the backbone of our strategic initiatives to design, code, test, and provide industry-leading solutions that make the world run today - planes and trains take off on time, bank transactions complete in the blink of an eye and the world remains safe because of the work our software developers do  Whether you are working on projects internally or for a client, software development is critical to the success of IBM and our clients worldwide  At IBM, you will use the latest software development tools, techniques and approaches and work with leading minds in the industry to build solutions you can be proud of

Your Role and Responsibilities
As Data Engineer, you will develop, maintain, evaluate and test big data solutions You will be involved in the design of data solutions using Hadoop based technologies along with Hadoop, Azure, HDInsights for Cloudera based Data Late using Scala Programming


  • Real time anomaly detection solutions that proactively identify service impacting incidents and prevent system downtimes This is done by leveraging an ensemble of Deep learning and LSTM models
  • Natural Language Processing for entity, topic clusters and relationship extraction
  • Text Analytics in human generated tickets and correlation with event tickets for event noise reduction ApplyNatural Language Classification and RNN algorithms to automatically route tickets
  • Log Analysis - Text mining, message clustering / templatization, Logs to metrics, anomaly detection, event annotation and sequencing
  • Learn Log Message Sequence for each mainframe batch job and Identify Anomalies during job runs using sequence mining techniques and provide early warning / alerts
  • Cloud Migration - Patterns-based discovery optimization: Identify potential business application boundaries using algorithmic approach from Cloudscape data
  • Wave planner: Employ goal-based reasoning from AI planning capabilities for Server affinity, cost, time, black-out windows, etc
  • To power the above use cases, we have a Big Data system that can handle 2-3 TB of data daily and we manage a data lake that is 15 PB in size

Required Technical and Professional Expertise
  • 8 Years of IT Industry Experience and 6 years relevant exp in data engineering
  • Design, Development & Deployment of various technology components needed for Big Data Analytics
  • Leading end to end deployment of ITOA Big Data solutions for enterprise customers
  • Provide inputs to Architects and Data scientists on various stages of solution design
  • Perform Integration of AIOPS solution as per design provided by Architects
  • Participate & be an active member of internal capability building projects
  • Train & support junior resources as needed
  • Provide resolution to customer queries and issues
  • Hands on expertise over Apache Spark and Hadoop framework
  • Hands on coding experience in PySpark or Scala using Spark libraries
  • A decent understanding of Relational Databases and can write SQL Codes
  • Well versed with Non Relational databases (No-SQL) and have good experience on Mongo DB, Cassandra, Hive, HBase etc

Preferred Technical and Professional Expertise
  • Experience working in IT Service delivery and Infrastructure domain,
  • Knowledge of ITIL Framework
  • Experience working with large data sets leveraging distributed systems eg Spark/Hadoop
  • Working knowledge of Relational (Oracle, Db2, SQL, etc) and new age databases (NoSQL databases) eg MongoDB, Cassandra
  • People with demonstrated past projects executed based on above teachnologies

About Business Unit
At Global Technology Services (GTS),we help our clients envision the future by offering end-to-end IT and technology support services, supported by an unmatched global delivery network  It's a unique blend of bold new ideas and client-first thinking If you can restlessly reinvent yourself and solve problems in new ways, work on both technology and business projects, and ask, 'What else is possible?' GTS is the place for you!

Your Life @ IBM
What matters to you when you’re looking for your next career challenge?

Maybe you want to get involved in work that really changes the world? What about somewhere with incredible and diverse career and development opportunities – where you can truly discover your passion? Are you looking for a culture of openness, collaboration and trust – where everyone has a voice? What about all of these? If so, then IBM could be your next career challenge Join us, not to do something better, but to attempt things you never thought possible

Impact Inclusion Infinite Experiences Do your best work ever

About IBM
IBM’s greatest invention is the IBMer We believe that progress is made through progressive thinking, progressive leadership, progressive policy and progressive action IBMers believe that the application of intelligence, reason and science can improve business, society and the human condition Restlessly reinventing since 1911, we are the largest technology and consulting employer in the world, with more than 380,000 IBMers serving clients in 170 countries

Location Statement
For additional information about location requirements, please discuss with the recruiter following submission of your application

Being You @ IBM
IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status

Job Type : Full Time
Interview Type : Face to Face Interview
Company Description
International Business Machines Corporation (IBM) is an American multinational information technology company headquartered in Armonk, New York, with operations in over 170 countries. The company began in 1911, founded in Endicott, New York, as the Computing-Tabulating-Recording Company (CTR) and was renamed 'International Business Machines' in 1924.
Job is expired
Similar Jobs
Big Data Engineer - Data DQMF
Experience : 0 to 3 Years
Education : Other Course
Location : Bangalore
Last Date : 26 Sep 20
Quick Apply
Big Data Engineer
Experience : 4 to 4 Years
Education : BE/B.Tech, MCA, ME/M.Tech
Location : Bangalore
Last Date : 16 Sep 20
Quick Apply
Experience : 3 to 4 Years
Education : Diploma, BCA, BE/B.Tech, BSc, MCA...
Location : Pune
Last Date : 12 Sep 20
Quick Apply
Experience : 0 to 3 Years
Location : Bangalore
Last Date : 11 Sep 20
Quick Apply
Experience : 2 to 4 Years
Education : BE/B.Tech
Location : Delhi, Gurgaon, Mumbai
Last Date : 08 Sep 20
Quick Apply
Big Data Engineer
Experience : 4 to 4 Years
Education : Diploma, BCA, BE/B.Tech, BSc, MCA...
Last Date : 23 Aug 20
Quick Apply
Experience : 1 to 4 Years
Education : BE/B.Tech
Location : Bangalore
Last Date : 15 Aug 20
Quick Apply
Active Jobs By Role
Accountant (1066) Admin (177) Agriculture and Dairy (18) Bartender (4) Architect (100) Beauticians / Spa (89) Bouncer (1) BPO / Customer care (1994) Caretaker / Nanny (9) Carpenter (21) Cashier (2) Cleaner / Washer (27) Construction / Laborer (39) Content Writer (301) Counsellor (103) Cook / Chef (228) Data Analytics (11) Data Entry / Back Office (780) Delivery (449) Design / Animation (525) Digital marketing / SEO (447) Draughtsman/Draftsman (0) Doctor / Physician (101) Driver (94) Electrician (66) Engineer (1579) Engraver (1) Event Planner (1) Fire Fighter (4) Fitter (78) Gardener(Mali) (1) Ground Staff (9) Hospitality Executives (151) Housekeeping (406) HR (1035) Insurance Consultant (41) IT - Mobile Developer (263) Lab Technician (47) IT Hardware Engineer (140) IT Software-Engineer (4517) Language Translator (2) Legal (9) Librarian (1) Mechanic (384) Management Trainee (280) Media / Journalism (25) MIS Executive (12) Moulder (3) Nurse (216) Nutritionist / Dietician (0) Operations (153) Office Assistant / Helper (135) Operator / Machinist (116) Packager (6) Painter (2) Pharmacist / Medical Rep (182) Photographer / Videographer (31) Physiotherapist (0) Plumber (6) Research/JRF/SRF (217) Receptionist / Front Office (247) Retail / Store Executive (425) Rigger (0) Sales / Marketing (2941) Security / Guards (45) Sports Trainer (2) Tailor/ dress designer (90) Teacher (254) Tool & Die Maker (1) Tourist Guide (0) Trainer (23) Waiter / Steward (7) Ward Boy (6) Warehouse Executive (40) Welder (46) Others (5280)

Teamlease does not charge any kind of payment for a job.