s

Big Data Engineer

InvestingChannel
Experience : 0 to 3 Years
Location : Hyderabad
Posted on 21 Oct 20
Apply now
Job DescriptionLast Date 19 Dec 20

InvestingChannel, an innovative digital media company featuring a valuable repertoire of financial websites, award winning content and robust advertising and subscription solutions

 We are looking for an experienced and passionate Data Engineer with 6+ years of experience in building scalable, high-performance distributed systems that deal with large data volumes You will be responsible for development work on all aspects of Big Data, data provisioning, modeling, performance tuning and optimization 


Responsibilities

  • Work closely with business and dev teams to translate the business/functional requirements into technical specifications that drive Big Data solutions to meet functional requirements
  • Participate in software design meetings and write technical design documents
  • Design, develop, implement and tune large-scale distributed systems and pipelines that process large volumes of data; focusing on scalability, low -latency, and fault-tolerance in every system built
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies
  • Maintain application stability and data integrity by monitoring key metrics and improving code base accordingly
  • Understand & maintain existing codebase by regular re-factoring and applying requested fixes and features
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader
  • Should be flexible to learn new technology / required frameworks


Requirements

  • 6+ years of experience in core Java and Spring Batch
  • Highly Proficient in SQL Expertise in writing complex, highly-optimized queries across large data sets
  • 4+ years of experience in ingestion pipeline and data processing
  • Experience with data governance (Data Quality, Metadata Management, Security, etc)
  • Hands-on with Parquet formats, AWS Redshift, Spectrum and Athena
  • Experience with multi-data sources and getting it all into a Data Lake
  • 2+ years of experience in Hadoop technologies
  • Experience in a Linux/UNIX environment is mandatory
  • Ability to grapple with log files and Unix processes
  • Strong analytic skills related to working with structured and unstructured datasets
  • Excellent understanding of Data Structures and Algorithms
  • Prior exposure to building real time data pipelines would be an added advantage
  • Experience on data visualization tools is good to have
  • Experience of working within a fast-paced Agile development process
  • Excellent problem solving skills
  • Technology 'Must Haves': Core Java, Spring Batch, Data Structures, Web Services, RDBMS (MySQL/SQL Server),NoSQL, HDFS, MapReduce, Hive, Kafka, Airflow, Spark, Hibernate Framework, Shell Scripting
  • Technology 'Good to Haves': Design Patterns, Jenkins, Python, R
  • Big Data Engineer
  • Experience : 0 to 3
  • Job Type : Full Time
  • Interview Type : Face to Face Interview


Job Type : Full Time
Interview Type : Face to Face Interview
Company Description
InvestingChannel
Apply now
Similar Jobs
Big Data Engineer
BRISA TECHNOLOGIES PRIVATE LIMITED
Experience : 0 to 3 Years
Education : BE/B.Tech
Location : Bangalore
Last Date : 04 Feb 21
Quick Apply
Experience : 1 to 4 Years
Education : BE/B.Tech, ME/M.Tech
Location : Gurgaon
Last Date : 06 Jan 21
Quick Apply
Experience : 0 to 3 Years
Education : BE/B.Tech, ME/M.Tech
Location : Mumbai
Last Date : 28 Dec 20
Quick Apply
AWS Big Data Engineer
GREAT RIVER FINANCIAL SERVICES INC.GRFS INC
Experience : 4 to 4 Years
Education : BE/B.Tech, ME/M.Tech
Location : Bangalore
Last Date : 28 Dec 20
Quick Apply
    
Active Jobs By Role
Accountant (1444) Admin (192) Agriculture and Dairy (23) Bartender (0) Architect (230) Beauticians / Spa (241) Bouncer (1) BPO / Customer care (3138) Caretaker / Nanny (25) Carpenter (27) Cashier (2) Cleaner / Washer (39) Construction / Laborer (63) Content Writer (814) Counsellor (248) Cook / Chef (510) Data Analytics (10) Data Entry / Back Office (1610) Delivery (873) Design / Animation (1485) Digital marketing / SEO (1201) Draughtsman/Draftsman (4) Doctor / Physician (154) Driver (78) Electrician (118) Engineer (2410) Engraver (4) Event Planner (12) Fire Fighter (10) Fitter (109) Gardener(Mali) (2) Ground Staff (141) Hospitality Executives (1082) Housekeeping (173) HR (1926) Insurance Consultant (34) IT - Mobile Developer (495) Lab Technician (76) IT Hardware Engineer (215) IT Software-Engineer (4737) Language Translator (2) Legal (25) Librarian (0) Mechanic (482) Management Trainee (417) Media / Journalism (279) MIS Executive (15) Moulder (0) Nurse (184) Nutritionist / Dietician (5) Operations (137) Office Assistant / Helper (207) Operator / Machinist (227) Packager (20) Painter (7) Pharmacist / Medical Rep (217) Photographer / Videographer (46) Physiotherapist (8) Plumber (9) Research/JRF/SRF (251) Receptionist / Front Office (398) Retail / Store Executive (493) Rigger (1) Sales / Marketing (5960) Security / Guards (38) Sports Trainer (1) Tailor/ dress designer (160) Teacher (509) Tool & Die Maker (0) Tourist Guide (0) Trainer (55) Waiter / Steward (24) Ward Boy (3) Warehouse Executive (12) Welder (71) Others (5425)

SAFETY ALERT!
Teamlease does not charge any kind of payment for a job.