Big Data/Event Streaming Engineer


Bangalore, KA, IN

Company:  ExxonMobil

Job Role Responsibilities


Work with business and technical teams to provide technical support and development expertise for overall big data pipeline using Nifi and Kafka, Hadoop Spark workflows, Hadoop Tables and implement data models in Data Science & Analytics portfolio.

Primary Job Functions:


  • Develop or enhance Nifi, Kafka and Spark flows for processing of structured and unstructured data.
  • Develop or enhance Hadoop workflows including data ingestion, extraction and processing of structured and unstructured data.
  • Engage in proof of concepts, technical demos and interaction with customers and other technical teams
  • Proactively automate monitoring, alerting based on workflow needs
  • Work to utilize common CI/CD best practices across different teams (data scientists, data visualization analysts, web developers etc.) when working on the same project 
  • Ensure solution compliance to technical design standards and architecture
  • Explore and develop skills in newer technologies according to big data technology roadmap

Job Requirements


  • Minimum Bachelor's degree from a recognized university in Computer Science or equivalent; minimum GPA - 6.5 (out of 10.0) 
  • 3-5 Years of experience working with Hadoop
  • Applicants must have the following skills:
    • Applied Experience with Spark
    • Applied Experience with Kafka
    • Applied Experience with Scala and/or Python
    • Applied Experience with NiFi
    • Applied Experience with Solr
    • Experience with Oozie
    • Experience with the Cloudera Data Platform (CDP)
    • Experience with Flink-SQL
    • Familiarity with Azure DevOps (nice to have, but not required)
    • Familiarity with SQL (nice to have, but not required)
    • Familiarity using Git (nice to have, but not required)
    • Experience in UNIX or UNIX-like systems
    • Experience with SCRUM or other similar Agile framework
  • Soft Skills:
    • Strong verbal and written communication skills
    • Self-starter and independent worker
    • Strong problem resolution skills
    • Ability to work with data scientists and develop seamless workflows
    • Ability to interface with customers, technology partners, testing, architecture and analysis groups
    •  Applicants will be given preference for having the following skills:
      • Contributions to open-source big data projects (please provide link to repos)



ExxonMobil does not use recruiting or placement agencies that charge candidates an advance fee of any kind (e.g., placement fees, immigration processing fees, etc.). Follow the LINK to understand more about recruitment scams in the name of ExxonMobil.

Job Segment: Database, Computer Science, Engineer, SQL, Unix, Technology, Engineering