Loading...

Hadoop Data Engineer

Location: 

Bangalore, KA, IN

Company:  ExxonMobil

Job Role Responsibilities

 

Work with business and technical teams to provide technical support and development expertise for overall data pipeline, Hadoop Spark workflows, Hadoop Tables and implement data models in Data Science & Analytics portfolio 


Primary Job Functions:

 

  • Develop or enhance Hadoop workflows including data ingestion, extraction and processing of structured and unstructured data.
  • Support ongoing activities ingestion of additional data or new data sources, processing and monitoring incremental flows, maintenance of Solr collection, reprocessing data when data science algorithms are updated
  • Engage in proof of concepts, technical demos and interaction with customers and other technical teams
  • Proactively automate monitoring, alerting based on workflow needs
  • Work to utilize common CI/CD best practices across different teams (data scientists, data visualization analysts, web developers etc.) when working on the same project 
  • Ensure solution compliance to technical design standards and architecture
  • Explore and develop skills in newer technologies according to big data technology roadmap

 

Job Requirements:

 

  • Minimum Bachelor's degree from a recognized university in Computer Science or equivalent; minimum GPA - 6.5 (out of 10.0) 
  • 3-5 Years of experience working with Hadoop
  • Applicants must have the following skills:

 

  • Applied Experience with Spark
  • Applied Experience with Scala and/or Python
  • Applied Experience with NiFi 
  • Applied Experience with Solr 
  • Experience with Kafka
  • Experience with Oozie 
  • Familiarity with Azure DevOps (nice to have, but not required)
  • Familiarity with SQL (nice to have, but not required)
  • Familiarity using Git (nice to have, but not required)
  • Experience in UNIX or UNIX-like systems
  • Experience with SCRUM or other similar Agile framework 
  • Soft Skills:
    • Strong verbal and written communication skills
    • Self-starter and independent worker
    • Strong problem resolution skills
    • Ability to work with data scientists and develop seamless workflows
    • Ability to interface with customers, technology partners, testing, architecture and analysis groups

 

 

ExxonMobil does not use recruiting or placement agencies that charge candidates an advance fee of any kind (e.g., placement fees, immigration processing fees, etc.). Follow the LINK to understand more about recruitment scams in the name of ExxonMobil.
 


Job Segment: Database, Engineer, Computer Science, Unix, SQL, Technology, Engineering