IPMC is one of Nigeria oilfield service companies providing innovative solutions, technology, and services to the oil and gas industry. The Company operates in Nigeria and has a network of, manufacturing, service, research and development, and training facilities.
It delivers innovative technologies and services designed to meet the world's current and future energy needs in a safe, ethical, and sustainable manner. Grounded by our core values and inspired by our world-class people, we are committed to being a trusted business partner to those we serve.
Job Summary
The Data Engineer is responsible for designing, developing and operationalizing ETL pipelines to support the data needs of cross-functional projects. They will also drive the adoption of data processing and analysis within the Microsoft Azure environment and help train other members of the team. They will provide technical leadership and support to our data analysts and data scientists on data initiatives and will ensure data delivery architecture is consistent throughout multiple projects.
Responsibilities
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure 'big data' technologies.
Implement data flows connecting operational systems, BI systems, and the big data platform
Build real-time, reliable, scalable, high-performing, distributed, fault tolerant systems
Clean and transform data into a usable state for analytics. Build data dictionary.
Create data tools for analytics and data scientist team members that assist them in their ML endeavors
Design and develop code, scripts and data pipelines that leverage structured and unstructured data
Implement measures to address data privacy, security, compliance
Required Education and Skills
BS in computer science or related STEM field
Experience with designing data and analytics architectures in Microsoft Azure cloud.
Experience with Big Data technologies like Spark, Hadoop, Hive, HBase, Kafka etc.
Fluency in several programming languages such as Python, Scala, Java, with the ability to pick up new languages and technologies quickly
Experience with data warehousing, data ingestion, and data profiling
Demonstrated teamwork, strong communication skills, and collaborative in complex engineering projects
