Key Responsibilities:
- Design and implement robust data architectures on Azure, Google Cloud, or on-premises platforms like Cloudera.
- Develop and optimize data pipelines, architectures, and data sets for real-time data integration.
- Ensure data architecture aligns with business requirements and supports the creation of data products.
- Apply expertise in SQL and data modelling to manage and manipulate large, complex data sets.
- Utilize data virtualization tools to provide efficient access to various data sources.
- Implement Master Data Management (MDM) and Data Quality frameworks to maintain high data integrity.
- Collaborate with cross-functional teams to integrate industry-standard data sources and systems such as PI, SAP, LIMS, SPF, Maximo, SharePoint, SCADA, and HYSYS.
- Uphold data governance and data integrity principles specific to the Oil and Gas/Power and Utility/Manufacturing industry.
- Stay current with emerging technologies and industry trends to drive innovation within the team.
Qualifications:
- 10+ years of experience in data architecture or a related field.
- Proven experience with Databricks and cloud technologies (Azure/Google Cloud).
- Familiarity with on-premises data solutions like Cloudera.
- Extensive experience in the Oil and Gas/Power and Utility/Manufacturing.
- Strong proficiency in SQL and experience with real-time data integration.
- Solid understanding of Data Products, Data Fabric, and Data virtualization tools.
- Knowledge of MDM and Data Quality principles.
- Proficiency with industry-standard data sources and systems (PI, SAP, LIMS, SPF, Maximo, SharePoint, SCADA, HYSYS).
- Excellent knowledge of data modelling, data governance, and data integrity principles.
- Bachelor's or master’s degree in computer science, Engineering, or a related field.