Procom Labs
About the Role:
In collaboration with the Business Intelligence (BI) Manager, the Data Engineer will undertake the responsibility of executing and managing Azure Data Factory Pipelines. This includes the design and implementation of the Data Lake, as well as the optimization of data refresh performance.
The role encompasses ownership (both execution and management) of Extract, Transform, Load (ETL) processes, Azure Data Lake, and Data Warehouse. Additionally, the Data Engineer will oversee the Power BI Semantic Data Model, ensuring its efficient operation and maintenance. This position requires a strong understanding of data architecture and cloud-based data services, particularly within the Microsoft Azure platform. The individual will play a critical role in the organization’s data strategy and its implementation.
Responsibilities:
- Develop and implement data using Azure cloud management solutions.
- Design and Develop Power BI Semantic models and custom reporting.
- Design and Develop Star Schema for Power BI Data Models.
- Design and manage data storage and data processing solutions in Azure.
- Integrate data sources and build data pipelines for data transformation and ingestion.
- Implement data security and governance measures in Azure.
- Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
- Work together with data scientists and analysts to understand the needs for data and create effective data workflows.
- Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
Qualifications:
- 5+ years of experience in a Data Engineering role
Required Skills:
- 4+ years of proven experience building data pipelines using MSFT Azure tools and services (Azure Data Factory, Azure Synapse, Azure Blob, Azure Databricks, Azure SQL Server, Azure Data Warehouse, Azure Batch)
- 3+ years of experience in Power BI Modeling and Reporting.
- Azure Expertise: Proficiency in designing comprehensive Azure solutions, considering infrastructure, apps, data, security, and ETL Development. This includes Azure administration skills and experience with Azure Data Factory for data ingestion and transformation.
- Database Management: Proficiency in managing database systems.
- Analytical Skills: Strong ability to analyze and solve complex problems.
- Data Modeling and Architecture: Expertise in designing data models and architectural frameworks.
- Programming Proficiency: Knowledge of SQL, Python, DAX & M is essential.
- Data Pipeline Construction: Experience in building data pipelines and applying data transformations for batch and real-time messaging systems.
- Data Source Evaluation: Ability to assess the effectiveness and accuracy of new data sources and data-gathering techniques.
- Data Transformation and Modeling: Ability to work on various aspects of data transformations and data modeling.
- Data Collection Enhancement: Experience in enhancing data collection procedures to include information relevant for building analytic systems.
- Cloud-Based Analytics Tools: Familiarity with Azure cloud-based analytics solutions, Experience in Power BI is an advantage.
A Bit About Us!
Procom Labs is building a world-class digital ecosystem of products to find, employ and manage the contingent workforce of today and tomorrow. Our products offer end-to-end solutions in Recruiting Technologies, Workforce Management, and Back-Office Processing. We are a group of people that love to try out creative and sometimes crazy solutions to solve complex problems. We want you to join us in our journey. You can find out more about our mission and products at https://procomservices.com/procom-labs/