Pearson Whiffin IT Looking for Azure Data Engineer at London Full Time
We have an exciting opportunity for an Azure Data Engineer to join my client’s dynamic and exciting team.
A great opportunity has arisen for an innovative and forward-thinking Azure Data Engineer to help shape the Data Platform Landscape.
You will be architecting, developing, and deploying cutting-edge solutions that leverage Azure cloud services. You will be mastering low latency approaches, event driven processes, big data pipelines and serverless APIs.
The Azure Data Engineer will be responsible for:
Designing and implementing projects focused on collecting, aggregating, storing, reconciling, and making data accessible from disparate sources to enable analysis and decision making.
Playing a critical part of the data supply chain by ensuring that stakeholders can access and manipulate data for routine and ad hoc analysis.
Supporting the full lifecycle of data from ingesting through analytics to action.
Skills and Experience:
Must have previously worked in Data Warehouse ETL & BI platforms, with a good understanding of DW strategy, architecture, data modelling, schemas following Kimball Methodology.
Experience with databases and analytics, including relational databases (e.g. SQL Server), Data Warehousing, Big Data (e.g. DataLake and Analytics).
Knowledge and experience using the Microsoft technology stack and associated development tools, such as Azure Data Lake, Azure Data Factory, Logic Apps, Azure Data Bricks, Azure functions, Event Grid, Service Bus, Synapse, Purview, Azure DevOps, Digital Twins, IoT Central, SharePoint, PowerPivot and business analytics using and Power BI.
Strong experience with SQL and T-SQL.
Strong experience with at least one of the programming languages: Python, PySpark, Scala, R.
Experience working with database, storage, collection and aggregation models, delta loading, external data (social media, web sites, ONS Councils), API integration and IoTransactions.
Good understanding on Master Data Services, DQ profiling, cleansing, update, DQ reports, Data catalogue.
Desirable:
Exposure to PowerShell Scripting would be advantageous.
Experience of working in an agile cross-functional delivery squad working with product owners, solution analysts, solution architects and test analysts
Awareness and understanding of key DevOps and cloud concepts including CI/CD, Iaas, PaaS and SaaS with enabled multi-disciplined, cross functional capabilities. Containerisation experience highly desirable
Experienced in designing and coordinating existing pilots, prototypes or proof of concepts.
Experience of the underlying technology in order to develop data integration layers and associated systems to provide repositories of information
Learning Opportunities
Do you have a passion to learn any of these technologies?
BDD using Selenium and Specflow with C#
Node JS (NPM)
Python
Typescript
SharePoint 365 with low code solutions such as Power Platform
Sitecore
Microsoft Dynamics and power platform (Data Verse)
