Backend Software Engineer — Data

We are looking for a Senior Software Engineer to join the DIAL (Data Integration & Analytics Layer) team, responsible for building scalable, high-performance enterprise applications that power data preprocessing, observability, and data product pipelines.

• Design and develop high-performance backend services using FastAPI, Pydantic, and SQLAlchemy.
• Build and maintain API-driven data processing and orchestration frameworks within DIAL.
• Implement asynchronous and concurrent processing using Python (asyncio) for scalable workloads.
• Integrate with Azure services such as ADLS, ADF, Databricks, and related data platforms.
• Develop robust data models, validation layers, and persistence mechanisms.
• Ensure observability, logging, and monitoring for enterprise-grade applications.
• Write unit and integration tests using Pytest to ensure code quality and reliability.
• Collaborate with data engineers, architects, and product owners to deliver end-to-end solutions.
• Participate in code reviews, design discussions, and performance optimisation initiatives.
• Contribute to CI/CD pipelines and containerised deployments.

• Strong experience in Python backend development.
• Hands-on experience with FastAPI, Pydantic, and SQLAlchemy.
• Good understanding of REST API design and microservices architecture.
• Experience working with Microsoft Azure (ADLS, Azure Data Factory / Databricks preferred).
• Working knowledge of Python asyncio.
• Understanding of high-throughput and low-latency system design.
• Practical experience with Pytest (unit, integration, and API testing).
• Experience with containerisation (Docker / Kubernetes) and CI/CD practices.
• Nice to have: performance testing & tuning, Terraform / IaC, observability frameworks (OpenTelemetry), data engineering ecosystems.
• Strong problem-solving and analytical thinking; ownership mindset focused on delivery and reliability.
• Good communication skills for enterprise stakeholder interactions.