Wayne Lambert
Senior Software Engineer specialising in designing and building scalable, production-grade systems, with expertise in distributed systems, complex data processing, and platform infrastructure supporting high-performance, data-driven applications.
Proven track record of engineering distributed systems handling billions of records across hundreds of customer environments. Skilled in developing data-driven applications and asynchronous processing workflows, alongside efficient data pipelines, with a focus on performance, reliability, and fault tolerance at scale.
Partners with product and engineering leadership to shape technical direction, clarify architectural constraints, and deliver solutions aligned with business objectives. Delivers solutions across application, data, and infrastructure layers, with experience in containerised deployments, automated pipelines, and cross-system integrations within complex production environments.
Senior Software Engineer (Python / Django)
Python Web Engineer
- Designed and implemented a resource-aware ELT scheduling orchestrator supporting asynchronous and multi-threaded data processing, regulating concurrent workloads across >250 customer environments to maintain system stability and prevent resource contention at scale
- Built and operated distributed ELT pipelines processing approximately 1.7 billion records nightly, ensuring reliable ingestion from relational databases and OData APIs while reducing downstream failure risk
- Reduced large-scale ELT execution time from almost 15 hours to approximately 3–3.5 hours across >250 customer environments through optimised collection, scheduling, database procedures, and SQL Server tuning, achieving required overnight performance without unnecessary resource saturation
- Evolved a multi-tenant architecture supporting hundreds of isolated customer environments on shared infrastructure, enabling efficient resource utilisation, scalability, and consistent deployment patterns
- Influenced technical and product direction by identifying system constraints, proposing architectural solutions, and guiding implementation approaches in collaboration with product and engineering leadership
- Engineered database-level processing using stored procedures and cross-database queries (including SQL Server linked servers), enabling efficient data movement across distributed systems
- Implemented pre-execution data integrity safeguards, including endpoint availability validation, reducing the likelihood of incomplete data collection and preventing downstream inconsistencies
- Built and maintained automated deployment pipelines using Jenkins, orchestrating container lifecycle (teardown, rebuild, redeploy) across multi-service environments and validating readiness of application, database, and supporting services (Redis, Celery, schedulers, web servers)
- Designed and optimised Docker-based environments, improving build efficiency through layering, ensuring deterministic, reproducible, and portable deployment runtimes across environments
- Implemented monitoring and diagnostic tooling across applications and deployments, improving system observability and reducing time to detect and resolve production issues
- Designed and built data-driven web applications using Python, Django, HTMX, and JavaScript, supporting complex user workflows through a combination of server-rendered, AJAX, and client-side interaction patterns
- Developed comprehensive automated test coverage for Python applications, including hundreds of unit tests (pytest) and system-level pipeline testing, improving confidence in application behaviour and reliability at scale
- Configured and optimised Nginx-based web infrastructure, enabling efficient request handling, reliable application access, and performant static asset delivery
- Acted as team specialist for Git workflows, resolving complex branching and merge issues and reducing delivery risk during releases
HR BI Specialist
- Delivered data analysis solutions within enterprise environments and began transitioning to programmatic data processing using Python (Pandas, NumPy, Matplotlib), developing exploratory models and simulations to extend beyond traditional BI tooling
BI Developer & Data Migration Specialist
- Delivered end-to-end data migration programme consolidating multiple legacy systems into a unified platform, ensuring data integrity and supporting process automation