Software Engineer

Job title: Software Engineer

Job type: Full-time 

Hours per week: 37.5 hours 

Salary: £55,000 per annum

We are a technology consulting and solutions provider helping organisations achieve meaningful digital transformation. We design, build, and maintain scalable, secure, and resilient systems that power essential services and improve everyday experiences for millions of users. We’ve proudly partnered with organisations such as Rant and Rave, the Department for Work and Pensions, the Department for Education, and the Royal Navy, helping them innovate, modernise, and deliver exceptional results.

· Design & Build Data Pipelines – Develop scalable ETL/ELT pipelines to ingest, transform, and load structured and unstructured data into data lakes and warehouses.

· Optimise Data Workflows – Improve performance, reliability, and cost-efficiency of Spark, SQL, or cloud-native pipelines through partitioning, caching, and indexing strategies.

. Support and enhance the current web-based application to meet the requirements of the UK and the rest of Europe.

· Data Modelling & Architecture – Implement data models (e.g., star/snowflake, Medallion architecture) and ensure proper normalisation, schema evolution, and version control.

· Maintain Data Quality & Integrity – Apply validation rules, deduplication, and monitoring to ensure trustworthy, consistent datasets for analytics and downstream consumers.

· Collaborate with Stakeholders – Work closely with analysts, data scientists, and product teams to understand business needs and translate them into data solutions.

· Automation & DevOps – Use CI/CD, infrastructure-as-code (Terraform, Bicep, etc.), and version control (Git) to automate deployments and manage environments.

· Monitoring & Maintenance – Implement observability, logging, and alerting for pipelines and jobs to detect issues proactively and ensure SLA compliance.

· Security & Governance – Enforce access control, data masking, encryption, and compliance with GDPR and company data policies.

· Documentation & Knowledge Sharing – Maintain technical documentation, share best practices, and contribute to coding standards for the wider engineering team.

· Continuous Improvement – Evaluate emerging tools and technologies (Databricks, Fabric, Delta Lake, Kafka, etc.) to enhance the data platform’s scalability and efficiency.

· Strong proficiency in Python and SQL for data and application development

· Experience developing software using Java and working with APIs or web services

. Knowledge of web-based Product development Architecture

· Knowledge of relational databases (MySQL, PostgreSQL) and data modelling principles

· Experience with cloud platforms such as Microsoft Azure and AWS

· Familiarity with ETL/ELT workflows, data architecture, and pipeline orchestration tools

· Understanding of DevOps practices, including CI/CD and infrastructure automation (Terraform, Bicep, Git)

· Experience working with modern data frameworks (Spark, Databricks, Delta Lake, Kafka) is a strong advantage

· Knowledge of security, access control, and data governance standards

· Strong problem-solving and analytical mindset with attention to detail

· Excellent communication and collaboration skills in an agile environment

· Master’s degree preferred in Computer Science, or a related technical field.

If you are interested in this job role, please send a copy of your CV and a short cover letter to  info@progressiveitservices.co.uk