Websites, automation,
and data solutions

I help businesses and teams look more professional, save time, and work smarter with bespoke websites, dashboards, automation, and internal tools. From 850,000+ records processed in daily operational pipelines to premium client websites, I build solutions that are reliable, measurable, and built for real-world use.

Available for freelance & contract work
850,000+
Records Processed in Daily Operational Pipelines
8,255.5
Staff Hours of Unnecessary Training Removed
82%
DNA Prediction Accuracy
~80%
Reduction in Data Errors Through Automation and Validation Improvements

Commercial delivery backed by real technical proof

A quick snapshot of the proof, services, and business value behind the work featured on this site.

Selected Proof
  • 4+ years delivering production systems inside a large public-sector organisation
  • 850,000+ records processed daily in live operational pipelines
  • Live client delivery with CMS handover, SEO setup, and maintainable builds
  • Custom platform work spanning dashboards, automation, and local-first AI systems
What I Help With
  • Bespoke websites that improve credibility, enquiries, and handover
  • Dashboards and reporting that turn messy data into usable decisions
  • Automation and internal tools that reduce admin and friction
  • End-to-end delivery from planning through to launch and support
Best Fit
  • Small businesses that need a stronger online presence
  • Service providers and brands that want a site they can actually manage
  • Operational teams with reporting, workflow, or admin pain
  • Availability: open to freelance, contract, and selected permanent opportunities
Portrait of Dorrian Sidwell
Large-scale production systems
Client-ready delivery

Engineer by trade,
builder by nature.

I'm Dorrian Sidwell — a data engineer and AI systems developer with 4+ years of production delivery inside a large public-sector organisation. I build systems that take messy, manual, high-stakes processes and turn them into reliable pipelines, dashboards, and operational tools people can actually trust.

That work has improved reporting, compliance, and operational forecasting by reducing manual effort, improving data quality, and giving teams clearer visibility into performance. My safeguarding compliance project also identified 1,499 incorrect mappings, reshaped how the organisation measures compliance, and earned a Merit distinction in my apprenticeship capstone.

Alongside core data engineering, I also build analytics dashboards, AI-powered support products, white-label internal platforms, and selected premium client websites. That breadth helps when a project needs someone who can understand the data layer, build the product, and ship the final experience without losing sight of business value.

Python (Pandas, FastAPI) PostgreSQL Power BI (DAX) React + TypeScript ETL Pipelines Ollama / Claude RAG Systems Analytics Dashboards Azure Data Factory Docker scikit-learn Leaflet / Data Visualisation

Core Delivery Toolkit

The core tools I use to deliver websites, dashboards, data platforms, automation, and internal systems that work in practice — not just in demos.

Data Engineering

ETL/ELT PipelinesPostgreSQLData ValidationBulk Loading (COPY)

Python & Backend

PythonFastAPI / PydanticAPI IntegrationsWorkflow Automation

BI & Analytics

Power BIKPI DashboardsForecastingDecision Support

AI Systems

Ollama / Local LLMsClaude APIRAG PipelinesChromaDB

Product & Frontend Delivery

ReactTypeScriptHTML/CSS/JSEleventy (11ty)

Platform & Deployment

DockerAzure Data FactoryNetlify / CI/CDRBAC / Auth

From Production Systems

A short technical sample for recruiters and technical reviewers who want to see implementation detail from live operational tooling.

position_mapping_pipeline.py
Python
import pandas as pd
from rapidfuzz import process, fuzz
from pathlib import Path

# 16,000+ positions mapped and validated
df_matrix = pd.read_excel(
    mapping_file,
    sheet_name="Active PNs",
    usecols=list(range(9, 18))
)

# Fuzzy match against validated list
for col in mapping_cols:
    for idx, val in df[col].items():
        match = process.extractOne(
            val, valid_courses,
            scorer=fuzz.ratio,
            score_cutoff=85
        )
        if match:
            df.at[idx, col] = match[0]
Position Mapping Pipeline — 16,000+ positions mapped and validated, with course names fuzzy matched using rapidfuzz against a validated reference list.
sql_bulk_loader.py
Python + SQL
import psycopg2

# Stage-swap: 850k+ records via COPY
conn = psycopg2.connect(
    dbname="ops_pipeline",
    host="localhost"
)

with conn.cursor() as cur:
    cur.execute(f"""
        CREATE TABLE {stage}
        (LIKE {table} INCLUDING DEFAULTS)
    """)

    with open(csv_path) as f:
        cur.copy_expert(
            f"COPY {stage} FROM STDIN CSV HEADER",
            f
        )

    # Atomic swap to production
    cur.execute(f"ALTER TABLE {table} RENAME TO _old")
    cur.execute(f"ALTER TABLE {stage} RENAME TO {table}")
    cur.execute("DROP TABLE IF EXISTS _old")

conn.commit()
PostgreSQL Bulk Loader — Stage-swap deployment via COPY for maximum throughput. Atomic table swaps ensure zero-downtime production updates.

Production metrics, pipeline architecture, and analytics evidence

Examples drawn from large-scale operational delivery featured in this portfolio, showing how the underlying systems perform and why the outputs can be trusted.

Daily ETL Pipeline — Morning → Midday → End of Day
Live Animation
SFTP Download
Footer Removal
Validation
Fuzzy Match
PostgreSQL Load
Power BI Refresh
Safeguarding Compliance Before vs After
Impact
Before87%

Reported safeguarding compliance before the remapping audit.

After61%

True compliance after correcting the underlying data.

1,499 Incorrect Mappings IdentifiedRole-to-course mapping issues surfaced through the audit.
8,255.5 Staff Hours of Unnecessary Training RemovedMeasured across the organisation.
Pipeline Performance Metrics
Production
850,000+
Records Processed in Daily Operational Pipelines
16,000+
Positions Mapped and Validated
80%
Error Reduction
82%
DNA Prediction Acc.
12-Week DNA Forecast — Holt-Winters Exponential Smoothing
Predictive Model
400 300 200 100 0 ← Historical (Actual DNAs) → ← Forecast → Actual DNA Count Holt-Winters Forecast (RMSE 221.40)

Featured projects for websites, systems, and operational delivery

A mix of live client work, production systems, and custom platform builds that show the kinds of problems I can help solve.

Commercial, production & client delivery

Work that proves design sense, technical depth, and business usefulness

These are the projects that best show how I help businesses and teams improve online presence, reduce friction, and build more capable systems.

PROJECT 01

Moments by Montrose

"Bespoke client website with self-service CMS, SEO setup, and premium brand presentation"

Live

A bespoke website for a real client that improved brand presentation, simplified content updates, and gave the business a clean, maintainable platform for enquiries and growth. Built to feel premium, perform well, and hand over confidently to a non-technical owner.

Non-technical CMS admin panel
Auto-deploy in ~30 seconds
Responsive image pipeline
SEO optimised
PROJECT 02

Operational Data Engineering Suite

"850,000+ records processed in daily operational pipelines · 8,255.5 staff hours of unnecessary training removed"

Production

Four years of production data engineering inside a large healthcare organisation — automating reporting, rebuilding fragile data flows, and delivering ETL pipelines, PostgreSQL models, and Power BI dashboards that support real operational decisions across the organisation.

850,000+ records processed in daily operational pipelines
16,000+ positions mapped and validated
1,499 incorrect mappings identified
8,255.5 staff hours of unnecessary training removed
82% DNA prediction accuracy
~80% reduction in data errors through automation and validation improvements
Power BI dashboards (DAX, Field Parameters)
PostgreSQL COPY bulk loading
PROJECT 03

DorrianAI — White-Label AI Consultant

"Custom AI support platform with local-first deployment options and role-based workflows"

In Development

A multi-tenant AI helpdesk platform designed to reduce repetitive support workload without forcing organisations to send sensitive knowledge externally. Built with a 7-stage RAG pipeline, local-first Ollama support, role-based controls, and full white-label branding for commercial reuse.

7-stage RAG pipeline
Email parser: 2,732 ops/sec
3-tier RBAC (Dev/Admin/User)
ChromaDB + sentence-transformers
9-intent classifier
Full white-label branding system
PROJECT 04

The Mariana Project

"AI-assisted marine data platform for mapped observations, validation, and research use"

In Development

A citizen science platform designed to turn diver observations into structured marine biodiversity data. Combines AI-assisted species ID, mapped dive-site discovery, community verification, and research-ready export — with a strong focus on data quality rather than vague concept hype.

AI species ID from photos (Claude)
Interactive map (Leaflet + ESRI)
1,065 species seeded from APIs
26-check data validation pipeline
Digital dive logbook + life lists
Custom AI training (QLoRA)
Experimental & R&D work

Technical depth, prototyping, and side-system exploration

These projects show range, curiosity, and systems thinking, but they are intentionally separated from the primary professional case studies above.

PROJECT 05

Need for Mead — Viking 2.5D Game

"Trolls have stolen your mead! 19 scenes · 1,288 sprites · 17 custom extensions"

In Development

A Viking-themed 2.5D side-scroller built in GDevelop with custom Blender assets. Players battle through Norse realms (Midgard, Jotunheim, Alfheim, Helheim) to reclaim stolen mead. Features tutorial progression, mobile-first joystick controls, realm-based level selection, and a full custom AI-assisted 3D asset pipeline using Blender Python scripts and ComfyUI.

19 scenes across Norse realms
1,288 sprite assets + 46 audio files
17 custom GDevelop extensions
Mobile-first with joystick controls
Blender Python rigging pipeline
AI 3D asset generation (ComfyUI)
PROJECT 06

Algorithmic Trading Platform

"ML-driven trading with XGBoost, LSTM, ARIMA & Prophet models"

Experiment

An algorithmic trading platform with 4 ML models (XGBoost, LSTM, ARIMA, Prophet), 30+ technical indicator feature engineering, risk management (VaR 95%, Kelly criterion position sizing), async OHLCV data loading via CCXT, comprehensive backtesting engine, and performance metrics (Sharpe, Sortino, Calmar ratios, MFE/MAE analysis).

4 ML models (XGBoost, LSTM, ARIMA, Prophet)
30+ technical indicator features
Risk management (VaR 95%, Kelly criterion)
Async data loading (CCXT + rate limiting)
Backtesting engine + trade analysis
Telegram alerts integration
PROJECT 07

Matched Betting Arbitrage Engine

"Real-time odds arbitrage with AI-powered opportunity ranking"

Experiment

A matched betting platform with real-time Betfair Exchange API integration, qualifying/SNR/SR bet calculators with lay drift recalculation, AI-powered opportunity ranking (heuristic + optional GPT re-ranking), fuzzy event matching across bookmakers, and automated Telegram notifications for profitable opportunities.

Betfair Exchange API integration
Qualifying, SNR & SR calculators
Lay drift recalculation engine
AI opportunity ranking (heuristic + GPT)
Fuzzy cross-bookmaker event matching
Telegram notification pipeline

Websites, dashboards, automation, and internal tools

A clearer offer structure for businesses and teams that need a better online presence, less manual work, and stronger operational visibility.

Bespoke Websites

  • Modern websites for service businesses, creatives, and brands
  • Clear enquiry paths, mobile optimisation, and strong presentation
  • CMS handover so clients can manage content themselves
  • SEO, analytics setup, deployment, and launch support

Automation & Internal Tools

  • Custom workflows, forms, portals, and process tools
  • Admin reduction through practical automation and better systems
  • Role-based internal products built around how teams actually work
  • AI features where they create real operational value

Dashboards & Reporting

  • Power BI dashboards and KPI reporting
  • Spreadsheet cleanup and reporting workflow redesign
  • Data models, validation, and automated reporting pipelines
  • Clear decision support for operational and leadership teams

Ongoing Support

  • Content updates, small improvements, and post-launch fixes
  • Analytics reviews and practical optimisation suggestions
  • Technical maintenance support after delivery
  • Clean handover with optional retained help where needed

Process

Clear scope, decisive execution, and production-minded delivery.

01

Discovery

We define the real problem, business goals, user needs, constraints, and success metrics before delivery starts.

02

Design & Architecture

Information architecture, technical approach, data structure, and UX direction are agreed up front so the build stays deliberate.

03

Development

I build in focused milestones with visible progress, regular check-ins, and practical feedback loops rather than disappearing into a black box.

04

Testing & Launch

Performance, QA, responsive behaviour, deployment, and launch support are handled end-to-end so the final result is ready for real users.

05

Support

Handover, documentation, iteration, and optional retained support keep the product maintainable and improving after launch.

Get In Touch

Need a website, dashboard, or internal tool? Let's talk about what's slowing your business down and what would make the biggest difference. I'm open to freelance projects, contract work, and selected long-term opportunities.

Contact Details

soaddorrian@gmail.com
github.com/dorriansidwell
linkedin.com/in/dorriansidwell
+44 7493 192359

Based in

Liverpool, United Kingdom

Available for remote work worldwide

Message sent!

Thanks for getting in touch. I'll get back to you within 1–2 business days.

Something went wrong — please try again or email me directly at soaddorrian@gmail.com.