Took a while to figure this out. The oil was actually sneaking out through a pinhole through the centre of the dipstick. Originally this was brazed together and it hadn't taken properly.
It's the scruffiest bit of brazing I've ever done but it's now oil tight.
