I seem to remember falling across this chap before. I need to dig out the details but I don't think he's one of ours. I think there was an Jos. Oliver who came from London, who maybe married a local girl if I remember correctly, then they lived mainly in London but occassionaly came back to Finstock - I think I remember reading in the Jacksons Oxford newspapers about them being very much liked by the locals as they gave generously to the community at Christmas and such like times - these are just mental notes from a couple of years back, best I qualify them, could be wrong!
There's an interesting entry in the Finstock baptisms dated August 1880. The baptism is for the son of Samuel Miller - occupation: Servant to Jos. Oliver Esq.
Which Oliver was this to be able to afford a Servant!