Ye, as in "ye olde whatever", is pronounced 'the'. It comes from typesetters using y instead of the Old English letter þ which had a ‘th’ sound.