I find the twins not being great swimmers entirely plausible even in the later timeline. Even in the mid-80s I missed about half of my two years school swimming due to perforated eardrums and generally not risking it. Earlier C20 "swimming pools are unhygienic" (out of date fear of polio) and delicate people not supposed to get their hair wet etc. would account for the twins not being great swimmers very easily.