I think it makes sense to give the overall story a title that fits it better.

What you could do, potentially, is keep "An Outsider and a Foreigner" as the title of the first chapter, which would retain a thread of continuity with its original publication -- although then, of course, you'd have to come up with titles for all the subsequent chapters as well...