He does tend to keep himself to himself.
Keep yourself to yourself, and you'll be all right there.
The public must think he's very easy-going, but at home he keeps himself to himself.