Hanging Around in the Dark

Sometimes I have trouble sleeping and so I get up and wander around the house. This is okay when I'm home but when I'm visiting someone else, this makes me a little uncomfortable ... kind of like I'm skulking around doing something shady. Why is that? Is the dark at my house different from other people's dark?