The stimuli which are allowed in are not connected by just simple one-to-one switches to the outgoing responses.
These walls are kind of funny like that. First you hate them, then you get used to them. Enough time passed, get so you depend>