Intermittent start

Last night, I had something happen that has not happened before (or since). After driving around for about an hour or so, I pulled into a 7-11 to hit the ATM. I was in there for about 3 min. I came back out and went to start the car. When I turned the key, everything came on as normal except for the starter motor. There was no clicking at all. No dimming of the lights. No noticable sounds out of the ordinary. The cooling fans were on because it had only been a few minutes since shutting her down. Everything else like the radio and dash lights came on as usual but no starter. I turned the key off and tried again. Still no starter. I sat there for a minute going over in my mind how fun it was going to be to get her home at 2 am. Then I tried again and she cranked right over. After driving around for about another hour and then reaching my garage, I shut her off and tried to start her back up. No problem! Started right up. I am thinking that this must be in the ignition switch itself since everything else worked. Has anyone else had this happen? I have been so spoiled lately due to many long drives with no CEL's and SDL's so it caught me off guard. I am hoping it was just a fluke and will not happen again.