yesh, i wouldn't necessarily worry about rsvp'ing based on the email reply i got. it's a courtesy, but i get the impression it's not a big deal if you invite a few people on friday afternoon.
I was off Friday, but my company had a free lunch event with them, and several people that went gave very positive reviews. Looks like I found a new once a week (if not more!) place for lunch!