Depending on the type of fish, you really don't want to have it out of refrigeration for more than about two hours. That's really pushing it, though. Some fish really shouldn't be out for more than an hour. Long story short: Sushi's not really a "to go" food, unless you're eating it right away.