Proposals for a new restaurant at a former post office in Swansea have been set back after a planning inspector said it can’t include takeaways or deliveries.