A Ballycastle man assaulted on the Twelfth of July has said he was set upon only because he had walked across the road during a contentious parade by the anti-Catholic Orange Order.