The man was escorted off the London-bound service moments after he boarded in Bristol, apparently because a group of female commuters raised concerns about his presence.
Some of the people on board reportedly even thanked the passengers who got the man thrown off, saying they had felt uncomfortable making the journey with him on board.
National Express, which was running the service, insisted he had been asked to leave because he refused to put a printer he was carrying in the hold.
The incident will raise fears that law-abiding Muslims could be discriminated against because of terror attacks linked to Islamic State (ISIS).
Britain has been on tenterhooks ever since crazed jihadis gunned down 130 people in Paris, with civilians on edge amid warnings the terrorists could attempt a bomb attack on these shores.