I wouldn't carry anything that is easily nicked ie a scarf/flag, there will be people out looking for "souvenirs", I'd say just be careful, if you want to be totally sure don't wear any, or keep them covered.
Had my City bobhat pulled off my head coming away from the ground and he was 50 yards away before I realized what had
happened. You're dealing with cowardly bastards!