Would a worshiper of Allah consider me bad ociation?

Your sentiments are innocent sounding but they will harden when you realise that fundamentalists are not interested in anything but conquest. You are OK with Islamic merchants who appreciate that money makes the world go around.