Just 20% of respondents to Reuters/Ipsos poll saw court is politically neutral, a view shared people from both parties