I support the rule of law as it underpins society.
The rule of law also underpinned Nazi Germany. The quality and source of a law does matter, and just blindly saying "it's the law" puts you in real bad company. Furthermore, it's upside down: Society underpins the rule of law! Just laws are made by just people, not the other way around, and following laws does not automatically make you righteous if those laws are not righteous.
There are two sides to every story.
This is bullshit on two levels. First off, there are not just two sides to every stories, there are many. Secondly, not all viewpoints are equal. Charles Manson had his side of the story, too; does that make it valid? When he is accused of murder, saying "but there are two sides to this story!" is not a neutral thing to say, it's not objective or wise. It's at best stupid, at worst sophistry. There is being crude, but there is also being so "nuanced" that you never arrive at any conclusion, ever. I despise that. I'd rather be wrong than be nothing at all.
Also see: Argument to moderation