Generally I'm in agreement with you, but sometimes the grammar may come in spite of the fact.

It is suspected that all the fuss about whether you are allowed to happily split an infinitive is because it's impossible to split an infinitive in Latin, and hence, it is clearly wrong to do so in any other language...