yeaaaa good relations suuuure… we are beeest friends…
just kidding. you need to be enemies with them to attack them :D applies to neutral settlements as well. fastest way for that is to accept a contract with alot of advance money and then cancel it directly for -20 relations. do it twice for a neutral and you can attack their patrols and caravans