I’m not saying that it isn’t in part true, there would be a fractious effect as moral implications are taken into account, and certainly there are problematic cases.
This is better than doing nothing.
It is perfectly acceptable for a community to have to adhere to a Code of Conduct in their interactions with maintainers, but those same contributors wash their hands of those being robbed of dignity downstream by their work?
This is the same sorry sort of argument one might imagine a gun manufacturer making for their guns ending up being used by child soldiers.
“I just made the guns! I shouldn’t care what people do with them.”
Opensource is ultimately a labour of love, and that same care needs to extend to those lives who maybe negatively impacted by your creation.