This reminds me quite much of Dijkstra’s EWD 924, On a cultural gap. Dijkstra makes the same complaint about the name “Computer Science”, although his conclusion is quite different from Brooks’. He emphasizes the mathematical nature of programming and notices how far apart math and CS culture are in spite of this similarity (the so-called cultural gap).
Of course, Dijkstra was arguably closer to the theoretical end of the spectrum, and Brooks closer to the applied end, so both having different views hardly comes as a surprise. In the end it mainly boils down to what “computer science” refers to in a specific context.