Three Ways to Get Rubble
First way to get it would be the sledgehammer tech and destroying stuff.
Second way would be the sorting station to recover rubble from some specific nodes.
And the last way is to get TNT and go blast some looted houses (some deconstruct for 250 rubble) and you might need diving for some of those.
And yes, rubble is a limited resource so you got to manage it.