As above, Size is basically how many things (house, furniture, defense, resource, etc.) you can fit in any settlement. There are multiple settlements you can build on.
I feel like if you have infinite power, water, food, resources, you wouldn't need infinite size and vice versa.