For PHYS11X1, doing preliminary HSC Physics would definitely help. Doing some of HSC Physics (just the space topic) would help too.
But yeah the most important part is having good maths knowledge. Then I would consider doing preliminary Physics helpful, but HSC Physics not really that much.
HSC Physics is very, very helpful however for PHYS12X1.