Make sure you are certain that chemistry will be better for your ATAR in the end. If you don't like the HSC course, you aren't necessarily going to get a higher ATAR due to scaling. If you're not sure, then don't drop anything yet.
FYI I missed out on all-rounders because of chemistry (band...