I recently dropped Physics and I did not feel sad at all, I was instead delighted as I could now focus on the things I enjoyed most, the things I will need in the long run.
Don't worry about what anyone says you are not a failure, chemistry just was not your thing.