I had the same dilemma as you when I was in year 11 although it was for chemistry. I was coming 2nd and my marks were good but I wanted to relieve the workload. Thank god i listened to my careers advisor who told me to stay with it until yr 12 and in the end I hated 4U maths and dropped that...