Yes, the mass will follow a straight line in the opposite direction to the force of the string. As the sum of the forces acting upon the mass is 0, taking away a force in one direction will cause the mass to move in the opposite direction if nothing else is changed. As you have said :)
everyone...