Shares of the handbag maker are down after last quarter’s earnings, but they could still fall further.