Scalar triple product of three vectors