Skip to main content

Vectors and Their Operations

Vectors are one of the foundational concepts in linear algebra. In Euclidean spaces they can represent quantities with magnitude and direction, while in an abstract vector space they are simply elements that obey the vector-space operations and axioms. This makes them essential in fields such as physics, engineering, computer graphics, and data science. This article explores Euclidean coordinate vectors and the fundamental operations that can be performed on them.


1. What is a Vector?​

A vector is an ordered list of numbers that represents a point in space, a direction, or a quantity with both magnitude and direction. Vectors can exist in any dimension, but they are most commonly encountered in two-dimensional (2D) or three-dimensional (3D) space.

1.1 Notation​

A vector is typically denoted by a bold lowercase letter, such as v, or as a list of components in parentheses or square brackets:

  • v=(v1,v2,…,vn)\mathbf{v} = (v_1, v_2, \dots, v_n) for an nn-dimensional vector.

1.2 Visual Representation​

In 2D, a vector can be visualized as an arrow pointing from the origin (0,0)(0,0) to the point (v1,v2)(v_1, v_2). The length of the arrow represents the magnitude of the vector, and the direction of the arrow represents the direction of the vector.


2. Vector Addition​

Vector addition is the process of combining two or more vectors to produce a resultant vector. This operation follows the parallelogram rule or the triangle rule.

2.1 Geometric Interpretation​

When two vectors u\mathbf{u} and v\mathbf{v} are added, the resultant vector r=u+v\mathbf{r} = \mathbf{u} + \mathbf{v} can be visualized as the diagonal of the parallelogram formed by u\mathbf{u} and v\mathbf{v}.

2.2 Component-wise Addition​

The sum of two vectors is obtained by adding their corresponding components:

  • If u=(u1,u2,…,un)\mathbf{u} = (u_1, u_2, \dots, u_n) and v=(v1,v2,…,vn)\mathbf{v} = (v_1, v_2, \dots, v_n), then r=u+v=(u1+v1,u2+v2,…,un+vn)\mathbf{r} = \mathbf{u} + \mathbf{v} = (u_1 + v_1, u_2 + v_2, \dots, u_n + v_n).

3. Scalar Multiplication​

Scalar multiplication involves multiplying a vector by a scalar (a single number). This operation scales the vector: a positive scalar preserves its direction, a negative scalar reverses it, and multiplication by zero produces the zero vector, which has no defined direction.

3.1 Geometric Interpretation​

If you multiply a vector v\mathbf{v} by a scalar cc, the resultant vector cvc\mathbf{v} has a magnitude scaled by ∣c∣|c| and points in the same direction as v\mathbf{v} if c>0c > 0, or the opposite direction if c<0c < 0.

3.2 Component-wise Multiplication​

The scalar multiplication of a vector is performed by multiplying each component of the vector by the scalar:

  • If v=(v1,v2,…,vn)\mathbf{v} = (v_1, v_2, \dots, v_n) and cc is a scalar, then cv=(c⋅v1,c⋅v2,…,c⋅vn)c\mathbf{v} = (c \cdot v_1, c \cdot v_2, \dots, c \cdot v_n).

4. Dot Product​

The dot product (also known as the scalar product) is an operation that takes two vectors and returns a scalar. It is a measure of the extent to which two vectors point in the same direction.

4.1 Geometric Interpretation​

The dot product of two vectors u\mathbf{u} and v\mathbf{v} is given by:

u⋅v=∣u∣∣v∣cos⁡(θ)\mathbf{u} \cdot \mathbf{v} = |\mathbf{u}| |\mathbf{v}| \cos(\theta)

where θ\theta is the angle between the two vectors.

4.2 Component-wise Calculation​

The dot product can also be computed by multiplying corresponding components of the vectors and summing the results:

  • If u=(u1,u2,…,un)\mathbf{u} = (u_1, u_2, \dots, u_n) and v=(v1,v2,…,vn)\mathbf{v} = (v_1, v_2, \dots, v_n), then u⋅v=u1v1+u2v2+⋯+unvn\mathbf{u} \cdot \mathbf{v} = u_1v_1 + u_2v_2 + \dots + u_nv_n.

5. Cross Product (3D Vectors)​

The standard cross product used here takes two vectors in R3\mathbb{R}^3 and returns a vector perpendicular to both. This familiar binary operation is specific to three-dimensional Euclidean calculations (although other higher-dimensional generalizations exist) and is widely used in physics and engineering.

5.1 Geometric Interpretation​

The magnitude of the cross product u×v\mathbf{u} \times \mathbf{v} is given by:

∣u×v∣=∣u∣∣v∣sin⁡(θ)|\mathbf{u} \times \mathbf{v}| = |\mathbf{u}| |\mathbf{v}| \sin(\theta)

where θ\theta is the angle between the vectors u\mathbf{u} and v\mathbf{v}. The direction of the resulting vector is determined by the right-hand rule.

5.2 Component-wise Calculation​

The cross product is calculated as follows:

  • If u=(u1,u2,u3)\mathbf{u} = (u_1, u_2, u_3) and v=(v1,v2,v3)\mathbf{v} = (v_1, v_2, v_3), then:
u×v=(u2v3−u3v2,u3v1−u1v3,u1v2−u2v1)\mathbf{u} \times \mathbf{v} = (u_2v_3 - u_3v_2, u_3v_1 - u_1v_3, u_1v_2 - u_2v_1)

6. Vector Magnitude and Normalization​

The magnitude (or length) of a vector is a measure of its size, and normalization is the process of scaling a vector so that it has a magnitude of 1.

6.1 Magnitude of a Vector​

The magnitude of a vector v=(v1,v2,…,vn)\mathbf{v} = (v_1, v_2, \dots, v_n) is given by:

∣v∣=v12+v22+⋯+vn2|\mathbf{v}| = \sqrt{v_1^2 + v_2^2 + \dots + v_n^2}

6.2 Normalizing a Vector​

To normalize a nonzero vector, divide each of its components by its magnitude:

vnormalized=v∣v∣\mathbf{v}_{\text{normalized}} = \frac{\mathbf{v}}{|\mathbf{v}|}

The zero vector cannot be normalized because its magnitude is zero, so the formula would require division by zero.


Conclusion​

Vectors are fundamental to linear algebra and have wide-ranging applications in various fields, including physics, engineering, and computer science. Understanding vector operations such as addition, scalar multiplication, dot product, and cross product is crucial for solving problems in these domains. Mastering these concepts will provide a strong foundation for more advanced topics in linear algebra.