Dark Energy

Mysterious form of energy comprising ~68% of the universe that drives the accelerating expansion of space.

In physical cosmology and astronomy, dark energy is a proposed form of energy that influences the universe on its largest scales. Its primary effect is to drive the accelerating expansion of the universe, while concurrently slowing down the rate of cosmic structure formation.

Assuming that the standard $\mathrm{\Lambda }$-CDM (Lambda Cold Dark Matter) model of cosmology is correct, dark energy stands as the dominant component of the modern cosmos. Its relative contributions to the present-day observable universe are distributed as follows:

• Dark energy: 68%
• Dark matter: 27%
• Ordinary (baryonic) matter: 5%
• Other components (photons, neutrinos): Nearly negligible

The local density of dark energy is extraordinarily low, measured at approximately $7\times {10}^{-30}{\text{ g/cm}}^3$ (equivalent to $6\times {10}^{-10}{\text{ J/m}}^3$ in mass-energy). This is vastly lower than the localized density of ordinary or dark matter within galaxies. However, dark energy dominates the total mass-energy budget of the universe because, unlike matter, it remains entirely uniform and homogeneous across all space.

Technical Definition and Fluid Mechanics

In standard cosmology, the constituents of the universe are classified by how their energy densities scale relative to the cosmic scale factor, $a$. This behavior is formally described by the fluid equation derived from the Friedmann equations:

The three primary components scale as follows:

• Matter: Comprises any non-relativistic particle whose energy density scales with the inverse cube of the scale factor ($\rho \propto a^{-3}$). Intuitively, for particles confined within a cube, doubling the length of the box's edges decreases the volume density by a factor of eight ($2^3$).
• Radiation: Comprises highly relativistic particles and photons whose energy density scales to the inverse fourth power of the scale factor ($\rho \propto a^{-4}$). The decrease is steeper than matter because spatial expansion not only dilutes the particle number over volume but also increases the wavelength of the radiation, inducing a redshift that reduces its energy according to the Planck relation ($E=h\nu$).
• Dark Energy: Behaves as an intrinsic, invariant property of space, maintaining a constant energy density regardless of the changing dimensions of the volume under consideration ($\rho \propto a^0$). Consequently, it is never diluted by the expansion of space.

The Necessity of Negative Pressure

To drive cosmic acceleration rather than deceleration, dark energy must possess a strong negative pressure (tension). In general relativity, the physical source that generates gravitational fields is the stress–energy tensor, which incorporates both energy density ($\rho$) and isotropic pressure ($P$).

According to the Second Friedmann equation, the acceleration of the cosmic scale factor is governed by:

For the acceleration ($\ddot{a}$) to yield a positive value, the pressure component must be strongly negative, specifically satisfying the condition:

When a substance possesses a constant negative pressure matching its energy density ($P=-\rho c^2$), it counteracts gravitational deceleration, creating a phenomenon often characterized as "gravitational repulsion" that accelerates the expansion of the surrounding space.

Theoretical Candidates

The exact nature of dark energy remains an outstanding mystery in modern physics, giving rise to several competing theoretical frameworks.

The Cosmological Constant ($\mathrm{\Lambda }$)

The simplest and most widely accepted candidate for dark energy is the cosmological constant, designated by the Greek letter $\mathrm{\Lambda }$. Introduced into the standard FLRW metric, it forms the foundational pillar of the $\mathrm{\Lambda }$-CDM model.

In this framework, dark energy is treated as the static vacuum energy of empty space. This concept draws from quantum field theory, which posits that empty space is filled with virtual particle-antiparticle pairs that continuously generate and mutually annihilate within time frames bounded by Heisenberg’s uncertainty principle:

The Cosmological Constant Problem

While vacuum energy naturally provides the required negative pressure ($P=-\rho c^2$), it introduces the cosmological constant problem—widely considered one of the deepest crises in modern theoretical physics.

Zero-point energy calculations derived from quantum field theory predict a theoretical vacuum energy density that is roughly 120 orders of magnitude larger than the actual value obtained via astronomical observations. Reconciling this discrepancy requires an extremely precise, fine-tuned cancellation from an equal and opposite counter-term, an explanation that remains unproven.

Furthermore, within string theory, it remains highly debated whether a stable or meta-stable state with a positive cosmological constant (a de Sitter vacuum) can legitimately exist. Some physicists, including Ulf Danielsson et al., have conjectured that no such stable states reside within the valid landscape of string theory, suggesting that the universe may occupy a false vacuum.

Scalar Fields (Quintessence)

If dark energy is not a static constant, it may be driven by a dynamic, spatially homogeneous scalar field known as quintessence (or related fields like moduli). Unlike the static cosmological constant, quintessence possesses an energy density and an equation-of-state parameter, $w$, that can vary continuously across cosmic time and space:

Depending on the balance between the kinetic and potential energy of the scalar field, $w$ can evolve dynamically. This allows the tracking of matter density in the early universe before transitioning to dominate the cosmic expansion at later epochs.

Other dynamic variants explore scenarios such as interacting dark energy—where dark energy directly exchanges energy with dark matter—or unified frameworks where dark matter and dark energy emerge as different manifestations of a singular underlying fluid.

History of Discovery and Speculation

Einstein's Static Universe

The concept of a cosmological constant originated in 1917, when Albert Einstein added the $\mathrm{\Lambda }$ term to his gravitational field equations of general relativity:

Einstein introduced this term purely as a mathematical mechanism to achieve a static solution to the equations, utilizing the repulsive effect of $\mathrm{\Lambda }$ to balance the attractive gravitational pull of the matter within the universe. In this formulation, empty space acted as a source of uniform negative mass distributed across interstellar space.

However, it was soon demonstrated that Einstein's static universe was inherently unstable. Localized inhomogeneities in matter distribution would inevitably trigger either runaway expansion or contraction. If the universe expanded slightly, the matter density would dilute while the vacuum energy density remained constant, leading to further expansion; conversely, a slight contraction would cause matter gravity to dominate, driving a runaway collapse.

Following Edwin Hubble’s 1929 empirical discovery that distant galaxies are receding in a systematic expansion, Einstein abandoned the cosmological constant, later reportedly describing his failure to predict a dynamic, evolving universe as his "greatest blunder."

Inflationary Dark Energy

In 1980, physicists Alan Guth and Alexei Starobinsky independently proposed that a negative pressure field, conceptually identical to dark energy, drove a period of cosmic inflation in the very early universe.

The inflationary paradigm states that a high-energy repulsive field triggered an exponential expansion of space when the universe was only a tiny fraction of a second old. While inflation operates on similar underlying physics as modern dark energy, it occurred at an energy density many orders of magnitude higher. Inflation terminated abruptly, transferring its energy into standard particles and radiation, and it remains a subject of ongoing research whether any direct physical mechanism links early-time inflation to late-time dark energy.

Late-Time Dark Energy and the Standard Model

Throughout the 1980s, cosmological research focused on flat models dominated entirely by matter, typically composed of 95% cold dark matter and 5% baryons. While these models successfully simulated basic galaxy formation, they began facing significant observational challenges by the late 1980s: they required an unrealistically low Hubble constant and systematically under-predicted the large-scale clustering of galaxies.

The tension deepened in 1992 when the COBE satellite mapped the first detailed anisotropies in the cosmic microwave background. To resolve these issues, cosmologists began testing modified variations, leading to the early formulation of the $\mathrm{\Lambda }$-CDM model.

The definitive breakthrough arrived in 1998 with the publication of direct observational evidence for accelerating cosmic expansion. The term "dark energy" was subsequently coined in late 1998 by cosmologist Michael S. Turner in a collaborative paper written with Saul Perlmutter and Martin White.

Observational Evidence

The modern consensus favoring dark energy relies on multiple independent, complementary lines of empirical evidence.

Type Ia Supernovae

The first direct evidence for accelerating cosmic expansion was published in 1998 by the High-Z Supernova Search Team (Riess et al.), followed closely in 1999 by the Supernova Cosmology Project (Perlmutter et al.). The leadership of these teams—Saul Perlmutter, Brian P. Schmidt, and Adam G. Riess—was recognized with the 2011 Nobel Prize in Physics.

Type Ia supernovae are highly effective astronomical standard candles because they occur when a carbon-oxygen white dwarf star accretes matter from a binary companion, crossing the Chandrasekhar limit of approximately $1.44$ solar masses and triggering a thermonuclear runaway. Because the mass at explosion is highly uniform, their intrinsic peak luminosity is exceptionally consistent. By measuring the apparent brightness of these supernovae, astronomers can determine their precise luminosity distances.

When these distances are plotted against the cosmological redshift ($z$) of their host galaxies, the resulting Hubble diagram reveals that high-redshift supernovae are systematically fainter—and therefore more distant—than they would be in a universe whose expansion was slowing down due to matter gravity. This indicates that the expansion rate of space has been accelerating over the latter half of cosmic history.

Large-Scale Structure and Baryon Acoustic Oscillations

The spatial distribution and clustering of galaxies provide a separate line of evidence. The theory of cosmic large-scale structure formation indicates that the total matter density of the universe accounts for only roughly 30% of the critical density required for a flat geometry, implying a deficit that must be filled by a smooth, non-clustering energy component.

This was measured mechanically by the 2011 WiggleZ galaxy survey, which mapped the redshifts of more than 200,000 galaxies. WiggleZ utilized Baryon Acoustic Oscillations (BAO) as a cosmological standard ruler. BAOs are relic imprints left by acoustic sound waves that traveled through the hot plasma of the early universe before freezing out at the epoch of recombination, leaving behind regular overdensities spaced roughly 150 megaparsecs ($\text{Mpc}$) apart.

By using these frozen acoustic spheres as a baseline scale, the survey mapped distances out to $2,000\text{ Mpc}$ ($z\approx 0.6$). The data confirmed that cosmic acceleration has been active for at least 7 billion years, providing a geometric verification of acceleration completely independent of supernova calibration.

The Cosmic Microwave Background

Observations of the Cosmic Microwave Background (Cosmic Microwave Background Radiation) provide a precise measurement of the global geometry of the universe. The angular power spectrum of the CMB temperature fluctuations, mapped with high precision by the WMAP satellite and subsequently by the Planck spacecraft in 2013, shows that the spatial curvature of the universe is flat to within a tight margin of error:

However, the spectrum also restricts the total matter density (both baryonic and dark matter) to ${\mathrm{\Omega }}_m\approx 0.315$. To maintain a spatially flat universe, an additional, smoothly distributed energy component must make up the remaining ${\mathrm{\Omega }}_{\mathrm{\Lambda }}\approx 0.683$. The 2013 Planck data refined these standard cosmological parameters to 68.3% dark energy, 26.8% dark matter, and 4.9% ordinary matter.

Late-Time Integrated Sachs–Wolfe Effect

Further direct evidence for dark energy in a flat universe comes from the late-time Integrated Sachs–Wolfe (ISW) effect. As CMB photons traverse the large-scale structures of the late universe, they fall into the gravitational potential wells of superclusters and climb out of gravitational potential hills of cosmic supervoids.

In a matter-dominated, decelerating universe, these potential wells and hills remain stable while the photon passes through, resulting in zero net energy change. However, the onset of accelerated cosmic expansion causes these gravitational structures to actively flatten and stretch while the photons are in transit. A photon entering a collapsing potential well gains more energy than it loses when climbing out, creating a localized hot spot in the CMB that correlates with massive superclusters. Conversely, photons passing through expanding supervoids emerge with a net loss of energy, producing cold spots. This correlation was detected at high statistical significance in 2008 by Ho et al. and Giannantonio et al., confirming the repulsive effect of dark energy on large-scale structures.

Cosmic Chronometers (Observational Hubble Data)

An alternative approach to constraining dark energy involves Observational Hubble constant Data (OHD), which utilizes passively evolving, massive early-type galaxies as cosmic chronometers. These galaxies formed the vast majority of their stellar mass at high redshifts and have evolved without significant subsequent starbursts, acting as standard cosmic clocks.

By measuring the differential age evolution ($\mathrm{\Delta }t$) of these galaxies across a narrow redshift interval ($\mathrm{\Delta }z$), astronomers can directly calculate the differential expansion rate of the universe without relying on integrated distance measures. The Hubble parameter as a function of redshift is determined via the relation:

Unlike supernova and BAO data, which rely on the line-of-sight integration of $H(z)$, cosmic chronometers provide a direct, model-independent measurement of the Hubble parameter at specific epochs. This methodology minimizes common systemic calibration errors and is widely utilized to map the real-time expansion history and test for variations in the dark energy equation of state.

Modern Observational Status and Evolution

While the standard $\mathrm{\Lambda }$-CDM model treats dark energy as an invariant cosmological constant ($w=-1$), modern observational cosmology focuses heavily on testing whether dark energy evolves over time.

Comprehensive datasets from the Supernova Legacy Survey (SNLS) and the Hubble Space Telescope's Higher-Z Team initially confirmed that dark energy has been actively influencing cosmic expansion for at least 9 billion years, behaving identically to Einstein's cosmological constant to within a 10% error margin.

In March 2025, the Dark Energy Spectroscopic Instrument (DESI) collaboration announced new results based on an extensive analysis combining high-precision BAO data with CMB anisotropies, weak gravitational lensing, and updated supernova catalogs. The collaboration reported tentative evidence of a time-evolving dark energy component, with a statistical significance ranging from $2.8\sigma$ to $4.2\sigma$ depending on the specific complementary datasets utilized.

The DESI results suggest that the energy density of dark energy may be slowly decreasing across cosmic time, a behavior that deviates from the static assumptions of the cosmological constant and points toward dynamic scalar field models.

Related Notes

• Dark Matter - Gravitational counterpart to dark energy
• Cosmic Microwave Background Radiation - Evidence for dark energy
• Observable Universe - Accelerating expansion

Next Action

Track DESI collaboration updates and quintessence model developments