Skip to main content
  • Regular article
  • Open access
  • Published:

Convergence of economic growth and the Great Recession as seen from a Celestial Observatory

Abstract

Macroeconomic theories of growth and wealth distribution have an outsized influence on national and international social and economic policies. Yet, due to a relative lack of reliable, system wide data, many such theories remain, at best, unvalidated and, at worst, misleading. In this paper, we introduce a novel economic observatory and framework enabling high resolution comparisons and assessments of the distributional impact of economic development through the remote sensing of planet Earth’s surface. Striking visual and empirical validation is observed for a broad, global macroeconomic σ-convergence in the period immediately following the end of the Cold War. What is more, we observe strong empirical evidence that the mechanisms driving σ-convergence failed immediately after the financial crisis and the start of the Great Recession. Nevertheless, analysis of both cross-country and cross-state samples indicates that, globally, disproportionately high growth levels and excessively high decay levels have become rarer over time. We also see that urban areas, especially concentrated within short distances of major capital cities were more likely than rural or suburban areas to see relatively high growth in the aftermath of the financial crisis. Observed changes in growth polarity can be attributed plausibly to post-crisis government intervention and subsidy policies introduced around the world. Overall, the data and techniques we present here make economic evidence for the rise of China, the decline of US manufacturing, the euro crisis, the Arab Spring, and various, recent, Middle East conflicts visually evident for the first time.

1 Introduction

The rise of more creative and powerful simulation, modeling, and computation along with a superlinear expansion in both the variety and size of data is transforming science [1, 2]. From high energy physics to cosmology, biology, and genetics, sophisticated instrumentation, massive, high throughput experiments and observatories are increasingly leveraged by scientists and scholars to empirically validate deep, longstanding theories [35].

Nevertheless, in many fields, it is still too often the case that deep theory remains untested due to the relative dearth of available, system wide data that would be necessary and sufficient for validation. Data of the commensurate size and shape needed to validate a big theory is often either merely unattainable, too expensive to derive, too elusive to observe, and, for some theories, it may simply be unclear what would so much as count as appropriate data in the first place. Where the requisite data needed to validate a given theory or even observe a theorized phenomenon is lacking, researchers often turn to various methods of indirect detection. An obvious example here is the search for empirical validation of the existence of weakly interacting massive particles [6, 7].

Perhaps not as obviously, many macroeconomic theories, the validity of which carry huge practical, political, and social ramifications, also rely on indirect detection for validation. Data for inferring the state or dynamics of many subnational, national, and global economy-wide phenomena (e.g., employment, income, production, migration, etc.) are gathered through national income and product accounts surveys. Moreover, given that these data are collected almost exclusively through surveying, they are often very small and of uncertain quality relative to the broad importance of the object of study. For instance, in the United States, data on national unemployment is gathered monthly by the Bureau of Labor and Statistics by surveying roughly 0.02% of US households. These data are then modified with additional data weighting and statistical adjustments to enhance their stability over time [8]. As a result, these data and the dynamics that are subsequently inferred from them are often unreliable. To give an example, [9] demonstrated that much of the observed decrease in US interstate migration was, in fact, a statistical artifact attributable to the Census Bureau’s introduction of a seemingly minor change to its procedures for imputing missing data.

Additionally, many nations either lack the necessary organizational or administrative infrastructure to construct accurate and reliable, if nevertheless basic, national accounts or they seek to frustrate the transparency of accounts data for political reasons or economic gain as noted in [10, 11]. As a result, many theories that are central to macroeconomics often have an outsized influence on policy even when empirical validation of those theories is missing or, worse, misleading. Extensive discussion of related issues in [1214] stresses the importance of rigorous model verification using a wide variety of methods.

While it is not at all clear what the direct observation of, for instance, gross domestic product (GDP), would be, it has been demonstrated that reliable proxies other than variables in national accounts data can been derived through the passive remote sensing of the Earth’s surface from space. In particular, nighttime luminosity data has been shown convincingly to be a useful and reliable proxy for socioeconomic statistics [1520]. For instance, the strong correlation between aggregate real GDP growth and aggregate changes in luminosity levels was found in [17] to be highly significant for the period 1992-2008. What is more, [20] found that variations in GDP explain roughly 75 percent of observed variation in the aggregate nighttime light emissions.

Crucially, recent work has shown robust correlations between the relative intensity of spatially disaggregated nighttime luminosity and GDP at both national and subnational resolutions. Moreover, this work has demonstrated that using nighttime luminosity does particularly well at resolving national and subnational GDP in countries that otherwise lack the administrative statistical infrastructure necessary to derive high-quality national accounts data [21]. Nevertheless, by merely observing statistical correlations between terrestrial light spillage and GDP, the extant literature on leveraging nighttime luminosity data for economic analysis has done little to inform or validate theory about global growth and production dynamics.

In this paper, we argue and demonstrate that passive remote sensing of the Earth’s surface can be leveraged to do more than merely proxy static accounting. Remote sensing can be used to add robustness to and support the empirical validation of economic theories. As stated above, the macroeconomic tradition for the observation and measurement of phenomena that are predicted by theory has been the employment of surveying and accounting to gather data to which a model can be fit. Apart from precise geographic and temporal resolution, the obvious benefits of these means of data acquisition are the uniform units of measure which are central to the internal structure of a given macroeconomic theory. However, to say nothing of the severe and highly problematic limitations introduced by sample size, the obvious drawbacks surround precision and accuracy of the measured units so that efforts to improve models and, therefore, theory require, at bottom, efforts to improve the institutional infrastructure needed for such measurement. At a deeper level, and for the purposes of validation, the constraint placed on the primary models of these theories by their parameterization and the near axiomatic requirement of specific units (e.g., currency values) of measure in those parameters will ceaselessly frustrate attempts to resolve inconsistencies between theoretical assumptions and observed data. This may seem trivially obvious, but resolving such inconsistencies without substantial modifications to either method or theory (or both) is anything but. These problems are further compounded when the phenomena predicted by theory are, seemingly, only observable by such indirect means.

In what follows, we introduce a novel method with its own, independent set of micro-state assumptions and conditions to detect, sense, or ‘observe’ the theorized macroeconomic phenomena known as ‘economic convergence’ and ‘divergence’. In particular, we use the highly calibrated, high resolution (pixel-level) heterogeneous magnitude of changes in detectable light spillage over time as a salient proxy for the dynamism of human economic activity. Given that, theories of economic convergence and divergence are, at bottom, concerned with relative changes in economic activity over time, our approach can serve to supply robustness to these theories since the derivation, identification, and measurement of these phenomena can be achieved with novel parameters that are completely independent from those used in all adjacent models. Moreover, in [22] it was strongly argued that the real test of economic convergence is a consistent diminution of variance, not among the means of aggregate variables, but among individual enterprises and households, there by, rather indirectly, arguing against the plausibility of observing convergence dynamics in models of aggregate national accounts data.

The remainder of this paper is organized as follows: Section 2 describes our data and method (our Celestial Observatory), Section 3 presents our results, and Section 4 serves as a summary and discussion.

2 Setup: data and methods

There are several flavors of the macroeconomic theory of convergence. In this paper, we are concerned mainly with so called ‘σ-convergence’ predicting a decrease in the dispersion of income/growth across countries as opposed to the somewhat weaker ‘β-convergence’ which holds that the economies of poorer countries will grow more rapidly than those of richer ones. In [23] it was shown that β-convergence is a necessary but not sufficient condition for σ-convergence. There are a number of proposed and plausible explanations for why this dynamic should occur. For instance, in a globalized economy, relatively rich nations will experience faster rates of diminishing returns on freely traded means of production, technologies, and innovations, than poorer countries. As a result, poorer countries will realize faster relative rates of growth than rich countries. In fact, the literature is littered with interpretations of what even counts as growth characteristics for nations [2429]. These dynamics are understood to act on very long timescales. For that reason, it is important that growth studies that aim to investigate convergence dynamics work with panel data at the longest timescales available.

Sampling issues notoriously frustrate attempts to observe convergence. For instance, [29] observed that the estimated speeds of β-convergence are so surprisingly similar across data sets, that economists can use a simple rule: economies will converge at a speed of two percent per year. And in [23] it is was argued that σ-convergence did not occur across the United States, or within a majority of the individual US states, from 1970 to 1998. Up to a point, our work, below, seems to affirm the former. However, in the wake of the economic crisis and in the data after 2008, we also observe strong divergence dynamics. So, in certain contexts, at certain statistical moments, and under certain decompositions of the theory itself, our work lends credibility to both. That is, depending on where, when, and how (with what instrument) one looks, one can obverse strong convergence or strong divergence dynamics. Ultimately, we believe that this supports the need for a gentle reassessment of the criteria, data, and instruments employed and deployed. While proposed explanations for why the existence of such theorized dynamics should occur may be intellectually or politically satisfying, from the perspective of economic theory, they ultimately do more to direct attention toward data and model selection rather than to establish the validity of the theory itself. We argue that the following discussion contributes a novel model of an additional, independent data set that provides evidence for the existence of convergence and divergence dynamics.

To generate an independent model for observing convergence and divergence dynamics, we turned to the version 4 DMSP-OLS Nighttime Lights Time Series collected by the US Air Force Weather Agency [30, 31]. The cloud-free, stable lights composites were processed using the entirety of the available archive data for the 1992-2013 period. This is a 21 year dataset that represents one of the longest panels available for growth studies. The analyzed products are 30 arc second grids, spanning −180 to 180degrees longitude and −65 to 75 degrees latitude whereby the resulting data arrays include \({\approx}730~\mbox{mm}\) observed pixels with \({\approx}20~\mbox{mm}\) non-zero (or active) pixels per year. We note that, while the radiance-calibrated NTL images provide better dynamic resolution, these images are only available at random points in time while, for this study, we seek to concentrate on consistent metrics of economic activity over the whole 1992-2013 time period.

Previous work [15] has established that the version 4 DMSP-OLS Nighttime Lights Time Series dataset has some substantive benefits in estimating quantifiable economic activity. Nevertheless, like most of the standard, national accounting approaches mentioned above, the use of nighttime lights has limitations. The most practical limitation is introduced by the impossibility of establishing a precise mapping from the rate and intensity of nighttime light leakage to the World Bank’s standard metrics (e.g., USD) for GDP. Additionally, the annual composites across years that are recorded by distinct satellites cannot be compared directly with each other due to differences in on-board calibration. Finally, the annual variability of cloud dynamics also affects the statistical reliability and estimate precision, particularly in areas for which there are fewer observations as noted in [32, 33].

We began our study by replicating much of the prior literature’s work. The extant literature is uniformly committed to analyzing aggregate light intensities. In replicating this literature, we immediately observe that the correlation between changes in aggregate light intensity and world economic growth is merely 0.31 for the period of 1993-2013, which is in line with findings in [17]. Next, we used a similar technique to separately estimate both country-specific and state-specific aggregate growth metrics for the periods of 1993-2006 and 2007-2013 with year fixed effects controlling for differences in sensor settings across satellites, as well as taking out the effects of changes in worldwide economic conditions as in [17]. These results are reported in Tables 1 and 2 for cross-sections of countries and individual US states with average annual growth rates \(\hat{y}_{93\text{-}06}\) for 1993-2006 period and \(\hat {y}_{07\text{-}13}\) for the 2007-2013 period. Using a basic, generalized least-squares procedure, we also estimated the standard deviations of growth across years in \(\sigma(y_{93\text{-}06})\), \(\sigma(y_{07\text{-}13})\). From these, it is obvious that, depending strongly on the particular subsample of countries or years included in studies, the point estimates of growth using prior, extant methods based on night lights can be plausible but misleading and results can be spurious. Nevertheless, and quite surprisingly, aggregate growth metrics have been used exclusively in all previous studies incorporating night lights.

Table 1 Cross-country comparison of average aggregate annual growth and Markov transition probabilities, percent
Table 2 Cross-state comparison of average aggegate annual growth and Markov transition probabilities, percent

To address these issues while simultaneously keeping the data array of observations as intact and free of adjustments as possible, we apply a differencing technique with zero mean (demeaned) difference centering. In what follows, we describe this method in detail and demonstrate the veracity of this approach. While we cannot completely rid our data of spurious local and global variability due to various measurement factors, this method is appealing both for its simplicity and for its clear empirical findings. Subsequent improvement is certainly possible by, for example, combining and aligning with independent data sets on cloud formation and behavioral dynamics with the possibility of near real-time monitoring of object conditions.

For our study, intensities for nighttime lights are represented by the time-indexed array \(X_{t}(i,j)\), where \(t=1992,\ldots,2013\) and each element contains the intensity of light detected for a pixel with a given longitude \(\operatorname{lon}(i)\) and latitude \(\operatorname{lat}(j)\). We perform the following differencing for all pixels to obtain:

$$\Delta X_{t}(i,j) = X_{t}(i,j) - X_{t-1}(i,j), \quad \forall t \in(1993,2013). $$

At each time step, we then center the differences in pixel light intensity by subtracting the globally (or country, or state-specific) averaged value of differences between years,

$$\begin{aligned}& \Delta X_{t}^{\prime}(i,j)*\mathbf{1}\bigl(\Delta X_{t}(i,j)\neq0\bigr) \\& \quad =\Delta X_{t}(i,j)*\mathbf{1}\bigl(\Delta X_{t}(i,j) \neq0\bigr) -\frac{\int _{\underline{\mathrm{lon}}}^{\overline{\mathrm{lon}}} \int_{\underline{\mathrm{lat}}}^{\overline {\mathrm{lat}}}\Delta X_{t}(u,v)\, du\, dv}{\int_{\underline{\mathrm{lon}}}^{\overline{\mathrm{lon}}} \int_{\underline{\mathrm{lat}}}^{\overline{\mathrm{lat}}}\mathbf{1}(\Delta X_{t}(u,v) \neq0)\,du\,dv}, \end{aligned}$$

where \(\mathbf{1}(\Delta X_{t}(i,j) \neq0)\) is an indicator function that is zero for all pixels with no change in intensity and one for all pixels that display a change in intensity.

Thus, we filter away both pixels that do not have any signal and pixels that do not show any difference when demeaned between annual time steps. What is more, this also helps us to avoid a known issue with saturation of light intensity due to detector sensitivity. Static, saturated areas (e.g., urban centers) are automatically filtered with a resultant time series providing a dynamic characterization of detected changes. Obviously, it is plausible that meaningful changes in economic activity in these saturated areas are not detected due to filtering and, therefore, remain hidden. Nevertheless, and perhaps surprisingly, we still observe detectable changes in highly urban and well-developed areas with highly variable light spillage contributing to the detection of economic activity patterns that could be further correlated with other known and observed data on social and economic events. For instance, as small capillaries wend fluctuations toward and away form great estuaries in our data, streams of traffic of higher of lower intensity can be, perhaps, detected spilling in and out of urban central districts on their evening commutes, carrying out freight delivery, or migrating.

Finally, we process our demeaned time series using a simple standard three-state Markov-chain growth model. We use a finite set \(S=\{-,0,+\} \) of three possible states: a negative change that is larger than the cross-sectional \(\sigma_{t}\) for year t, a positive change that is larger than the cross-sectional \(\sigma_{t}\), and a neutral (no change) state that is within \(\sigma_{t}\).

To understand the characteristics of changes in luminal intensity over time, we compute the transition probabilities \(P_{t}(i|j)\), \(i,j \in S \) for a state j at time \(t-1\) to become state i at time t as stochastic the matrix:

$$\begin{aligned}& P_{t}(+|+);\qquad P_{t}(+|0);\qquad P_{t}(+|-); \qquad \sum_{i} P_{t}(+|i) =1; \\& P_{t}(0|+);\qquad P_{t}(0|0);\qquad P_{t}(0|-); \qquad \sum_{i} P_{t}(0|i) =1; \\& P_{t}(-|+);\qquad P_{t}(-|0);\qquad P_{t}(-|-); \qquad \sum_{i} P_{t}(-|i) =1. \end{aligned}$$

Next, for each stochastic matrix \(P_{t}\) at time t we find the asymptotic stationary matrix:

$$\lim_{n\to\infty} P_{t}^{n} = \overline{P}_{t} $$

and take the diagonal elements of this matrix as \(a_{t}^{++}\), \(a_{t}^{00}\), \(a_{t}^{--}\), corresponding to ‘persistent high growth’, ‘persistent neutral growth’, and ‘persistent high decay’, used in subsequent discussion. The benefit of using stationary probabilities conditioned on the state of world at time t is that it allows us to abstract away the transitory effects of stochastic shocks, to reveal how permanent effects from shocks like, for instance, financial crises, shift the world into different trajectories of development. This allows us to test whether variance in the cross-sectional distribution of economically active pixels increase over time. We find that the gap \(a_{t}^{++}-a_{t}^{--}\) between the probabilities of persistent, high growth and persistent, high decay provides a good metric for particularly negative (if the gap is negative) or positive shocks that perturb countries on their path to convergence. Obtaining those metrics allows the direct tracking of both the ‘majority club’ (as in [23]) of locations that ‘converge’ under specific σ bounds and the ‘minority club’ that grow or decay more rapidly and sit about the long tails of the distribution.

3 Results and discussion

In what follows, we present a number of observations that demonstrate global, national, and subnational convergence and divergence in intensities of terrestrial, nighttime luminosity. We argue that these deltas represent distributional impacts of economic activity and, when these distributional impacts conform to phenomena predicted by broad σ-convergence/-divergence, we further claim that these observations add robustness to that theory.

Figure 1(left panel) shows a histogram for the demeaned difference distribution representing cumulative change over the 1993-2013 period. Our observed change distribution for nighttime light spillage is leptokurtic (excess kurtosis is 8.5) and skewed to the right (where skewness is 0.5 with a standard deviation of 3.68%). Reference [23] studied the US per capita income distribution from 1970 to 1998 and found that excess kurtosis increased from 0.4 to 7.3. This is, indeed, in line with and supported by our findings for night light distribution.

Figure 1
figure 1

Probability distributions of observed cumulative zero-mean annual change variations in 1993-2013 period against normal distribution (left) and quantile-quantile-plots across different years (right).

Figure 1(right panel) confirms that samples from different years come from a similar distribution (e.g., AF satellites are looking at the same planet and distribution is stable over time). However, there are important differences across years. For example, pixels in the Middle East that were previously growing in relative intensity suddenly shift into a depressed slide as the region slips into a series of well documented wars and episodes of tremendous civil unrest.

Figure 2(left panel) shows cumulative change in 1992-2002 (Y-axis) vs 2003-2006 (X-axis) with color coded pixels based on total intensity growth in 1992-2006 subsample. Figure 2(right panel) shows cumulative change in 2008-2013 (Y-axis) vs 1992-2007 (X-axis) with color coded pixels based on total intensity growth in 1992-2013 sample. A 45-degree (positive sloped) line corresponds to autocorrelation of growth and, therefore, an increase in divergence of growth over time as faster growing pixels persistently outperform slower ones. We see that post-2007 growth shows a noticeable divergence along the systemically high-growth area of the spectrum. However, overall, most points are clustered in either anti-correlated or not correlated quadrants thereby providing support for the idea that general convergence mechanisms are in effect.

Figure 2
figure 2

Distribution change, effect of Great Recession shock. (left) 2003-2006 (Y-axis) vs 1992-2002 (X-axis), (right) 2008-2013 (Y-axis) vs 1992-2007 (X-axis). Total growth over 2013-1992 period is color coded.

Reference [34] found that energy consumption inequality decreased from 0.66 in 1980 to 0.55 in 2010. This finding is in line with the satellite observed production and use of light at night which also indicates similar decreases in inequality after the Cold War and in the run up to the financial crisis of 2008. Unfortunately, comprehensive, post-crisis economic indicators are still lagging and largely unavailable.

We also compute the cumulative cross-sectional standard deviation of our vectorized data array:

$$\sigma_{t}=\sigma\bigl(\Delta X_{t}^{\prime}(i,j) \bigr),\quad \forall t \in(1993,2013). $$

This approach takes the statistically unreliable, absolute aggregate levels of growth completely out of the picture and centers the focus on the distributional impacts of growth. As a result, σ-convergence in our framework still captures unconditional estimates of local, high-resolution deviations as in [22] while avoiding statistical fallacies required for testing across samples that are grouped by means in a specific year.

Figure 3 shows global cross-sectional change variability before and after the Great Recession event. We see again, that there is support for a theory of global σ-convergence kicking in immediately after the end of the Cold War period and before the Great Recession. However, the global cross-sectional provides strong empirical evidence for economic divergence in the years immediately following the economy-wide shocks delivered by the financial crisis with long and persistent recovery dynamics.

Figure 3
figure 3

Standard deviation of annual zero-centered change. (left) annual global, (\(\sigma_{g}\)), percent, (right) across countries, (Δ), percent.

To aid in understanding the sources of these dynamics, we report in Tables 1 and 2 the calculated values for the transition probabilities \(a^{++}\), \(a^{--}\), \(a^{00}\) in our 3-state Markov model. Here we see that both persistent high growth and persistent high decay rates shrank over time, with some prominent exceptions (e.g., Syria). In general, moreover, the gap between high growth and high decay became larger indicating that the mechanisms driving σ-convergence failed immediately after the financial crisis. This observation highlights another strength of our approach. Namely, it provides indicators for the direction of research attention and aids in the development of hypotheses. For instance, perhaps the observed breakdown in σ-convergence dynamics can be attributed to intentional suppression of extreme volatility through post-crisis monetary policies. Such policies may be directly implicated in decreasing the probability of failure to a large degree while also decreasing slightly the probability of higher success.

Figures 4 and 5 show the annual Markov transition probabilities for a selected subset of countries and US states. Red and blue dots represent the observed transition probabilities for high growth areas to high growth areas and high decay areas to high decay areas respectively. The solid red and blue lines represent the mean probabilities for a given time period with a break at the end of the 1993-2006 subsample and the start of the sample for 2007-2013. The mean observations tell a fairly consistent story and confirm that there is broad heterogeneity in the observed variation in growth and decay probability outcomes across nations after the global financial crisis. The individual observations also tell a series of interesting stories. For example, Switzerland appears to have been particularly sensitive to the financial crises that occurred in the observed period, including the Asian crisis (1997) and Euro zone crisis (2009-2011). Looking at the United States, we observe that the high growth probabilities and high decay probabilities moved in, more or less, lockstep through most of the 1993-2006 period but that, after the financial crisis, a gap opened up whereby the high growth probabilities climbed slightly while the high decay probabilities look rather unchanged. One could reasonably hypothesize that this uptick in growth-growth probability is due to massive stimulus programs enacted in direct response to the broad financial meltdown.

Figure 4
figure 4

Markov transition probabilities across selected countries. Red markers are for \(a^{++}\) values, blue markers are for \(a^{--}\) values, solid blue and red lines are mean values over 1993-1006 and 2007-2013 periods, percent.

Figure 5
figure 5

Markov transition probabilities across selected US states. Red markers are for \(a^{++}\) values, blue markers are for \(a^{--}\) values, solid blue and red lines are mean values over 1993-1006 and 2007-2013 periods, percent.

Apart from interrogating the calculated transition probabilities, much can be learned simply by looking at individual pixel-level data. So, in order to facilitate merely looking, we produced maps of the global distributional impacts with color-coded values of \(\Delta\mathbf {X}(i,j) = \sum_{t=1993}^{t=2013}\Delta X_{t}^{\prime}(i,j)\). Figure 6 shows the total, globally mean-centered change over a period of 22 years spanning 1992-2013. Blue-coded areas correspond to net negative dynamics (decay) and red-colored areas to net positive dynamics (growth). Neutral changes are not distinguishable from the black background. It is important stress that coded deviations represent movements away from the global zero-mean centered panel time series. This means that relative decline (blue-colored areas) or relative growth (red-colored areas) do not necessarily translate to absolute decline of economic activity in a given area. This is, of course, consistent with broad mechanics of σ-convergence.

Figure 6
figure 6

Annual average global mean-centered change, 1993-2013. Blue-coded areas correspond to net negative dynamics (decay) and red-colored areas to net positive dynamics (growth). Neutral changes are not distinguishable from the black background. Extreme outliers for negative and positive change are marked with cyan and orange correspondingly.

Looking closely, the major economic transformations following the end of Cold War are clearly visible with, for example, the net positive rise of China and the decline of US industry, capital transfers within the European Union with net beneficiaries in eastern Europe and Scandinavia, growth in India and China alongside the relative decline in Pakistan and Syria. The development of shale oil drilling along side conventional oil extraction techniques represent important factors in economic production and development and their impact can be clearly observed in the northern United States and Russia.

To demonstrate the resolution of our observatory, we also conduct distributional impact studies with σ-convergence tests within particular countries and states of the United States across our full panel data time series. For these studies, we zero-mean centered our time series data for each, particular, country or state as a whole for country/state-specific fixed effects.

Figure 7 represents a decomposition of the total mean-centered change into annual averages for the period of 1993-2006 (left panel) as compared to 2007-2013 (right panel) for Germany. There is a distinct, observable contrast between relatively larger growth in central and eastern Germany before the global financial crisis and a shift in growth toward historically more developed centers in the western regions following the crisis.

Figure 7
figure 7

Annual average mean-centered change, Germany. (left) 1993-2006 period, (right) 2007-2013 period.

Figure 8(left panel, right panel) represents the same period decompositions for Thailand, one of the more successful developing nations with notably sustained high levels of growth. Interestingly, there is an obvious and quite sharp contrast between an observably equatable or diffuse growth distribution before the crisis and a post crisis concentration of growth toward and around central Bangkok.

Figure 8
figure 8

Annual average mean-centered change, Thailand. (left) 1993-2006 period, (right) 2007-2013 period.

Figure 9(left, right) represents the same period decomposition for the state of Maryland (USA) that surrounds the nation’s capital, Washington, DC. The magnitude of observable urban renewal is striking. We also note a similar phenomenon for the city of Chicago, as well as other major metropolitan areas in the US and around the world. There are, nevertheless, equally striking exceptions.

Figure 9
figure 9

Annual average mean-centered change, Maryland. (top) 1993-2006 period, (bottom) 2007-2013 period.

Figure 10(left panel, right panel)-Figure 11(top panel, bottom panel) represents Syria and Turkey. The change in growth polarity for the once prosperous province of Aleppo, since captured by insurgents, as well as new areas of growth away from the central government are clearly visible and highlight a possible use of this observatory and method for humanitarian purposes. Namely, the early detection of on-the-ground social crises.

Figure 10
figure 10

Annual average mean-centered change, Syria. (left) 1993-2006 period, (right) 2007-2013 period.

Figure 11
figure 11

Annual average mean-centered change, Turkey. (top) 1993-2006 period, (bottom) 2007-2013 period.

Our approach directly exposes a substantial amount of policy relevant heterogeneity in economic development both inside and across countries. Moreover, this heterogeneity is demonstrably impossible to observe using only mean-aggregated data and serves to further emphasize the contributions our observatory and approach can make to theory. While the correlation between photons emitted as a byproduct of economic transactions and economic development has been described in the literature, technology improvements should, in theory, lead to increases in terrestrial light spillage as a result of falling costs. For instance, in [27], the amount of labor required to pay for a lumen-hour of light consumption was estimated over time and shown to fall precipitously. However, technologies and energy conservation measures can introduce ambiguous observational effects and further frustrate attempts to make sense of observations. On the one hand, conservation necessarily leads to reductions in light spillage due to, for instance, improved efficiencies in building lighting management (i.e. automatically turning off lights at night). On the other hand, technologies can be implicated in increased luminal production due to more efficient energy-to-light conversion mediums (as, for example, switching from incandescent lighting to LED) thereby driving down the cost (in both dollars and carbon) of leaving the lights on. Of course, increasing urban population densities are a factor. Yet, as we can see from Figure 8 and Figure 9, there is a visible effect from the growth of suburbia and general urban sprawl, suggesting that urban commute light spillage does, at least partially, capture the effects of urban growth. Nevertheless, applying proper spatial statistical methods to characterize dynamic processes to support our general qualitative findings is by no means trivial due to substantial spatial autocorrelations and on-board calibrations that bias observations.

4 Conclusion

Our mean-centered differencing procedure represents a significant improvement over all prior approaches to using the intensity of nighttime lights as a means to estimating the characteristics of macroeconomic phenomena. Our method efficiently filters away the effects of well documented (and replicated in this study) mean value biases in remote sensing that are caused by ground or on-board sensor conditions. As a result, our approach can provide reliable and interesting metrics across time and space that qualitatively agree with evidence from other data sources. While it is certainly possible to enhance the obtained metrics with quantitative interpolation across socioeconomic datasets to micro- and macro-levels using regressions or other statistical, geospatial methods, we stress the value and importance of our meso-level observations of the regional and time specific flow patterns presented in this paper which, moreover, have not been discussed or considered in the prior literature.

To date, no studies have looked at variance in global nighttime luminosity data across time as a proxy for convergence and divergence phenomena or, for that matter, any theorized dynamic economic processes. Previous work has merely noted correlations between nighttime lights and aggregate static accounts data (e.g., GDP). As noted above, unlike our approach, these prior studies focused on aggregate nighttime lights panels which are, themselves, deeply flawed. One likely reason for the relative scarcity of studies like this one is the lack of examples of big data analysis in economics that leverage interesting higher statistical moments and patterns that are computed and analyzed rigorously, with rare exceptions in [3538]. We argue that more research is needed that makes use of big (complex) data and takes seriously the theoretical underpinnings of the aggregate models currently in use. This will not only lead to improvements in current theory, but also shows promise for validation, rejection, and, even, introduction of novel hypotheses and theory.

Passive remote sensing of the Earth’s surface using satellites can allow researchers to obtain real-time proxies for economic activity that are spatially and temporally well-defined. As opposed to the somewhat fictitious aggregate data generated by society’s tax optimized accounting, where investments in production and sales of products can be artificially separated in offshore holding companies with country of origin labels attached that do not reflect the actual economic transactions, seeing is believing. Moreover, while most survey-based data can also be misleading due to sample biases and hidden information, here we have a global dataset with complete coverage of nighttime photon spillage from human activity with, arguably, leading real-time indicators of economic activity that can be useful for a more precise characterization of on the ground economic development as well as early crisis warnings when investments do not realize growth in economic output as, otherwise, expected.

We observe both support for the broad σ-convergence theory in the post-Cold War period as well as strong divergence dynamics immediately following the financial crisis and Great Recession with, moreover, observable patterns of growth that are correlated in time with governmental policies introduced in the wake of economic shocks. While it can be argued that the social insurance of government transfers provides benefits by limiting the extent and magnitude of Schumpeterian damage during and immediately following a crisis, we observe that there is both a direct cost of generally lower growth in more successful areas, as well as an indirect cost of higher accumulation of benefits in more urban areas leading to flows of labor and capital into already densely populated regions while leaving the hinterland relatively more impoverished. These metrics could be improved significantly with even more up-to-date data. Particularly, with real-time (daily), high-resolution feeds of satellite data, the improvements in precision for global activity anomaly detection would enable a vast portfolio of early crisis warning signaling systems. Governments, foundations, philanthropy, and NGOs could intervene in real time as, for instance, communities slip into decay.

We have stood for centuries, squinting skyward, learning from looking. One of the most striking and exciting byproducts of our approach is the manner in which our visual representations of human economic activity are immediately suggestive, drawing the inquisitive researcher’s eye to conspicuous structures, asterisms of light.

References

  1. Evans J, Rzhetsky A (2010) Philosophy of science: machine science. Science 329(5990):399-400

    Article  Google Scholar 

  2. Hey AJ, Tansley S, Tolle KM (2009) The fourth paradigm: data-intensive scientific discovery, vol 1

    Google Scholar 

  3. Aad G, Abajyan T, Abbott B, Abdallah J, Khalek SA, Abdelalim AA, Abdinov O, Aben R, Abi B, Abolins M et al. (2012) Observation of a new particle in the search for the standard model Higgs boson with the ATLAS detector at the LHC. Phys Lett B 716(1):1-29

    Article  Google Scholar 

  4. Abbott BP, Abbott R, Abbott TD, Abernathy MR, Acernese F, Ackley K, Adams C, Adams T, Addesso P, Adhikari RX et al. (2016) Observation of gravitational waves from a binary black hole merger. Phys Rev Lett 116(6):061102

    Article  Google Scholar 

  5. Covert MW, Knight EM, Reed JL, Herrgard MJ, Palsson BO (2004) Integrating high-throughput and computational data elucidates bacterial networks. Nature 429(6987):92-96

    Article  Google Scholar 

  6. Conrad J (2014) Indirect detection of WIMP dark matter: a compact review. arXiv:1411.1925

  7. Beltran M, Hooper D, Kolb EW, Krusberg ZA (2009) Deducing the nature of dark matter from direct and indirect detection experiments in the absence of collider signatures of new physics. Phys Rev D 80(4):043509

    Article  Google Scholar 

  8. BLS (2006) Current population survey: design and methodology. Technical paper, US Department of Labor

  9. Kaplan G, Schulhofer-Wohl S (2012) Interstate migration has fallen less than you think: consequences of hot deck imputation in the current population survey. Demography 49(3):1061-1074

    Article  Google Scholar 

  10. Nordhaus WD (2006) Geography and macroeconomics: new data and new findings. Proc Natl Acad Sci USA 103(10):3510-3517

    Article  Google Scholar 

  11. Sinton JE (2001) Accuracy and reliability of China’s energy statistics. China Econ Rev 12(4):373-383

    Article  Google Scholar 

  12. Rogoff K, Reinhart C (2010) Growth in a time of debt. Am Econ Rev 100(2):573-578

    Article  Google Scholar 

  13. Herndon T, Ash M, Pollin R (2014) Does high public debt consistently stifle economic growth? A critique of Reinhart and Rogoff. Camb J Econ 38(2):257-279

    Article  Google Scholar 

  14. Leamer EE (2007) Linking the theory with the data: that is the core problem of international economics. In: Heckman JJ, Leamer EE (eds) Handbook of econometrics, vol 6, Part A, Chapter 67. Elsevier, Amsterdam, pp 4587-4606. doi:10.1016/S1573-4412(07)06067-9.

    Google Scholar 

  15. Ghosh T, Powell RL, Elvidge CD, Baugh KE, Sutton PC, Anderson S (2010) Shedding light on the global distribution of economic activity. Open Geogr J 3:147-160

    Article  Google Scholar 

  16. Levin N, Duke Y (2012) High spatial resolution night-time light images for demographic and socio-economic studies. Remote Sens Environ 119:1-10

    Article  Google Scholar 

  17. Henderson JV, Storeygard A, Weil DN (2012) Measuring economic growth from outer space. Am Econ Rev 102:994-1028

    Article  Google Scholar 

  18. Chen X, Nordhaus WD (2011) Using luminosity data as a proxy for economic statistics. Proc Natl Acad Sci USA 108(21):8589-8594

    Article  Google Scholar 

  19. Elvidge CD, Baugh KE, Anderson SJ, Sutton PC, Ghosh T (2012) The night light development index (NLDI): a spatially explicit measure of human development from satellite data. Soc Geogr 7(1):23-35

    Article  Google Scholar 

  20. Pinkovskiy M, Sala-i-Martin X (2016) Lights, camera, …. Income! Illuminating the national accounts-household surveys debate. Q J Econ 131(2):579-631

    Article  Google Scholar 

  21. Nordhaus W, Chen X (2015) A sharper image? Estimates of the precision of nighttime lights as a proxy for economic statistics. J Econ Geogr 15(1):217-246

    Article  Google Scholar 

  22. Friedman M (1992) Do old fallacies ever die? J Econ Lit 30:2129-2132

    Google Scholar 

  23. Young AT, Higgins MJ, Levy D (2008) Sigma convergence versus beta convergence: evidence from US county-level data. J Money Credit Bank 40(5):1083-1093

    Article  Google Scholar 

  24. Piketty T (2014) Capital in the twenty-first century. The Belknap Press of Harvard University Press, Cambridge

    Book  Google Scholar 

  25. Durlauf SN, Quah DT (1999) The new empirics of economic growth. In: Handbook of macroeconomics, vol 1. Elsevier, Amsterdam, pp 235-308

    Google Scholar 

  26. Easterly W, Levine R (2001) It’s not factor accumulation: stylized facts and growth models. World Bank Econ Rev 15(2):177-219

    Article  Google Scholar 

  27. Nordhaus WD (1996) Do real-output and real-wage measures capture reality? The history of lighting suggests not. In: The economics of new goods. University of Chicago Press, Chicago, pp 27-70

    Google Scholar 

  28. Rodrik D (2013) Unconditional convergence in manufacturing. Q J Econ 128:165-204

    Article  Google Scholar 

  29. Sala-i-Martin XX (1996) The classical approach to convergence analysis. Econ J 106:1019-1036

    Article  Google Scholar 

  30. Doll CN (2008) CIESIN thematic guide to night-time light remote sensing and its applications. Center for International Earth Science Information Network of Columbia University, Palisades, NY

  31. Baugh K, Elvidge CD, Ghosh T, Ziskin D (2010) Development of a 2009 stable lights product using DMSP-OLS data. Proc Asia-Pac Adv Netw 30:114-130

    Article  Google Scholar 

  32. Free M, Sun B (2014) Trends in US total cloud cover from a homogeneity-adjusted dataset. J Climate 27(13):4959-4969

    Article  Google Scholar 

  33. Norris JR, Evan AT (2015) Empirical removal of artifacts from the ISCCP and PATMOS-x satellite cloud records. J Atmos Ocean Technol 32(4):691-702

    Article  Google Scholar 

  34. Lawrence S, Liu Q, Yakovenko VM (2013) Global inequality in energy consumption from 1980 to 2010. Entropy 15(12):5565-5579

    Article  Google Scholar 

  35. Yoshikawa H, Aoyama H, Fujiwara Y, Iyetomi H (2015) Deflation/inflation dynamics: analysis based on micro prices. Available at SSRN 2565599

  36. Butaru F, Chen Q, Clark B, Das S, Lo AW, Siddique A (2015) Risk and risk management in the credit card industry. Technical report, National Bureau of Economic Research

  37. Burdick D, Franklin M, Issler P, Krishnamurthy R, Popa L, Raschid L, Stanton R, Wallace N (2014) Data science challenges in real estate asset and capital markets. In: Proceedings of the international workshop on data science for macro-modeling. ACM, New York, pp 1-5.

    Google Scholar 

  38. Giesecke K, Sirignano J, Sadhwani A (2016) Deep learning for mortgage risk. Working paper, Stanford University

Download references

Acknowledgements

This work was completed in part with resources provided by the University of Chicago Research Computing Center and a generous gift from Facebook.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eamon Duede.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

ED and VZ conceived and designed the research. VZ acquired and analyzed the data. ED and VZ interpreted the results. All authors discussed, wrote, and approved the final version of the manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Duede, E., Zhorin, V. Convergence of economic growth and the Great Recession as seen from a Celestial Observatory. EPJ Data Sci. 5, 29 (2016). https://doi.org/10.1140/epjds/s13688-016-0091-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1140/epjds/s13688-016-0091-3

Keywords