Global Financial Data has recently introduced commodity indices that provide data on over 1000 years of commodity prices. It is only as a result of these indices that we can see the anomalous behavior of energy prices over the past forty years and wonder how long or whether this trend will continue.  

Energy Resources During the Past 750 Years

From the 1200s to the 1800s, the economy’s primary energy resource was firewood, with coal and lamp oil acting as secondary resources. Each, in its own way, provided different types of energy for cooking, heating and power. GFD’s data on firewood prices begins in 1252, coal prices begin in 1447, and lamp oil price data begins in 1272. Although firewood was the primary source for energy from the 1200s to the 1800s, it was gradually replaced by electricity and gas in the 1800s as energy was brought directly into the home. As the graph below shows, although there were periods when the price of firewood rose dramatically, the price of firewood also stayed the same for centuries. As the graph of whale oil prices below shows, the impact of war on energy prices is nothing new. The primary spikes in whale oil prices in the 1800s occurred during the War of 1812 and the Civil War.   The logarithmic chart below compares the behavior of energy prices to agricultural and industrial commodity prices over the past 750 years. Between the three, energy prices have increased the most, rising over 500-fold in the past 750 years, while industrial commodities have increased in price the least. A quick study of the chart shows that there were long periods of hundreds of years when the price of energy hardly changed, in particular, between 1350 and 1550 and again between 1700 and 1900. However, the 1900s and the 2000s have proven to be a period of wild, but generally rising changes in the price of energy and other commodities. The price of energy really began to diverge from agricultural prices around 1860 when petroleum oil was discovered in Pennsylvania. Energy prices have leapt ahead of agricultural prices during the past 50 years, especially as a result of large price increases in the 1970s and 2000s. Since 1970, commodity prices have followed dramatically different paths. Between 1970 and 2016, the agricultural index increased almost four-fold, the industrial index ten-fold and the energy index thirty-fold! It is only with this chart that we realize the anomalous behavior in commodity prices that has occurred over the past 40 years and broke a 700-year trend of fairly equal increases in energy and agricultural commodity prices. Another interesting revelation of the chart is the periodic spikes in commodity prices that occur. Such spikes were rare before the industrial revolution, but now seem to come with some degree of regularity. The first three spikes occurred during wars, in the 1810s during the Napoleonic Wars and War of 1812, in the 1860s during the American Civil War, and in the 1910s during World War I. The first two spikes were followed by forty-year price decreases as a reversion to the mean in prices during times of peace. The price increase during World War I saw a similar decline in prices follow in the 1920s and 1930s in agricultural and industrial commodities, but not in energy prices. On the other hand, while agricultural and industrial commodity prices showed sharp increases during World War II, no similar increase in energy prices occurred during the war. The two most recent spikes in energy prices in the 1970s and in the 2000s have yet to be followed by reversions to the mean. While supply factors, primarily scarcity, drove the spike in energy prices in the 1970s, higher demand from China and other countries drove the spike in prices during the 2000s. Since the 1970s, both energy and industrial commodities have followed similar price patterns while agricultural price increases have been more steady.  

The Surprising Interplay Between Coal and Oil Prices

The chart below provides a comparison of the behavior of two of the underlying components of the energy price index, oil, represented by the lower price line since 1800 and coal, which has shown a steady uptrend over the past few centuries. Were one to simply rely upon the persistence of current trends into the future, there would be two logical conclusions. First, energy and industrial commodity prices will continue to increase at a faster rate than agricultural prices. Second, oil prices will continue to rise at a faster rate than coal prices. The reality of supply and demand appear to reinforce these trends. Declining population combined with improving technology means that food is unlikely to become scarce causing large price increases. As people become richer, they switch from low-resource grains to high-resource livestock, but there is little reason to believe that this change in the composition of food consumption will cause dramatic overall increases in agricultural prices. With respect to energy, future changes in demand will be driven more by economic growth than by population increases. In developed countries, energy input per unit of production is declining and to some degree, this offsets the increased demand for energy in emerging markets. Countries like China, which rely heavily on oil imports, are reducing their energy dependence through the development of solar power and improved storage for batteries. Services play an increasing role in both developed and emerging markets, and as services increase their share of GDP, the relative dependence of the economy on petroleum and coal will decline. Future supply and demand for energy depend upon technology and how quickly solar and battery technology are able to improve, as well as how much fracking and related technologies are able to increase the amount of oil that can be retrieved from the ground. Because of the impact of carbon-based energy on global warming, the world is attempting to reduce its reliance on coal and oil. Long-term global trends in population, the composition of the work force, technology, the impact of carbon-based resources on the environment, slower overall economic growth and other factors favor reduced reliance on commodities in the future. Since the economy has passed through its most recent 30-year spike in commodity prices in the 2000s (previous spikes were in the 1910s, 1940s and 1970s), commodity prices are likely to decline at least until the 2020s. Whether commodity prices spike again in the 2030s will depend upon global economic conditions twenty years in the future. The analysis of long-term trends in commodity prices is enlightening. The fears of the 1970s that the world would soon be facing a resource-scarce planet which was running short of energy, food and other commodities never occurred. If anything, the expectation should be for increased supplies of resources and declining commodity prices for the next twenty years. Higher demand for commodities will depend primarily upon how quickly emerging markets increase their GDP while technological improvements both increase the supply of energy and provide substitutes through solar power, material composites and other technological improvements. A review of the 750-year chart of commodity prices shows that for most of history, commodity prices stayed the same for periods of several centuries. It was mainly in the 1500s and the 1900s that the world experienced irreversible increases in commodity prices. Could this pattern repeat itself in the twenty-first century? Right now, this seems unlikely. The pattern over the past 100 years has shown no sign of reversing itself. For now, the safest bet is for rising commodity prices, and especially for rising energy prices. But then, safe bets are not always safe.

By our count, 37 countries hit what could be bear market bottoms in 2016. We excluded eight countries (Ghana, Cyprus, Kenya, Malawi, Portugal, Tanzania, Uganda and Zambia) because these countries failed to rally at least 10% from their market bottom, and so, their bear market could continue into 2017. The Cyprus stock market, for example, has declined 99.45% from its all-time high in November 1999. If you had put a $1000 in the Cyprus stock market in 1999, now you would barely have enough left for a cup of coffee at Starbucks. We also excluded Canada from this list. Even though Canada ended a 24.36% bear market in January and has rallied 29% since then, the Canadian market had only risen 40% from its previous bear market bottom in October 2011. We calculated both the percentage increase in the previous bull market and the decrease in the bear market that ended in 2016. For the 37 countries in our list, the previous bull market had risen by 141% with Mongolia ending the strongest bull run with a 626% increase. The bear markets that ended in 2016 had an average decline of 41%, but since then, most of the markets have shown significant recoveries. By the end of 2016, the average stock market in our list had risen by 31% from its market bottom. Several countries ended bear markets that had lasted over five years (Brazil, Colombia, the Czech Republic, Kuwait, Mongolia, and Oman).   Of the 37 countries that probably hit a bear market bottom in 2016, one-third of them were in Europe. Interestingly, even though most European countries hit their market bottoms in January or February, the MSCI Europe Index hit its bottom on June 27, 2016 after the United Kingdom voted in favor of Brexit. Two other international indices hit bottoms in 2016. The MSCI EAFE Index declined by 25% between July 2014 and February 2016 while the MSCI Emerging Market Index declined by 43% between May 2011 and January 2016. Both of them now appear to have hit a bottom and are moving up again. The MSCI World Index did not suffer a 20% bear market decline primarily because of the strength of the United States stock market. Although a bear would argue that there is no reason why the bear markets these countries endured could not continue and each market hit a lower low in 2017, given the fact that on average the markets have bounced off their bear market bottom by 30%, it seems unlikely that they are all headed for lower lows in 2017. Although some bears may argue that a country like the United States has been in a bull market for almost eight years, which is longer than the historical average, there is no reason why the bull market in the United States cannot continue. The fact that numerous countries hit market bottoms in 2016 at least provides support for a continuance of the current bull market into 2017 and reduces the likelihood that markets are headed for a major top in 2017. The table below provides information on the 37 countries and three international indices that hit bear market bottoms in 2016. The table provides information on the previous market top, when it ended and the size of that bull market; when the bear market decline ended and the amount of the decline; and how much the market has recovered since then. Individual stock markets are measured in local currency while international indices and Venezuela are measured in US Dollars.  

Country	Bull Top	Change	Bear Bottom	Change	2016 Recovery
Abu Dhabi	9/18/2014	144.93	1/21/2016	-28.59	21.66
Belgium	4/13/2015	104.31	2/11/2016	-21.25	16.30
Brazil	11/4/2010	133.58	1/20/2016	-48.43	59.99
China	6/12/2015	165.15	2/29/2016	-48.02	15.53
Colombia	11/5/2010	151.96	1/18/2016	-51.78	28.75
Croatia	2/11/2011	84.84	1/18/2016	-32.55	26.54
Czech Republic	4/15/2010	107.51	6/27/2016	-39.42	16.65
Egypt	9/7/2014	147.67	1/21/2016	-48.26	147.74
France	4/27/2015	92.87	2/11/2016	-25.28	24.47
Germany	4/10/2015	120.19	2/11/2016	-29.00	26.40
Greece	3/1/2014	187.51	2/11/2016	-67.81	45.99
Hong Kong	4/28/2015	75.03	2/12/2016	-35.59	20.09
India	1/29/2015	95.60	2/11/2016	-22.67	16.01
Iraq	10/4/2011	63.50	6/16/2016	-73.18	28.75
Italy	4/15/2015	91.29	6/27/2016	-30.74	22.61
Japan	8/10/2015	143.17	2/12/2016	-29.27	26.91
Kazakhstan	9/3/2014	55.26	1/21/2016	-39.12	69.89
Kuwait	6/24/2008	70.82	1/26/2016	-68.47	16.46
Luxembourg	4/14/2015	73.02	2/11/2016	-34.48	41.39
Mongolia	2/25/2011	626.20	5/5/2016	-68.18	17.09
Namibia	5/5/2015	199.62	1/20/2016	-36.31	38.52
Netherlands	4/13/2015	85.92	2/11/2016	-24.28	24.42
Nigeria	7/9/2014	118.19	1/19/2016	-47.82	19.68
Norway	4/15/2015	72.83	1/20/2016	-26.35	29.50
Oman	1/16/2011	66.38	1/21/2016	-30.74	18.81
Peru	4/2/2012	298.29	1/20/2016	-63.09	75.34
Philippines	4/10/2015	376.85	1/21/2016	-25.14	12.43
Poland	4/28/2011	120.89	1/20/2016	-42.90	16.32
Qatar	9/18/2014	239.24	1/18/2016	-40.65	22.54
Romania	8/10/2015	83.09	1/18/2016	-21.21	17.71
Saudi Arabia	9/9/2014	169.96	10/3/2016	-51.42	33.12
Singapore	5/22/2013	143.72	1/21/2016	-26.50	12.75
Spain	4/13/2015	99.78	2/11/2016	-34.95	20.49
Sweden	4/27/2015	109.56	2/11/2016	-22.84	22.79
Ukraine	8/1/2014	65.89	5/24/2016	-54.63	23.17
Venezuela	6/13/2015	100.40	12/10/2016	-73.34	14.07
Zimbabwe	8/1/2013	133.18	6/17/2016	-59.95	54.76
MSCI EAFE	7/3/2014	52.30	2/12/2016	-25.21	12.84
MSCI Emerging	5/2/2011	153.96	1/21/2016	-42.93	5.24
MSCI Europe	5/21/2015	53.45	6/27/2016	-25.53	12.89

Global Financial Data has introduced commodity indices which have the longest histories available anywhere as part of its family of GFD Indices. These commodity indices begin in the year 1000 and are current through 2016. The data are monthly and are updated on an ongoing basis. The GFD Commodity Indices include a composite index, three commodity indices and eight commodity sub-indices. The Composite Index is broken down into three categories, energy, agriculturals and industrials. There are no sub-indices for energy, but there are five sub-indices for agriculturals (beverages, soft foods, grains, livestock and oils and meal) and three sub-indices for industrials (non-food agriculturals, base metals and precious metals). The energy index begins in 1252, beverages in 1287, softs in 1209, grains in 1000, livestock in 1209, oils and meal in 1306, non-food agriculturals in 1248, base metals in 1268 and precious metals in 1000. Every index has at least 700 years of history. For the agricultural indices, beverages include beer, cocoa, coffee, milk and tea; the soft foods include butter, cheese, eggs, potatoes and sugar; the grains include barley, corn, hay, oats, rice and wheat; livestock includes, hogs, cattle and lambs; the oils and meal include corn oil, cottonseed oil, cottonseed meal, flaxseed, lard, oatmeal, palm oil, soybean meal, soybean oil, soybeans and tallow. For the industrial indices, base metals include aluminum, copper, iron, lead, nickel, steel, tin and zinc; the non-food agriculturals include cotton, rubber, tobacco, wood and wool; and the precious metals include gold, palladium, platinum and silver. The energy index includes coal, coal gas, firewood, natural gas and oil (which includes lamp oil, whale oil and petroleum). Data are taken from the United States and England. Annual data from England use historical series calculated by Gregory Clark in “The Price History of English Agriculture, 1209-1914.” British data is used until the 1700s when data from the United States becomes available. Most U.S. data before 1861 comes from Arthur H. Cole, Commodity Prices in the United States, 1700-1861, Cambridge: Harvard University Press, 1938. Series from the 1900s and 2000s use government and traded spot prices data. The underlying commodities have for each series have changed over time. Whenever a new commodity source was introduced, we chain-linked different series to provide a continuous set of data for the underlying commodity. Composites were created for iron (beginning in 1268), steel (1720), coffee (1708), milk (1287), tea (1673), coal (1259), oil (1272), butter (1261), potatoes (1724), sugar (1265), barley (1209), corn (1756), hay (1258), oats (1209), rice (1000), wheat (1209), hogs (1732), cattle (1209), lambs (1874), cotton (1749), tobacco (1618), wood (1443), wool (1248) and lard (1797). Commodities are weighted based upon the amount of trade and consumption of each component. No exact data are available for the amount traded and consumed before the 1900s, so the weights have been estimated. The GFD Commodity Indices are available to subscribers to the GFD Indices, which include hundreds of proprietary series calculated for commodities, stocks and bonds. To get more information on these indices, or if you would like a list of the indices and the companies that have been added, call today to speak to one of our sales representatives at 877-DATA-999 or 949-542-4200.  

Standard and Poor’s and MSCI recently revised their GICS sector indices, introducing Real Estate as a separate sector, removing it as an industry within Finance. S&P/MSCI also revised several of its sub-indices, both adding and subtracting several of them. The GICS Codes now include 11 Sectors, 24 Industry Groups, 68 Industries and 157 Sub-Industries. Because of these changes, GFD has decided to reorganize and simplify the tickers for its S&P Sector Indices. Until now, the S&P Sector index tickers used abbreviations to name a particular sector. For example, RAIL was used for railroads and AIRL was used for Airlines. The problem was that it was impossible to know which alphabetic abbreviation was used for each sector. Going forward, GFD will use the actual GICS numerical codes in the tickers to make it easier for our subscribers to find the sector index they want. Once they have the GICS Code for any sector or industry, they can easily put together the ticker for the index using a simple formula. An Excel file of the current GICS codes can be found at https://www.msci.com/documents/10199/4547797/GICS+Structure+effective+Sep+1%2C+2016.xls/d8600f87-cc12-4070-912f-08590232441d All S&P tickers used in the GFDatabase begin with an underscore (_), followed by a one or two-digit number indicating whether the index is from the S&P 500 Large Cap (5), S&P 400 Midcap (4), S&P 600 Small Cap (6) or S&P 1500 Supercomposite (15) index. The number is then followed by “SP”, and then the GICS Code. For example, the code for the S&P 500 Energy Sector is _5SP10 using 5SP for the S&P 500 and 10 for the Energy Sector. The code for the S&P 400 Transports Industry Group is _4SP2030 using 4SP for the S&P 500 and 2030 for the Transportation Industry Group. The code for the S&P 600 Health Care Providers and Services Industry is _6SP351020 using 6SP for the S&P 600 and 351020 for the Health Care Providers and Services Industry. The code for the S&P 1500 Electric Utilities Sub-Industry is _15SP55101010 using 15SP for the S&P 1500 and 55101010 for the Electric Utilities Sub-Industry. This methodology eliminates the need to determine the letter suffix for each sector and industry. Because the GICS Sectors and Industries are global codes, some industries may not be available for the United States S&P Indices, but GFD Includes all the indices that are available for the S&P 500 Large Cap Indices, S&P 400 Midcap Indices, the S&P 600 Small Cap Indices and the S&P 1500 Supercomposite Indices. To get more information on these indices, or if you would like a list of the indices, call today to speak to one of our sales representatives at 877-DATA-999 or 949-542-4200.