Archive for the ‘api’ Category

new report shows widespread air quality data manipulation

Wednesday, June 3rd, 2009

Last fall, I wrote about Steven Andrews’ report demonstrating data biasing in Beijing’s air quality reporting.

The China Environment Forum has just published a second peer-reviewed report written by Mr. Andrews, this one detailing on a much larger scale the data manipulation present in air quality reporting across all of China. Mr. Andrews’ overall conclusion is as follows:

Publicizing the API and where cities rank in terms of air quality keeps the public informed of air quality and potential health threats. However, misleading data presentation and revised laws have prevented the API system from accurately communicating air quality problems to the public.

Mr. Andrews’ report focuses on several points, including:

1) SEPA’s loosening of ambient air quality standards in 2000 artificially inflated the number of cities in compliance:

In 2006, the annual average NO2 concentration in Beijing was 66μg/m3 and in Guangzhou it was 67μg/m3 (BJEPB, 2007; GZEPB, 2007). Under the 1996 standards, Beijing and Guangzhou would have exceeded the annual average NO2 standard in 2006 by 65 percent and 67 percent, respectively. Under the revised standards, both were in compliance (SEPA, 2000).

(Note: link to old standards here; link to new standards here; discussion and comparison to international standards here.)

2) The assignment of 100 as the cut-off point for a “Blue Sky Day,” coupled with rising pressure for cities to meet increasing numbers of annual Blue Sky Days, has encouraged the “bumping” of API data just above 100 to just below. Mr. Andrews writes:

Although the establishment of “Blue Sky” targets and well-publicized tallies of the number of days meeting the national standard has resulted in an easily understood metric for air quality, it strongly appears that pollution levels near this boundary are being manipulated in many major cities.

This was one of his core findings in his previous report on Beijing alone. In this report, Mr. Andrews expands the analysis to many more Chinese cities. The table below shows 30 cities which reported above 90% of all API values within the range 96-105 as 100 or below in a given year. (Statistically, one would expect around 50% of data points in this range to be on either side of 100.)
API Bias in Chinese Cities

3) The moving of monitoring stations within cities has artificially inflated air quality:

Although there has been a reported 10.8 percent decrease in Beijing’s annual average NO2 level between 1998 and 2006, the two stations in traffic areas have reported annual average NOx concentrations 100 percent higher than the non-traffic stations (BJEPB, 1998). This indicates that all the reported decrease in NO2 concentrations in Beijing from 1998-2006 may be due to the changing locations of monitoring stations.

4) Although not one of Mr. Andrews’ key conclusions, one of his smaller but fascinating findings is that, apparently, there was a mistake in the English-language version of MEP’s website regarding how to calculate API. This is something I never realized, but has apparently wreaked some havoc in international data analyses of air quality in China:

Although the calculation methodologies to go from API values to pollutant concentrations are straightforward, an error in the sample calculation on the MEP website has lead to misunderstandings of the true severity of pollution levels—inaccuracies that have been replicated in several leading reports on air pollution in China.

It seems that MEP has since removed the English explanation of API calculation, so I’m not sure what this error was; I’ll keep digging and see if I can find out more.

Thoughts

Similar to Mr. Andrews’ September 2008 report, this report is a scathing indictment and well-supported criticism of MEP’s air quality data quality and transparency. It highlights a number of issues that MEP – as well as city and provincial-level EPBs – should ideally work quickly to resolve in order to regain international trust and credibility.

april 2009 was beijing’s cleanest april in 10 years

Thursday, May 14th, 2009

I’m a couple of weeks late on this (still playing catch up), but I thought this recent story was worth noting.

On May 2nd, China Daily reported that “Beijing has ‘cleanest month’ in 9 years,” writing, “the city experienced its best month of air quality since 2000 with 23 blue-sky days in April.”

The excellent blog Daily Dose of Air Pollution highlighted that this claim is dubious, noting at least three other months (August and September, 2008, and August 2006) in which Beijing had higher numbers of Blue Sky Days and lower average APIs than April 2009.

I think I’ve identified the source of confusion. The official Beijing EPB announcement (Chinese), titled 4月本市空气质量创2000年以来同期最好水平, states specifically that April 2009 was the best April since 2000, not the best month overall. It seems the China Daily (or the Beijing EPB spokesperson during the press conference) misrepresented the real announcement.

Two follow up points:

1) While acknowledging progress, we should also simultaneously not get too excited over the “clean” air. The Beijing EPB claims that the average PM concentration during this month was 120 ug/m3 (主要污染物可吸入颗粒物月均浓度为每立方米0.12 毫克), which is still well above China’s national air quality target (100 ug/m3) and six times higher than the WHO recommended guideline (20 ug/m3). (Comparison of international standards in this post.) Although it is critically important in China to note progress, we must not wrap ourselves so much in cheers of success that we become blinded to the significant challenges and work still ahead.

2) The China Daily article describes in more detail than I have ever seen how the economic slowdown may have contributed to improved air quality, writing:

Besides strict environmental protection measures, experts think the global economic slowdown might be playing a positive role in environmental protection.

Zhu Tong, an environment professor with Peking University, told China Daily on Friday that heavy industry has decreased production in many polluting factories, which benefits the air.

“Most companies in heavy industry are seeing fewer orders. The output of the Shougang Group this year so far equals the same period during the Olympics,” said Wang Dawei, head of the air quality control division of the Beijing municipal environmental protection bureau.

In the first season this year, the added value for ferrous metal and chemistry manufacturing in the capital was 3.36 billion yuan ($490 million) and 1.85 billion yuan, a year-on-year decrease of 18.1 percent and 17.9 percent respectively.

If the improved air quality is indeed due to the slowdown, then this means there is even less cause for celebration.

slides from my talk wednesday night

Friday, April 10th, 2009

The other night I had a great time presenting at the Beijing Energy Network’s wonderfully titled BEER (Beijing Energy & Environment Roundtable) event. The title of my talk was “150 Million and Counting… Controlling the Energy and Environmental Impacts of China’s Vehicles.” I tried to have fun with it – I presented it at 9pm at a bar, after all – while touching on a range of topics and issues related to the transportation sector in China.

Although I fear the slides may seem a little too bare-bones without the context of my accompanying speech, I did get enough requests to distribute that I figured I might as well put them online:

I welcome any questions or comments either here or by e-mail at livefrombeijing at gmail dot com.

Lastly, apologies for the light posting recently; I have been slammed at work in preparation for a trip to the States this weekend. I’ll be gone for two weeks and will post while there if time permits, but no promises…

summary of beijing’s 2009 first quarter air quality

Wednesday, April 1st, 2009

beijing q1 09 api

Yesterday, Xinhua reported that Beijing achieved above an 80% “blue sky” rate in the first half of this year:

BEIJING, March 31 (Xinhua) — Beijing saw 73 “blue sky days”, 81.1 percent of the total, in the first three months of 2009, Beijing authorities said here on Tuesday.

The city experienced six more blue sky days than in the first quarter of last year, and 24.3 days more than the average of the last decade, said an official of the Beijing Municipal Environmental Protection Bureau.

Experts at the bureau said active cold airflows had helped particulate matter to disperse.

Efforts to reduce pollution from heating systems had paid off with January having the most blue sky days since 2000, said the official.

For those who prefer original sources, here is the notice from the Beijing EPB (in Chinese).

Let’s take a closer look at the data and examine what this means in terms of air quality.

First of all, as a quick introduction for new readers, China defines “Blue Sky Days” as days for which the Air Pollution Index (API) is 100 or below. For a detailed description of exactly what the API is, see this post. Past Beijing API data may be queried from MEP’s datacenter, but unfortunately only in Chinese.

For this post, I queried the data for 1/1/09 to 3/31/09, and ran some quick analyses to see what interesting things I could find.

Part 1: Checking Beijing’s EPB’s Numbers

The Beijing EPB claims “截至3月31日,今年累计73个达标天,占监测天数的81.1%。其中一级7天,二级66天,三级15天,四级1天,五级1天。” The second sentence says that in this time period there were 7 days of Grade 1 (API 0-50) air, 66 days of Grade 2 (API 51-100) air, 15 days of Grade 3 (API 101-200) air, and 1 day each at Grade 4 (API 201-300) and Grade 5 (API 301+).

However, by my count, there were 8 days of Grade 1 (one more than reported) 64 days of Grade 2 (two less than reported), then 15, 1, and 1 days of Grades 3, 4, and 5, respectively (identical to that reported). It seems pretty basic to me that you would want your publicly reported data summary to match your public database, so I can’t imagine what’s going on here. This is especially true because, in this case, the data indicates Beijing did better than they claimed.

The data for one day, 2/19/09, is missing from the database. If we assume that 2/19 was a Blue Sky Day, though, then at least we do indeed have 73 Blue Sky Days for the quarter.

Part 2: Converting to Pollutant Concentrations

Because API is a unitless index, in order to evaluate air quality we have to convert back to pollutant concentrations. This is a bit tricky, because the API is only reported according to whichever pollutant had the highest daily concentration, meaning that we do not have daily raw data for every pollutant. Still, we can make a rough approximation by assuming that PM10 is the limiting pollutant on all days. (Of the 89 data points, 72 (81%) were reported with PM10 highest, 9 were reported with SO2 highest, while 8 had no pollutant data because no pollutants are listed for Grade 1 air quality days.)

In any case, given the above assumption, this graph shows calculated daily PM10 concentrations for this quarter:

beijing q1 09 pm

These data yield a quarterly average PM10 concentration of 124 ug/m^3. This is very similar to what I calculated as last year’s annual average.

124 ug/m^3 is still well above China’s annual target (100 ug/m^3) and well well above the WHO’s ideal target for developed nations (20 ug/m^3).

Appendix

For those of you following along at home, here is an Excel formula for converting API to PM10 concentration (in this example, the API would be in cell E9):

=IF(E9<51,e9,if(e9<201,(e9-25)/0.5,if(e9<301,(e9+300)/1.429,if(e9<401,(e9+225)/1.25,e9+100))))

This is based on equations presented at the bottom of this post.

3-21-09 api missing

Sunday, March 22nd, 2009

3 21 09

I’m not sure why, but Saturday’s API was never reported.

In 2008, there were two days for which the API was not reported. There were no missing days in either 2007 or 2006.


Update 3/31/09: The API for 3/21 has been added to the database.

greenpeace china beijing api widget

Thursday, March 19th, 2009

Greenpeace China has generated a cool new Beijing API website widget that supposedly updates automatically every day:

Looks good!

For a general introduction of API, see this post.

dust storm blowing into beijing?

Wednesday, March 18th, 2009

Stay inside today; Beijing’s API currently stands at 268 (PM10 concentration 397 ug/m^3). This is considered Very Unhealthy. (More info here.)

I thought this was a dust storm blowing into Beijing, but now I can’t find any media references to one outside of this article from Sunday. (FYI, Sunday’s API peaked at 119).

This is the second day this year with an API above 200. The first was the day of the Mandarin Oriental fire.


Update 3/19/09: Check out this terrific NASA image from Sunday:

bohai_tmo_2009074

Again, this was Sunday, whose API was 119. Still no word on the cause of yesterday’s 268.

looking for data biasing in 2008 blue sky data

Thursday, March 12th, 2009

Last year, a report by consultant Steven Q. Andrews highlighted apparent data biasing in Beijing’s API data, particularly in the years 2006-2007. My take on his report (from last October) is here.

One of Mr. Andrews’ core findings is that there were statistical anomalies in the frequency of Beijing’s reported pollutant concentrations around the “Blue Sky Day” cut-off point. Specifically, there were too many reported values just below the cut-off, and too few just above, suggesting data manipulation to meet targets for number of Blue Sky Days. For reference, here is the excellent Figure 2 from Mr. Andrews’ report:

api inconsistency

Mr. Andrews’ graph shows frequency of reported values vs. PM10 concentration, for which the Blue Sky Day cut-off value is 150 ug/m3.

With 2008 behind us, I decided to take a look back to see if a similar phenomenon existed last year. After querying Beijing’s API data from MEP’s datacenter, I parsed the data for each year into frequency by units of 5. In other words, I counted the number of days with API from 0 to 5, 6 to 10, 11 to 15, etc., all the way to 500. Rather than use PM10 concentration, I looked directly at API, for which the Blue Sky Day cut-off is 100. The results for 2006, 2007, and 2008 are graphed here:

api frequency

Notes and Conclusions:

1) As expected, the 2006-2007 data biasing identified by Mr. Andrews is clearly visible here. In 2006, there were 50 days with API from 96-100, but only 2 days with API from 101-105. In 2007, there were 56 days with API from 96-100, and only 5 days with API from 101-105.

2) As for 2008, to be honest, I’m not sure how to interpret the data. Although there is clearly no dramatic spike in frequency of reported API values just below 100 (a good sign), there are only 3 days with API from 101-105. I do not know enough about statistics to know whether or not this is significant. (For reference, there were 16 days in the range 96-100, 9 days in the range 106-110, and 12 days 111-115). Anyone have any insights?

Related posts:
summary of beijing’s 2008 air quality
beijing meets 2008 blue sky day target
problems with the “blue sky day” metric

evidence of pollution spike from mandarin oriental fire

Wednesday, February 11th, 2009

I posted yesterday that the API of 307 would be classified by the US EPA as hazardous, and I wondered if it was related to the Mandarin Oriental fire. Today, both Xinhua and China Daily mentioned yesterday’s highest grade pollution amid stories about the fire. China Daily even hinted that human health impacts from the pollution spike should be counted in the total cost of the fire (though to be fair I’m not exactly sure what they mean by “sphere”):

The total cost of the disaster has not been calculated, the fire department said, but the environmental bureau in the capital recorded a maximum grade for air pollution due to Monday’s fireworks sphere.

Also today, we have a new data point implicating the fire as the key cause of yesterday’s asphyxiating pollution. Take a look at MEP’s graph of the last 30 days of API data:

fire api spike

We’ve seen some dramatically rapid air quality changes in the past here in Beijing, but I can’t remember ever seeing a spike like this that could be directly tied to a single event.

Lastly, I think it is interesting to note in the above graph that there is a slight rise, but no dramatic spike, in pollution just after Chinese New Year’s Eve (the impact of which would have shown up in the January 26th data point), despite the fact that the sky that night looked like this:

fireworks

Image in graph: https://docs.google.com/View?docid=dggh5mp6_0cmqqrrdb
Fireworks image: Boston.com’s The Big Picture


Update 3/11/09
I know this happened a month ago, but I feel I should note that a commenter below pointed out that the Beijing EPB issued an explanation for the 307 API pollution spike. The explanation did not reference the fire, only the fireworks:

燃放爆竹带来今年首个重度污染天
2009-02-10

受不利气象条件和元宵节燃放烟花爆竹的双重影响,今天北京出现了今年以来最严重的污染天气,空气质量五级,污染程度达到了重度污染。

据市环保监测中心的监测数据显示,由于风速小、大气层稳定,大气污染物扩散条件变差,9号白天我市已经出现了轻微污染;晚上19点开始,由于元宵节燃放烟花爆竹,污染物浓度迅速上升,并且长时间维持在较高水平。19点到凌晨4点一直在每立方米400微克以上,其中21点时浓度最高,达到每立方米810微克,早晨5点为399微克每立方米,开始降到每立方米400微克以下。但由于受到静风等不利气象条件的影响,污染物浓度下降速度缓慢。

通过多年不间断的控制大气污染措施,本市出现5级重度污染的天数已经屈指可数,上一次重度污染天气出现在去年的5月29号。

Rough translation:
Setting Off Fireworks Brings This Year’s First Heavy Pollution Day
2009-02-10

The dual impact of unfavorable meteorological conditions and the setting off of fireworks for the Lantern Festival led to Beijing’s first severe pollution day this year. The air quality grade was 5, heavily polluted.

According to data from the environmental monitoring center, due to low wind and stable atmosphere, the atmosphere dispersion conditions changed to unfavorable. During the day of the 9th, the air quality was lightly polluted, but starting from 7pm, due to the Lantern Festival fireworks, pollution increased quickly and remained high. From 7pm to 4am, the PM10 concentration was above 400 ug/m3; it was highest at 9pm, reaching 810 ug/m3. By 5am, the concentration was 399 ug/m3, and began to drop after that. But because of calm winds and unfavorable meteorological conditions, the drop in pollution concentration was slow.

Through the continuous implementation of air pollution control policies, this city has experienced fewer and fewer grade 5 pollution days. The last grade 5 pollution day was last year on 5/29.

warning: beijing air today is hazardous

Tuesday, February 10th, 2009

Beijing’s API today is at 307, corresponding to a PM10 concentration of 426 ug/m3. The US EPA calls this “Hazardous - Health warnings of emergency conditions. The entire population is more likely to be affected.” China, on the other hand, merely calls it 重污染, heavy pollution.

hazardous

I wonder if this is related to the Mandarin Oriental fire?

fire3

Image: The Beijinger
Another recommended link about the fire:
https://docs.google.com/View?docid=dggh5mp6_0cmqqrrdb

Much more info about China and US API designations in this related post:
12/9/08: stay inside today – beijing api at 246