Archive for the ‘api’ Category

beijing’s 2010 blue sky day target announced as 266

Wednesday, January 13th, 2010

A China Daily report today mentions Beijing’s 2010 Blue Sky Day target as 266. This is the first time I’ve seen the target referenced; I’m not sure how/when they set or publicize them. Perhaps they are in Beijing’s Five Year Plan. Does anyone know?

This China Daily report also mentions Beijing’s 2009 Blue Sky Day total, 285, representing the first time I’ve seen it mentioned in English-language domestic media (although Xinhua covered the accomplishment in Chinese on 1/1.)

Recent targets and totals are shown below. Note that the 2010 target is below the number of Blue Sky Days achieved in both 2008 and 2009.

blue sky day targets and totals

why number of blue sky days is a terrible metric

Sunday, January 3rd, 2010

In my post summarizing Beijing’s 2009 air quality, I noted that although the number of Blue Sky Days increased from 2008 to 2009, there was a very minimal reduction in annual average particulate matter concentration (the reduction has now been confirmed by the Beijing EPB to be just 0.8%). I then called the “number of Blue Sky Days” metric scientifically meaningless.

Here is a simple example showing clearly how and why the use of number of Blue Sky Days can distort the reality of air quality:

Suppose you take two sets of two days, and you wish to evaluate which period had better air quality. Here are the data you have:

Day 1 and Day 2: API* is 100 on both days.
Day 3: API is 101.
Day 4: API is 1.

Over the period Day 1-2, we have an average API of 100, and a total of 2 Blue Sky Days.
Over the period Day 3-4, we have an average API of 51, and a total of 1 Blue Sky Day.

If you are judging air quality by “number of Blue Sky Days,” you would conclude that the air quality was better on Days 1-2. On the other hand, if you are judging air quality by average concentration of pollutants people are exposed to, you would judge that Days 3-4 were much better. Actually, because the normalization from pollutant concentration to API is non-linear, in this example, the average pollution level of Days 1-2 could be up to three times higher than the pollution on Days 3-4, and yet this period is judged as being better, because it has more Blue Sky Days.

This is what I mean by a scientifically meaningless metric.

*Reminder: API (air pollution index) is a 0-500 normalized measure of the pollution people are exposed to; a Blue Sky Days is a day with API of 100 or below.

summary of beijing’s 2009 air quality

Thursday, December 31st, 2009

Happy New Year (a few hours early)!!! For my last post of the year, here is some overall analysis of Beijing’s air quality over the past 12 months.

First, the numbers. As usual, I’m working from air quality data downloaded from the Ministry of Environmental Protection’s datacenter. (Direct link to Beijing’s data is here.) There is a bug in the system that prevents the query function from working properly, but you can still scroll through the data and download it manually through copy and paste.

The datacenter reports 363 data points for 2009; 2/18 and 11/14 are mysteriously missing. Assuming those two days were Blue Sky Days yields a Blue Sky Day count of 285 and a calculated average PM10 concentration of 120 ug/m3.

For anyone who is new to this blog or who needs a refresher, a Blue Sky Day is a day with an Air Pollution Index (API) of 100 or below, which means that the air quality meets China’s National Grade II air quality standard – theoretically “excellent” or “good” air quality. China tallies annual number of Blue Sky Days as a consumer-friendly and easily-understood measure of air quality progress, although the metric is prone to gaming and scientifically meaningless.

PM10 means particulate matter of size 10 microns or smaller, also called “inhalable particles.” In 2009, PM10 was the reported dominant pollutant on 97% of days with an API above 50. (No dominant pollutant is reported on days with an API 50 or below.) I back-calculated PM10 from API using formulas and assumptions described here.

Trends of Blue Sky Days and PM10 concentration since 2000 are shown here:

beijing 2000-2009 air quality trends

The Good News: The good news isn’t really that good, but in the interest of balance here are some positive perspectives. First, Beijing’s count of 285 Blue Sky Days in 2009 is well above that of 2008 (274), and also well above the goal of 259. This will keep the trending up in official reporting and for boosting public morale; I imagine this fact will be spun as success / progress in the Chinese media in the days to come. I suppose another bit of good news is that Beijing has achieved what appears to be an improvement over 2008 without the boost of two months of extreme traffic restrictions and factory closures implemented last year during the Olympic period.

The Bad News: My calculated average PM10 concentration in Beijing for 2009 is 120.2 ug/m3, which less than a 1% reduction from 2008’s average. In other words, from the perspective of average particulate matter concentration, there was no improvement in air quality in Beijing from 2008 to 2009. This shows the danger of using “number of Blue Sky Days” as a metric for air quality evaluation – just because the number of Blue Sky Days increases doesn’t mean that air quality has improved.

Interestingly, as a thought experiment, let’s suppose that China’s air quality goal was that all cities should meet the Grade I air quality standard, meaning that a Blue Sky Day would have an API of 50 or below as opposed to an API of 100 or below. If we count these days (shown in the graph above in light blue), we actually see that 2009 was worse than 2008; 2008 had 62 Grade I days, while 2009 had only 47.

Most importantly, regardless of how you spin the data, Beijing’s 2009 level of inhalable particulate matter was still 20% higher than China’s own air quality standard and six times higher than the WHO’s recommended annual PM10 standard. What this means, of course, is that our work continues to be cut out for us moving into 2010 and beyond.

Related post:  Summary of Beijing’s 2008 air quality

mep website redesign and datacenter problems

Monday, November 9th, 2009

The Ministry of Environmental Protection unveiled a new Chinese website about a week or so ago.  The English version appears unchanged for now. This news would probably not be blog-worthy except that the datacenter now seems a little buggy, causing two problems:

1) The Greenpeace Beijing API widget that I have on the top right of this blog isn’t fetching daily data anymore. (I’ve been in touch with the developers and I know they are working on it.)

2) The datacenter’s query function for past air quality data doesn’t quite work right; data queries return past data different from the date range entered. I hope and presume this will be fixed soon.

After the redesign, the presentation of API on the MEP homepage is now done in the datacenter analysis format, as opposed to the old list format (still used on the English site).

new mep page

air in beijing hazardous again

Friday, November 6th, 2009

11 6 09 twitter

The pollution in Beijing right now is bad. Really bad. So bad that you can feel the heaviness, the denseness of the air as you breathe it in. It is stifling.

So how bad it is? Well, the closest thing we’ve got to real-time data, the US Embassy’s BeijingAir Twitter feed, confirms our worst fears; it has been reporting hazardous air for over 24 hours now, with over half of the hourly data points maxed out at an AQI of 500. MEP’s air quality data released this afternoon, on the other hand, shows an API of just 186, “lightly polluted” (”轻度污染”).

I wrote a lot about this discrepancy back in June when Beijing experienced a similar pollution spike. (See these posts: 6/18: air in Beijing is hazardous; 6/19: more info on Beijing’s 6/18 air quality; 6/22: US Embassy outed as source of BeijingAir Twitter feed.) In June, I posited that the hazardous pollution was not reflected in the MEP data because the MEP data is a 24-hour average, while the pollution events then only lasted for a few hours each. In this case, though, BeijingAir has been continuously reporting hazardous air since around 4pm yesterday, so it’s hard to imagine how the MEP data is still so “low.” (Low is in quotation marks because an API of 186 still represents very polluted air.)

I’m afraid I don’t have time to post more right now; I’ll try to get some graphs up this weekend. In the meantime, avoid strenuous exercise and stay inside if you can. With the Embassy-reported AQI maxed out at 500, the air is, in theory, worse than hazardous:

11 6 09 aqi

translations from beijing’s 2008 state of the environment report

Thursday, October 29th, 2009

state of env report 1

Beijing’s annual State of the Environment Report was released in June of this year. Even though it came out a few months ago, I haven’t written about it yet, so I want to post the link here along with some comments and translations of key figures.

2008年北京市环境状况公报 (Chinese only)
Past reports available here: http://www.bjepb.gov.cn/bjhb/tabid/375/Default.aspx

About half of the 31-page report is devoted to air quality, with primary focus on the measures taken to control air quality during the Olympics and Paralympics. But first I’d like to show the annual data, which is presented in the standard forms of trends of annual average concentrations of pollutants (decreasing) and numbers of blue sky days (increasing):

state of env report 2

state of env report 3

Overall, the short conclusion on annual air quality is given as follows:

state of env report 9

Translation:

Annual Air Quality
In 2008, there were 274 days at or above Grade II air quality, 74.9% of the year. This was 89 more days and 24% higher than in 2001. Atmospheric concentrations of SO2, CO, NO2, and PM10 were 0.036, 1.4, 0.049, and0.122 mg/m3, respectively, representing reductions of 43.8%, 46.2%, 30.9%, and 26.1%, respectively, from 2001. Concentrations of SO2, CO, and NO2 met the national standard. PM10 concentration exceeded the national standard by 22%.

According to current government monitoring and standards, PM10 is the biggest pollutant of concern presently in Beijing. In January of this year, I estimated 2008 annual PM10 at 0.123 mg/m3 (close enough to the actual reported figured of 0.122), noting that this is over six times higher than the WHO’s recommended ideal annual PM10 standard of 0.020 mg/m3.

As for the Olympics and Paralympics, Beijing’s State of the Environment Report presents individual graphs for Air Pollution Index for both periods, as if to prove that Beijing met its commitment to keep the API below 101 throughout the Games:

state of env report 6

state of env report 7

Related posts: final day of temporary air quality measures, end of the games.

Pollution concentration data are also shown, along with comparative reductions to 2007:

state of env report 4

state of env report 5

These numbers all support widespread claims that pollution during the Games was reduced by around 50% from 2007. Conclusion:

state of env report 8

Translation:

Olympic Period Air Quality
Beijing’s air quality met the standard every day during the Olympics and Paralympics. The atmospheric concentrations of main pollutants were reduced by about 50% from last year. Daily concentrations of SO2, CO, and NO2 met world standards for developed cities, and the daily concentration of PM10 met the WHO Stage 3 guidelines, meeting Beijing’s promises by far.

I’ll be investigating that last sentence in a separate post.

Top image source: Page 1 of the report. All figures and tables copied from Beijing’s 2008 State of the Environment Report and then translated.

new york times on beijing’s air quality

Thursday, October 29th, 2009

About two weeks ago, the New York Times published an excellent article on Beijing’s air quality. I feel honored that the online version of the article links to this blog, but that’s not the only reason I think it’s a great piece. The title of the article, “Beijing’s Air Is Cleaner, but Far From Clean,” is itself a succinct and accurate portrayal of the current state of the air here, and is a strong prelude to the article’s comprehensive, balanced view of both the successes and challenges faced by Beijing.

The article’s author, Michael Wines, portrays Beijing’s air quality situation from four different angles / contexts, all of which I think are important and valid for anyone wishing to understand the complexity of the air pollution issue. Here, I will describe and expand upon these four contexts.

1) Both the Beijing government and local researchers assert that air quality has steadily improved over the past decade. In other words, we’re making progress:

Through September, the government counted 221 days in which the 0-to-500 pollution index — the lower the number, the better — was below 101. It was the greatest number of “blue-sky days,” as the city calls them, since daily measurements were first published in 1998.

At the same time, the city has recorded only 2 days with dangerously high air pollution. That is the lowest number in a decade, and fully 17 days fewer than were logged in the same period in 2000.

“For those of us who have been monitoring air pollutants for about 10 years, we see a clear reduction in pollution,” Zhu Tong, a professor and air pollution scientist at Peking University’s College of Environmental Sciences and Engineering, said in an interview.

2) Valid concerns exist over the accuracy and validity of the government data. In other words, be careful not to base all of your analysis on official statistics:

Outside experts caution that the city’s measurements are not just imprecise — they do not measure the tiniest particulates that are most damaging to lungs, for instance — but potentially misleading.

3) Although it appears that we are making progress, even the government’s official numbers show current air quality that is objectively still quite poor. In other words, we have a lot of work left to do:

And Beijing’s air remains far from pristine by any measure. The average concentration of particulates in city air during 2008, for example, was six times the ideal standard recommended by the World Health Organization. Indeed, Beijing has yet to meet the W.H.O.’s interim air standards for developing countries — or even the less stringent standards posted by China’s national government.

(Data supporting both of these claims may be found in these two posts from this blog: comparing international standards and summary of Beijing’s 2008 air quality.)

4) The improvements so far have been the result of impressive, massive, widespread programs and policies targeting air quality improvement; indeed such programs have been required for the government to have any chance in winning the “race” against the booming growth. In other words, although the government should be doing more, we recognize and applaud what they are already doing:

In the past decade, in fact, authorities have moved against air pollution problems with a tenacity that some environmentalists in developed nations, pitted against industry lobbyists and balky political machinery, can only envy.

The piece concludes by describing many such programs, including strict emission standards, fuel quality standards, introduction of alternative fuel buses, elimination of coal-fired burners, and more.

Rarely have I seen an article which succeeds at presenting all four perspectives. My general sense is that the Western media tends to focus largely on (2) and (3) (the data is suspect, air quality is still poor), whereas the Chinese media highlights (1) and (4) (we’re making progress, we have many successful programs in place). And yet, honest and comprehensive dialogue on solutions to Beijing’s air quality problem requires considering all four angles.

Lastly, my only objection to the article is the comparison of China’s scrappage program for high-emitting vehicles with the US’ Cash for Clunkers program. This is a little misleading, because the US program targets fuel economy while China’s program targets air pollutant emissions, but this is a subject for another post.

Disclosure: The author, Michael Wines, interviewed me for background information before writing the article.

api data anomaly during olympics

Friday, September 18th, 2009

While preparing some analysis comparing this summer with last, I discovered something strange. The Ministry of Environmental Protection’s datacenter now lists two Air Pollution Index values for 8/16/08:

8 16 08
This is very unusual for several reasons:

1) There should only be one API value for each day. Although I have occasionally noticed data points missing, I’ve never seen two different data points for the same day.

2) This double data point did not appear until months after the Olympics were over. I know this both because I was tracking the Olympic air quality data on a day-by-day basis last August, and also because I downloaded datasets earlier this year that did not include the double point.

3) There is a rather large discrepancy between the existing, reported 8/16/08 API, 23, and the new, second data point for the same day, 84. Given that 8/16/08 was right in the middle of the Olympics, if the second data point is indeed correct, it has implications for the overall air quality assessment of the Games.

My guess and hope is that it’s just some strange glitch in the data reporting system. I’ll continue to monitor it to see if anything changes.

beijing epb admits blue sky data frequency abnormality

Sunday, August 23rd, 2009

Although a little late, I do want to highlight a rather unexpected comment from the Beijing EPB at a press conference in early July. As reported in the Time blog:

[The Beijing EPB] spent much of their press conference Friday responding to doubts about the veracity of their numbers. Last year an American environmental consultant pointed out that the official numbers showed a disproportionately high number of days that fell just within the official target for a “blue sky day.” Yu Jianhua, head of Beijing’s environmental monitoring center, said the local government used emergency measures such as closing down construction sites on days when it expected pollution would exceed targets. That led to the high number of days just under the cutoff, Yu said.

This is the first time I’ve seen the Beijing EPB both directly acknowledge that a statistical anomaly in the number of blue sky days exists and provide a concrete reason why. The statistical anomaly I’m referring to can be be seen in this figure, from a 2008 report by environmental consultant Steven Andrews. The graph appears to show data biasing right around the “blue sky day” cut-off point (in this case, a PM10 concentration of 150 ug/m3).

api inconsistency
It has been interesting to watch the evolving responses from the EPB to Mr. Andrews’ discovery – from official data – of what appears to be blatant data massaging to achieve an artificial result. In February 2008, Beijing EPB spokesperson Du Shaozhong infamously responded to criticisms of data manipulation with, “this phenomenon does not exist. ” By July 2008, in a press conference before the Olympics, the Beijing EPB response had shifted to the bewildering  “some convenience maybe taken in very adverse situations to improve the air quality within 9 square kilometers so that the API can remain at or below 100.” (The WSJ reported on this response the following day.)

Now, however, we have a definitive claim from the Beijing EPB that the preponderance of API values just below the blue sky day cut-off point resulted from emergency measures taken on days which were predicted to be dangerously close to the limit.

As is so often the case in China, this reponse only makes me ask more questions. Questions like:

- Why didn’t the Beijing EPB admit this last year, as soon as Mr. Andrews’ report came out?
- How are such accurate predictions made? Can we have more details on the program, like which factories or construction sites were closed?
- Why do this at all? Is there really a critical human health benefit to a 99 API day as opposed to a 101 day? (Answer: not really, since where we need to be is below 20.)
- Why were these emergency shut-downs conducted from 2003-2007, but not in 2008?
- Was this program really conducted in dozens of cities around China?

I can keep asking questions of course, but I think it’s time now to invoke Occam’s Razor in support of the more obvious conclusion…

More info in related posts on this blog:
October 2008: problems with the blue sky day metric
March 2009:  looking for biasing in 2008 blue sky day data
June 2009: new report shows widespread air quality data manipulation

Final note: I am playing catch up on posting after falling behind the last few weeks with the site redesign and work distractions. Apologies in advance that some of the commentary will be on “old” (e.g., from July) news.

xinhua’s international herald leader on the us embassy air quality monitor

Wednesday, July 1st, 2009

This post contains some translation and commentary on the recent story in Xinhua’s International Herald Leader (国际先驱导报) on the US Embassy’s independent air quality monitor. The story was reprinted in the Hong Kong-based Phoenix magazine (凤凰) here.

First, title: I think it’s noteworthy that, although the stories in the two Chinese-language sources are the same, the title in the IHL is 美国驻华使馆自建空气监测站 (”US Embassy Independently Sets Up Air Quality Monitoring Station”), whereas that in the Hong Kong-based Phoenix is more provocative: 美驻华使馆发布自测北京空气指数 与气象局数据分歧 (”US Embassy in China Issues Independently-Tested Beijing Air Quality Index – Different from the Meteorological Bureau’s Data”).

And now content: The IHT begins with similar content as the China Daily story: information about the Embassy’s twitter feed and concerns about discrepancies with the officially-reported data, followed by assurance from an Embassy official that the numbers are not directly comparable. As in the China Daily, the IHT story then describes the health impact differences between PM2.5 and PM10.

Following this, though, the IHT diverges from the China Daily story. A section titled 建监测站应循通行规则 (Regulations Should Be Followed When Setting Up Monitoring Stations) questions whether the US Embassy’s data is even valid:

中国气象科学院院长张人禾向《国际先驱导报》介绍道,设立空气监测的站点需要在整个区域具备代表性,且50米内不能有污染源,否则将严重影响监测结果。…

因此事实上,美国驻华使馆自建的空气监测站并不符合通行的国际规范。

According to Zhang Renhe, Director of the Chinese Academy of Meteorological Sciences, an air quality monitor must be installed in a location representative of of the entire city; moreover, there should be no pollution sources within 50m that could strongly impact the monitoring results…

In fact, the US embassy’s independent air quality monitoring station is not in accordance with international criteria.

于去年8月建成的美国新使馆区坐落在北京CBD商业圈、背靠亮马河的黄金地段,它毗邻女人街等商业场所,平日里交通繁忙、人群熙攘,这些因素都很可能对监测站的数据收录产生影响。

记者28日在美国使馆的所在地更是发现,其对面原有的星吧路酒吧餐饮街已被大规模拆除,工地上一片狼藉,灰尘扑面。而它南面的其他使馆区仍在建设中…

Completed last August, the US Embassy is located in the CBD business area, near the prime locations around Liangmahe. It is near the Ladies’ Market and other commercial areas with high weekday traffic and bustling crowds; these factors all possibly influence the data recorded by the monitor.

On the 28th, this reporter visited the location of the US Embassy and discovered the large scale demolition of Super Bar Street across the street; much dust blew out from the messy construction site. Additionally, on the south side was another embassy area under construction…

Although the article does not question the accuracy of the Embassy’s data, it clearly indicates that the Embassy’s data is disproportionately bad because of poor and non-standard monitor placement. This possibility was not raised in the China Daily piece.

(Side note for future investigation: I think perhaps the US Embassy monitor is at the old embassy near Ritan park, not on site at the new location.)

Moving on, the article briefly mentions Steven Andrews’ criticisms of Beijing’s air quality management, that Beijing’s air quality monitors have been selectively placed in areas of low pollution to yield better overall averages and that officials artificially inflated the statistics on number of blue sky days. Although it is noteworthy that the article mentions Mr. Andrews at all (I haven’t seen his analysis directly covered in the Chinese media before), the article immediately quotes experts supposedly refuting his claims:

“蓝天数量有目共睹,如何造假?”周凌唏评价到。在她眼中,为了北京奥运会顺利召开,在北京民众的努力下,的确明显提高了首都空气质量,“蓝天多,说明大气透明情况好,在一定程度上说明内含的污染物就少。”

而张人禾对“监测站多分布在低污染区”的质疑感到“不解”,“别忘了,空气也是流动的。”他说。

“Everyone can see the number of blue sky days, so how can they be faked?” [an analyst with the Chinese Academy of Meteorology] commented. In her eyes, to ensure a smooth Olympics in Beijing, through the effort of all of Beijing’s citizens, there was indeed an obvious improvement to Beijing’s air quality. “More blue sky days means a more transparent atmosphere, which means to some extent less pollutants.”

In addition, Zhang Renhe felt he “couldn’t understand” the suspicion that “some of the monitoring stations are located in low pollution areas.” “Don’t forget, air is also flowing,” he said.

I can’t quite understand what either of these experts meant, which may or may not be due to the language barrier. Despite that, though, it doesn’t seem as if either expert addressed Mr. Andrews’ concerns directly, so it doesn’t make sense to me that the article would raise them at all.

Finally, the article quotes an anonymous Beijing EPB official saying that the Embassy is breaking no laws by independently monitoring air quality, before closing with this quote:

“不过,与此相关的我国《环境监测条例》已被纳入国务院今年的立法计划中,有望今年内通过。”他说。

“However, the relevant “Environmental Monitoring Regulations” have already been placed into the State Council’s legislation plan for this year; there is hope they will be passed this year,” [the Beijing EPB official] said.

In other words, although there is nothing wrong with Beijing’s current monitoring system, the Beijing EPB still hopes that it will be improved this year with new, unspecified State Council legislation.

Although I was initially encouraged by yesterday’s direct and somewhat challenging China Daily piece, this Chinese-language Xinhua piece is more of what I would expect from China’s state media: convoluted logic and fact-twisting that attempts to shape reality to fit the government’s agenda as opposed to strong investigative reporting attempting to uncover the truth.