Archive for the ‘api’ Category

beijing epb admits blue sky data frequency abnormality

Sunday, August 23rd, 2009

Although a little late, I do want to highlight a rather unexpected comment from the Beijing EPB at a press conference in early July. As reported in the Time blog:

[The Beijing EPB] spent much of their press conference Friday responding to doubts about the veracity of their numbers. Last year an American environmental consultant pointed out that the official numbers showed a disproportionately high number of days that fell just within the official target for a “blue sky day.” Yu Jianhua, head of Beijing’s environmental monitoring center, said the local government used emergency measures such as closing down construction sites on days when it expected pollution would exceed targets. That led to the high number of days just under the cutoff, Yu said.

This is the first time I’ve seen the Beijing EPB both directly acknowledge that a statistical anomaly in the number of blue sky days exists and provide a concrete reason why. The statistical anomaly I’m referring to can be be seen in this figure, from a 2008 report by environmental consultant Steven Andrews. The graph appears to show data biasing right around the “blue sky day” cut-off point (in this case, a PM10 concentration of 150 ug/m3).

api inconsistency
It has been interesting to watch the evolving responses from the EPB to Mr. Andrews’ discovery – from official data – of what appears to be blatant data massaging to achieve an artificial result. In February 2008, Beijing EPB spokesperson Du Shaozhong infamously responded to criticisms of data manipulation with, “this phenomenon does not exist. ” By July 2008, in a press conference before the Olympics, the Beijing EPB response had shifted to the bewildering  “some convenience maybe taken in very adverse situations to improve the air quality within 9 square kilometers so that the API can remain at or below 100.” (The WSJ reported on this response the following day.)

Now, however, we have a definitive claim from the Beijing EPB that the preponderance of API values just below the blue sky day cut-off point resulted from emergency measures taken on days which were predicted to be dangerously close to the limit.

As is so often the case in China, this reponse only makes me ask more questions. Questions like:

- Why didn’t the Beijing EPB admit this last year, as soon as Mr. Andrews’ report came out?
- How are such accurate predictions made? Can we have more details on the program, like which factories or construction sites were closed?
- Why do this at all? Is there really a critical human health benefit to a 99 API day as opposed to a 101 day? (Answer: not really, since where we need to be is below 20.)
- Why were these emergency shut-downs conducted from 2003-2007, but not in 2008?
- Was this program really conducted in dozens of cities around China?

I can keep asking questions of course, but I think it’s time now to invoke Occam’s Razor in support of the more obvious conclusion…

More info in related posts on this blog:
October 2008: problems with the blue sky day metric
March 2009:  looking for biasing in 2008 blue sky day data
June 2009: new report shows widespread air quality data manipulation

Final note: I am playing catch up on posting after falling behind the last few weeks with the site redesign and work distractions. Apologies in advance that some of the commentary will be on “old” (e.g., from July) news.

xinhua’s international herald leader on the us embassy air quality monitor

Wednesday, July 1st, 2009

This post contains some translation and commentary on the recent story in Xinhua’s International Herald Leader (国际先驱导报) on the US Embassy’s independent air quality monitor. The story was reprinted in the Hong Kong-based Phoenix magazine (凤凰) here.

First, title: I think it’s noteworthy that, although the stories in the two Chinese-language sources are the same, the title in the IHL is 美国驻华使馆自建空气监测站 (”US Embassy Independently Sets Up Air Quality Monitoring Station”), whereas that in the Hong Kong-based Phoenix is more provocative: 美驻华使馆发布自测北京空气指数 与气象局数据分歧 (”US Embassy in China Issues Independently-Tested Beijing Air Quality Index – Different from the Meteorological Bureau’s Data”).

And now content: The IHT begins with similar content as the China Daily story: information about the Embassy’s twitter feed and concerns about discrepancies with the officially-reported data, followed by assurance from an Embassy official that the numbers are not directly comparable. As in the China Daily, the IHT story then describes the health impact differences between PM2.5 and PM10.

Following this, though, the IHT diverges from the China Daily story. A section titled 建监测站应循通行规则 (Regulations Should Be Followed When Setting Up Monitoring Stations) questions whether the US Embassy’s data is even valid:

中国气象科学院院长张人禾向《国际先驱导报》介绍道,设立空气监测的站点需要在整个区域具备代表性,且50米内不能有污染源,否则将严重影响监测结果。…

因此事实上,美国驻华使馆自建的空气监测站并不符合通行的国际规范。

According to Zhang Renhe, Director of the Chinese Academy of Meteorological Sciences, an air quality monitor must be installed in a location representative of of the entire city; moreover, there should be no pollution sources within 50m that could strongly impact the monitoring results…

In fact, the US embassy’s independent air quality monitoring station is not in accordance with international criteria.

于去年8月建成的美国新使馆区坐落在北京CBD商业圈、背靠亮马河的黄金地段,它毗邻女人街等商业场所,平日里交通繁忙、人群熙攘,这些因素都很可能对监测站的数据收录产生影响。

记者28日在美国使馆的所在地更是发现,其对面原有的星吧路酒吧餐饮街已被大规模拆除,工地上一片狼藉,灰尘扑面。而它南面的其他使馆区仍在建设中…

Completed last August, the US Embassy is located in the CBD business area, near the prime locations around Liangmahe. It is near the Ladies’ Market and other commercial areas with high weekday traffic and bustling crowds; these factors all possibly influence the data recorded by the monitor.

On the 28th, this reporter visited the location of the US Embassy and discovered the large scale demolition of Super Bar Street across the street; much dust blew out from the messy construction site. Additionally, on the south side was another embassy area under construction…

Although the article does not question the accuracy of the Embassy’s data, it clearly indicates that the Embassy’s data is disproportionately bad because of poor and non-standard monitor placement. This possibility was not raised in the China Daily piece.

(Side note for future investigation: I think perhaps the US Embassy monitor is at the old embassy near Ritan park, not on site at the new location.)

Moving on, the article briefly mentions Steven Andrews’ criticisms of Beijing’s air quality management, that Beijing’s air quality monitors have been selectively placed in areas of low pollution to yield better overall averages and that officials artificially inflated the statistics on number of blue sky days. Although it is noteworthy that the article mentions Mr. Andrews at all (I haven’t seen his analysis directly covered in the Chinese media before), the article immediately quotes experts supposedly refuting his claims:

“蓝天数量有目共睹,如何造假?”周凌唏评价到。在她眼中,为了北京奥运会顺利召开,在北京民众的努力下,的确明显提高了首都空气质量,“蓝天多,说明大气透明情况好,在一定程度上说明内含的污染物就少。”

而张人禾对“监测站多分布在低污染区”的质疑感到“不解”,“别忘了,空气也是流动的。”他说。

“Everyone can see the number of blue sky days, so how can they be faked?” [an analyst with the Chinese Academy of Meteorology] commented. In her eyes, to ensure a smooth Olympics in Beijing, through the effort of all of Beijing’s citizens, there was indeed an obvious improvement to Beijing’s air quality. “More blue sky days means a more transparent atmosphere, which means to some extent less pollutants.”

In addition, Zhang Renhe felt he “couldn’t understand” the suspicion that “some of the monitoring stations are located in low pollution areas.” “Don’t forget, air is also flowing,” he said.

I can’t quite understand what either of these experts meant, which may or may not be due to the language barrier. Despite that, though, it doesn’t seem as if either expert addressed Mr. Andrews’ concerns directly, so it doesn’t make sense to me that the article would raise them at all.

Finally, the article quotes an anonymous Beijing EPB official saying that the Embassy is breaking no laws by independently monitoring air quality, before closing with this quote:

“不过,与此相关的我国《环境监测条例》已被纳入国务院今年的立法计划中,有望今年内通过。”他说。

“However, the relevant “Environmental Monitoring Regulations” have already been placed into the State Council’s legislation plan for this year; there is hope they will be passed this year,” [the Beijing EPB official] said.

In other words, although there is nothing wrong with Beijing’s current monitoring system, the Beijing EPB still hopes that it will be improved this year with new, unspecified State Council legislation.

Although I was initially encouraged by yesterday’s direct and somewhat challenging China Daily piece, this Chinese-language Xinhua piece is more of what I would expect from China’s state media: convoluted logic and fact-twisting that attempts to shape reality to fit the government’s agenda as opposed to strong investigative reporting attempting to uncover the truth.

china daily features online survey on beijing’s air quality monitoring

Wednesday, July 1st, 2009

When I wrote yesterday about the China Daily article on the discrepancies between China’s officially reported air quality data and the US Embassy’s BeijingAir Twitter feed, I didn’t realize that the China Daily story appeared on the site’s home page along with an incredibly direct web survey:

china daily survey 1

Web surveys are, of course, not scientific or reliable at all, but nonetheless here’s a screen capture of the results as of around 11am this morning:

china daily survey 2
It’s difficult to imagine such a critical survey happening on a Chinese-language state media site, but I will keep an eye out for anything comparable.

Lastly, for the record, there are several mistakes in the China Daily story that I should point out. Three are in this sentence alone: “A blue-sky day is when the city’s air pollution index, the level of five airborne pollutants, falls below 100, indicating that no health implications exist.”

First, MEP makes no claim that blue-sky days have “no health implications,” only that those days have the poorly-defined “excellent” or “good” air quality. Air quality on blue-sky days can certainly have negative health implications, especially for sensitive populations in the short term and for everyone in the long term. What MEP calls “good,” the US EPA calls “moderate,” saying, “Air quality is acceptable; however, for some pollutants there may be a moderate health concern for a very small number of people who are unusually sensitive to air pollution.”

Second, the air pollution index only covers three pollutants, not five. I’m not sure how China Daily made this mistake, because later in the article they describe the number correctly (”the current evaluation system uses only three indices: Sulfur dioxide, carbon dioxide and PM 10s”), although they get the pollutants wrong. (The three are sulfur dioxide, nitrogen dioxide, and PM10.)

Third, this is minor, but a blue-sky day is a day in which the API is technically 100 or below, not below 100.

china daily questions official air quality statistics

Tuesday, June 30th, 2009

The story about the US Embassy’s BeijingAir air quality twitter feed (whose subscribers now top 2,200) was picked up by the China Daily today. Perhaps surprisingly, the China Daily article uses the embassy data to question whether the Beijing EPB’s official data present an accurate view of Beijing’s air quality:

China Daily calculated that only five days were above “moderate” level in May on BeijingAir, but the local environment bureau said on its website on May 31 that the capital’s air quality was the clearest during the same period since 2000, with 25 blue-sky days.

However, the article goes on to quote both an embassy official and a Chinese expert cautioning that the single station is not representative of Beijing’s overall air quality:

“This is a single site,” [US Embassy spokesperson Susan] Stevenson said. “It cannot be used to measure the air quality across the city. They can’t be compared.”

“The embassy is located in the central business district, which has heavy traffic, and its monitoring station cannot represent the overall picture,” Zhu Tong, an environment professor with Peking University, said yesterday.

Signficantly, the China Daily article does not question whether or not the embassy data is valid for that area, only whether the single data point can be extrapolated out to the rest of the city. To me, this is an important distinction, because collective agreement that the embassy data is valid should ultimately help pressure the Beijing EPB to set up their own real-time PM2.5 monitors across the city (which is the direction we should be driving in).

The article closes with this comment, noteworthy for its open questioning of air quality data. Such questioning is rare in the Chinese state-run media:

Some residents expressed doubts about the official air quality data.

Wang Haiyan, a 36-year-old Beijinger living in Chaoyang district, said that even under a different measuring system, there is still no reason to get such different air quality results.

Within Chinese-language media, Xinhua’s International Herald Leader (国际先驱导报) published a story two days ago (also printed with a different title in the Hong Kong-based Phoenix magazine (凤凰) here) on the US Embassy’s air quality reporting; the story included this photo that is apparently of the monitor:

xin_470606291116348146534

As one would expect, the tone of the Xinhua piece is much more defensive of the official data and critical of the embassy. Unfortunately, I don’t have time now to write more on this; stay tuned tomorrow for some translation and commentary.

beijing epb responds to us embassy air quality twitter feed

Friday, June 26th, 2009

A friend tipped me to an article in today’s South China Morning Post (registration required) on the US Embassy’s Beijing air quality twitter feed.

Although the majority of the content of the SCMP piece echoes that published last week in other sources, there is one important bit of new information:

Du Shaozhong, deputy director of Beijing’s environment protection bureau, was unaware of the US embassy’s move, but said: “Any attempts to question our figures with a single monitoring station are not authoritative enough.”

This could get bad. Let’s see if it gets picked up by other media and begins to escalate.

FYI, the twitter feed has around 1600 followers now (up from 300 just a week ago).>

us embassy outed as source of beijingair twitter feed

Monday, June 22nd, 2009

On Friday of last week, Time’s Austin Ramzy outed the BeijingAir twitter feed as being set up and administered by the US Embassy:

The U.S. Embassy operates a single station in eastern Beijing that records levels of PM2.5, fine particles considered particularly dangerous to human health…

While the U.S. doesn’t actively promote the information, it has slowly been getting more attention from Beijing residents concerned about the city’s air quality. “The U.S. Embassy has an air quality monitor to measure PM 2.5 particulates on the Embassy compound as an indication of air quality,” says Susan Stevenson, a State Department spokesperson. “This monitor is a resource for the health of the Embassy community.” She cautions that citywide analyses cannot be done from a single machine, but because the embassy has the data available, it makes it available to others.

Before the story came out, there were around 300 followers of the feed; now there are more than 1,100 and rising fast.

Beijing experienced some bizarre and extremely rapid changes in air quality on Thursday and Friday of last week. On both days, BeijingAir reported maximum pollution levels (hazardous air, AQI = 500) for brief periods in the afternoon. However, hazardous air was never reported by either the Beijing EPB or MEP, presumably because the pollution spikes on both days were short-lived enough that the overall 24-hour averages evened out as just “light pollution.” (More discussion here and here.)

Here’s a graph showing BeijingAir and MEP-reported air quality over the period noon Tuesday to midnight Sunday last week. Because MEP has no system for real-time reporting, the extreme pollution spikes on the 18th and 19th were never truly reflected in MEP’s air quality data:

6 18 weekend beijingair with mep data

The events of last week highlight the need for real-time reporting of air quality in Beijing. I wonder if the growing popularity of the embassy’s twitter feed will ratchet up pressure on MEP / Beijing EPB to implement such a system here in Beijing.

Final note: the speed of the drop in pollution levels during the afternoon of 6/19 was stunning. With no technical background in air quality modeling or meteorology, I have no idea how this is even possible:

6 19 afternoon

more info on beijing’s 6/18 air quality

Friday, June 19th, 2009

Yesterday, beginning at around 10am, there was a sudden and dramatic spike of air pollution here in Beijing. I blogged about it here, and it was covered in the Guardian and Time’s blog, with surely more to come. The pollution spike lasted until close to midnight yesterday. I presume yesterday evening’s rain is what ended the event, although it should be noted that, as I write this, the pollution seems to be creeping up again.

Yesterday’s pollution spike may be seen very clearly in the BeijingAir tweeted hourly data over the past couple of days. Shown here are PM2.5 concentration and AQI:

6 18 beijingair data

Note the missing data points in the afternoon of 6/18 and the maxing out of AQI at 500 during the same period.

Despite yesterday afternoon’s stifling pollution, MEP’s officially reported Air Pollution Index (API) for 6/18 was just 104 – indicating “slightly polluted” air quality. The reason, as noted yesterday, is that MEP’s API does not report real-time air quality; it is an average air quality indicator covering noon to noon beginning from the previous day. Therefore, we wouldn’t expect the afternoon pollution spike of 6/18 to show up until the 6/19 reported data point.

However, the API for 6/19, which was released a few minutes ago, is just 159 (”lightly polluted”), which is significantly lower than I would have expected.


Edit: An API of 159 – corresponding to a PM10 concentration of 266 ug/m^3 – still represents awful air quality, despite my use of the word “just.” China’s daily/yearly goals for PM10 are 150/100 ug/m^3, while the WHO’s recommended targets are 50/20 ug/m^3.

The following graph shows MEP PM10 and API data, as well as BeijingAir PM2.5 and AQI data, for the last few days. Note that the absolute magnitudes of the BeijingAir and MEP data are not directly comparable due to slightly different measurements and scales. But the trending should be the same:

6 18 beijingair with mep data

Although the MEP data increases beginning noon on 6/18, as one would expect, the increase just doesn’t seem commensurate with the seemingly atrocious pollution yesterday afternoon and evening.

What’s going on here? Well, there are a few options, but I’m not sure which one is correct:

First – it’s theoretically possible that, because MEP averages over 24 hours over a number of different monitoring stations, the overnight reduction combined with lower pollution outside the city center brought the overall average down. Here is the daily individual monitor data from the Beijing EPB:

beijing epb

There are certainly some high readings, e.g. Dongsi, but there are also some that report only half as bad (Pinggu, Miyun).

Second – it is possible that the BeijingAir monitor is either not calibrated correctly or suffered some unusual activity (e.g. a car idling for an extended period outside the monitor). This seems unlikely.

Third – I’m not sure if this is correct or not, but it may be possible that the pollution event was largely PM2.5 – particles of diameter smaller than 2.5 microns – that do not register in the EPB’s monitoring stations designed to measure PM10. Can anyone comment on this?

Fourth – I don’t think I need to write this option explicitly.

More info as I learn it.

air in beijing hazardous

Thursday, June 18th, 2009

BeijingAir is currently reporting hazardous air quality in Beijing (there was an error in the most recent hour, but you can see the PM2.5 concentration slowly creeping up over the course of the morning and early afternoon):

beijingairtwitter 6 18

Note, though, that with the AQI maxed out at 500, the air quality is theoretically worse than “hazardous,” whatever that might be.

On the other hand, MEP is reporting an API today of 104, “slightly polluted.”

A few people have asked me about this blatant discrepancy, so here’s a brief comment:

It’s important to remember that MEP’s reported API for 6/18/09 is actually an average API for the period noon to noon 6/17 to 6/18. Given that this current pollution spike seems to have rolled in over the course of the late morning and early afternoon, it is reasonable that the impact has not yet registered in the MEP reported data. From the perspective of MEP’s official reporting, we will have to wait until around 2pm tomorrow to see the results of this episode.

Of course, this discrepancy highlights the necessity of working towards a system of real-time air quality reporting (like the AIRNow program in the US) in Chinese cities. (More on this in another post.)

Final note: during my time in Beijing (3.5 years), I’ve only experienced a handful of days in which MEP reported a 500 API. The most recent ones were 12/28/2007 and 12/12/2006, plus a few during the sandstorm season of the spring of 2006. I am curious to know if tomorrow will yield another.

how clean were april and may?

Monday, June 8th, 2009

This past spring, the months of April and May in Beijing were reported as the cleanest April / May in a decade. (Sources for April: China Daily and Beijing EPB, see also my previous post; sources for May: Xinhua and Beijing EPB.)

Independent of the quantitative results, these reports seem to confirm what a lot of people have been mentioning to me, that this past spring has seemed surprisingly clean.

Let’s evaluate the truth in all of this. The following graph shows average API*, average PM10 concentration, and number of Blue Sky Days for the period April-May from 2005 through 2009:

april may

From these numbers, the results are pretty clear: the period April-May 2009 in Beijing was indeed significantly better in terms of air quality than the same period in any of the previous four years. (I could have looked farther back, but I decided only to look at five years total for this analysis.)

Here are some comparisons of 2009 vs 2005-2008 averages:

april may 2

I think it’s probably fair to say that the air quality this April and May was 30-40% better than the average air quality during the same period over the previous four years.

As usual, we should celebrate the progress while being mindful of the significant improvements still required. My calculated average PM10 concentration for this period, 117 ug/m^3, is still well above China’s annual target (100 ug/m^3) and well well above the WHO’s ideal target for developed nations (20 ug/m^3). It is also well above my estimate for the average PM10 concentration during last year’s two-month Olympic period (79 ug/m^3).

Related:
Summary of Beijing’s 2009 first quarter air quality
Summary of Beijing’s 2008 air quality
Update on fall air quality in Beijing

*I don’t really like averaging API, because it can lead to some misleading results (further discussion in this post), but despite that I still think it has value as an indicator here.

news to be positive about: PM2.5 and ozone monitoring coming soon; Pollution Transparency Index

Friday, June 5th, 2009

Three recent air pollution-related news stories to be positive about:

1) China Daily: Tougher rules for air quality likely soon

China is mulling more stringent appraisal standards for air quality, and pilot projects are likely to start from coastal cities in the Yangtze River delta and Pearl River delta next year.

The environmental authorities are planning to include particles less than 2.5 microns (PM2.5) and ozone, into the Air Pollution Index (API), which currently measures the concentration of sulfur dioxide, nitrogen dioxide and PM10, or particles smaller than 10 microns.

This is terrific news. With the pressure of the Olympics off, I was beginning to think that MEP had forgotten about the comments they made last year on this topic. No dates given in the article, but still a positive sign.

2) China Daily: Pollution index up and running

China’s first Pollution Information Transparency Index (PITI) has been officially launched and has published its first annual assessment of the pollution information disclosure performance of 113 Chinese cities for 2008.

The PITI, set up by the Institute of Public and Environmental Affairs (IPE) and the US-based Natural Resources Defense Council (NRDC), is part of efforts to strengthen public awareness and supervision of environmental issues and protection.

Here is the link to the index methodology and results (Chinese). Note that the index encompasses several types of pollution, not just air pollution. Although most cities scored rather poorly (Beijing overall scored 49.1 out of 100), it’s still encouraging to see this index go public as a baseline for future comparison. It is also very encouraging to see this activity by NGOs reported in the Chinese media.

3) Xinhua: China’s central environment authorities to open hotline for direct complaints

BEIJING, June 4 (Xinhua) — People who have complaints about environmental pollution in China would have a direct way to inform the Ministry of Environmental Protection as the ministry opens a tip-off hotline on Friday, the International Environment Day.

The ministry said Thursday that the hotline, 010-12369, will take calls about emergency environment issues, cross-provincial pollution and other environmental issues that should be directly dealt with by the ministry.

A nice little green hop, I’d say (to borrow an expression from the Green Leap Forward).