Dublicate rows

[ilia-semenov]

The output may contain duplicate rows due to intersection between Previous Generation Pricing and Current Generation Pricing APIs (m1, t1 families).

[setuk]

i was looking at this earlier. When you load the EC2 data as you iterate all the URL's both current and previous generation it doesnt look as if you store any data about the source of the data to disambiguate between the generations. Is this correct? How big an issue is this?