WEB SCRAPER TESTING GROUND

TABLE REPORT

Suppose you need to scrape a financial report organized as a table. This test checks the scraper's ability to:
  1. Support tables with indefinite number of rows and columns
  2. Tolerate merged columns and rows
  3. Parse currency format
  4. Extract only a certain year
To change the table you may use the following parameters: There should be a one year section with a merged column (for Product 3), and if more than one year are shown, there should be one or more merged cells in some quarter rows (for Products 1 and 2). All merged cells in the report contain a hyphen only.

For testing, you may use the following sample links. The scraper should sufficiently scrape all data from the reports using the same project:

Quarter Product 1Product 2Product 3Product 4Product 5Product 6Product 7Product 8Product 9Product 10 Total Amount
ItemsAmountItemsAmountItemsAmountItemsAmountItemsAmountItemsAmountItemsAmountItemsAmountItemsAmountItemsAmount
2000
Q18$1,591.2010$1,989.0013$2,585.7015$2,983.5017$3,381.3020$3,978.0022$4,375.8024$4,773.6026$5,171.4029$5,768.10$36,597.60
Q214$2,784.6016$3,182.4019$3,779.1021$4,176.9023$4,574.7025$4,972.5027$5,370.3030$5,967.0032$6,364.8034$6,762.60$47,934.90
Q320$3,978.0022$4,375.8024$4,773.6026$5,171.4029$5,768.1031$6,165.9033$6,563.7035$6,961.5037$7,359.3039$7,757.10$58,874.40
Q425$4,972.5027$5,370.3030$5,967.0032$6,364.8034$6,762.6036$7,160.4038$7,558.2040$7,956.0042$8,353.8044$8,751.60$69,217.20
Total for 2000$1,025,528.40
2001
Q131$6,165.9033$6,563.7035$6,961.5037$7,359.3039$7,757.1041$8,154.9043$8,552.7045$8,950.5047$9,348.3049$9,746.10$79,560.00
Q236$7,160.4038$7,558.2040$7,956.0042$8,353.8044$8,751.6046$9,149.4048$9,547.2050$9,945.0051$10,143.9053$10,541.70$89,107.20
Q341$8,154.9043$8,552.7045$8,950.5047$9,348.3049$9,746.1051$10,143.9052$10,342.8054$10,740.6056$11,138.4057$11,337.30$98,455.50
Q446$9,149.4048$9,547.2050$9,945.0051$10,143.9053$10,541.7055$10,939.5056$11,138.4058$11,536.2060$11,934.0061$12,132.90$107,008.20
Total for 2001$1,936,689.30
2002
Q151$10,143.9052$10,342.8054$10,740.6056$11,138.4057$11,337.3059$11,735.1060$11,934.0062$12,331.8063$12,530.7065$12,928.50$115,163.10
Q255$10,939.5056$11,138.4058$11,536.2060$11,934.0061$12,132.9063$12,530.7064$12,729.6065$12,928.5066$13,127.4068$13,525.20$122,522.40
Q359$11,735.1060$11,934.0062$12,331.8063$12,530.7065$12,928.5066$13,127.4067$13,326.3068$13,525.2069$13,724.1070$13,923.00$129,086.10
Q463$12,530.7064$12,729.6065$12,928.5066$13,127.4068$13,525.2069$13,724.1070$13,923.0071$14,121.9072$14,320.8073$14,519.70$135,450.90
Total for 2002$2,674,011.60
2003
Q166$13,127.4067$13,326.3068$13,525.2069$13,724.1070$13,923.0071$14,121.9072$14,320.8073$14,519.7074$14,718.6075$14,917.50$140,224.50
Q269$13,724.1070$13,923.0071$14,121.9072$14,320.8073$14,519.7074$14,718.6074$14,718.6075$14,917.5076$15,116.4076$15,116.40$145,197.00
Q371$14,121.9072$14,320.8073$14,519.7074$14,718.6075$14,917.5075$14,917.5076$15,116.4076$15,116.4077$15,315.3077$15,315.30$148,379.40
Q474$14,718.6074$14,718.6075$14,917.5076$15,116.4076$15,116.4077$15,315.3077$15,315.3077$15,315.3078$15,514.2078$15,514.20$151,561.80
Total for 2003$3,171,261.60
2004
Q1
-
76$15,116.4076$15,116.4077$15,315.3077$15,315.3077$15,315.3078$15,514.2078$15,514.2078$15,514.2078$15,514.20$138,235.50
Q277$15,315.3077$15,315.3077$15,315.3078$15,514.2078$15,514.2078$15,514.2078$15,514.2078$15,514.2078$15,514.2078$15,514.20$154,545.30
Q377$15,315.3078$15,514.2078$15,514.2078$15,514.2078$15,514.2078$15,514.2078$15,514.2078$15,514.2077$15,315.3077$15,315.30$154,545.30
Q478$15,514.2078$15,514.2078$15,514.2078$15,514.2078$15,514.2078$15,514.2077$15,315.3077$15,315.3076$15,116.4076$15,116.40$153,948.60
Total for 2004$3,237,097.50
2005
Q178$15,514.2078$15,514.20
-
-
77$15,315.3077$15,315.3077$15,315.3076$15,116.4076$15,116.4075$14,917.5074$14,718.60$136,843.20
Q278$15,514.2077$15,315.3076$15,116.4076$15,116.4075$14,917.5075$14,917.5074$14,718.6073$14,519.7072$14,320.80$134,456.40
Q377$15,315.3076$15,116.4075$14,917.5074$14,718.6074$14,718.6073$14,519.7072$14,320.8071$14,121.9070$13,923.00$131,671.80
Q475$14,917.5075$14,917.5073$14,519.7072$14,320.8072$14,320.8071$14,121.9070$13,923.0068$13,525.2067$13,326.30$127,892.70
Total for 2005$2,812,048.20
2006
Q174$14,718.6073$14,519.7072$14,320.8071$14,121.9070$13,923.0069$13,724.1068$13,525.2067$13,326.3065$12,928.5064$12,729.60$137,837.70
Q272$14,320.8071$14,121.9070$13,923.0068$13,525.2067$13,326.3066$13,127.4065$12,928.5064$12,729.6062$12,331.8061$12,132.90$132,467.40
Q369$13,724.10
-
67$13,326.3065$12,928.5064$12,729.6063$12,530.7061$12,132.9060$11,934.0058$11,536.2057$11,337.30$112,179.60
Q466$13,127.4065$12,928.5064$12,729.6062$12,331.8061$12,132.9059$11,735.1058$11,536.2056$11,138.4054$10,740.6053$10,541.70$118,942.20
Total for 2006$2,795,738.40
2007
Q163$12,530.7061$12,132.9060$11,934.0058$11,536.2057$11,337.3055$10,939.5054$10,740.6052$10,342.8050$9,945.0048$9,547.20$110,986.20
Q259$11,735.1058$11,536.2056$11,138.4054$10,740.6053$10,541.7051$10,143.9049$9,746.1047$9,348.3045$8,950.5043$8,552.70$102,433.50
Q355$10,939.5054$10,740.6052$10,342.8050$9,945.0048$9,547.2046$9,149.4044$8,751.6043$8,552.7041$8,154.9039$7,757.10$93,880.80
Q451$10,143.9049$9,746.1047$9,348.3045$8,950.5043$8,552.7042$8,353.8040$7,956.0038$7,558.2035$6,961.5033$6,563.70$84,134.70
Total for 2007$2,270,642.40
2008
Q146$9,149.4044$8,751.6043$8,552.7041$8,154.9039$7,757.1036$7,160.4034$6,762.6032$6,364.8030$5,967.0028$5,569.20$74,189.70
Q242$8,353.8040$7,956.0038$7,558.2035$6,961.5033$6,563.7031$6,165.9029$5,768.1027$5,370.3025$4,972.5022$4,375.80$64,045.80
Q336$7,160.4034$6,762.6032$6,364.8030$5,967.0028$5,569.2026$5,171.4024$4,773.6021$4,176.9019$3,779.1017$3,381.30$53,106.30
Q431$6,165.9029$5,768.1027$5,370.3025$4,972.5022$4,375.8020$3,978.0018$3,580.2016$3,182.4013$2,585.7011$2,187.90$42,166.80
Total for 2008$1,425,516.30
2009
Q126$5,171.4024$4,773.6021$4,176.9019$3,779.1017$3,381.3014$2,784.6012$2,386.8010$1,989.008$1,591.205$994.50$31,028.40
Q220$3,978.0018$3,580.2016$3,182.4013$2,585.7011$2,187.909$1,790.106$1,193.404$795.602$397.801$198.90$19,890.00
Q314$2,784.6012$2,386.8010$1,989.008$1,591.205$994.503$596.701$198.902$397.804$795.606$1,193.40$12,928.50
Q49$1,790.106$1,193.404$795.602$397.801$198.903$596.705$994.508$1,591.2010$1,989.0012$2,386.80$11,934.00
Total for 2009$501,426.90