TABLE REPORT
Suppose you need to scrape a financial report organized as a table. This test checks the scraper's ability to:
- Support tables with indefinite number of rows and columns
- Tolerate merged columns and rows
- Parse currency format
- Extract only a certain year
- products - number of product columns (from 1 to 50)
- years - number of year sections in the report
- quarters - number of quarters in the last year
For testing, you may use the following sample links. The scraper should sufficiently scrape all data from the reports using the same project:
Quarter | Product 1 | Product 2 | Product 3 | Product 4 | Product 5 | Product 6 | Product 7 | Product 8 | Product 9 | Product 10 | Total Amount | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Items | Amount | Items | Amount | Items | Amount | Items | Amount | Items | Amount | Items | Amount | Items | Amount | Items | Amount | Items | Amount | Items | Amount | ||
Q1 | 8 | $1,591.20 | 10 | $1,989.00 | 13 | $2,585.70 | 15 | $2,983.50 | 17 | $3,381.30 | 20 | $3,978.00 | 22 | $4,375.80 | 24 | $4,773.60 | 26 | $5,171.40 | 29 | $5,768.10 | $36,597.60 |
Q2 | 14 | $2,784.60 | 16 | $3,182.40 | 19 | $3,779.10 | 21 | $4,176.90 | 23 | $4,574.70 | 25 | $4,972.50 | 27 | $5,370.30 | 30 | $5,967.00 | 32 | $6,364.80 | 34 | $6,762.60 | $47,934.90 |
Q3 | 20 | $3,978.00 | 22 | $4,375.80 | 24 | $4,773.60 | 26 | $5,171.40 | 29 | $5,768.10 | 31 | $6,165.90 | 33 | $6,563.70 | 35 | $6,961.50 | 37 | $7,359.30 | 39 | $7,757.10 | $58,874.40 |
Q4 | 25 | $4,972.50 | 27 | $5,370.30 | 30 | $5,967.00 | 32 | $6,364.80 | 34 | $6,762.60 | 36 | $7,160.40 | 38 | $7,558.20 | 40 | $7,956.00 | 42 | $8,353.80 | 44 | $8,751.60 | $69,217.20 |
Total for 2000 | $1,025,528.40 | ||||||||||||||||||||
Q1 | 31 | $6,165.90 | 33 | $6,563.70 | 35 | $6,961.50 | 37 | $7,359.30 | 39 | $7,757.10 | 41 | $8,154.90 | 43 | $8,552.70 | 45 | $8,950.50 | 47 | $9,348.30 | 49 | $9,746.10 | $79,560.00 |
Q2 | 36 | $7,160.40 | 38 | $7,558.20 | 40 | $7,956.00 | 42 | $8,353.80 | 44 | $8,751.60 | 46 | $9,149.40 | 48 | $9,547.20 | 50 | $9,945.00 | 51 | $10,143.90 | 53 | $10,541.70 | $89,107.20 |
Q3 | 41 | $8,154.90 | 43 | $8,552.70 | 45 | $8,950.50 | 47 | $9,348.30 | 49 | $9,746.10 | 51 | $10,143.90 | 52 | $10,342.80 | 54 | $10,740.60 | 56 | $11,138.40 | 57 | $11,337.30 | $98,455.50 |
Q4 | 46 | $9,149.40 | 48 | $9,547.20 | 50 | $9,945.00 | 51 | $10,143.90 | 53 | $10,541.70 | 55 | $10,939.50 | 56 | $11,138.40 | 58 | $11,536.20 | 60 | $11,934.00 | 61 | $12,132.90 | $107,008.20 |
Total for 2001 | $1,936,689.30 | ||||||||||||||||||||
Q1 | 51 | $10,143.90 | 52 | $10,342.80 | 54 | $10,740.60 | 56 | $11,138.40 | 57 | $11,337.30 | 59 | $11,735.10 | 60 | $11,934.00 | 62 | $12,331.80 | 63 | $12,530.70 | 65 | $12,928.50 | $115,163.10 |
Q2 | 55 | $10,939.50 | 56 | $11,138.40 | 58 | $11,536.20 | 60 | $11,934.00 | 61 | $12,132.90 | 63 | $12,530.70 | 64 | $12,729.60 | 65 | $12,928.50 | 66 | $13,127.40 | 68 | $13,525.20 | $122,522.40 |
Q3 | 59 | $11,735.10 | 60 | $11,934.00 | 62 | $12,331.80 | 63 | $12,530.70 | 65 | $12,928.50 | 66 | $13,127.40 | 67 | $13,326.30 | 68 | $13,525.20 | 69 | $13,724.10 | 70 | $13,923.00 | $129,086.10 |
Q4 | 63 | $12,530.70 | 64 | $12,729.60 | 65 | $12,928.50 | 66 | $13,127.40 | 68 | $13,525.20 | 69 | $13,724.10 | 70 | $13,923.00 | 71 | $14,121.90 | 72 | $14,320.80 | 73 | $14,519.70 | $135,450.90 |
Total for 2002 | $2,674,011.60 | ||||||||||||||||||||
Q1 | 66 | $13,127.40 | 67 | $13,326.30 | 68 | $13,525.20 | 69 | $13,724.10 | 70 | $13,923.00 | 71 | $14,121.90 | 72 | $14,320.80 | 73 | $14,519.70 | 74 | $14,718.60 | 75 | $14,917.50 | $140,224.50 |
Q2 | 69 | $13,724.10 | 70 | $13,923.00 | 71 | $14,121.90 | 72 | $14,320.80 | 73 | $14,519.70 | 74 | $14,718.60 | 74 | $14,718.60 | 75 | $14,917.50 | 76 | $15,116.40 | 76 | $15,116.40 | $145,197.00 |
Q3 | 71 | $14,121.90 | 72 | $14,320.80 | 73 | $14,519.70 | 74 | $14,718.60 | 75 | $14,917.50 | 75 | $14,917.50 | 76 | $15,116.40 | 76 | $15,116.40 | 77 | $15,315.30 | 77 | $15,315.30 | $148,379.40 |
Q4 | 74 | $14,718.60 | 74 | $14,718.60 | 75 | $14,917.50 | 76 | $15,116.40 | 76 | $15,116.40 | 77 | $15,315.30 | 77 | $15,315.30 | 77 | $15,315.30 | 78 | $15,514.20 | 78 | $15,514.20 | $151,561.80 |
Total for 2003 | $3,171,261.60 | ||||||||||||||||||||
Q1 | 76 | $15,116.40 | 76 | $15,116.40 | 77 | $15,315.30 | 77 | $15,315.30 | 77 | $15,315.30 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | $138,235.50 | ||
Q2 | 77 | $15,315.30 | 77 | $15,315.30 | 77 | $15,315.30 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | $154,545.30 |
Q3 | 77 | $15,315.30 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 77 | $15,315.30 | 77 | $15,315.30 | $154,545.30 |
Q4 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 78 | $15,514.20 | 77 | $15,315.30 | 77 | $15,315.30 | 76 | $15,116.40 | 76 | $15,116.40 | $153,948.60 |
Total for 2004 | $3,237,097.50 | ||||||||||||||||||||
Q1 | 78 | $15,514.20 | 78 | $15,514.20 | 77 | $15,315.30 | 77 | $15,315.30 | 77 | $15,315.30 | 76 | $15,116.40 | 76 | $15,116.40 | 75 | $14,917.50 | 74 | $14,718.60 | $136,843.20 | ||
Q2 | 78 | $15,514.20 | 77 | $15,315.30 | 76 | $15,116.40 | 76 | $15,116.40 | 75 | $14,917.50 | 75 | $14,917.50 | 74 | $14,718.60 | 73 | $14,519.70 | 72 | $14,320.80 | $134,456.40 | ||
Q3 | 77 | $15,315.30 | 76 | $15,116.40 | 75 | $14,917.50 | 74 | $14,718.60 | 74 | $14,718.60 | 73 | $14,519.70 | 72 | $14,320.80 | 71 | $14,121.90 | 70 | $13,923.00 | $131,671.80 | ||
Q4 | 75 | $14,917.50 | 75 | $14,917.50 | 73 | $14,519.70 | 72 | $14,320.80 | 72 | $14,320.80 | 71 | $14,121.90 | 70 | $13,923.00 | 68 | $13,525.20 | 67 | $13,326.30 | $127,892.70 | ||
Total for 2005 | $2,812,048.20 | ||||||||||||||||||||
Q1 | 74 | $14,718.60 | 73 | $14,519.70 | 72 | $14,320.80 | 71 | $14,121.90 | 70 | $13,923.00 | 69 | $13,724.10 | 68 | $13,525.20 | 67 | $13,326.30 | 65 | $12,928.50 | 64 | $12,729.60 | $137,837.70 |
Q2 | 72 | $14,320.80 | 71 | $14,121.90 | 70 | $13,923.00 | 68 | $13,525.20 | 67 | $13,326.30 | 66 | $13,127.40 | 65 | $12,928.50 | 64 | $12,729.60 | 62 | $12,331.80 | 61 | $12,132.90 | $132,467.40 |
Q3 | 69 | $13,724.10 | 67 | $13,326.30 | 65 | $12,928.50 | 64 | $12,729.60 | 63 | $12,530.70 | 61 | $12,132.90 | 60 | $11,934.00 | 58 | $11,536.20 | 57 | $11,337.30 | $112,179.60 | ||
Q4 | 66 | $13,127.40 | 65 | $12,928.50 | 64 | $12,729.60 | 62 | $12,331.80 | 61 | $12,132.90 | 59 | $11,735.10 | 58 | $11,536.20 | 56 | $11,138.40 | 54 | $10,740.60 | 53 | $10,541.70 | $118,942.20 |
Total for 2006 | $2,795,738.40 | ||||||||||||||||||||
Q1 | 63 | $12,530.70 | 61 | $12,132.90 | 60 | $11,934.00 | 58 | $11,536.20 | 57 | $11,337.30 | 55 | $10,939.50 | 54 | $10,740.60 | 52 | $10,342.80 | 50 | $9,945.00 | 48 | $9,547.20 | $110,986.20 |
Q2 | 59 | $11,735.10 | 58 | $11,536.20 | 56 | $11,138.40 | 54 | $10,740.60 | 53 | $10,541.70 | 51 | $10,143.90 | 49 | $9,746.10 | 47 | $9,348.30 | 45 | $8,950.50 | 43 | $8,552.70 | $102,433.50 |
Q3 | 55 | $10,939.50 | 54 | $10,740.60 | 52 | $10,342.80 | 50 | $9,945.00 | 48 | $9,547.20 | 46 | $9,149.40 | 44 | $8,751.60 | 43 | $8,552.70 | 41 | $8,154.90 | 39 | $7,757.10 | $93,880.80 |
Q4 | 51 | $10,143.90 | 49 | $9,746.10 | 47 | $9,348.30 | 45 | $8,950.50 | 43 | $8,552.70 | 42 | $8,353.80 | 40 | $7,956.00 | 38 | $7,558.20 | 35 | $6,961.50 | 33 | $6,563.70 | $84,134.70 |
Total for 2007 | $2,270,642.40 | ||||||||||||||||||||
Q1 | 46 | $9,149.40 | 44 | $8,751.60 | 43 | $8,552.70 | 41 | $8,154.90 | 39 | $7,757.10 | 36 | $7,160.40 | 34 | $6,762.60 | 32 | $6,364.80 | 30 | $5,967.00 | 28 | $5,569.20 | $74,189.70 |
Q2 | 42 | $8,353.80 | 40 | $7,956.00 | 38 | $7,558.20 | 35 | $6,961.50 | 33 | $6,563.70 | 31 | $6,165.90 | 29 | $5,768.10 | 27 | $5,370.30 | 25 | $4,972.50 | 22 | $4,375.80 | $64,045.80 |
Q3 | 36 | $7,160.40 | 34 | $6,762.60 | 32 | $6,364.80 | 30 | $5,967.00 | 28 | $5,569.20 | 26 | $5,171.40 | 24 | $4,773.60 | 21 | $4,176.90 | 19 | $3,779.10 | 17 | $3,381.30 | $53,106.30 |
Q4 | 31 | $6,165.90 | 29 | $5,768.10 | 27 | $5,370.30 | 25 | $4,972.50 | 22 | $4,375.80 | 20 | $3,978.00 | 18 | $3,580.20 | 16 | $3,182.40 | 13 | $2,585.70 | 11 | $2,187.90 | $42,166.80 |
Total for 2008 | $1,425,516.30 | ||||||||||||||||||||
Q1 | 26 | $5,171.40 | 24 | $4,773.60 | 21 | $4,176.90 | 19 | $3,779.10 | 17 | $3,381.30 | 14 | $2,784.60 | 12 | $2,386.80 | 10 | $1,989.00 | 8 | $1,591.20 | 5 | $994.50 | $31,028.40 |
Q2 | 20 | $3,978.00 | 18 | $3,580.20 | 16 | $3,182.40 | 13 | $2,585.70 | 11 | $2,187.90 | 9 | $1,790.10 | 6 | $1,193.40 | 4 | $795.60 | 2 | $397.80 | 1 | $198.90 | $19,890.00 |
Q3 | 14 | $2,784.60 | 12 | $2,386.80 | 10 | $1,989.00 | 8 | $1,591.20 | 5 | $994.50 | 3 | $596.70 | 1 | $198.90 | 2 | $397.80 | 4 | $795.60 | 6 | $1,193.40 | $12,928.50 |
Q4 | 9 | $1,790.10 | 6 | $1,193.40 | 4 | $795.60 | 2 | $397.80 | 1 | $198.90 | 3 | $596.70 | 5 | $994.50 | 8 | $1,591.20 | 10 | $1,989.00 | 12 | $2,386.80 | $11,934.00 |
Total for 2009 | $501,426.90 | ||||||||||||||||||||