Add Performance and Accuracy Testing Script for FertiScan Pipeline

[Endlessflow]

This PR introduces a basic performance and accuracy testing framework for the FertiScan pipeline as outlined in Issue #18. The key features include the ability to measure the end-to-end execution time of the pipeline, evaluate accuracy using Levenshtein similarity, and generate structured reports in CSV format.

My apologies @k-allagbe for the long PR. I will try to summarize the most important information bellow.

Key Changes:

1. TestCase Class:

   • A class responsible for individual performance and accuracy tests.
   • Measures the time taken by the pipeline and compares the actual output against expected output using Levenshtein similarity.
   • Saves actual JSON output for debugging or future comparison. (I actually am hesitant on if this is really useful - looking for feedback)

2. TestRunner Class:

   • A class responsible to executes a suite of test cases in a single run.
   • Generates a structured CSV report after running the test suite with the following fields: Test Case, Field Name, Accuracy Score, Expected Value, Actual Value, Pass/Fail, and Pipeline Speed (seconds).

3. Accuracy Calculation:

   • Implemented basic accuracy assessment using Levenshtein similarity between the expected and actual output fields.
   • Configurable global accuracy threshold (set to 80%).

4. Performance Reporting:

   • Measures the total execution time for the pipeline from end-to-end.

5. Output Handling: ( I used it for debugging mostly idk if it's pertinent to keep - looking for feedback)

   • Actual output is saved in test_outputs, allowing for a side-by-side comparison with expected output JSON.

How to Test:

1. Prepare test data under the test_data/labels folder with images and expected_output.json files. (follow structure in the README found in the test_data/labels folder).
2. Run the script using python performance_test.
3. After execution, check the reports folder for a CSV report that details test case performance and accuracy.

Example CSV Report:

Test Case ,Field Name                      ,Accuracy Score ,Expected Value                                        ,Actual Value                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   ,Pass/Fail ,Pipeline Speed (seconds)
        1 ,company_name                    ,         12.50 ,Stoller Enterprises Inc.                              ,                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               ,Fail      ,                  7.1083
        1 ,company_address                 ,          3.92 ,"9090 Katy Freeway, suite 400, Houston, TX 77024 USA" ,                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               ,Fail      ,                  7.1083
        1 ,company_website                 ,        100.00 ,                                                      ,                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               ,Pass      ,                  7.1083
        1 ,company_phone_number            ,          0.00 ,1-800-539-5283 ou 713-461-1493                        ,                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               ,Fail      ,                  7.1083
        1 ,manufacturer_name               ,         96.00 ,Stoller Enterprises Inc.                              ,"Stoller Enterprises, Inc."                                                                                                                                                                                                                                                                                                                                                                                                                                                                    ,Pass      ,                  7.1083
        1 ,manufacturer_address            ,         96.08 ,"9090 Katy Freeway, suite 400, Houston, TX 77024 USA" ,"9090 Katy Freeway, Suite 400 Houston, TX 77024 USA"                                                                                                                                                                                                                                                                                                                                                                                                                                           ,Pass      ,                  7.1083
        1 ,manufacturer_website            ,        100.00 ,                                                      ,                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               ,Pass      ,                  7.1083
        1 ,manufacturer_phone_number       ,         96.67 ,1-800-539-5283 ou 713-461-1493                        ,1-800-539-5283 or 713-461-1493                                                                                                                                                                                                                                                                                                                                                                                                                                                                 ,Pass      ,                  7.1083
        1 ,fertiliser_name                 ,        100.00 ,Balancer                                              ,Balancer                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       ,Pass      ,                  7.1083
        1 ,registration_number             ,        100.00 ,2012063B                                              ,2012063B                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       ,Pass      ,                  7.1083
        1 ,lot_number                      ,        100.00 ,                                                      ,                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               ,Pass      ,                  7.1083
...        

Suggested Next Steps

• Automated CI Integration: The framework can be integrated into a CI/CD pipeline to run tests automatically after new updates.
• Semantic Similarity: The framework should use a test to check the semantic similarity of fields.
• Data aggregation and visualisation: The framework should eventually be expended to include a way to aggregate data of the results across dozen of test cases and visualise the results.

closes #18