Hi,
I use evaluate.py to batch process a dataset and I want to compare how results differ when I plug different language models. To achieve this I have changed evaluate.py to output the full report (all results) as a simple CSV (just changed the print format). I plan to import the data from different CSVs as tables and join them. Unfortunately, there is no column of unique values.
The filenames would work perfectly, however I cannot figure out how to extract them from the TF iterator that consumes the dataset or how to match them to results if I manually import them as a list.
Any ideas for a straightforward solution to include filenames in the report produced by evaluate.py?