Usually, contents of a CSV file represent something higher level. You might look for a plugin that presents that higher level thing, then convert the CSV to the format of that higher level thing and display it using the Jenkins plugin for that thing.
For example, if it is test results, you could convert the CSV to JUnit format and display the results as test results.
If the CSV represents compiler warnings, you could convert the output to match the compiler warnings expected output.
If the CSV represents some row and column data computed by the Jenkins job, you could convert it to an HTML table in an HTML page and use the HTML Publisher to show that HTML page in your Jenkins job.
Mark Waite