Sudheer,
It's pretty straightforward. On the "Plugin Manager" page, look for "MSBuild Plugin". That one can call MSBuild (part of Visual Studio) to build .proj and .sln files.
If you click on the name of the plugin, it takes you to the plugin home page, which has some more information about configuring the plugin to point to your installation of MSBuild.
This is all, of course, assuming you are running Jenkins on Windows and have whatever version of Visual Studio you normally use to build the project installed on the same machine that you have Jenkins on.
Rich