Hi Ashwin,
Thank you for your question.
The boundary map indicates that some of the areas are outside the farmland boundary. Those pixels will not be evaluated during testing. In this case, the label map has also been masked out accordingly, it is therefore smaller than the green area in the RGB image.
The Agriculture-Vision Team