If you want to link *individual* IP addresses to sites, I can see two approaches:
1. Add a custom field to IP address
2. Add a /32 prefix for each site - which you can easily query from the API.
However the second case currently has an issue where the GUI doesn't show addresses underneath a /32 prefix, see:
Depending on your use case, it may be better just to create a *prefix* of size /32 to assign to the site, and no IP address at all.