Two public ip for server, how to block a port for ip2 but not for ip1

Hello,
I am not sure that it's possible to set a server for explained below scenario:

I have ordered a second ip for my streaming server. Both ip addresses are set and well responding to my ping requests. LAMP is installed into server.
Assume that port 15678 is running for nginx. Admin port is also the same, 15678. I am able to login admin panel when I enter below links:

http://server_ip1:15678
http://server_ip2:15678

admin page:

http://server_ip1:15678/admin/login.php

live stream line format is:

http://server_ip2:15678/live/user/pass/stream_nr?token=****

Is it possible to set nginx accepting connection requests to port 15678 for only ip1 or ip2, not both of them ?

I am planning to connect to admin page via only ip1, ip2 will not accept connection requests.

thanks in advance
Boris