(In addition to the previous post)
When you access the pages on the server, the time required for transferring the page content (from server to browser) is very short.
When using the LAN or Internet, everything depends on the speed of that network. Comparing to processing speed (server to read and send the page / browser to display it), the transmission time takes the big part of the delay.
Supposing that your LAN is quite fast, it would be a good idea to consider the amount of data in those pages (especially pictures, pdf files, excel files).
Good luck!
p.s.: Did you try to access the server using its LAN IP?