One of the clients connecting to your server doesn't properly end it's connection. Ask around if someone is having problems with their access or a PC crashing.
If it's a public accessible server, someone might be portscanning you, sending SYN or RST packets. Check if there are any excessive failed authentication attempts.