A cable with RJ11 plugs is supplied with the base station. If your router has separate telephone outlets, these are equipped with RJ11 sockets. You can then connect the base station and the telephone output with the RJ11 cable.
The cable supplied will also fit into the RJ45 socket on the router, but you will probably not have a telephone signal at the RJ45 sockets on the router.