I don’t see that as a problem. They basically only save the phone number, creation date and date of the last connection to the server.

Signal was only able to provide two sets of data: the timestamp of when the account was created and the date of the last connection to the Signal server, as Signal does not store any other information about its users. source