Similar for us, were staying in Venice on Thursday night. Trainline is simple and gives you multiple options.
We've got a direct train to Rimini on the Friday, plenty time for us to have a look about Venice, thursday night/friday morning.
Venezia Santa Lucia to Rimini - https://www.thetrainline.com/