ArrowChat

I use the embed code to put the chatroom on the sidebar of my site. But it doesn't show previous messages in the chatroom when you join as a new user.

You can adjust how long the history shows up for under Manage > Chat Rooms > Chat Room History Length.