Captured traffic on both sides, sequence numbers don't match up

I captured both sides of a conversation, but when I go to look at the packets in Wireshark they are different sequence numbers. Any idea what could cause it?