There's actually a book series (for kids) about it! I loved them! PotC was my first big fandom, just because I thought Captain Jack was such an amazing character! There's a ton of lit published by Disney about all the characters' back stories.
Curse of the Black Pearl: Elizabeth: “Yes, the rum is gone.” Captain Jack Sparrow: “But is why the rum gone?” Dead Man’s Chest: Captain Jack Sparrow: “Elizabeth. Hide the rum.” And he never forgave and he never forgot