It comes from the folk song [Dance me a Jig][1], which is based upon events in 1863 in South Carolina during the American Civil War.

>I didn't want no posses chasing after me,   
So I took all the livestock and set 'em free,   
Now master's so mad that he's liable to bust,   
'Cause he **gotta catch 'em all** while I'm kicking up dust.

See also the 1950 publication "[Sing Out!".][2]


  


  [1]: http://faujsa.fau.edu/music-data/405018/405018.pdf
  [2]: https://www.google.com/#q=%22want+no+posses+chasing+after+me%22&tbm=bks