It comes forfrom the folk song Dance me a Jig, which is based upon events in 1863 in South Carolina during the American Civil War.
I didn't want no posses chasing after me,
So I took all the livestock and set 'em free,
Now master's so mad that he's liable to bust,
'Cause he gotta catch 'em all while I'm kicking up dust.
See also the 1950 publication "Sing Out!".