With lust all sins are desired. With gluttony all sins are consumed. With avarice all sins are gathered. With pride display sins as riches. With envy others sins are stolen. With sloth all sins are lost. With wrath are other sins destroyed.
I will say, though, that I don't think starting each line with "with" was either necessary nor in your best interests. It gets slightly repetitive, and not in a good way. Perhaps you would try with a bit less conventional of a structure? I really feel this is the sort of poem that would benefit from that.
As always, though, that's just my opinion, and just because I think it could be better doesn't mean it wasn't already good
Yes, it's not normally a rhythm I would have employed in a poem.
This work only came about because I was writing to complete a challenge, I noticed the titles had a certain rhythm to them that I liked and they worked rather well together. It's certainly not what I would consider my best work but it brought together the folder of short stories I had created for the challenge rather nicely.