Most Android devices aren't capable of outputting audio over USB. So no, it won't work.
You pretty much have two options. Either the 3.5mm jack, or over Bluetooth Audio. You would need to find some sort of Bluetooth adapter with either a 3.5mm jack or optical out or whatever.