With those GTK3 applications that have their own shadow (and probably window border), if compton's shadow is turned on, those windows will have bigger square box with shadow surrounding them.
Screenshot with compton shadow on: http://i.imgur.com/AbWHh66.png
compton shadow off: http://i.imgur.com/k0nFnT4.png
I'm using Openbox on Arch Linux.