D2, D3, D4 and D5 have two inputs. One input will be high and one input low. It is anyones guess which will win.
Disconnect one input on each of the LEDs to see if they still work.
If you wish to drive a LED from more than one supply, then a diode (1N4148, 1N914, !N400* etc) in each output can stop back feeding.