New Zealand nightshade (Solanum aviculare)

Solanum aviculare is an Australian and New Zealand shrub, bearing purple flowers and berries ripening from green to orange. Unripe fruit is toxic; ripe fruit edible.

Above information is sourced from Wikipedia