The number of rufous hummingbirds visiting southern Vancouver Island over the summer is dropping and the cause may be climate change, says a local bird expert.