Since employees have been purposefully bypassing IT with their cloud efforts, there's some resentment and ill feelings there, which will just add to the challenges of working together to build an overall cloud system.
"The teams are not accustomed to working together and implementing change," Krans said. "It's not just a technology problem. It's an organization problem. It's a culture problem. The cloud is exacerbating a problem that's been there all along."
Jeff Kagan, an independent industry analyst, said IT managers shouldn't wait to be invited to the cloud discussion. They should reach out to business executives and explain the benefits, risks and challenges of adopting the cloud and reigning in those rogue cloud users.
"This is both a blessing and a curse for the IT department," said Kagan. "This is very positive for the enterprise if they do this correctly, and if they don't have any security problems along the way. This is the way business will be run going forward. We are in the bumpy transition period, which will take several years."
Part of that transition means IT managers need to bone up on all things cloud before they enter into discussions with business executives. IT executives need to be able to assess the different cloud implementations they'll be asked about and understand the implications of a cloud or no-cloud decision.
IT will also need to develop policies to govern cloud use and mechanisms to make it easy for departments to comply, noted Olds.
"This is a good development because it gives IT visibility into what's actually going on in the rest of the organization," he added. "The fact that departments already are using outside cloud providers will complicate it, for sure. Many computing revolutions started out with disgruntled users rolling their own solutions without the approval or knowledge of central IT. This is just the circle of life in the business-IT ecosystem."
Sign up for CIO Asia eNewsletters.