According to Fagan, having the right SLAs in place is crucial to ensuring the availability and security of data.
"Selecting the appropriate infrastructure environment is also extremely important, as is ensuring that the hybrid cloud platform allows reliable and efficient workload transfer, and a high level of interoperability so your resources work well with your cloud provider's resources," he says.
It is not only security concerns and business criticality which determine what data goes where. As always, costs are prominent.
"A good weightage for shifting to public clouds is cost," Mathew says. "If the cost to value does not match, organisations will tend to pull back some of their core workloads in-house."
However, public cloud companies like Amazon are trying to make it harder for organisations to look back.
Building AWS (Amazon Web Services) on a programmable architecture running with very thin margins has allowed Amazon to cut prices over 26 times since 2006.
With this likely to continue, and security concerns easing, public cloud adoption may be closer than people think.
Sign up for CIO Asia eNewsletters.