- Home
- AI in your business
- Cloud AI or local AI
Cloud AI or local AI: the right choice for your data
You get a decision guide on which tasks a cloud service can take on, what requires a language model on your own hardware and when a combination of both is worthwhile.

Not all information belongs in the cloud
Cloud services such as Microsoft 365 Copilot, ChatGPT or Claude provide very powerful models without you needing your own hardware. Your inputs are processed in the provider's data centres, depending on the provider and plan also outside the EU.
A locally operated language model processes inputs and documents in your own network. In return, you are responsible for the hardware, operation and updates, and the models do not match the performance of the largest cloud models for every task. The decision therefore depends on which data you process and which tasks the AI is to take on.
Cloud AI and local AI compared
| Criterion | Cloud AI | Local AI |
|---|---|---|
| Confidentiality | processing by the provider, terms depending on plan and contract | processing in your own network, inputs and documents do not leave the company |
| Model performance | access to the largest current models | depends on hardware and model, often sufficient for clearly defined tasks such as questions about internal documents |
| Start and effort | ready to go quickly, no hardware of your own | purchase, set-up and ongoing operation of the hardware |
| Costs over the lifetime | ongoing costs per user or based on usage | investment in hardware and ongoing operation, largely independent of the number of requests |
| Dependence on the provider | the provider determines models, plans and terms | you decide on the models and the timing of changes yourself |
| External connection | internet connection required | can be used in your own network even without an external connection |
| Evidence | contracts and evidence from the provider | your own documentation and controls |
How your decision is reached
- Collecting use cases Together with your specialist departments, it is recorded what AI is to be used for and which data it needs to work with for this.
- Classifying data You define which information may go into cloud services, which is only processed locally and which does not belong in AI systems at all.
- Reviewing requirements Legal and contractual requirements are taken into account, for example from NIS-2, from professional secrecy obligations or from contracts with your customers.
- Evaluating providers and models Cloud plans and local models are compared by storage location, contract terms and suitability for your tasks.
- Costs over the lifetime You see the ongoing costs of the cloud plans side by side with the investment in and operation of a local solution.
- Recommendation with next steps You get a recommendation for cloud, local or a combination, with a proposal for the first pilot.
For classified information, we do not make a general statement about the suitability of an AI solution. A case-by-case review is required here, more on this on the VS-NfD page.
For critical infrastructure (KRITIS) and security-sensitive companies
Operators of critical facilities, the healthcare sector, law firms and public institutions work with data whose leakage would have serious consequences. Among other things, NIS-2 requires risks in the supply chain to be taken into account, and this also includes cloud services for AI.
For these companies, a combination often makes sense: general tasks such as help with wording run on a reviewed cloud plan, while confidential documents are processed by a local AI server in-house.
Related topics
- Local AI servers You run language models on NVIDIA DGX systems or GPU servers, in-house or at our partner in Germany, delivered, set up and supported by conpro IT.
- ChatGPT and Claude You get an objective comparison of the business plans covering storage location, contract terms and administration.
- NIS-2 and KRITIS You find out whether and how your business is affected, and you get support with implementing the required measures.
Frequently asked questions about cloud AI and local AI
Is local AI automatically more secure?
Not automatically. Although your data stays in your own network, security depends on how the system is operated: with current updates, clean permissions, logging and backup. A poorly maintained local server can be a greater risk than a reviewed cloud plan.
Can we combine cloud AI and local AI?
Yes, and this is often exactly the right solution. What matters are clear rules on which data belongs in which system, set out in your AI policy.
Is a local model sufficient for our tasks?
That depends on the task. For clearly defined tasks such as questions about internal documents, a local model is often sufficient, while for very demanding tasks the large cloud models are usually superior. A pilot with your own tasks shows whether the quality is sufficient.
May we process classified information with AI?
We do not make a general statement on this. Classified information is subject to special requirements for products and operation, which must be reviewed case by case. You can find information on handling classified information in IT on the VS-NfD page.