A company that runs an open-weight language model on its own server for internal use is a deployer under the EU AI Act, not a provider. For most internal uses its obligations today are AI literacy measures (Article 4), staying clear of the prohibited practices (Article 5) and the transparency duties of Article 50. The heavier high-risk rules for Annex III use cases were postponed to 2 December 2027 by Regulation (EU) 2026/1744, in force since 27 July 2026. Under the GDPR the company is a controller whether it calls a US API or hosts the model itself. Self-hosting removes the processor contract and the international transfer for the model step, and leaves security, impact assessment and lawfulness with the company.

This article is information for IT and compliance leads, read from the legal texts and the Commission and EDPB pages on 16 November 2026. It is not legal advice. Running a model yourself does not make any processing compliant: that depends on your purposes, your legal basis, your safeguards and your documentation, and on advice from your data protection officer or counsel.

The AI Act timeline as amended in 2026

The AI Act is Regulation (EU) 2024/1689. It was amended by Regulation (EU) 2026/1744 of 8 July 2026, often called the Digital Omnibus on AI, published in the Official Journal on 24 July 2026 and in force on 27 July 2026. The omnibus is adopted law. Its main effect for most companies is that the high-risk dates moved.

DateWhat appliesChanged by the omnibus?
1 August 2024The AI Act entered into forceNo
2 February 2025Prohibited AI practices and AI literacy obligations applyThe date stands; the wording of Article 4 was replaced
2 August 2025Governance rules and the obligations for general-purpose AI (GPAI) models applyNo
2 August 2026General date of application, with exceptions. The AI Office and national authorities implement, supervise and enforceThe date stands; the high-risk rules were carved out of it
2 December 2026New prohibitions added by the omnibus (systems producing non-consensual intimate content or child sexual abuse material). Providers of generative systems placed on the market before 2 August 2026 must comply with the marking duty in Article 50(2) by this dateNew
2 December 2027High-risk rules for the Annex III use casesPostponed from 2 August 2026
2 August 2028High-risk rules for AI embedded in products regulated under Annex IPostponed from 2 August 2027
2 August 2030Providers and deployers of high-risk systems intended for public authorities must complyNo

As of 16 November 2026 the prohibitions, the literacy duty, the GPAI model rules and Article 50 apply, and the next date is 2 December 2026.

Provider or deployer: which one are you?

Article 3 defines both roles. A provider is a person or body that "develops an AI system or a general-purpose AI model or that has an AI system or a general-purpose AI model developed and places it on the market or puts the AI system into service under its own name or trademark, whether for payment or free of charge". A deployer is a person or body "using an AI system under its authority except where the AI system is used in the course of a personal non-professional activity".

A company that downloads open weights and runs them behind an internal chat tool is a deployer. The organisation that trained and published the model is the provider of the GPAI model, and most of the Act's documentation and conformity duties sit with providers.

Three ways the line moves:

What must a company deploying an open-weight model internally do?

ArticleApplies whenWhat it asks of a deployer
Article 4, AI literacyAlways, since 2 February 2025As replaced by the omnibus: "take measures to support the development of AI literacy of their staff". The text adds that this "does not require providers or deployers to guarantee any specific level of AI literacy of any individual"
Article 5, prohibited practicesAlways, for everyoneDo not build or use the banned applications, including the ones added from 2 December 2026
Article 50, transparencyWhen the use case triggers itFor example Article 50(4): a deployer of a system that generates a deep fake "shall disclose that the content has been artificially generated or manipulated". Notices also apply to emotion recognition and biometric categorisation, and to AI-generated text published to inform the public
Article 26, deployers of high-risk systemsOnly if the use is high-risk; from 2 December 2027 for Annex IIIUse the system according to its instructions, assign human oversight to competent people, keep input data relevant, monitor operation, report incidents and suspend use on risk
Article 25If you rebrand, substantially modify or repurpose into high-riskYou take on the provider's obligations for that high-risk system

In practice, an internal assistant for drafting, coding and search needs four things on file: an inventory entry, an acceptable-use policy that rules out Article 5 practices and names the uses that would be high-risk, a record of the literacy measures taken, and a check of whether any published output triggers Article 50.

The open-source exemptions and where they stop

There are two, and neither is a general pass for deployers.

Article 2(12) says the Regulation "does not apply to AI systems released under free and open-source licences, unless they are placed on the market or put into service as high-risk AI systems or as an AI system that falls under Article 5 or 50". So an open-source system used for a high-risk purpose, a prohibited practice or a use covered by the transparency article is back inside the Act.

Article 53(2) concerns the providers of GPAI models. It lifts the duties in Article 53(1)(a) and (b), the technical documentation and the information for downstream providers, for models "released under a free and open-source licence that allows for the access, usage, modification, and distribution of the model, and whose parameters, including the weights, the information on the model architecture, and the information on model usage, are made publicly available". Its last sentence reads: "This exception shall not apply to general-purpose AI models with systemic risks". The copyright policy and the public summary of training content in points (c) and (d) still apply to the model provider. We did not check whether the omnibus changed Article 53, so read the consolidated text.

What this means for a deployer:

GDPR when you call a US LLM API

If prompts contain personal data (names in e-mails, customer tickets, HR files), sending them to an API is processing by a third party on your behalf.

Where the API is the better choice: low volumes, data that is not personal, and tasks that need the quality of a frontier model. The API versus self-hosted cost comparison covers the money side.

GDPR when you run the model yourself

Self-hosting removes the AI vendor as processor and removes the transfer for the inference step. It leaves you as controller with these duties:

API or self-hosted: a decision table by data category

The table is a starting point for a discussion with your DPO, not a ruling.

Data in the promptHosted APISelf-hosted modelUsual lean
Public or non-personal data (marketing copy, public documentation, open-source code)No GDPR issue for the prompt; contract terms on confidentiality still matterWorks, but the server costs the same whether used or notAPI, unless volume is high
Ordinary personal data (customer support tickets, CRM notes)Article 28 contract, transfer basis, DPIA screening, retention settingsArticle 32 security and DPIA screening; no AI processor, no transfer for inferenceEither; decided by volume and by how much vendor management you want
Special categories and employee data (health, HR files, union membership)All of the above with a full DPIA; the transfer question becomes the hard partFull DPIA and strict access control; data stays on one machineSelf-hosted
Trade secrets and unreleased source codeNot a GDPR matter, but retention and training terms are criticalNo third party sees the materialSelf-hosted
Data under professional secrecy (legal, medical, audit)Professional rules may require client consent in addition to the GDPRRemoves the AI provider; the hosting contract and location remainSelf-hosted, see the posts on law firms and healthcare
Any data, in a use that would be high-risk under Annex IIIArticle 26 duties from 2 December 2027The same Article 26 duties, plus the Article 25 risk if you modify or repurposeDecided by the use, not the hosting

On cost, paying per token costs less at low volume. A dedicated server is a fixed bill: the GPU dedicated servers start at $449.99 per month for 24 GB of video memory and $1,656.15 for 96 GB, each a bare-metal machine for one customer. The private AI hosting page maps workloads to servers, and the VRAM guide explains which models fit.

Frequently Asked Questions

Does the EU AI Act apply to a self-hosted open-source LLM used only internally?

Yes, in part. The company is a deployer. The AI literacy duty in Article 4 and the prohibitions in Article 5 apply now, Article 50 applies if a use triggers it, and Article 26 applies from 2 December 2027 if the use falls under the Annex III high-risk list. The open-source exemption in Article 2(12) does not cover high-risk uses or uses under Articles 5 or 50.

Did the AI Act high-risk deadline of August 2026 move?

Yes. Regulation (EU) 2026/1744, in force since 27 July 2026, postponed the high-risk rules for Annex III use cases from 2 August 2026 to 2 December 2027, and those for AI embedded in Annex I regulated products from 2 August 2027 to 2 August 2028.

Is calling a US LLM API with personal data legal under the GDPR?

It can be, with an Article 28 processing contract and a valid transfer basis under Chapter V. The EU-US Data Privacy Framework adequacy decision of 10 July 2023 is in force as far as the Commission's page showed on 16 November 2026, and a court challenge to it was reported as pending on appeal, so keep standard contractual clauses as a fallback. This is not legal advice.

Does self-hosting an LLM make us GDPR compliant?

No. It removes the AI vendor as a processor and the transfer for the inference step. You remain the controller, with duties for security (Article 32), impact assessment (Article 35), a legal basis and a contract with the hosting provider. If the server location matters, confirm it with sales before ordering a GPU server.

Does the Article 53(2) open-source exemption help a company that only uses the model?

Not directly. It relieves providers of open-source GPAI models from the technical documentation and downstream-information duties, and it does not apply to models with systemic risk. A deployer's own obligations under Articles 4, 5, 26 and 50 are unchanged.

Run the model on a server that is yours alone

MassiveGRID GPU dedicated servers are bare metal with one customer per machine and root access: an RTX PRO 4000 with 24 GB for $449.99 per month, or an RTX PRO 6000 with 96 GB from $1,656.15, each with a 1 Gbps port and unlimited traffic, hosted in an ISO 27001 certified data center. If data residency matters, ask sales which data center a server will be delivered in before ordering.

See Private AI Hosting

Further Reading