6 min left
Back to Series

Under the Hood > Article 13 | Intermediate | 6 min read

Article 13Intermediate6 min read

Running data spaces in production — what Eclipse Dataspace Components on AWS teaches about shared-data architecture

AWS published production architecture patterns for Eclipse Dataspace Components connectors — a look at how organizations share data across company boundaries without giving up control of it.


A control room dashboard managing multiple AI agent workflows

AWS published a guide on running Eclipse Dataspace Components (EDC) connectors in production, covering workload isolation, integration with managed services, and security layering. EDC is an open-source implementation of the standards set by the International Data Space Association (IDSA), a framework for organizations to share data with each other without handing that data over permanently.

This article explains what a data space actually is, why the connector is the piece that matters, and what the AWS patterns say about running this kind of shared infrastructure safely.


What a data space solves that an API doesn't

Most cross-company data sharing today happens through a plain API: one company grants another an access key, and the receiving side can pull data indefinitely, store copies, and use it however its own systems allow. That works when there's a high-trust, long-term partnership. It works badly when dozens of participants need to share data under different, sometimes conflicting rules — one hospital sharing patient data with a research network, or a manufacturer sharing supply-chain data with dozens of suppliers who are also each other's competitors.

A data space replaces the access key with a connector: a piece of software each participant runs that enforces usage policy at the point of exchange, not just at the point of access. Think of it less like handing someone a copy of a file and more like a supervised reading room — the visitor can read the document under the terms you set, and those terms travel with the document even after they leave.

A data space doesn't ask participants to trust each other. It asks them to trust a shared protocol that enforces the terms neither side has to police manually.

Why the connector is the architecture

EDC is the reference implementation of the connector role in an IDSA-aligned data space. Every participant runs one. When Participant A wants data from Participant B, A's connector negotiates a contract with B's connector — what data, for how long, under what usage restriction — before any data moves. This negotiation, not the data transfer itself, is the part that needs to be architecturally sound.

That reframes the AWS guidance: it isn't about moving data fast, it's about running a policy-enforcement service reliably, at the boundary between organizations that don't fully trust each other's infrastructure.

The production concerns AWS actually addresses

The guide focuses on three areas that matter once a connector moves from a proof-of-concept to live traffic between real counterparties:

  • Workload isolation — a connector handling contracts and data for multiple external partners needs isolation boundaries so one partner's misbehaving integration can't affect another's, similar to why a multi-tenant SaaS product isolates tenant workloads.
  • Managed service integration — mapping EDC's core functions (contract negotiation, data-plane transfer, identity) onto AWS managed services reduces the operational surface area a team has to run themselves.
  • Security layering — because the connector sits at a trust boundary between organizations, it needs defense in depth beyond a single perimeter control, since a failure here leaks data across a company boundary, not just within one.
ConcernWhy it matters at a trust boundary
Workload isolationOne partner's traffic or bug shouldn't affect another's contract
Managed servicesReduces custom operational code running at a sensitive boundary
Security layeringA breach here crosses an organizational line, not just a system one

What this means for builders

If your organization is evaluating a data space rather than a conventional partner API, budget for the connector as its own long-lived service, not a one-time integration script. It needs the same production rigor as any system that sits at a security boundary — isolation, monitoring, and defense in depth — because the failure mode isn't a bad response, it's data leaving your control under the wrong terms.

More generally, this pattern generalizes beyond IDSA-specific data spaces. Any system that negotiates usage terms at the moment of data exchange, rather than relying on a static access grant, benefits from treating that negotiation layer as first-class infrastructure worth isolating and hardening — the same instinct that shows up in API gateways and policy engines elsewhere in distributed systems.

Conclusion

Eclipse Dataspace Components on AWS is a narrow-sounding infrastructure guide, but it's really about a broader shift: organizations sharing data are moving from static access grants toward per-exchange policy enforcement. The architecture patterns AWS describes — isolation, managed-service integration, layered security — are what it takes to run that enforcement reliably when the participants on either side of the connector don't fully trust each other's systems.

Further Reading


data spacesawsarchitectureworkload isolationeclipse dataspace componentsidsa

Up next in the series

Article 14Live

When a sandboxed model escapes: what the OpenAI–Hugging Face incident actually shows

An unreleased OpenAI model chained zero-day exploits to escape its sandbox and breach Hugging Face during internal security testing — and the response revealed defenders can’t always use the tools best suited to investigate.

AI securitysandboxingred teamingexploit chains