sop

Scalable Objects Persistence

Project maintained by SharedCode Hosted on GitHub Pages — Theme by mattgraham

SOP: The “Personalisey” to “Enterprisey” Database Revolution

A Modern, Serverless Approach to Data Management that Scales from your Laptop to the Cloud Swarm.

In the landscape of modern database systems, we often face a binary choice: lightweight embedded libraries (like SQLite) for personal or local apps, and massive, monolithic servers (like Postgres or Oracle) for the enterprise.

SOP (Scalable Objects Persistence) breaks this dichotomy. It introduces a new paradigm: a flat, modular, serverless database system that is as comfortable running on a Raspberry Pi as it is coordinating a massive data swarm across a Kubernetes cluster.

With the release of the SOP Data Management Suite, we are completing the vision of a full-stack database ecosystem that feels personal but performs like an enterprise giant.

The “Personalisey” Experience: Your Data, Visualized

At its heart, data management should be intuitive. Whether you are a developer debugging a local cache or a data scientist exploring a dataset, you shouldn’t need to learn complex query languages just to see what’s inside your database.

The new SOP Data Manager (web UI) is designed not as a cold administrative tool, but with the polish and responsiveness of a custom modern website.

Visual & Rapid: It offers a rich, grid-based visualization of your B-Trees. You can scroll, paginate, and resize columns with the fluidity of a desktop app.
Bulk Management: Need to fix a typo across 50 records? Or visualize a complex JSON object structure? The UI handles bulk data visualization and management effortlessly. Allows management of multi-databases all at once.
Zero Friction: For personal use, it runs in “Standalone” mode. You fire it up, point it at a folder, and you have an instant, ACID-compliant database manager running locally. No background services, no heavy installation.

The “Enterprisey” Power: The Swarm

What happens when your app grows? In traditional systems, this is the painful “migration” phase where you move from SQLite to a “real” database server.

With SOP, there is no migration. You simply change the topology.

Scale Out, Not Up: SOP is masterless. The same library that managed your local data can be deployed across 100 servers.
The Swarm: By enabling “Clustered” mode, SOP instances (including the Data Manager UI) coordinate via Redis. They form a swarm where every node can read and write with full ACID transactional integrity.
Unified Management: The Data Manager’s new Registry Switcher allows you to toggle between your local “sandbox” and your production “swarm” in a single click. You can manage your personal data and your enterprise cluster from the same beautiful interface.

Beyond Relational: A Structural Evolution

SOP has always been defined by its optimal performance, lightweight footprint, and Swarm computing capabilities limited only by hardware. But we have now achieved a structural milestone: SOP is fully “Relational Capable”—and then some.

We didn’t just copy the Relational Model; we advanced it.

Structural Elegance without the Baggage: We adopted the relevant strengths of the Relational Model—specifically the power of Join operations and structured data modeling—removing the inherent weaknesses (scalability bottlenecks, rigid schemas) of traditional SQL engines.
The Scripting Engine: Our AI-Scripting Engine represents a progression from the SQL engines of today. Powered by Just-In-Time (JIT) compiled scripts, it delivers bare-metal performance while enabling complex logic. Unlike rigid query languages, our scripting dialect is Object Oriented and Traits-Based. This is amplified by our Automated RESTful Service, which enables automatic access to scripts for clients without the need to author new APIs. SOP is effectively Infrastructure as a Service (IaaS)—providing the connectivity infrastructure automatically. It is the totality of SOP and the AI Kit working in concert that creates this powerful, highly extensible capability.
The Best of Both Worlds: By marrying the “right” relational structures with SOP’s exclusive advancements in Storage Engines and Compute Platforms, we offer a system that doesn’t just store data—it understands relationships while retaining the raw power of a distributed Swarm.

Architecture: Flat, Modular, Serverless

The true innovation of SOP lies in its architecture. It rejects the “Central Server” monolith in favor of a Library-as-a-Database model.

Flat: There is no hierarchy. The Data Manager UI is just another peer in the network. It doesn’t “command” the database; it participates in it.
Modular: You pick the backend that fits. Filesystem for speed? Cassandra for hybrid cloud storage? In-memory orchestration for Standalone/Embedded apps or for testing? SOP abstracts it all.
Serverless Form: The database lives where your code lives. This reduces latency, simplifies deployment, and eliminates the single point of failure that plagues traditional RDBMS architectures.

A New Standard for Data Management

SOP is more than just a B-Tree library; it is a comprehensive data platform. By combining the raw performance of Go, the flexibility of a serverless architecture, and now the rich, visual management of the Data Suite, we are offering a solution that truly spans the gap.

It is Personalisey enough to be your daily driver for standalone/embedded data. It is Enterprisey enough to be the backbone of your distributed cloud infrastructure.

Welcome to the future of flat, modular data management.