Data Management & PDM: Comparing CAD Files and Databases

Managing files in folders on a desktop is fine for family photos and videos, but for valuable intellectual property such as CAD files, you’ll need a safer and more robust data management strategy.

Files are easily lost, corrupted, and overwritten. Adding a Product Data Management (PDM) system on top adds a thin layer of security to file-based data storage, along with easier access from a central company server.

However, PDM systems eliminate efficient CAD collaboration. With a library-card-like procedure, only one engineer at a time can check a file in and out of the “digital lockbox.”

“Fileless” data management systems simply improve the interface of the PDM system without any real benefits to the designer.

Onshape’s cloud-native database is the only CAD data management architecture that can simultaneously deliver data security, real-time team collaboration, and seamless workflows – because it doesn’t hide files; it eliminates them entirely.

Why Engineers Shouldn’t Have to Think About Data Management

Even among very tech-savvy engineers, there is still a lot of confusion about what it means to store design information in a file versus a database.

In a LinkedIn discussion, the following question came up:

A better first question: Why should engineers need to know the intricate details of how their data is stored at all?

What engineers actually need to know is what they can and can’t do with their data, and what overhead the system creates for them every day. The more an engineer has to think about data management – saving, checking in, resolving conflicts, finding the right version – the more it negatively impacts their design processes, their deadlines, and their budgets.

Es ist in der Tat ein komplexes Thema, eine klare Unterscheidung zwischen Dateien und verschiedenen Arten von Datenbankspeichern zu treffen. Einige mögen dies als Semantik abtun, aber eine bestimmte Methode der Datenspeicherung hat klare Vorteile.

Sehen wir uns also die verschiedenen Möglichkeiten an, wie CAD-Daten gespeichert werden können und wie sie sich auf Ihr Unternehmen auswirken.

The Four Ways CAD Data Can Be Stored

1. Data Storage in a File

This is the easiest one to explain. Anybody who has ever used a computer to create something – an image, a spreadsheet, or a CAD design – has saved their data into a discrete file on their local hard drive.

Jeder Dateityp hat seine eigene Datenstruktur, die alle Informationen in einem Format aufzeichnet, das nur die Software, die ihn erstellt hat, verstehen kann. Daher kann jeder, der dieselbe Version derselben Software wie Sie hat, Ihre Datei öffnen und bearbeiten. Proprietäre Dateistrukturen können auch leicht rückentwickelt werden, um die erforderlichen Informationen zu extrahieren (das DWG-Dateiformat ist das beste Beispiel).

Most experts would agree that computer files are an extremely insecure method of storing data. Files are easily mislaid, corrupted, or overwritten. Files get copied and emailed everywhere, and nobody knows who has what or which copy is the latest version.

That’s why every CAD vendor has its own bolt-on PDM software that they can charge extra for.

2. Data Storage in a PDM Database

This statement is misleading. Your data is not stored in a PDM database, but is still stored in files on a file server with all the inherent issues mentioned above.

What is stored in the PDM database is data about your data, otherwise known as “metadata.” It’s like keeping a Rolodex or library card system to keep track of where files are kept and a brief summary of what each file contains. To find a file, you consult your index card to find where the file is stored and then copy it to your local hard drive, known as “checking out” the file (just like a library book).

All PDM databases use what is called a relational database. These databases store metadata in fixed tables with rigid schemas and pointers linking multiple tables together. This enables data to be structured and categorized so that it can be indexed, searched, and easily manipulated using Structured Query Language (SQL) transactions.

For a CAD file, a table may state what type of file it is, where it is stored, list all of its custom properties, and have links to the assembly or project that it belongs to. A simple SQL query is able to extract all the information about a file and its relational hierarchy to all the other files in your database.

This means that finding files is fast, but in order to work on them, you must check them out and have them copied locally to your hard drive. Keeping with the library book analogy, once a copy of the file is checked out, it is no longer available to others who wish to access it. You can still see the library card data and a view-only representation of the file, but the file itself can’t be copied or edited.

In practice, this system of checking CAD files in and out of a digital lockbox further exacerbates PDM system issues, interferes with workflow, and reduces product-to-market speed. The bigger the team and the more agile the design process, the bigger this problem becomes.

Sobald CAD-Dateien aus einem PDM-System ausgecheckt sind, sind sie unkontrolliert. Sie können nach Belieben kopiert und per E-Mail versendet werden, was eine weitere große Sicherheitsbedrohung darstellt und die Möglichkeit birgt, dass ein Lieferant die falsche Version eines Teils herstellt.

3. Data Storage in a “Fileless” CAD Database

Diese Aussage ist ebenfalls irreführend. Einige CAD-Systeme haben eine „neue“ Art von Dateispeichersystem eingeführt — die sogenannte „dateilose“, „keine Datei“ oder „Nulldatei“ -Datenbank. Der Endbenutzer interagiert immer nur mit der PDM-Schnittstelle und sieht nie die tatsächlichen CAD-Dateien.

Die Dateien werden jedoch im Hintergrund heruntergeladen, wenn ein Benutzer daran arbeiten möchte. Wenn Sie wissen, wo Sie suchen müssen, finden Sie sie versteckt in einem dunklen Bereich Ihrer Festplatte. Obwohl diese Dateien technisch als Cache bezeichnet werden können, enthalten sie immer noch die bearbeitbaren CAD-Daten und jede Datei muss zuerst heruntergeladen werden, bevor das CAD-System sie öffnen kann.

Die dateilose Speicherung von CAD-Daten bietet Vorteile. Erstens gibt es einen zentralen Dateispeicher, sodass jeder die benötigten Daten abrufen kann, ohne sich Gedanken darüber machen zu müssen, wo sich die Dateien befinden (genau wie bei normalem PDM). Zweitens sind die zwischengespeicherten Dateien ausreichend versteckt und verschleiert, sodass sie nur vom installierten CAD-System geöffnet und daher nicht per E-Mail versendet werden können.

Der Nachteil dieser Methode ist, dass sie im Vergleich zu einem herkömmlichen PDM-System keine wirklichen Vorteile bietet. Wenn ein Teil bearbeitet werden muss, wird es lokal auf die Festplatte des Benutzers heruntergeladen und gesperrt, sodass niemand anderes es bearbeiten kann.

Sound familiar? This is akin to checking out the data from a file-based PDM system. Once an edit is complete, the part file is committed back to the database (a.k.a., save, upload, and check-in), which, for a large file, can take some time while the file is copied back to the server over the network or the internet.

Ich verstehe, weshalb das zu Verwirrung sorgt und die Unterschiede nicht erkannt werden.

Since this type of database is based on SQL with rigid schemas that can’t be easily changed, just like regular PDM, this type of system requires periodic maintenance downtime to install service packs and upgrades.

Es handelt sich um alte Technologien mit neuem Anstrich.

4. Data Management in Onshape’s Database

The final type of database structure is the one that, in CAD terms, is unique to Onshape.

Onshape verwendet ein dokumentenorientiertes Datenbankmodell, das verschiedene Datenformen und vollständig flexible Schemas unterstützt. Es handelt sich um eine hochleistungsfähige und verteilte nichtrelationale Datenbank, die in Big-Data-Anwendungen und anderen Verarbeitungsaufgaben verwendet wird, bei denen Daten verwendet werden, die nicht gut in ein starres relationales Modell passen. Anstatt Tabellen und Zeilen wie relationale Datenbanken zu verwenden, besteht eine nichtrelationale Datenbankarchitektur aus Sammlungen und Dokumenten.

„Und was?“ Ich höre dich sagen.

This fundamental difference is what enables real-time CAD collaboration, simultaneous editing, instant and secure sharing, version control, and release management. No other product development platform comes close. There are definitely NO files here.

What Database Architecture Makes Possible

Onshape’s Data Management Advantage

In plain terms, CAD collaboration in Onshape allows entire design teams to work on the same project, same assembly, same part, and even the same sketch if need be, at the same time.

Nothing is locked. All design activities are carried out in parallel. As changes are made, every action is recorded in the database and instantly updated wherever it’s used. There is no save button, no check-in / check-out, no accidental overwrites, and no waiting around for someone else to finish their work before you can start yours.

This enables teams to co-design complex parts and assemblies without having to be physically in the same location. Since every design change is recorded, conflicts are easily resolved. Your team can experiment as much as they like, either in the same workspace or in their own branch, confident in the fact that any errors or bad decisions can always be undone. In short, Onshape gives you unlimited undo/redo.

With dedicated servers, data encryption, and third-party security testing, Onshape protects your CAD data when sharing with colleagues, suppliers, or customers. Just like Google Docs, all you need to do is enter a person’s email address, set view or edit permissions, and press “Share.”

Clicking on the email link will open your design in a web browser or a mobile device. No software or downloads are required. This enables design teams to work together from anywhere and to carry out design reviews in real time on any device. Everybody works on the exact same document, not different copies of the data. Access is just as easily revoked.

These are just some of the powerful, time-saving benefits that Onshape’s unique CAD database architecture delivers. And I haven’t even mentioned Onshape’s CAD features.

Are You Storing CAD Data in Files or a Database?

To revisit the LinkedIn question: The confusion is understandable, because most CAD vendors use the word “database” to describe systems that are, at their core, still file-based. The honest answer is:

The more an engineer has to think about CAD file management, the more time they’re spending on infrastructure instead of design. The goal of any good CAD data management system should be to make itself invisible.

(This blog was originally published March 24, 2019.)