graphql-engine/docs/graphql/core/migrations/manage-metadata.rst
Rikin Kachhia c8181d345b docs: fix api reference structure
GitOrigin-RevId: bd7dba60fd6ad69df0bfc83862ea8a7b5b359c9d
2021-02-16 09:39:24 +00:00

222 lines
7.2 KiB
ReStructuredText

.. meta::
:description: Manage Hasura metadata
:keywords: hasura, docs, metadata
.. _manage_hasura_metadata:
Managing Hasura metadata
========================
.. contents:: Table of contents
:backlinks: none
:depth: 1
:local:
Introduction
------------
If your Postgres schema is already managed with a tool like knex, TypeORM,
Django/Rails migrations, you will still need a way to export the actions you
performed on the Hasura console to apply it later on another Hasura instance.
All the actions performed on the console, like tracking tables/views/functions,
creating relationships, configuring permissions, creating event triggers and remote
schemas, etc. can be exported as a JSON/yaml metadata file which can be version
controlled. The metadata file can be later imported to another Hasura instance to get the same
configuration. You can also manually edit the metadata file to add more objects to
it and then use it to update the instance.
Exporting Hasura metadata
-------------------------
.. rst-class:: api_tabs
.. tabs::
.. tab:: CLI
Metadata can be exported with the :ref:`hasura metadata export <hasura_metadata_export>`
command.
This will export the metadata as yaml files in the ``/metadata`` directory
.. tab:: Console
1. Click on the settings (⚙) icon at the top right corner of the console screen.
2. In the Hasura metadata actions page that opens, click on the ``Export Metadata`` button.
.. thumbnail:: /img/graphql/core/migrations/metadata-export.png
:alt: Export metadata
3. This will prompt a file download for ``hasura_metadata_<timestamp>.json``. Save the file.
.. tab:: API
The export can be done via the :ref:`export_metadata metadata API <export_metadata>`.
Response will be a JSON object with the Hasura metadata.
Here is an example using ``curl`` to save this as a file:
.. code-block:: bash
curl -d'{"type": "export_metadata", "args": {}}' http://localhost:8080/v1/query -o hasura_metadata.json
This command will create a ``hasura_metadata.json`` file.
If an admin secret is set, add ``-H 'X-Hasura-Admin-Secret: <your-admin-secret>'`` as the API is an
admin-only API.
.. note::
The metadata exported via the **console and API** will be a single JSON file that can be applied
via the console or the API only.
The metadata exported via the **CLI** is broken into multiple YAML files for easier
management in version control and CI/CD and can be applied via the CLI or the
:ref:`cli-migrations <auto_apply_migrations>` image only.
Applying/Importing Hasura metadata
----------------------------------
You can apply exported metadata from one Hasura GraphQL engine instance to another. You can also apply an older or
modified version of an instance's metadata onto itself.
Importing completely replaces the metadata on that instance, i.e. you lose any metadata that was already present
before.
.. rst-class:: api_tabs
.. tabs::
.. tab:: CLI
Metadata can be applied with the :ref:`hasura metadata apply <hasura_metadata_apply>`
command.
.. tab:: Console
1. Click on the settings (⚙) icon at the top right corner of the console screen.
2. Click on ``Import Metadata`` button.
.. thumbnail:: /img/graphql/core/migrations/metadata-import.png
:alt: Import metadata
3. Choose a ``hasura_metadata.json`` file that was exported earlier.
4. A notification should appear indicating the success or error.
.. tab:: API
The exported JSON can be imported via the :ref:`replace_metadata metadata API <replace_metadata_v1>`.
Here is an example using ``curl``:
.. code-block:: bash
curl -d'{"type":"replace_metadata", "args":'$(cat hasura_metadata.json)'}' http://localhost:8080/v1/query
This command reads the ``hasura_metadata.json`` file and makes a POST request to
replace the metadata.
If an admin secret is set, add ``-H 'X-Hasura-Admin-Secret: <your-admin-secret>'`` as the API is an
admin-only API.
.. note::
All the dependent objects, like tables, views, functions etc. should exist on
Postgres before importing the metadata. Otherwise, it will result in an error
saying the object does not exist. So, apply the Postgres schema first, before
importing the metadata.
.. _reload_metadata_manual:
Reloading Hasura metadata
-------------------------
In some cases, the metadata can be out of sync with the Postgres schema. For example,
when a new column has been added to a table via an external tool such as ``psql``.
.. rst-class:: api_tabs
.. tabs::
.. tab:: CLI
Metadata can be reloaded with the :ref:`hasura metadata reload <hasura_metadata_reload>`
command.
.. tab:: Console
1. Click on the settings (⚙) icon at the top right corner of the console screen.
2. Click on ``Reload`` button.
.. thumbnail:: /img/graphql/core/migrations/metadata-reload.png
:alt: Reload metadata
3. A notification should appear indicating the success.
.. tab:: API
The reload of metadata can be done via the :ref:`reload_metadata metadata API <reload_metadata>`.
Here is an example using ``curl``:
.. code-block:: bash
curl -d'{"type": "reload_metadata", "args": {}}' http://localhost:8080/v1/query
If an admin secret is set, add ``-H 'X-Hasura-Admin-Secret: <your-admin-secret>'`` as the API is an
admin-only API.
.. note::
Reloading may result in inconsistent metadata status. You may need to resolve
all inconsistent objects manually or delete them. After that, you need to reload
metadata again.
.. _reset_metadata_manual:
Resetting Hasura metadata
-------------------------
Resetting GraphQL engine's metadata is an irreversible process. It is recommended to first export the metadata
so that it can be reapplied if needed or else that information will be lost and Hasura will have to be configured
again from scratch (e.g. tracking tables, relationships, creating triggers, actions, etc.).
.. rst-class:: api_tabs
.. tabs::
.. tab:: CLI
Metadata can be reset with the :ref:`hasura metadata clear <hasura_metadata_clear>`
command.
.. tab:: Console
1. Click on the settings (⚙) icon at the top right corner of the console screen.
2. Click on ``Reset`` button.
.. thumbnail:: /img/graphql/core/migrations/metadata-reset.png
:alt: Reset metadata
3. A pop-up will appear prompting you to confirm the process.
4. A notification should appear indicating the success.
.. tab:: API
The reset of metadata can be done via the :ref:`clear_metadata metadata API <clear_metadata>`.
Here is an example using ``curl``:
.. code-block:: bash
curl -d'{"type": "clear_metadata", "args": {}}' http://localhost:8080/v1/query
If an admin secret is set, add ``-H 'X-Hasura-Admin-Secret: <your-admin-secret>'`` as the API is an
admin-only API.
Managing Hasura metadata in CI/CD
---------------------------------
In case you need an automated way of applying/importing the metadata, take a
look at the :ref:`cli-migrations <auto_apply_migrations>` Docker image, which
can start the GraphQL engine after automatically importing a mounted metadata
directory.