> For the complete documentation index, see [llms.txt](https://www.csvpath.org/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://www.csvpath.org/readme.md).

# CSV, Excel and JSONL Ingestion

Stop writing custom import and validation scripts. CsvPath Framework automates CSV and Excel ingestion and data quality checks. Open source. Python.

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2FMIV0dqreHnvlTQhGqMYx%2FScreenshot%202026-09-19%20at%201.33.20%E2%80%AFAM.png?alt=media&amp;token=6e1dff92-6467-43b0-a9a7-af24538ce5cc" alt="CsvPath Framework enables Data Contracts for Edge Data Governance of JSON, XML, and tabular data coming from external partners in files, API calls, or streaming messages. " width="563"><figcaption></figcaption></figure>

#### CsvPath Framework registers, versions, validates, upgrades, and stages CSV, JSON, XML, Excel, JSONL and data frames from data partners *before* your pipelines break.&#x20;

If your MFT or REST API drives external data directly into the data lake or database the damage is already done.&#x20;

[CsvPath Framework](https://github.com/csvpath/csvpath) is the open source way to shift-left data quality. Enforce clear data contracts at the edge with **less manual effort, fewer ingestion failures, and more agile development** using consistent data preboarding tools [you can try in minutes](/getting-started/quickstart.md).  &#x20;

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2FenNshk0Hh2pjTL2xtAej%2FScreenshot%202025-03-09%20at%206.45.40%E2%80%AFPM.png?alt=media&amp;token=1169d82b-ce59-4f6a-9d38-d91b0bee2235" alt="" width="375"><figcaption><p>Your data lake deserves a data publisher it can trust!</p></figcaption></figure>

<h2 align="center">Get FlightPath Data, the open frontend</h2>

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2F4EaKgKH0UKdpVY0XEEGI%2Fflightpath-logo-1-sm.png?alt=media&amp;token=9786cf7f-b3d4-466c-b708-a4d3948bace9" alt=""><figcaption></figcaption></figure>

[**FlightPath Data** is a powerful frontend to CsvPath Framework](https://www.flightpathdata.com/). Go beyond CsvPath Framework's built-in CLI. Get up and running faster with a purpose-built data contracts, data preboarding development, and data operations console. FlightPath Data gives you all the help and examples you need move quickly.&#x20;

FlightPath Data is bundled with **FlightPath Server**, the no-code/low-code automation REST API connecting your existing infrastructure to robust edge data governance.&#x20;

Available as a *free* download from the [Microsoft Store](https://apps.microsoft.com/detail/9p9pbpkz4jdf?hl=en-US\&gl=US) and the [Apple MacOS Store](https://apps.apple.com/us/app/flightpath-data/id6745823097).

<h3 align="center">The Architecture For Efficient Edge Data Ingestion</h3>

**CsvPath Framework** implements the [**Collect, Store, Validate Publish architectural pattern.** ](https://static1.squarespace.com/static/66df9d47982d0d40e1574327/t/6771fe6f63bbf5361725ad05/1735523953587/The+Collect+Store+Validate+Pattern+-+Atesta+Analytics.pdf) External data ingestion goes faster, is more cost-efficient, and more effective with a Data Preboarding stage.&#x20;

CsvPath Framework was built to fill the blindspot between the edge and downstream data systems with a simple path to provably correct data.

This Data Preboarding blindspot is a big deal. Think about it. If even 1 in 30 companies depends existentially on CSV, JSON, XML, or Excel files or JSON streaming data from external data partners, ***the lack of edge Data Preboarding is a trillion-dollar problem waiting to happen.***&#x20;

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2Fj1rhr8AHakntfl8fJ4kT%2Fgovern.png?alt=media&amp;token=37f684da-fe9f-4edf-abfa-eff3d544751e" alt="A data flow diagram showing the position of CsvPath Framework acting as an Edge Data Governance Gateway managing data flow to protect core enterprise data systems"><figcaption></figcaption></figure>

Why roll your own data preboarding tool chain? CsvPath Framework is a purpose-built off-the-shelf solution you can rollout now.

<h3 align="center">Powerful Validation For Batch Files and Real-time Data</h3>

CSV, Excel, NDJSON, and JSONL validation has never been as sophisticated as JSONQuery and XSD — until now. **CsvPath Validation Language** is simple, easy to integrate, and flexible enough to handle the unexpected. Inspired by Schematron, XPath, and SQL, CsvPath Validation Language brings powerful data validation to tabular and JSON Lines structured data. Together, JSON Schema, XSD, and CsvPath Validation Language are unstoppable. [Start here](/topics/higher-level-topics/validation/schemas-or-rules.md).

Running CsvPath Framework and FlightPath Data can help you build your organization's confidence that your data governance doesn't turn a blind eye to its most unruly data.&#x20;

<h3 align="center">Integrated With Your Existing Tools</h3>

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2FzlYFVV4xbiaKZb6uc0TR%2Fintegration_logos.png?alt=media&amp;token=86d6e931-f247-412d-b870-2192f6c4e22b" alt="Logos of the many popular DataOps tools that are integrated with CsvPath Framework: aws s3, azure, slack, Excel, opentelemetry, sftp, ckan, pandas, openlineage, and more" width="563"><figcaption><p>CsvPath has many built-in integrations. Suggest more!</p></figcaption></figure>

[JSON Schema](https://json-schema.org/) / [Parquet](/topics/how-tos/parquet.md) / [Sqlite](/topics/how-tos/sqlite.md) / [S3](/topics/how-tos/storage-backends/aws-s3.md) / [OpenLineage](/getting-started/dataops-integrations/openlineage.md) / [OpenTelemetry](/getting-started/dataops-integrations/opentelemetry.md) / [Slack](/topics/how-tos/slack.md) / [Postgres](/topics/how-tos/postgres-and-mysql.md) / [MySQL](/topics/how-tos/postgres-and-mysql.md) / [Azure](/topics/how-tos/storage-backends/azure.md) / [Pandas](https://pandas.pydata.org/) / [Google Cloud Storage](/topics/how-tos/storage-backends/google-cloud-storage.md) / [Webhooks](/topics/how-tos/webhooks.md) / [JSONPath](https://github.com/csvpath/csvpath/blob/main/docs/func_gen/jsonpath.md) / [XSD](https://en.wikipedia.org/wiki/XML_Schema_\(W3C\)) / [XPath](https://github.com/csvpath/csvpath/blob/main/docs/func_gen/xpath.md) / [Airflow](/topics/how-tos/airflow.md) / [CKAN](https://ckan.org/) and more.

<h3 align="center">Give CsvPath Framework a Try</h3>

* [Getting Started](/getting-started/quickstart.md)
* [How-tos](/topics/how-tos.md)
* [DataOps Integrations](/getting-started/dataops-integrations.md)
* [The FlightPath Examples](/getting-started/the-flightpath-data-examples.md)

{% hint style="success" %}
For more background on preboarding and the CsvPath and FlightPath architecture [check out the CsvPath blog](https://blog.csvpath.org/).&#x20;
{% endhint %}

{% file src="/files/mT8DDvqSrnXqfODHeaRF" %}

{% embed url="<https://github.com/csvpath/csvpath>" %}