> For the complete documentation index, see [llms.txt](https://www.csvpath.org/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://www.csvpath.org/readme.md).

# CSV, Excel and JSONL Ingestion

      

<figure><img src="/files/aPKD2vMrvGstHKIYcnUS" alt="Logo for the CsvPath Framework" width="321"><figcaption></figcaption></figure>

<h2 align="center">Automate CSV, Excel, and JSONL Data Preboarding </h2>

<h3 align="center">End Manual File-by-file Validation!</h3>

#### CsvPath Framework registers, versions, validates, upgrades, and stages CSV, Excel, and JSONL files from data partners before they break your pipelines.

[CsvPath Framework](https://github.com/csvpath/csvpath) is open source data quality. Shift-left. Control data entering the enterprise with **less manual effort, fewer ingestion failures, and more agile development** using consistent data preboarding [you can try in minutes](/getting-started/quickstart.md).  &#x20;

<figure><img src="/files/P8OXtgkBB6zfJcx6gQyn" alt="" width="375"><figcaption><p>Your data lake deserves a data publisher it can trust!</p></figcaption></figure>

### Introducing FlightPath Data, the frontend to CsvPath Framework

<figure><img src="/files/wA1yCtkSpFhyQcBUyVJw" alt=""><figcaption></figcaption></figure>

[**FlightPath Data** is a powerful new frontend to CsvPath Framework](https://www.flightpathdata.com/). Go beyond CsvPath Framework's built-in CLI. Get up and running faster with a purpose-built preboarding development and operations console. FlightPath Data gives you all the help and examples you need move quickly.&#x20;

FlightPath Data is bundled with **FlightPath Server**, the automation REST API connecting your existing infrastructure to data preboarding.&#x20;

Available as a *free* download from the [Microsoft Store](https://apps.microsoft.com/detail/9p9pbpkz4jdf?hl=en-US\&gl=US) and the [Apple MacOS Store](https://apps.apple.com/us/app/flightpath-data/id6745823097).

### The Architecture For Efficient Data File Feed Ingestion

**CsvPath Framework** implements the [**Collect, Store, Validate Publish architectural pattern.** ](https://static1.squarespace.com/static/66df9d47982d0d40e1574327/t/6771fe6f63bbf5361725ad05/1735523953587/The+Collect+Store+Validate+Pattern+-+Atesta+Analytics.pdf) Ingestion goes faster, is more cost-efficient, and more effective with a preboarding stage.&#x20;

CsvPath Framework was built to fill the blindspot between MFT (managed file transfer) and the data lake with a simple path to provably correct data.

This data preboarding blindspot is a big deal. Think about it. If even 1 in 30 companies depends heavily on CSV or Excel data, the *lack of **delimited file preboarding is a trillion-dollar problem***.&#x20;

<figure><img src="/files/W44biutTVTi22wZp9PzM" alt="A data flow diagram showing how CSV, Excel and other tabular data come into the organization through a preboarding process that acts as a Trusted Publisher to the data lake and applications."><figcaption></figcaption></figure>

Why roll your own preboarding? CsvPath Framework is a purpose-built solution you can rollout now.

### Powerful CSV and Excel Validation

CSV and Excel validation is core to the Framework. **CsvPath Validation Language** is simple, easy to integrate, and flexible enough to handle the unexpected. Inspired by Schematron, XPath, and SQL, CsvPath Validation Language brings powerful data validation to less structured data. [Start here](/topics/higher-level-topics/validation/schemas-or-rules.md).

Together CsvPath Framework and FlightPath Data can help you build leadership's confidence that your data governance doesn't turn a blind eye to your most unruly data.&#x20;

### Integrated With Your Existing Tools

<figure><img src="/files/qIeRQh2M83YGpBeNgSqu" alt="Logos of the many popular DataOps tools that are integrated with CsvPath Framework: aws s3, azure, slack, Excel, opentelemetry, sftp, ckan, pandas, openlineage, and more" width="563"><figcaption><p>CsvPath has a bunch of built-in integrations. Suggest more!</p></figcaption></figure>

[Parquet](/topics/how-tos/parquet.md) / [Sqlite](/topics/how-tos/sqlite.md) / [S3](/topics/how-tos/storage-backends/aws-s3.md) / [OpenLineage](/getting-started/dataops-integrations/openlineage.md) / [OpenTelemetry](/getting-started/dataops-integrations/opentelemetry.md) / [Slack](/topics/how-tos/slack.md) / [Postgres](/topics/how-tos/postgres-and-mysql.md) / [MySQL](/topics/how-tos/postgres-and-mysql.md) / [Azure](/topics/how-tos/storage-backends/azure.md) / [Google Cloud Storage](/topics/how-tos/storage-backends/google-cloud-storage.md) / [Webhooks](/topics/how-tos/webhooks.md) / [JSONPath](https://github.com/csvpath/csvpath/blob/main/docs/func_gen/jsonpath.md) / [XPath](https://github.com/csvpath/csvpath/blob/main/docs/func_gen/xpath.md) / [Airflow](/topics/how-tos/airflow.md) and more.

### Give CsvPath Framework a Try

* [Getting Started](/getting-started/quickstart.md)
* [How-tos](/topics/how-tos.md)
* [DataOps Integrations](/getting-started/dataops-integrations.md)
* [The FlightPath Examples](/getting-started/the-flightpath-data-examples.md)

{% hint style="success" %}
For more background on preboarding and the CsvPath and FlightPath architecture [check out the CsvPath blog](https://blog.csvpath.org/).&#x20;
{% endhint %}

{% file src="/files/mT8DDvqSrnXqfODHeaRF" %}

{% embed url="<https://github.com/csvpath/csvpath>" %}