Add Data
Last updated:2024-09-20

Add Data

After the data table is created, you can add data to it. The data added can be structured data or unstructured data. Depending on the type of data your enterprise has, you can choose different methods to add it. image-20241011144756364

Unstructured Data

GPTBots supports entity extraction from unstructured data documents (such as PDF, Word, Excel, TXT, etc.) through LLM, importing structured data into the database for quick data entry and management. The specific methods of addition are as follows:

  1. Click the "Add Data" button, Selecting unstructured document data. to enter the data addition page.

    image-20241114201140426

  2. Choose "Local Document" or "Google Drive" method, select the unstructured data file to import, supporting file types including PDF, Word, Excel, TXT, etc. Each file has a token limit of 10K, and content exceeding this limit will be truncated. image-20241114201214636

  3. Click "Next" to enter the document entity extraction page, displaying information such as "Recognition Service, Data Extraction Method, and Extraction Field Name." image-20241114201244139

    • Recognition Service: When the uploaded knowledge document is in PDF format, you can choose to use "Normal Recognition or Advanced Recognition" to parse the PDF file. The difference is that the normal recognition service parses faster and does not consume credits, while the advanced recognition service has higher parsing quality, slower speed, and consumes more credits.
    • Data Extraction Method: GPTBots supports two data extraction methods. "Extract only one piece of data per document" means extracting 1 field value of the data table from each document, while "Extract multiple pieces of data per document" means extracting multiple field values of the data table from each document.
    • Extraction Field Name: This shows all the field names of the data table, which are the target fields to be extracted.
  4. Click the "Save" button to complete the data addition work. The submitted document enters the task queue, and once processing is complete, the extracted data can be added to the data table. In "Current Tasks," you can view the task status progress and credit consumption. image-20241012104210783

Structured Data

Template Import

Once the fields of the data table are created, you can quickly add structured data to the database through template import. The specific methods of addition are as follows:

  1. On the data table page, click on structured template data to enter the data addition page.

    image-20241114201404296

  2. Choose the "Template Import" method, download the template.csv file, fill in the data according to the format, and then upload the template CSV file. image-20241114201430741

  3. Click "Next" to enter the data import page, click the "Save" button to complete the data addition work.

  4. After the data parsing and import tasks in the template file are completed, you can view the added data on the data table page.

API Addition

Once the fields of the data table are created, you can add structured data to the database through the API interface.

Coming soon...