BatchCreate BatchCreate

yaml
type: "io.kestra.plugin.weaviate.BatchCreate"

Batch-insert data to a Weaviate database.

Data can be either in an ION-serialized file format or as a list of key-value pairs. If the schema doesn't exist yet, it will be created automatically.

Examples

Send batch object creation request to a Weaviate database.

yaml
id: weaviate_batch_load
namespace: company.team

tasks:
  - id: batch_load
    type: io.kestra.plugin.weaviate.BatchCreate
    url: "https://demo-cluster-id.weaviate.network"
    apiKey: "{{ secret('WEAVIATE_API_KEY') }}"
    className: WeaviateDemo
    objects:
      - textField: "some text"
        numField: 24
      - textField: "another text"
        numField: 42

Send batch object creation request to a Weaviate database using an ION input file e.g. passed from output of another task.

yaml
id: weaviate_batch_insert
namespace: company.team

tasks:
  - id: extract
    type: io.kestra.plugin.core.http.Download
    uri: https://huggingface.co/datasets/kestra/datasets/raw/main/ion/ingest.ion

  - id: batch_insert
    type: io.kestra.plugin.weaviate.BatchCreate
    url: "https://demo-cluster-id.weaviate.network"
    apiKey: "{{ secret('WEAVIATE_API_KEY') }}"
    className: Titles
    objects: "{{ outputs.extract.uri }}"

Properties

objects

  • Type:
    • string
    • array
  • Dynamic:
  • Required: ✔️

Objects to create with their properties

ION File URI or the list of objects to insert

url

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️
  • Min length: 1

Connection URL

Example: localhost:8080 or https://cluster-id.weaviate.network

apiKey

  • Type: string
  • Dynamic: ✔️
  • Required:

API key to authenticate with a managed Weaviate cluster

If not provided, the anonymous authentication scheme will be used.

className

  • Type: string
  • Dynamic: ✔️
  • Required:

Class name where you want to insert data

headers

  • Type: object
  • SubType: string
  • Dynamic: ✔️
  • Required:
  • Default: {}

Additional headers to add to the request e.g. to authenticate with OpenAI API

Outputs

Definitions

Was this page helpful?