Is there a Flux Query Size Limit?

stanton009 · October 18, 2021, 4:14pm

i am generating Flux queries somewhat dynamically by attaching numerous filters into the query, and wondering is there limit to the size of the query (query not results)?

I am using the java-client-library on Influx Cloud if that makes a different.

Anaisdg · October 18, 2021, 10:24pm

Hello @stanton009,
Great question.
I don’t expect there to be. I don’t think the size matters as much as the data you’re trying to query and the about of data you’re trying to transform. How long is your query?
You’ll notice some of the flux scripts in the flux repo are pretty long:

github.com

influxdata/flux/blob/0c6bb642a8150af4da208a4b4b153495b8b3b075/stdlib/sql/sql.flux

// Package SQL provides tools for working with data in SQL
// databases such as:
// - Amazon Athena
// - Google BigQuery
// - Microsoft SQL Server
// - MySQL
// - PostgreSQL
// - Snowflake
// - SQLite
package sql


// from is a function that retrieves data from a SQL data source.
//
// ## Parameters
// - `driverName` is the driver used to connect to the SQL database.
//
//   The following drivers are available:
//    - awsathena
//    - bigquery

This file has been truncated. show original

github.com

influxdata/flux/blob/7709193f76ba8dcee3e3880df959d69c76922041/stdlib/experimental/geo/geo.flux

// Provides functions for geographic location filtering and grouping based on S2 cells.
package geo


import "experimental"
import "influxdata/influxdb/v1"

// Units
option units = {
    distance: "km",
}

//
// Builtin GIS functions
//
// Returns boolean whether the region contains specified geometry.
builtin stContains : (region: A, geometry: B, units: {distance: string}) => bool where A: Record, B: Record

// Returns distance from given region to specified geometry.
builtin stDistance : (region: A, geometry: B, units: {distance: string}) => float where A: Record, B: Record

This file has been truncated. show original

Topic		Replies	Views
I'm using Flux to do a search, when the query has more than 1 million rows, the inflow returns me null InfluxDB 2	1	356	January 8, 2021
Flux performance compared to similar influxQL query Fluxlang performance	5	485	December 9, 2022
[URGENT] Flux vs InfluxQL Groupby Speed InfluxDB 2 flux	7	359	August 30, 2023
Could someone help me with migrating InfluxQL query to Flux? Please :) Fluxlang	1	342	August 18, 2021
Nested query runs out of memory Fluxlang query , performance	0	469	April 22, 2022

Is there a Flux Query Size Limit?

Related Topics